The largest National Bodies for Research in the world: some performance indicators (2003-2010)

Last year we published a series of posts characterizing, through scientometrics methods, the research activity carried outin some of the major National Bodies for Reserach from Europe. Specifically, the series comprised the Cosiglio Nazionale delle Ricerche CNR (Italy), the Max Planck Society (Germany), and the Spanish Consejo Superior de Investigaciones Científicas. With the goal of highlighting some global characteristics involving the research outcomes of national organizations, we are releasing in this post a informative table containing a selection of performance indicators belonging to the six largest National Bodies for Research (in number of scientific publications):

  • Centre National de la Recherche Scientifique,
  • Chinese Academy of Sciences,
  • Russian Academy of Sciences,
  • Max Planck Gesellschaft,
  • Consejo Superior de Investigaciones Cientificas,
  • Consiglio Nazionale delle Ricerche

photo

Félix de Moya Anegón is Research Professor at the Institute of Public Goods and Policies (IPP) from the Spanish National Research Council (CSIC), his academic interests include scientometrics, bibliometrics, research evaluation and science policy; he has published around 100 papers in these fields. He is SCImago Research Group‘s main researcher, where he has led renowned bibliometic projects including Scimago Journal & Country Rank, Scimago Institution Rankings and The Atlas of Science. Prof. De Moya is also advisor for Science Policy issues for national organizations of science and technology and research institutions around the world.

Universities by country among the Top 100 by research field based on SCOPUS and SCIMAGO

For this post, we have elaborated rankings of universities based on the output they have in each of the major scientific fields. Then we took the Top 100 in each field and saw them by countries. The result is the following table where each row represents a country and each cell shows how many institutions that country has within the Top 100 in the corresponding field. The rank is ordered by the average of institutions that countries have in Top 100. We have used Scopus as the data source, after a disambiguation process of institution names.

Download the table.

Download the full list of universities.

 

photo

Félix de Moya Anegón is Research Professor at the Institute of Public Goods and Policies (IPP) from the Spanish National Research Council (CSIC), his academic interests include scientometrics, bibliometrics, research evaluation and science policy; he has published around 100 papers in these fields. He is SCImago Research Group‘s main researcher, where he has led renowned bibliometic projects including Scimago Journal & Country Rank, Scimago Institution Rankings and The Atlas of Science. Prof. De Moya is also advisor for Science Policy issues for national organizations of science and technology and research institutions around the world.

Forecasting exercise: How World Scientific Output will be in 2018

According to how nations’ scientific output have increased during the period 2003-2010 (top 50), we propose the following forecasting exercise, we will use this data to obtain a prediction not necessarily realistic, but anyhow suggestive, of the scientific output scenario for 2018.

Forecasting Excercise

Growth rate (percentage) and Total Output by country during the period 2003-2010 (click on the graph to access the table with all the data of this forecasting exercise)

Source: SCOPUS. Elaboration: SCImago

photo

Félix de Moya Anegón is Research Professor at the Institute of Public Goods and Policies (IPP) from the Spanish National Research Council (CSIC), his academic interests include scientometrics, bibliometrics, research evaluation and science policy; he has published around 100 papers in these fields. He is SCImago Research Group‘s main researcher, where he has led renowned bibliometic projects including Scimago Journal & Country Rank, Scimago Institution Rankings and The Atlas of Science. Prof. De Moya is also advisor for Science Policy issues for national organizations of science and technology and research institutions around the world.

Science Indicators of Spanish HEIs 2006-2010

Felix de Moya Anegon. This post is devoted to characterize the research activity carried out at Spanish Higher Education Institutions over the period 2006-2010. The following table (in PDF format) shows scientometric indicators of research output, international collaboration, normalized impact, % Output in 1st quartile journals according to the Scimago Journal Rank indicator and the number of works of excellence (ordering criteria) published by any of the institutions.

The indicators exposed are the following:

Output

The output or number of scientific papers published in scholarly journals reveals the ability of an institution to produce scientific knowledge. Output values are affected by institution sizes and research profiles, among others factors. The Output indicator forms the basis for more complex metrics. At co-authored publications a score is assigned to each contributing institution through the author’s institutional address.

International Collaboration

This indicator shows the ability of institutions to create international research links through the output ratio that has been produced in collaboration with foreign institutions. The values are computed by analyzing the institution’s output whose affiliations include more than one country address.

Normalized Impact

Normalized Impact scores indicate the scientific impact that institutions have over the scientific community. In order to obtain a fair measurement of such impact, its calculation removes the influence due to institutions’ size and research profile making it ideal for comparing research performance. Normalized Impact values show the ratio between the average scientific impact of an institution and the world average impact of publications of the same time frame, document type and subject category. The values are expressed in percentages and show the relationship of the institution’s average impact to the world average, which is 1, –i.e. a score of 0.8 means the institution is cited 20% below world average and 1.3 means the institution is cited 30% above world average. Normalized Impact is computed using the methodology established by the Karolinska Intitutet in Sweden where it is named “Item oriented field normalized citation score average”. The long name used is because the normalization of the citation values is done on an individual article level. Further information on the methodology at Bibliometric Handbook for Karolinska Institutet .

High Quality Publications Q1

Ratio of publications an institution publishes in the world most influential scholarly journals. Journals considered for this indicator are those ranked in the first quartile (25%) in their categories as ordered by SCImago Journal Rank SJR indicator.

Excellence

The Excellence indicates the number of papers an institution included into the set formed by the 10% of the most cited papers in their respective scientific fields. It is a measure of high quality output of research institutions.

photo

Félix de Moya Anegón is Research Professor at the Institute of Public Goods and Policies (IPP) from the Spanish National Research Council (CSIC), his academic interests include scientometrics, bibliometrics, research evaluation and science policy; he has published around 100 papers in these fields. He is SCImago Research Group‘s main researcher, where he has led renowned bibliometic projects including Scimago Journal & Country RankScimago Institution Rankings and The Atlas of Science. Prof. De Moya is also advisor for Science Policy issues for national organizations of science and technology and research institutions around the world.

Performance Indicators of Italian CNR Institutes

Felix de Moya Anegon. This is the third post in our series on performance indicators of government organizations and leading national scientific institutions (National Research Councils and Science Academies). After the analysis of Spanish CSIC and German Max Planck Society we now focus on the Italian Cosiglio Nazionale delle Ricerche CNR and its research institutes. Mainly funded by public funds, the Italian leading scientific institution is a government agency with 107 Institutes set throughout the country (four of them have been discontinued) and grouped into 11 thematic departments. In 2009, the scientific output attributable to CNR Institutes represented more than 10% of Italian scientific output. Again, we present in this post a table (in PDF format) that, based on Elsevier’s Scopus database, shows scientometric indicators of research output, citation impact and international collaboration related to CNR Institutes. Its main goal is not to rank the institutes, but to highlight some of the differential characteristics in regard to the research outcomes achieved by these centers.

In order to show trends, the table includes three consecutive 5-year periods (2003-2007, 2004-2008 and 2005-2009). Ordering criteria is the output of the CNR Institutes during the period 2005-2009. The institutes are color-marked to indicate which ones have Normalized Impact (NI) values higher than the NI average over all CNR Institutes, which surpass Italian NI average (but fall below CNR average) and which ones fall below Italian NI average.

The following table provide some background information by showing the same four indicators and periods that you will find in the PDF report, but referred to the CNR entire organisation and to Italy:

CNR Output % IC NI % Q1
2003-2007 39,949 41.8 1.2 66.0
2004-2008 38,528 42.2 1.2 64.8
2005-2009 37,916 42.7 1.3 63.8
ITALY Output % IC NI % Q1
2003-2007 292,346 35.8 1.2 54.8
2004-2008 311,598 36.5 1.2 53.9
2005-2009 328,826 37.2 1.2 53.1

The indicators exposed are the following:

Output

The output or number of scientific papers published in scholarly journals reveals the ability of an institution to produce scientific knowledge. Output values are affected by institution sizes and research profiles, among others factors. The Output indicator forms the basis for more complex metrics. At co-authored publications a score is assigned to each contributing institution through the author’s institutional address.

International Collaboration IC(%)

This indicator shows the ability of institutions to create international research links through the output ratio that has been produced in collaboration with foreign institutions. The values are computed by analyzing the institution’s output whose affiliations include more than one country address.

Normalized Impact NI

Normalized Impact scores indicate the scientific impact that institutions have over the scientific community. In order to obtain a fair measurement of such impact, its calculation removes the influence due to institutions’ size and research profile making it ideal for comparing research performance. Normalized Impact values show the ratio between the average scientific impact of an institution and the world average impact of publications of the same time frame, document type and subject category. The values are expressed in percentages and show the relationship of the institution’s average impact to the world average, which is 1, –i.e. a score of 0.8 means the institution is cited 20% below world average and 1.3 means the institution is cited 30% above world average. Normalized Impact is computed using the methodology established by the Karolinska Intitutet in Sweden where it is named “Item oriented field normalized citation score average”. The long name used is because the normalization of the citation values is done on an individual article level. Further information on the methodology at Bibliometric Handbook for Karolinska Institutet .

High Quality Publications Q1(%)

Ratio of publications an institution publishes in the world most influential scholarly journals. Journals considered for this indicator are those ranked in the first quartile (25%) in their categories as ordered by SCImago Journal Rank SJR indicator.

photo

Félix de Moya Anegón is Research Professor at the Institute of Public Goods and Policies (IPP) from the Spanish National Research Council (CSIC), his academic interests include scientometrics, bibliometrics, research evaluation and science policy; he has published around 100 papers in these fields. He is SCImago Research Group‘s main researcher, where he has led renowned bibliometic projects including Scimago Journal & Country Rank, Scimago Institution Rankings and The Atlas of Science. Prof. De Moya is also advisor for Science Policy issues for national organizations of science and technology and research institutions around the world.