View More View Less
  • 1 EC3: Evaluación de la Ciencia y la Comunicación Científica, Centro de Investigación Médica Aplicada, Universidad de Navarra, 31008, Pamplona, Navarra, Spain
  • | 2 Department of Computer Science and Artificial Intelligence, Universidad de Granada, 18071 Granada, Spain
  • | 3 EC3: Evaluación de la Ciencia y la Comunicación Científica, Departamento de Biblioteconomía y Documentación, Universidad de Granada, 18071 Granada, Spain
Restricted access

Abstract

The problem of comparing academic institutions in terms of their research production is nowadays a priority issue. This paper proposes a relative bidimensional index that takes into account both the net production and the quality of it, as an attempt to provide a comprehensive and objective way to compare the research output of different institutions in a specific field, using journal contributions and citations. The proposed index is then applied, as a case study, to rank the top Spanish universities in the fields of Chemistry and Computer Science in the period ranging from 2000 until 2009. A comparison with the top 50 universities in the ARWU rankings is also made, showing the proposed ranking is better suited to distinguish among non-elite universities.

  • Adler, N., Harding, A.-W. 2009 When Knowledge Wins: Transcending the Sense and Nonsense of Academic Rankings. The Academy of Management Learning & Education 8 1 7295 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Aguillo, I.F., Bar-Ilan, J., Levene, M., Priego, J.L.O. 2010 Comparing university rankings. Scientometrics 85 1 243256 .

  • Aksnes, D. 2003 Characteristics of highly cited papers. Research Evaluation 12:159170 .

  • Aksnes, D., Sivertsen, G. 2004 The effect of highly cited papers on national citation indicators. Scientometrics 59:213224 .

  • Alonso, S., Cabrerizo, F., Herrera-Viedma, E., Herrera, F. 2009 h-Index: A review focused in its variants, computation and standardization for different scientific fields. Journal of Informetrics 3 4 273289 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Billaut, J.-C., Bouyssou, D., Vincke, P. 2010 Should you believe in the Shanghai ranking?: An MCDM view. Scientometrics 84 1 237263 .

  • Bornmann, L., Daniel, H.-D. 2008 Selecting manuscripts for a high-impact journal through peer review: A citation analysis of communications that were accepted by Angewandte Chemie International Edition, or rejected but published elsewhere. Journal of the American Society for Information Science and Technology 59 11 18411852 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bornmann, L., Daniel, H.-D. 2008 What do citation counts measure? A review of studies on citing behavior. Journal of Documentation 64 1 4580 .

  • Bornmann, L., Mutz, R., & Daniel, H.-D. (2010). The h index research output measurement: Two approaches to enhance its accuracy. Journal of Informetrics, 4 (3), 407414.

    • Search Google Scholar
    • Export Citation
  • Buela-Casal, G., Gutiérrez-Martínez, O., Bermúdez-Sánchez, M.P., Vadillo-Muñoz, O. 2007 Comparative study of international academic rankings of universities. Scientometrics 71 3 349365 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Cabrerizo, F., Alonso, S., Herrera-Viedma, E., Herrera, F. 2010 q2-Index: Quantitative and qualitative evaluation based on the number and impact of papers in the Hirsch core. Journal of Informetrics 4 1 2328 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dehon, C., McCathie, A., Verardi, V. 2010 Uncovering excellence in academic rankings: A closer look at the Shanghai ranking. Scientometrics 83 2 515524 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dill, D. D., & Soo, M. (2005). Academic quality, league tables, and public policy: A cross-national analysis of university ranking systems. Higher Education 49, 495-533. doi:.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Egghe, L. 2006 Theory and practise of the g-index. Scientometrics 69 1 131152 .

  • Elsevier B.V. Scopus. (2010). See http://www.scopus.co. Accessed Oct 2010.

  • Hirsch, J.E. 2005 An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences 102 46 1656916572 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ISI Web of Science. Science Citation Index. See http://isiknowledge.co. Accessed Oct 2010.

  • Kosmulski, M. 2009 New seniority-independent Hirsch-type index. Journal of Informetrics 3 4 341347 .

  • Leydesdorff, L., & Opthof, T. (2010). Normalization, CWTS indicators, and the Leiden Rankings: Differences in citation behavior at the level of fields. http://www.leydesdorff.net/reply2cwts/reply2cwts.pd. Accessed Oct 2010.

    • Search Google Scholar
    • Export Citation
  • Liu, N. C., & Cheng, Y. (2005). Academic ranking of world universities: Methodologies and problems. Higher Education in Europe 30 (2), 127136.

    • Search Google Scholar
    • Export Citation
  • Moed, H.F. 2005 Citation analysis in research evaluation Springer New York.

  • Moed, H. F. (2010). CWTS crown indicator measures citation impact of a research group's publication oeuvre. CoRR, abs/1003.5884.

  • Price, DJDS 1965 Networks of scientific papers. Science 149 3683 510515 .

  • QS World University Rankings. (2010). http://www.topuniversities.com/university-rankings/world-university-rankings/hom. Accessed Oct 2010.

  • SCImago Institutions Rankings. (2007). http://www.scimagoir.co. Accessed Oct 2010.

  • Shanghai Jiao Tong University. ( 2009). Academic ranking of world universities (ARWU). http://www.arwu.org/index.js. Accessed Oct 2010.

  • Sypsa, V., Hatzakis, A. 2009 Assessing the impact of biomedical research in academic institutions of disparate sizes. BMC Medical Research Methodology 9:3342 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Universiteit Leiden. (2010). Leiden university rankings. http://www.socialsciences.leiden.edu/cwts/products-services/leiden-ranking-2010-cwts. Accessed Oct 2010.

    • Search Google Scholar
    • Export Citation
  • A.F.J. van Raan T.N. van Leeuwen Visser, M.S. N.J. van Eck Waltman, L. 2010 Rivals for the crown: Reply to Opthof and Leydesdorff. Journal of Informetricx 4 3 431435 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Vieira, E., Gomes, J. 2010 A research impact indicator for institutions. Journal of Informetrics 4 4 581590 .

Manuscript submission: http://www.editorialmanager.com/scim/

  • Impact Factor (2019): 2.867
  • Scimago Journal Rank (2019): 1.210
  • SJR Hirsch-Index (2019): 106
  • SJR Quartile Score (2019): Q1 Computer Science Apllications
  • SJR Quartile Score (2019): Q1 Library and Information Sciences
  • SJR Quartile Score (2019): Q1 Social Sciences (miscellaneous)
  • Impact Factor (2018): 2.770
  • Scimago Journal Rank (2018): 1.113
  • SJR Hirsch-Index (2018): 95
  • SJR Quartile Score (2018): Q1 Library and Information Sciences
  • SJR Quartile Score (2018): Q1 Social Sciences (miscellaneous)

For subscription options, please visit the website of Springer

Scientometrics
Language English
Size B5
Year of
Foundation
1978
Volumes
per Year
4
Issues
per Year
12
Founder Akadémiai Kiadó
Founder's
Address
H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
Publisher Akadémiai Kiadó
Springer Nature Switzerland AG
Publisher's
Address
H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
CH-6330 Cham, Switzerland Gewerbestrasse 11.
Responsible
Publisher
Chief Executive Officer, Akadémiai Kiadó
ISSN 0138-9130 (Print)
ISSN 1588-2861 (Online)