Scientometrics
Volume/Issue:
Volume 93: Issue 2
How does the normalization of data affect the ARWU ranking?
Authors:
Milica Jovanovic Faculty of Organizational Sciences, University of Belgrade, Jove Ilica 154, 11000, Belgrade, Serbia

Search for other papers by Milica Jovanovic in
Current site
Google Scholar
PubMed Close
,
Veljko Jeremic Faculty of Organizational Sciences, University of Belgrade, Jove Ilica 154, 11000, Belgrade, Serbia

Search for other papers by Veljko Jeremic in
Current site
Google Scholar
PubMed Close
,
Gordana Savic Faculty of Organizational Sciences, University of Belgrade, Jove Ilica 154, 11000, Belgrade, Serbia

Search for other papers by Gordana Savic in
Current site
Google Scholar
PubMed Close
,
Milica Bulajic Faculty of Organizational Sciences, University of Belgrade, Jove Ilica 154, 11000, Belgrade, Serbia

Search for other papers by Milica Bulajic in
Current site
Google Scholar
PubMed Close
, and
Milan Martic Faculty of Organizational Sciences, University of Belgrade, Jove Ilica 154, 11000, Belgrade, Serbia

Search for other papers by Milan Martic in
Current site
Google Scholar
PubMed Close
Pages:
319–327
Online Publication Date:
29 Feb 2012
Publication Date:
01 Nov 2012
Article Category:
Brief Report
DOI:
https://doi.org/10.1007/s11192-012-0674-0
Keywords:
Ranking of universities; The I-distance method; ARWU; Statistical methods; Classification; Normalization of data; C38; 62H30
Restricted access

Abstract

The aim of this paper is to present new ideas in evaluating Shanghai University's Academic Ranking of World Universities (ARWU). In particular, this paper shall try to determine whether the normalization of data affects University ranks. In accordance with this, both the normalized and original (raw) data for each of the six variables has been obtained. Based on a sample containing the 54 US universities which are placed in the ARWU top 100, the statistical I-distance method was performed. The results showed great inconsistencies between university ranks obtained for the original and normalized data. These findings were then analyzed and the universities that had the greatest fluctuation in their ranks were noted.

  • Agasisti, T, Perez-Esparrells, C. Comparing efficiency in a cross-country perspective: the case of Italian and Spanish state universities. Higher Education 2010 59:85–103 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Aguillo, I, Bar-IIan, J, Levene, M, Ortega, JL. Comparing university rankings. Scientometrics 2010 85 1 243–256 .

  • Al-Lagilli, S, Jeremic, V, Seke, K, Jeremic, D, Radojicic, Z. Evaluating the health of nations: A Libyan perspective. Libyan Journal of Medicine 2011 6:6021.

    • Search Google Scholar
    • Export Citation

  • ARWU (2010). Academic ranking of world universities. http://www.arwu.org/ARWUMethodology2010.jsp. Accessed 14 Jan 2012.

  • Billaut, JC, Bouyssou, D, Vincke, P. Should you believe in the Shanghai ranking: An MCDM view. Scientometrics 2010 84 1 237–263 .

  • Bornmann, L, Leydesdorff, L. Which cities produce more excellent papers than can be expected? A new mapping approach—using google maps—based on statistical significance testing. Journal of the American Society of Information Science and Technology 2011 62 10 1954–1962 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Bornmann, L, Waltman, L. The detection of “hot regions” in the geography of science: A visualization approach by using density maps. Journal of Informetrics 2011 5 4 547–553 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Bowman, N, Bastedo, M. Anchoring effects in world university rankings: Exploring biases in reputation scores. Higher Education 2011 61 4 431–444 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Dehon, C, McCathie, A, Verardi, V. Uncovering excellence in academic rankings: A closer look at the Shanghai ranking. Scientometrics 2010 83 2 515–524 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Docampo, D. (2008). International rankings and quality of the university systems. Revista Education, Sp. Iss. SI, 149-176.

  • Docampo, D. On using the Shanghai ranking to assess the research performance of university systems. Scientometrics 2011 86 1 77–92 .

  • Docampo, D. Adjusted sum of institutional scores as an indicator of the presence of university systems in the ARWU ranking. Scientometrics 2012 90 2 701–713 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Fields (2010). Fields medals laureates. http://www.mathunion.org/general/prizes. Accessed 25 Jan 2012.

  • HiCi (2010). Highly cited authors. http://www.isihighlycited.com/. Accessed 18 Jan 2012.

  • Hien, PD. A comparative study of research capabilities of East Asian countries and implications for Vietnam. Higher Education 2010 60:615–625 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Ivanovic, B 1973 A method of establishing a list of development indicators United Nations educational, scientific and cultural organization Paris.

    • Search Google Scholar
    • Export Citation

  • Ivanovic, B 1977 Classification theory Institute for Industrial Economics Belgrade.

  • Ivanovic, B, Fanchette, S 1973 Grouping and ranking of 30 countries of sub-Saharan Africa, two distance-based methods compared United Nations educational, scientific and cultural organization Paris.

    • Search Google Scholar
    • Export Citation

  • Jeremic, V., & Radojicic, Z. (2010). A new approach in the evaluation of team chess championships rankings. Journal of Quantitative Analysis in Sports, 6 (3), 6. doi: .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Jeremic, V, Bulajic, M, Martic, M, Radojicic, Z. A fresh approach to evaluating the academic ranking of world universities. Scientometrics 2011 87 3 587–596 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Jeremic, V, Isljamovic, S, Petrovic, N, Radojicic, Z, Markovic, A, Bulajic, M. Human development index and sustainability: What's the correlation?. Metalurgia International 2011 16 7 63–67.

    • Search Google Scholar
    • Export Citation

  • Jeremic, V, Vukmirovic, D, Radojicic, Z, Djokovic, A. Towards a framework for evaluating ICT infrastructure of countries: A Serbian perspective. Metalurgia International 2011 16 9 15–18.

    • Search Google Scholar
    • Export Citation

  • Jeremic, V, Markovic, A, Radojicic, Z. ICT as crucial component of socio-economic development. Management 2011 16 60 5–9.

  • Jeremic, V, Seke, K, Radojicic, Z, Jeremic, D, Markovic, A, Slovic, D, Aleksic, A. Measuring health of countries: A novel approach. Health MED 2011 5 6 1762–1766.

    • Search Google Scholar
    • Export Citation

  • Knezevic, S, Jeremic, V, Zarkic-Joksimovic, N, Bulajic, M. Evaluating the Serbian banking sector: A statistical approach. Metalurgia International 2012 17 1 171–174.

    • Search Google Scholar
    • Export Citation

  • Leydesdorff, L, Shin, JC. How to evaluate universities in terms of their relative citation impacts: Fractional counting of citations and the normalization of differences among disciplines. Journal of the American Society of Information Science and Technology 2011 62 6 1146–1155 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Liu, NC, Cheng, Y. Academic ranking of world universities: Methodologies and problems. Higher Education in Europe 2005 30 2 127–136 .

  • Liu, NC, Cheng, Y, Liu, L. Academic ranking of world universities using scientometrics: A comment to the “fatal attraction”. Scientometrics 2005 64 1 101–109 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Mihailovic, N, Bulajic, M, Savic, G. Ranking of banks in Serbia. Yugoslav Journal of Operational Research 2009 19 2 323–334 .

  • Nobel (2010). Nobel price laureates. http://nobelprize.org/. Accessed 23 Jan 2012.

  • Radojicic, Z, Isljamovic, S, Petrovic, N, Jeremic, V. A novel approach to evaluating sustainable development. Problemy Ekorozwoju—Problems of Sustainable Development 2012 7 1 81–85.

    • Search Google Scholar
    • Export Citation

  • Stolz, I, Hendel, D, Horn, A. Ranking of rankings: Benchmarking twenty-five higher education ranking systems in Europe. Higher Education 2010 60 5 507–528 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Torres-Salinas, D, Moreno-Torres, JG, Delgado-Lopez-Cezar, E, Herrera, F. A methodology for institution-field rankings based on a bidimensional analysis: The IFQ2A index. Scientometrics 2011 88 3 771–786 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • AFJ van Raan 2005 Fatal attraction: Ranking of universities by bibliometric methods. Scientometrics 62:133–145 .

  • AFJ van Raan 2005 Reply to the comments of Liu et al. Scientometrics 64 1 111–112 .

  • Web of Knowledge (2010). Web of Knowledge. http://www.isiknowledge.com. Accessed 22 Jan 2012.

  • Collapse
  • Expand
Cover Scientometrics
Scientometrics
Print ISSN:
0138-9130
Online ISSN:
1588-2861

To see the editorial board, please visit the website of Springer Nature.

Manuscript submission: http://www.editorialmanager.com/scim/

For subscription options, please visit the website of Springer Nature.

Scientometrics
Language English
Size B5
Year of
Foundation		 1978
Volumes
per Year		 1
Issues
per Year		 12
Founder Akadémiai Kiadó
Founder's
Address		 H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
Publisher Akadémiai Kiadó
Springer Nature Switzerland AG
Publisher's
Address		 H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
CH-6330 Cham, Switzerland Gewerbestrasse 11.
Responsible
Publisher		 Chief Executive Officer, Akadémiai Kiadó
ISSN 0138-9130 (Print)
ISSN 1588-2861 (Online)

Monthly Content Usage

Abstract Views Full Text Views PDF Downloads
Dec 2024 21 0 0
Jan 2025 44 0 0
Feb 2025 61 1 1
Mar 2025 68 0 0
Apr 2025 22 0 0
May 2025 2 0 0
Jun 2025 0 0 0