View More View Less
  • 1 Faculty of Organizational Sciences, University of Belgrade, Jove Ilica 154, 11000, Belgrade, Serbia
Restricted access

Abstract

The aim of this paper is to present new ideas in evaluating Shanghai University's Academic Ranking of World Universities (ARWU). In particular, this paper shall try to determine whether the normalization of data affects University ranks. In accordance with this, both the normalized and original (raw) data for each of the six variables has been obtained. Based on a sample containing the 54 US universities which are placed in the ARWU top 100, the statistical I-distance method was performed. The results showed great inconsistencies between university ranks obtained for the original and normalized data. These findings were then analyzed and the universities that had the greatest fluctuation in their ranks were noted.

  • Agasisti, T, Perez-Esparrells, C. Comparing efficiency in a cross-country perspective: the case of Italian and Spanish state universities. Higher Education 2010 59:85103 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Aguillo, I, Bar-IIan, J, Levene, M, Ortega, JL. Comparing university rankings. Scientometrics 2010 85 1 243256 .

  • Al-Lagilli, S, Jeremic, V, Seke, K, Jeremic, D, Radojicic, Z. Evaluating the health of nations: A Libyan perspective. Libyan Journal of Medicine 2011 6:6021.

    • Search Google Scholar
    • Export Citation
  • ARWU (2010). Academic ranking of world universities. http://www.arwu.org/ARWUMethodology2010.jsp. Accessed 14 Jan 2012.

  • Billaut, JC, Bouyssou, D, Vincke, P. Should you believe in the Shanghai ranking: An MCDM view. Scientometrics 2010 84 1 237263 .

  • Bornmann, L, Leydesdorff, L. Which cities produce more excellent papers than can be expected? A new mapping approach—using google maps—based on statistical significance testing. Journal of the American Society of Information Science and Technology 2011 62 10 19541962 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bornmann, L, Waltman, L. The detection of “hot regions” in the geography of science: A visualization approach by using density maps. Journal of Informetrics 2011 5 4 547553 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bowman, N, Bastedo, M. Anchoring effects in world university rankings: Exploring biases in reputation scores. Higher Education 2011 61 4 431444 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dehon, C, McCathie, A, Verardi, V. Uncovering excellence in academic rankings: A closer look at the Shanghai ranking. Scientometrics 2010 83 2 515524 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Docampo, D. (2008). International rankings and quality of the university systems. Revista Education, Sp. Iss. SI, 149-176.

  • Docampo, D. On using the Shanghai ranking to assess the research performance of university systems. Scientometrics 2011 86 1 7792 .

  • Docampo, D. Adjusted sum of institutional scores as an indicator of the presence of university systems in the ARWU ranking. Scientometrics 2012 90 2 701713 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fields (2010). Fields medals laureates. http://www.mathunion.org/general/prizes. Accessed 25 Jan 2012.

  • HiCi (2010). Highly cited authors. http://www.isihighlycited.com/. Accessed 18 Jan 2012.

  • Hien, PD. A comparative study of research capabilities of East Asian countries and implications for Vietnam. Higher Education 2010 60:615625 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ivanovic, B 1973 A method of establishing a list of development indicators United Nations educational, scientific and cultural organization Paris.

    • Search Google Scholar
    • Export Citation
  • Ivanovic, B 1977 Classification theory Institute for Industrial Economics Belgrade.

  • Ivanovic, B, Fanchette, S 1973 Grouping and ranking of 30 countries of sub-Saharan Africa, two distance-based methods compared United Nations educational, scientific and cultural organization Paris.

    • Search Google Scholar
    • Export Citation
  • Jeremic, V., & Radojicic, Z. (2010). A new approach in the evaluation of team chess championships rankings. Journal of Quantitative Analysis in Sports, 6 (3), 6. doi: .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Jeremic, V, Bulajic, M, Martic, M, Radojicic, Z. A fresh approach to evaluating the academic ranking of world universities. Scientometrics 2011 87 3 587596 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Jeremic, V, Isljamovic, S, Petrovic, N, Radojicic, Z, Markovic, A, Bulajic, M. Human development index and sustainability: What's the correlation?. Metalurgia International 2011 16 7 6367.

    • Search Google Scholar
    • Export Citation
  • Jeremic, V, Vukmirovic, D, Radojicic, Z, Djokovic, A. Towards a framework for evaluating ICT infrastructure of countries: A Serbian perspective. Metalurgia International 2011 16 9 1518.

    • Search Google Scholar
    • Export Citation
  • Jeremic, V, Markovic, A, Radojicic, Z. ICT as crucial component of socio-economic development. Management 2011 16 60 59.

  • Jeremic, V, Seke, K, Radojicic, Z, Jeremic, D, Markovic, A, Slovic, D, Aleksic, A. Measuring health of countries: A novel approach. Health MED 2011 5 6 17621766.

    • Search Google Scholar
    • Export Citation
  • Knezevic, S, Jeremic, V, Zarkic-Joksimovic, N, Bulajic, M. Evaluating the Serbian banking sector: A statistical approach. Metalurgia International 2012 17 1 171174.

    • Search Google Scholar
    • Export Citation
  • Leydesdorff, L, Shin, JC. How to evaluate universities in terms of their relative citation impacts: Fractional counting of citations and the normalization of differences among disciplines. Journal of the American Society of Information Science and Technology 2011 62 6 11461155 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Liu, NC, Cheng, Y. Academic ranking of world universities: Methodologies and problems. Higher Education in Europe 2005 30 2 127136 .

  • Liu, NC, Cheng, Y, Liu, L. Academic ranking of world universities using scientometrics: A comment to the “fatal attraction”. Scientometrics 2005 64 1 101109 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Mihailovic, N, Bulajic, M, Savic, G. Ranking of banks in Serbia. Yugoslav Journal of Operational Research 2009 19 2 323334 .

  • Nobel (2010). Nobel price laureates. http://nobelprize.org/. Accessed 23 Jan 2012.

  • Radojicic, Z, Isljamovic, S, Petrovic, N, Jeremic, V. A novel approach to evaluating sustainable development. Problemy Ekorozwoju—Problems of Sustainable Development 2012 7 1 8185.

    • Search Google Scholar
    • Export Citation
  • Stolz, I, Hendel, D, Horn, A. Ranking of rankings: Benchmarking twenty-five higher education ranking systems in Europe. Higher Education 2010 60 5 507528 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Torres-Salinas, D, Moreno-Torres, JG, Delgado-Lopez-Cezar, E, Herrera, F. A methodology for institution-field rankings based on a bidimensional analysis: The IFQ2A index. Scientometrics 2011 88 3 771786 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • AFJ van Raan 2005 Fatal attraction: Ranking of universities by bibliometric methods. Scientometrics 62:133145 .

  • AFJ van Raan 2005 Reply to the comments of Liu et al. Scientometrics 64 1 111112 .

  • Web of Knowledge (2010). Web of Knowledge. http://www.isiknowledge.com. Accessed 22 Jan 2012.

To see the editorial board, please visit the website of Springer Nature.

Manuscript submission: http://www.editorialmanager.com/scim/

For subscription options, please visit the website of Springer Nature.

Scientometrics
Language English
Size B5
Year of
Foundation
1978
Volumes
per Year
1
Issues
per Year
12
Founder Akadémiai Kiadó
Founder's
Address
H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
Publisher Akadémiai Kiadó
Springer Nature Switzerland AG
Publisher's
Address
H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
CH-6330 Cham, Switzerland Gewerbestrasse 11.
Responsible
Publisher
Chief Executive Officer, Akadémiai Kiadó
ISSN 0138-9130 (Print)
ISSN 1588-2861 (Online)