View More View Less
  • 1 National Research Council of Italy, Rome, Italy
  • 2 Laboratory for Studies of Research and Technology Transfer, School of Engineering, Department of Management, University of Rome “Tor Vergata”, Via del Politecnico 1, 00133, Rome, Italy
Restricted access

Abstract

An increasing number of nations allocate public funds to research institutions on the basis of rankings obtained from national evaluation exercises. Therefore, in non-competitive higher education systems where top scientists are dispersed among all the universities, rather than concentrated among a few, there is a high risk of penalizing those top scientists who work in lower-performance universities. Using a 5 year bibliometric analysis conducted on all Italian universities active in the hard sciences from 2004 to 2008, this work analyzes the distribution of publications and relevant citations by scientists within the universities, measures the research performance of individual scientists, quantifies the intensity of concentration of top scientists at each university, provides performance rankings for the universities, and indicates the effects of selective funding on the top scientists of low-ranked universities.

  • Abramo, G, D'Angelo, CA 2011 National-scale research performance assessment at the individual level. Scientometrics 86 2 347364 .

  • Abramo, G, D'Angelo, CA F Di Costa 2008 Assessment of sectoral aggregation distortion in research productivity measurements. Research Evaluation 17 2 111121 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Abramo, G., D'Angelo, C.A., & Cicero, T. (2010). The dispersion of research performance within and between universities as an indicator of the competitive intensity in higher education systems. Working paper LabRTT, a short abstract available on http://www.disp.uniroma2.it/laboratorioRTT/TESTI/Working%20paper/RESPOL_Cicero.pdf.

    • Search Google Scholar
    • Export Citation
  • Auranen, O, Nieminen, M 2010 University research funding and publication performance. An international comparison. Research Policy 39 6 822834 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bhattacharya, A., & Newhouse, H. (2008). Allocative efficiency and an incentive scheme for research. University of California-San Diego Working Paper. Retrieved June 18, 2010 from http://econ.ucsd.edu/∼hnewhous/research/Bhattacharya-Newhouse-RAE.pdf.

    • Search Google Scholar
    • Export Citation
  • Butler, L 2003 Explaining Australia's increased share of ISI publications. The effects of a funding formula based on publication counts. Research Policy 32 1 143155 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • D'Angelo, CA, Giuffrida, C, Abramo, G 2011 A heuristic approach to author name disambiguation in large-scale bibliometric databases. Journal of the American Society for Information Science and Technology 62 2 257269 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Debackere, K, Glänzel, W 2004 Using a bibliometric approach to support research policy making: the case of the Flemish BOF-key. Scientometrics 59 2 253276 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Georghiou, L, Larédo, P 2005 Report on the Berlin international workshop on “The evaluation of publicly funded research” Berlin Germany 26/27 September.

    • Search Google Scholar
    • Export Citation
  • Geuna, A, Martin, BR 2003 University research evaluation and funding: an international comparison. Minerva 41:277304 .

  • Glänzel, W. (2008). “Seven myths in bibliometrics. About facts and fiction in quantitative science studies. Kretschmer & F. Havemann (Eds): Proceedings of WIS Fourth international conference on webometrics, informetrics and scientometrics & ninth COLLNET meeting, Berlin, Germany.

    • Search Google Scholar
    • Export Citation
  • Langford, CH, Hall, J, Josty, P, Matos, S, Jacobson, A 2006 Indicators and outcomes of Canadian university research: proxies becoming goals?. Research Policy 35 10 15861598 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Laudel, G 2006 The art of getting funded: how scientists adapt to their funding conditions. Science and Public Policy 33 7 489504 .

  • Lundberg, J 2007 Lifting the crown-citation z-score. Journal of Informetrics 1 2 145154 .

  • Moed, HF 2008 UK research assessment exercises: informed judgments on research quality or quantity?. Scientometrics 74 1 153161 .

  • Moed, HF, Glänzel, W, Schmoch, U 2004 Handbook of quantitative science and technology research: the use of publication and patent statistics in studies of S & T systems Springer Dordrecht.

    • Search Google Scholar
    • Export Citation
  • Orr, D, Jaeger, M, Schwarzenberger, A 2007 Performance-based funding as an instrument of competition in German higher education. Journal of Higher Education Policy and Management 29 1 323 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Rousseau, R, Smeyers, M 2000 Output-financing at LUC. Scientometrics 47 2 379387 .

  • Shattock, M 2004 Managing successful universities. Perspectives: Policy and Practice in Higher Education 8 4 119120 .

  • Strehl, F., Reisinger, S., & Kalatschan, M. (2007). Funding systems and their effects on higher education systems. OECD Education Working Papers, No. 6, OECD Publishing. doi: .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • VTR. (2006). Italian Triennial Research Evaluation. VTR 2001-2003. Risultati delle valutazioni dei Panel di Area. Retrieved November 10, 2010 from http://vtr2006.cineca.it/.

    • Search Google Scholar
    • Export Citation

Manuscript submission: http://www.editorialmanager.com/scim/

  • Impact Factor (2019): 2.867
  • Scimago Journal Rank (2019): 1.210
  • SJR Hirsch-Index (2019): 106
  • SJR Quartile Score (2019): Q1 Computer Science Apllications
  • SJR Quartile Score (2019): Q1 Library and Information Sciences
  • SJR Quartile Score (2019): Q1 Social Sciences (miscellaneous)
  • Impact Factor (2018): 2.770
  • Scimago Journal Rank (2018): 1.113
  • SJR Hirsch-Index (2018): 95
  • SJR Quartile Score (2018): Q1 Library and Information Sciences
  • SJR Quartile Score (2018): Q1 Social Sciences (miscellaneous)

For subscription options, please visit the website of Springer