Abstract
We compared three different bibliometric evaluation approaches: two citation-based approaches and one based on manual classification of publishing channels into quality levels. Publication data for two universities was used, and we worked with two levels of analysis: article and department. For the article level, we investigated the predictive power of field normalized citation rates and field normalized journal impact with respect to journal level. The results for the article level show that evaluation of journals based on citation impact correlate rather well with manual classification of journals into quality levels. However, the prediction from field normalized citation rates to journal level was only marginally better than random guessing. At the department level, we studied three different indicators in the context of research fund allocation within universities and the extent to which the three indicators produce different distributions of research funds. It turned out that the three distributions of relative indicator values were very similar, which in turn yields that the corresponding distributions of hypothetical research funds would be very similar.
ProCite
RefWorks
Reference Manager
BibTeX
Zotero
EndNote
-
Auranen, O, Nieminen, M. University research funding and publication performance-An international comparison. Research Policy 2010 39 6 822–834 .
-
Braun, T, Glänzel, W. United Germany–the new scientific superpower. Scientometrics 1990 19 5–6 513–521 .
-
Butler, L 2004 What happens when funding is linked to publication counts? HF Moed W Glänzel U Schmoch eds. Handbook of quantitative science and technology research Kluwer Dordrecht 389–405.
-
Debackere, K, Glänzel, W. Using a bibliometric approach to support research policy making: The case of the Flemish BOF-key. Scientometrics 2004 59 2 253–276 .
-
Fawcett, T. An introduction to ROC analysis. Pattern Recognition Letters 2006 27 8 861–874 .
-
Geuna, A. The changing rationale for European university research funding: Are there negative unintended consequences?. Journal of Economic Issues 2001 35 3 607–632.
-
Geuna, A, Martin, BR. University research evaluation and funding: An international comparison. Minerva 2003 41 4 277–304 .
-
Hosmer, DW, Lemeshow, S 2000 Applied logistic regression 2 Wiley New York .
-
Lundberg, J. Lifting the crown-citation z-score. Journal of Informetrics 2007 1 2 145–154 .
-
Moed, HF RE De Bruin TN van Leeuwen 1995 New bibliometric tools for the assessment of national research performance: Database description, overview of indicators and first applications. Scientometrics 33 3 381–422 .
-
Opthof, T, Leydesdorff, L. Caveats for the journal and field normalizations in the CWTS (“Leiden”) evaluations of research performance. Journal of Informetrics 2010 4 3 423–430 .
-
Sandström, U, Sandström, E. The field factor: towards a metric for academic institutions. Research Evaluation 2009 18 3 243–250 .
-
Schneider, JW. An outline of the bibliometric indicator used for performance-based funding of research institutions in Norway. European Political Science 2009 8 3 364–378 .
-
Seglen, PO. Causal relationship between article citedness and journal impact. Journal of the American Society for Information Science 1994 45 1 1–11 .
-
Sivertsen, G. A performance indicator based on complete data for the scientific publication output at research institutions. ISSI Newsletter 2010 6 1 22–28.
-
AFJ van Raan 1996 Advanced bibliometric methods as quantitative core of peer review based evaluation and foresight exercises. Scientometrics 36 3 397–420 .
-
Weingart, P. Impact of bibliometrics upon the science system: Inadvertent consequences?. Scientometrics 2005 62 1 117–131 .
Monthly Content Usage
| Abstract Views | Full Text Views | PDF Downloads | |
|---|---|---|---|
| Aug 2020 | 29 | 0 | 0 |
| Sep 2020 | 1 | 1 | 0 |
| Oct 2020 | 4 | 0 | 0 |
| Nov 2020 | 5 | 74 | 37 |
| Dec 2020 | 2 | 0 | 0 |
| Jan 2021 | 0 | 0 | 0 |
| Feb 2021 | 0 | 0 | 0 |
Copyright Akadémiai Kiadó
AKJournals is the trademark of Akadémiai Kiadó's journal publishing business branch.
Copyright Akadémiai Kiadó AKJournals is the trademark of Akadémiai Kiadó's journal publishing business branch.
Powered by PubFactory