Educatio
Volume/Issue:
Volume 32: Issue 3
A finn felsőoktatási értékelőrendszer
Authors:
Péter Sasvári Nemzeti Közszolgálati Egyetem Budapest Magyarország
Miskolci Egyetem Miskolc Magyarország

Search for other papers by Péter Sasvári in
Current site
Google Scholar
PubMed Close
and
Anna Urbanovics Nemzeti Közszolgálati Egyetem Budapest Magyarország

Search for other papers by Anna Urbanovics in
Current site
Google Scholar
PubMed Close
Pages:
486–502
Online Publication Date:
28 Dec 2023
Publication Date:
28 Dec 2023
Article Category:
Research Article
DOI:
https://doi.org/10.1556/2063.32.2023.3.9
Keywords:
performance-based research funding; research excellence; research visibility;
Keywords (Hungarian):
teljesítményalapú finanszírozási rendszer; tudományos kiválóság; tudományos láthatóság;
Open access

2015 óta Finnországban is megjelenik a Publication Forum nevű minősítési és osztályozási rendszer, amely a kvantitatív kimutatások mellett támogatja a kutatási eredmények minőségi értékelését is. A rendszer a „norvég modellhez” hasonló, és a teljesítményalapú kutatási finanszírozás elemeként játszik szerepet az országban. A modell négy kategória között differenciál és helyezi el az egyes tudományos megjelenési felületeket. Kutatásunk célja rámutatni, hogy a finn rendszer hogyan és milyen mértékben orientálja kutatóit a tudományos kiválóság felé. Az elemzés módszertanát tudománymetriai adatokon alapuló leíró statisztika adja, amely elsősorban a folyóiratkiadók és országaik megoszlására fókuszál.

Eredményeink azt mutatják, hogy a topkategóriában dominálnak a nemzetközi szinten vezető hagyományos kiadók (elsősorban a Big Five: Elsevier, Springer Nature, Taylor and Francis, Wiley és Sage), illetve azt is láthatjuk, hogy a regionális lapok, valamint a megafolyóiratok ezzel szemben leértékeltek. Megfigyelhetjük a nyugat-európai – főleg a brit – folyóiratok felértékelődését is. A tanulmány érdekessége, hogy a finn értékelési rendszer szerint vizsgáljuk a hazai intézmények (16 egyetem) teljesítményét is.

Since 2015, Finland has also published the Publication Forum journal evaluation system, which supports qualitative evaluation of research outputs in addition to quantitative reporting. The system is similar to the “Norwegian model” and plays a role as an element of the performance-based research funding in the country. The model differentiates between 4 categories and ranks each of them according to their scientific output. The paper aims to highlight how and to what extent the Finnish system orients its researchers towards scientific excellence. The analysis is built on descriptive statistics based on scientometric data, that focuses mainly on the distribution of journal publishers and their countries.

Our results demonstrate that the top level is dominated by the internationally leading traditional publishers (mainly the Big Five: Elsevier, Springer Nature, Taylor and Francis, Wiley and Sage), while, in contrast, regional journals and mega-journals underperform. We can also observe an appreciation of Western European – mainly British – publications. An interesting feature of the study is that the performance of Hungarian institutions (16 universities) is also examined according to the Finnish evaluation system.
  • 1

    Adam, E. (2020) ‘Governments Base Performance-Based Funding on Global Rankings Indicators’: A Global Trend in Higher Education Finance or a Global Rankings Literature Fiction? A Comparative Analysis of Four Performance-Based Funding Programs. International Journal of Educational Development, 76 (2020. július): 102197. https://doi.org/10.1016/j.ijedudev.2020.102197

  • 2

    Benito, M., Gil, P. & Romera, R. (2020) Evaluating the influence of country characteristics on the Higher Education System Rankings’ progress. Journal of Informetrics, Vol. 14. No. 3. 101051. https://doi.org/10.1016/j.joi.2020.101051

  • 3

    Burk, J. C. (2002) Funding Public Colleges and Universities for Performance: Popularity, Problems, and Prospects. New York, Rockefeller Institute Press. https://www.amazon.com/Funding-Public-Colleges-Universities-Performance/dp/0914341960

  • 4

    Clark, I. D., Moran, G., Skolnik, M. L. & Trick, D. (2009) Academic Transformation: the Forces Reshaping Higher Education in Ontario. Queen’s Policy Studies Series. Montreal–Kingston, McGillQueen’s University Press. https://www.mqup.ca/academic-transformation-products-9781553392385.php

  • 5

    Dondio, P., Casnici, N., Grimaldo, F., Gilbert, N. & Squazzoni, F. (2019) The “invisible hand” of peer review: The implications of author-referee networks on peer review in a scholarly journal. Journal of Informetrics, Vol. 13. No. 2. pp. 708–716. http://dx.doi.org/10.1016/j.joi.2019.03.018

  • 6

    Dougherty, K. J., Natow, R. S., Bork, R. H., Jones, S. M. & Vega, B. E. (2013) Accounting for higher education accountability: Political origins of state performance funding for higher education. Teachers College Record, Vol. 115. No. 1. pp. 1–50. https://doi.org/10.1177/016146811311500101

  • 7

    Hazelkorn, E. (2015) Rankings and the reshaping of higher education: The battle for world-class excellence. London, Palgrave Macmillan. https://doi.org/10.1057/9780230306394

  • 8

    Hicks, D. (2012) Performance-Based University Research Funding Systems. Research Policy, Vol. 41, No. 2. pp. 251–61. https://doi.org/10.1016/j.respol.2011.09.007

  • 9

    Hicks, D., Wouters, P. F., Waltman, L., de Rijcke, S. & Rafols, I. (2015) The Leiden Manifesto for research metrics: Use these 10 principles to guide research evaluation. Nature, Vol. 520. pp. 429–431. https://doi.org/10.1038/520429a

  • 10

    Kulczycki, E., Engels, T. C. E., Pölönen, J., Bruun, K., Dušková, M., Guns, R., Nowotniak, R., Petr, M., Sivertsen, G., Istenič Starčič, A. & Zuccala, A. (2018) Publication patterns in the social sciences and humanities: The evidence from eight European countries. Scientometrics, Vol. 116. pp. 463–486. https://doi.org/10.1007/s11192-018-2711-0

  • 11

    Letto-Vanamo, P. (2019) Evaluation of academic legal publications in Finland. In: R. van Gestel, A. Lienhard (eds) Evaluating academic legal research in Europe: The advantage of lagging behind. Edward Elgar. pp. 218–237. (Chapter 8) http://doi.org/10.4337/9781788115506.00013

  • 12

    Lucianelli, G. & Citro, F. (2017) Financial conditions and financial sustainability in higher education: A literature review. In: M. P. R. Bolivar (ed.) Financial Sustainability in Public Administration: Exploring the Concepts of Financial Health. UK, Palgrave. pp. 23–53. https://doi.org/10.1007/978-3-319-57962-7_2

  • 13

    Macilwain, C. (2010) Science economics: What science is really worth. Nature News, Vol. 456. pp. 682–684. https://doi.org/10.1038/465682a

  • 14

    OECD (2003) Education Policy Analysis. Paris, OECD. https://www.oecd.org/education/school/educationpolicyanalysis-2003edition.htm

  • 15

    OECD (2015) Education at a Glance 2015: OECD Indicators. OECD Publishing. https://doi.org/10.1787/eag-2015-en

  • 16

    Pfeffer, J. & Salancik, G. R. (1978) The External Control of Organizations: A Resource Dependence Perspective. New York, Harper and Row. https://www.gsb.stanford.edu/faculty-research/books/external-control-organizations-resource-dependence-perspective

  • 17

    Pölönen, J. & Auranen, O. (2022) Research Performance and Scholarly Communication Profile of Competitive Research Funding: The Case of Academy of Finland. Scientometrics, Vol. 127. No. 12. pp. 7415–7433. https://doi.org/10.1007/s11192-022-04385-8

  • 18

    Pölönen, J., Pylvänäinen, E., Aspara, J., Puuska, H. -M. & Rinne, R. (2021) Publication Forum 20102020: Self-evaluation report of the Finnish quality classification system of peer-reviewed publication channels. Helsinki, Federation of Finnish Learned Societies. https://julkaisufoorumi.fi/sites/default/files/2021-03/Publication%20Forum%20self-evaluation%20report%202021_0.pdf [Letöltve: 2023. 09. 01.]

  • 19

    Pruvot, E. B., Claeys-Kulik, A.-L & Estermann, T. (2015) Strategies for efficient funding of universities in Europe. In: A. Curaj, L. Matei, R. Pricopie, J. Salmi & P. Scott (eds) The European higher education area: Between critical reflections and future policies. Cham, Springer International Publishing. pp. 153–168. http://doi.org/10.1007/978-3-319-20877-0_11

  • 20

    Saarela, M., Kärkkäinen T., Lahtonen, T. & Tuomo, R. (2016) Expert-based versus Citation-Based Ranking of Scholarly and Scientific Publication Channels. Journal of Informetrics, Vol. 10. No. 3. pp. 693–718. https://doi.org/10.1016/j.joi.2016.03.004

  • 21

    Saarela, M. & Tommi Kärkkäinen, T. (2020) Can We Automate Expert-Based Journal Rankings? Analysis of the Finnish Publication Indicator. Journal of Informetrics, Vol. 14. No. 2. 101008. https://doi.org/10.1016/j.joi.2020.101008

  • 22

    Sandström, U., Van den Besselaar, P. (2018) Funding, evaluation, and the performance of national research systems. Journal of Informetrics, Vol. 12. No. 1. pp. 365–384. https://doi.org/10.1016/j.joi.2018.01.007

  • 23

    Sasvári, P. & Urbanovics, A. (2022) Subject Area Risk Assessment of Four Hungarian Universities with a View to the QS University Rankings by Subject. Journal of Data and Information Science, Vol. 7. No. 4. pp. 61–80. https://doi.org/10.2478/jdis-2022-0023

  • 24

    Sasvári, P. & Urbanovics, A. (2023) Az MDPI kiadójú közlemények helyzete – látlelet az EU 27 tagállamában. In: János Tibor Karlovitz (ed.) What will our Future be Like? 2 essays in German, 7 in English, 30 in Hungarian languag. (német, angol és magyar nyelvű esszék) Grosspetersdorf, Ausztria, Sozial und Wirtschafts Forschungsgruppe. pp. 209–221. http://real.mtak.hu/170987/

  • 25

    Sivertsen, G. (2010) A performance indicator based on complete data for the scientific publication output at research institutions. ISSI Newsletter, Vol. 6. No. 1. pp. 22–28. https://www.researchgate.net/publication/284078906_A_performance_indicator_based_on_complete_data_for_the_scientific_publication_output_at_research_institutions

  • 26

    Sivertsen, G. (2016) Publication-based funding: The Norwegian model. In: M. Ochsner (ed.) Research Assessment in the Humanities: Towards Criteria and Procedures. Springer International Publishing. pp. 71–90. https://doi.org/10.1007/978-3-319-29016-4_7

  • 27

    Sivertsen, G. (2019) Developing Current Research Information Systems (CRIS) as data sources for studies of research. In: W. Glänzel, H. F. Moed, U. Schmoch & M. Thelwall (eds) Springer Handbook of Science and Technology Indicators. Springer. pp. 667–683. https://doi.org/10.1007/978-3-030-02511-3_25

  • 28

    Thelwall, M. (2017) Three practical field normalised alternative indicator formulae for research evaluation. Journal of Informetrics, Vol. 11. pp. 128–151. http://dx.doi.org/10.1016/j.joi.2016.12.002

  • 29

    Verleysen, F. T. & Engels, T. C. (2014) Internationalization of peer reviewed and non-peer reviewed book publications in the Social Sciences and Humanities. Scientometrics, Vol. 101. No. 2. pp. 1431–1444. https://doi.org/10.1007/s11192-014-1267-x

  • 30

    Wang, L., Vuolanto, P. & Muhonen, R. (2014) Bibliometrics in the research assessment exercise reports of Finnish universities and the relevant international perspectives. Tampere, University of Tampere. http://tampub.uta.fi/handle/10024/96266

  • 31

    World Bank (1996) World Development Report 1996: From Plan to Market. New York, Oxford University Press. https://openknowledge.worldbank.org/handle/10986/5979 [Letöltve: 2023. 09. 01.]

  • 32

    World Bank (2002) Transition, the first ten years. Analysis and Lessons for Eastern Europe and the Former Soviet Union. Washington (D.C.), World Bank. https://openknowledge.worldbank.org/handle/10986/14042

  • 33

    Publication Forum folyóiratkereső felülete, URL2, https://www.tsv.fi/julkaisufoorumi/haku.php?lang=en

  • 34

    Publication Forum főoldala, URL3, https://www.julkaisufoorumi.fi/en

  • 35

    Sustainability to JUFO 0 level in 2023, URL1, https://ajatuksia.postach.io/post/sustainability-to-jufo-0-level-in-2023

  • Collapse
  • Expand
Cover Educatio
Educatio
Print ISSN:
1216-3384

Senior editors

Editor(s)-in-Chief: Anikó FEHÉRVÁRI

Kutatás közben: Roland HEGEDŰS

Szemle: Gábor TOMASZ

Editorial Board

  • Iván BAJOMI (Eötvös Loránd Tudományegyetem)
  • Zsuzsanna Hanna BIRÓ (Wesley János Lelkészképző Főiskola)
  • Anikó FEHÉRVÁRI (Eötvös Loránd Tudományegyetem)
  • Katalin FORRAY R. (Pécsi Tudományegyetem)
  • Roland HEGEDŰS (Eszterházy Károly Katolikus Egyetem, Eger)
  • Ildikó HRUBOS (Budapesti Corvinus Egyetem)
  • Zoltán GYÖRGYI (Debreceni Egyetem)
  • Tamás KOZMA (Debreceni Egyetem)
  • Gergely KOVÁTS (Budapesti Corvinus Egyetem)
  • Péter LUKÁCS (Wesley János Lelkészképző Főiskola)
  • Péter Tibor NAGY (Wesley János Lelkészképző Főiskola)
  • István POLÓNYI (Debreceni Egyetem)
  • Géza SÁSKA (Eötvös Loránd Tudományegyetem)
  • Marianna SZEMERSZKI (Oktatási Hivatal)
  • Krisztián SZÉLL (Eötvös Loránd Tudományegyetem)
  • Gábor TOMASZ (Oktatási Hivatal)
  • Zsuzsanna VEROSZTA (KSH Népességtudományi Kutatóintézet)

Institute: ELTE Neveléstudományi Intézet
Address: Kazinczy u. 23-27. H-1075 Budapest, Hungary
Phone: (06-1) 461-4500
Fax: (06-1) 461-4528

Educatio
Publication Model Gold Open Access
Submission Fee none
Article Processing Charge none
Subscription Information Gold Open Access

Educatio
Language Hungarian
Size B5
Year of
Foundation		 1991
Publication
Programme		 2020 Volume 29
Volumes
per Year		 1
Issues
per Year		 4
Founder Eötvös Loránd Tudományegyetem
Founder's
Address		 H-1053 Budapest, Hungary Egyetem tér 1-3.
Publisher Akadémiai Kiadó
Publisher's
Address		 H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
Responsible
Publisher		 Chief Executive Officer, Akadémiai Kiadó
ISSN 1216-3384 (Print)
ISSN 1419-8827 (Online)

Monthly Content Usage

Abstract Views Full Text Views PDF Downloads
Aug 2024 0 30 14
Sep 2024 0 60 9
Oct 2024 0 172 4
Nov 2024 0 136 3
Dec 2024 0 205 5
Jan 2025 0 54 2
Feb 2025 0 0 0