Scientometrics
Volume/Issue:
Volume 59: Issue 2
Using a bibliometric approach to support research policy making: The case of the Flemish BOF-key
Authors:
Koenraad Debackere Katholieke Universiteit Leuven, Steunpunt O&O Statistieken Dekenstraat 2 B-3000 Leuven Belgium Dekenstraat 2 B-3000 Leuven Belgium

Search for other papers by Koenraad Debackere in
Current site
Google Scholar
PubMed Close
and
Wolfgang Glänzel Katholieke Universiteit Leuven, Steunpunt O&O Statistieken Dekenstraat 2 B-3000 Leuven Belgium Dekenstraat 2 B-3000 Leuven Belgium

Search for other papers by Wolfgang Glänzel in
Current site
Google Scholar
PubMed Close
Pages:
253–276
Online Publication Date:
01 Jan 2004
Publication Date:
01 Jan 2004
Article Category:
Research Article
DOI:
https://doi.org/10.1023/b:scie.0000018532.70146.02
Restricted access

In this paper, we describe the development of a methodology and an instrument to support a major research funding allocation decision by the Flemish government. Over the last decade, and in parallel with the decentralization and the devolution of the Belgian federal policy authority towards the various regions and communities in the country, science and technology policy have become a major component of regional policy making. In the Flemish region, there has been an increasing focus on basing the funding allocation decisions that originate from this policy decentralization on “objective, quantifiable and repeatable” decision parameters. One of the data sources and indicator bases that have received ample attention in this evolution is the use of bibliometric data and indicators. This has now led to the creation of a dedicated research and policy support staff, called “Steunpunt O&O Statistieken,” and the first time application of bibliometric data and methods to support a major inter-university funding allocation decision. In this paper, we analyze this evolution. We show how bibliometric data have for the first time been used to allocate 93 million Euro of public research money between 6 Flemish universities for the fiscal year 2003, based on Web-of-Science SCI data provided to “Steunpunt O&O Statistieken” via a license agreement with Thomson-ISI. We also discuss the limitations of the current approach that was based on inter-university publication and citation counts. We provide insights into future adaptations that might make it more representative of the total research activity at the universities involved (e.g., by including data for the humanities) and of its visibility (e.g., by including impact measures). Finally, based on our current experience and interactions with the universities involved, we speculate on the future of the specific bibliometric approach that has now been adopted. More specifically, we hypothesize that the allocation method now developed and under further improvement will become more criticized if it turns out that it (1) also starts influencing intra-university research allocation decisions and, as a consequence (2) introduces adverse publication and citation behaviors at the universities involved.

  • Amram, M. (2002), Value Sweep: Mapping Corporate Growth Opportunities, Harvard Business School Press, Boston.

  • Audretsch, D B., Bozeman, B, Combs, K L., Feldman, M, Link, A N., Siegel, D S., Stephan, P, Tassey, G, Wessner, C (2002), The economics of science and technology, The Journal of Technology Transfer, 27(2): 155–203.

    • Search Google Scholar
    • Export Citation

  • Boer, F P. (2002), Financial management of R&D 2002, Research Technology Management, July–August Issue: 23–35.

  • Brockhoff, K (1994), Forschung und Entwicklung: Planung und Kontrolle (4. Auflage), R Oldenbourg Verlag, München.

  • CORDIS Focus (2002), European Innovation Scoreboard 2002, EC. Luxembourg.

  • Debackere, K, Glänzel, W, Meyer, M (2002), A Reflection on the Opportunities and Limitations in Using Publication and Patent Based Indicators, Working Paper, Steunpunt O&O Statistieken, KU. Leuven.

    • Search Google Scholar
    • Export Citation

  • EIRMA (1970), Methods for the Evaluation of R&D Projects, Vol. I, Paris.

  • FWO-Vlaanderen (2002), Jaarverslag.

  • Gibbons, M, Georghiou, L (1986), Research Evaluation, OECD, Paris.

  • Gibbons, M, Limoges, C, Nowotny, H, Schwartzman, S, Scott, P, Trow, M (1994), The New Production of Knowledge, Sage Publications, London.

    • Search Google Scholar
    • Export Citation

  • Glänzel, W (1996), The need for standards in bibliometric research and technology, Scientometrics, 35(1): 167–176.

  • Glänzel, W, Schubert, A (2002), A new classification scheme of science fields and subfields designed for scientometric evaluation purposes, Scientometrics, 56(3): 357–367.

    • Search Google Scholar
    • Export Citation

  • Griliches, Z (1984), R&D, Patents and Productivity, Chicago University Press, Chicago.

  • HBPWB (2003), Horizontaal Begrotingsprogramma Wetenschapsbeleid, AWI Publication, Ministery of the Flemish Community, Brussels.

  • IWT-Vlaanderen (2002), Jaarverslag.

  • Katz, J S., Hicks, D M. (1996), A Systemic view of British science, Scientometrics, 35(1): 133–154.

  • Luwel, M (1999), Is the Science Citation Index US-biased, Scientometrics, 46(3): 549–562.

  • Luwel, M, Noyons, E C. M., Moed, H F. (1999), Bibliometric assessment of research performance in Flanders: Policy background and implications, R & D Management, 29(2): 133–141.

    • Search Google Scholar
    • Export Citation

  • Moed, H F. M., De Bruin, R E., Nederhof, A J., van Raan, A F. J., Tijssen, R. J. W. (1992), State of Art Bibliometric Macro-Indicators. An Overview of Demand and Supply, Office for Official Publications of the European Community, Luxembourg.

    • Search Google Scholar
    • Export Citation

  • NSF (1961), Investing in Scientific Progress, National Science Foundation Report 61-27, Washington.

  • NSF (1967), Patterns of National R&D Resources, 1953–1968, Reviews of Data on Science Resources, National Science Foundation Report 67-7, Washington.

    • Search Google Scholar
    • Export Citation

  • NSF (1976), Indicators of International Trends in Technological Innovation, National Science Foundation, Washington.

  • OECD (2000), Knowledge, Technology and Economic Growth: Recent Evidence from OECD Countries.

  • OECD (2001), Benchmarking Industry-Science Relationships, Science, Technology and Industry Outlook 2000.

  • Paxson, D A. (2001), Introduction to real R&D options, (Special Issue), R&D Management Journal, 31(2): 109–248.

  • Roberts, E B. (1964), The Dynamics of Research and Development, Harper & Row Publishers, New York.

  • Roman, D D. (1968), Research and Development Management: The Economics and Administration of Technology, Prentice-Hall, Englewood Cliffs, New Jersey.

    • Search Google Scholar
    • Export Citation

  • Roussel, P A., Saad, K. N., Erickson, T J. (1991), Third Generation R&D, Harvard Business School Press, Boston.

  • Seiler, R E. (1965), Improving the Effectiveness of Research and Development, McGraw-Hill Book Company, New York.

  • Tidd, J, Bessant, J, Pavitt, K (2001), Managing Innovation, John Wiley & Sons, Chichester.

  • Tijssen, R J. W., Visser, M S., van Leeuwen, T N. (2001), Searching for scientific excellence: Scientometric measurements and citation analyses of national research systems, Proceedings of the 8th International Conference on Scientometrics & Informetrics, pp. 675–689.

    • Search Google Scholar
    • Export Citation

  • Van Den Berghe, H, Houben, J A., De Bruin, R E., Moed, H. F., Kint, A, Luwel, M, Spruyt, E H. J. (1998), Bibliometric indicators of university research performance in Flanders, Journal of the American Society for Information Science, 49(1): 59–67.

    • Search Google Scholar
    • Export Citation

  • Villers, R (1964), Research and Development: Planning and Control, Financial Executives Institute, New York.

  • Vinck, D (Ed.) (1991), Gestion de la Recherche, De Boeck Publishing, Brussels.

  • VRWB (2002), Het “grote” begrotingsadvies wetenschaps-en technologisch innovatiebeleid 2002, Brussel.

  • Collapse
  • Expand
Cover Scientometrics
Scientometrics
Print ISSN:
0138-9130
Online ISSN:
1588-2861

To see the editorial board, please visit the website of Springer Nature.

Manuscript submission: http://www.editorialmanager.com/scim/

For subscription options, please visit the website of Springer Nature.

Scientometrics
Language English
Size B5
Year of
Foundation		 1978
Volumes
per Year		 1
Issues
per Year		 12
Founder Akadémiai Kiadó
Founder's
Address		 H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
Publisher Akadémiai Kiadó
Springer Nature Switzerland AG
Publisher's
Address		 H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
CH-6330 Cham, Switzerland Gewerbestrasse 11.
Responsible
Publisher		 Chief Executive Officer, Akadémiai Kiadó
ISSN 0138-9130 (Print)
ISSN 1588-2861 (Online)

Monthly Content Usage

Abstract Views Full Text Views PDF Downloads
Aug 2024 14 0 0
Sep 2024 26 0 0
Oct 2024 72 0 0
Nov 2024 20 0 0
Dec 2024 13 0 0
Jan 2025 2 0 0
Feb 2025 0 0 0