View More View Less
  • 1 Department of Economics, University of Pretoria, Pretoria 0002, South Africa
  • | 2 Institute for Technological Innovation, University of Pretoria, Pretoria, South Africa Anastassios.Pouris@up.ac.za
Restricted access

Abstract

The influence of the National Research Foundation's (NRF) rating system on the productivity of the South African social science researchers is investigated scientometrically for the period from 1981 to 2006. Their output performance is mainly indicated by their research publications. Following international best practice in scientometrics as well as the behavioural reinforcement theory, we employed the “before/after control impact (BACI) method”, as well as the well known econometric breakpoint test as proposed by Chow. We use as control group the publications in the field of clinical medicine. The field is not supported by NRF and hence clinical medicine researchers are not affected by the evaluation and rating system. The findings show a positive impact of the NRF programme on the research outputs of social sciences researchers and the implementation of the programme has increased the relevant population of research articles by an average of 24.5% (during the first 5 years) over the expected number of publication without the programme. The results confirm the scientometric findings of other studies (e.g. that of Nederhof) that ratings promulgate research productivity.

  • Arenas, JLD, Valles, J, Arenas, M 2000 Educational research in Mexico: Socio-demographic and visibility issues. Educational Research 42:8590 .

  • Berkhout, F, Hertin, J, Jordan, A 2002 Socio-economic futures in climate change impact assessment: Using scenarios as “learning machines”. Global Environmental Change 12:8395 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bertrand, M., Djankov, S., Hanna, R., & Mullainathan, S. (2006). Does corruption produce unsafe drivers? National Bureau of Economic Research NBER Working Paper #12274, Cambridge, MA.

    • Search Google Scholar
    • Export Citation
  • Bouabid, H., Dalimi, M., & Elmajid, Z. (2010). Impact evaluation of the voluntary early retirement policy on research and technology outputs of the faculties of science in Morocco. Scientometrics, 85, 125132.

    • Search Google Scholar
    • Export Citation
  • Caspary, G 2009 Assessing, mitigating and monitoring environmental risks of large infrastructure projects in foreign financing decisions: The case of OECD country public financing for large dams in developing countries. Impact Assessment and Project Appraisal 27:1932 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Chow, CG 1960 Tests of equality between sets of coefficients in two linear regressions. Econometrica 28:591605 .

  • Duflo, E., Glennerster, R., & Kremer, M. (2006). Using randomization in development economics research: A toolkit. National Bureau of Economic Research (NBER), Technical Working Paper 333, Cambridge, MA.

    • Search Google Scholar
    • Export Citation
  • Groot, T, Garcia-Valderrama, T 2006 Research quality and efficiency—An analysis of assessments and management issues in Dutch economics and business research programmes. Research Policy 35:13621376 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gujarati, DN 2003 Basic econometrics McGraw-Hill New York.

  • Habib, A, Morrow, S 2007 Research, research productivity and the state in South Africa. Journal of Higher Education in Africa 5:113130.

    • Search Google Scholar
    • Export Citation
  • Jain, A, Garg, Kc, Sharma, P, Kumar, S 1998 Impact of Serc's funding on research in chemical sciences. Scientometrics 41:357370 .

  • Johnston, R 1995 Research impact quantification. Scientometrics 34 3 415426 .

  • Kim, MJ 2007 A bibliometric analysis of the effectiveness of Korea's biotechnology stimulation plans with a comparison with four other Asian nations. Scientometrics 72:371388 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kremer, M 2003 Randomized evaluations of educational programmes in developing countries: Some lessons. American Economic Review 93:102106 .

  • Leigh, A 2003 Employment effects of minimum wages: Evidence from a quasi-experiment. Australian Economic Review 36:361373 .

  • Miguel, S, Moya-Anegon, F, Herrero-Solana, V 2010 The impact of the socioeconomic crisis of 2001 on the scientific system of Argentina from the scientometric perspective. Scientometrics 85:495507 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Momtaz, S 2002 Environmental impact assessment in Bangladesh: A critical review. Environmental Impact Assessment Review 22:163179 .

  • Morgan, RK 2008 Institutionalising Health Impact assessment: The New Zealand experience. Impact Assessment and Project Appraisal 26:26 .

  • National Research Foundation. (n.d.). NRF profile, [online]. Available from http://www.nrf.ac.za/about_overview.php. Last accessed 23 June 2011.

  • Nederhof, AJ 1988 Changes in publication patterns of biotechnologists: An evaluation of the impact of government stimulation programmes in six industrial nations. Scientometrics 15:475484 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nederhof, AJ 2008 Policy impact of bibliometric rankings of research performance of departments and individuals in economics. Scientometrics 74:163174 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Pouris, A 1991 Effects of funding policies on research publications in South Africa. South African Journal of Science 87:7881.

  • Pouris, A 2007 The national research foundation rating system: Why scientists let their ratings lapse. South African Journal of Science 103:439442.

    • Search Google Scholar
    • Export Citation
  • Raitzer, DA, Kelley, TG 2008 Assessing the contribution of impact assessment to donor decisions for international agricultural research. Research Evaluation 17:187199 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Shadish, RW, Cook, DT, Campbell, TD 2003 Experimental and quasi experimental designs for generalised causal inference Houghton Mifflin Company Boston.

    • Search Google Scholar
    • Export Citation
  • Skinner, BF 1969 Contingencies of reinforcement: A theoretical analysis Prentice Hall Englewood Cliffs, NJ.

  • Smith, PE, Orvos, RD J Cairns Jr 1993 Impact assessment using the before-after-control-impact (BACI) model: Concerns and comments. Canadian Journal of Fisheries and Aquatic Sciences 50:627637 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Tassey, G. (2003). Methods for assessing the economic impacts of government R&D. National Institute of Standards and Technology, [Online]. Available at http://www.nist.gov/director/planning/upload/report03-1.pdf.

    • Search Google Scholar
    • Export Citation
  • Tertiary Education Commission (TEC) (2007). PBRF evaluating research excellence. The 2006 assessment. [Online]. Available at http://www.tec.govt.nz/Documents/Publications/pbrf-full-report-2006.pdf. Last accessed 23 June 2011.

    • Search Google Scholar
    • Export Citation
  • Tien, FF 2007 Faculty research behaviour and career incentives: the case of Taiwan. International Journal of Educational Development 27:17 .

    • Crossref
    • Search Google Scholar
    • Export Citation

Manuscript submission: http://www.editorialmanager.com/scim/

  • Impact Factor (2019): 2.867
  • Scimago Journal Rank (2019): 1.210
  • SJR Hirsch-Index (2019): 106
  • SJR Quartile Score (2019): Q1 Computer Science Apllications
  • SJR Quartile Score (2019): Q1 Library and Information Sciences
  • SJR Quartile Score (2019): Q1 Social Sciences (miscellaneous)
  • Impact Factor (2018): 2.770
  • Scimago Journal Rank (2018): 1.113
  • SJR Hirsch-Index (2018): 95
  • SJR Quartile Score (2018): Q1 Library and Information Sciences
  • SJR Quartile Score (2018): Q1 Social Sciences (miscellaneous)

For subscription options, please visit the website of Springer

Scientometrics
Language English
Size B5
Year of
Foundation
1978
Volumes
per Year
4
Issues
per Year
12
Founder Akadémiai Kiadó
Founder's
Address
H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
Publisher Akadémiai Kiadó
Springer Nature Switzerland AG
Publisher's
Address
H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
CH-6330 Cham, Switzerland Gewerbestrasse 11.
Responsible
Publisher
Chief Executive Officer, Akadémiai Kiadó
ISSN 0138-9130 (Print)
ISSN 1588-2861 (Online)