View More View Less
  • 1 Department of Sociology and Social Anthropology and DST-NRF Centre of Excellence for Invasion Biology, Stellenbosch University, Private Bag x1, Matieland, South Africa
  • 2 Centre for Research on Evaluation, Science and Technology, Stellenbosch University, Private Bag x1, Matieland, South Africa
Restricted access

Abstract

Citations to published work are gaining increasing prominence in evaluations of the research performance of scientists. Considering the importance accorded to gender issues in South African science, it is surprising that (to our knowledge) no research has as yet ascertained the extent of sex differences in citations to the published work of scientists in this country. Our literature study shows that studies that have been conducted elsewhere tend to neglect in their analyses important gender-related and other factors, such as the sex composition of multi-authored papers and the extent of foreign co-authorship. Against this background, we illustrate the difficulties inherent in measuring the quality aspect of sex-specific research performance by means of an analysis of a dataset of articles (n = 229) that were published between 1990 and 2002 in the field of invasion ecology and in journals included in the Thomson Reuters Web of Science. Each article has at least one South African author address. The results indicate that foreign co-authorship is a better correlate of high citations than the sex of South African authors, and this is true irrespective of whether the annual citation rate or window period is used, whether or not self-citations are excluded, and whether or not the number of authors is controlled for by calculating fractional counts. The paper highlights these and other considerations that are relevant for future gender-focused bibliometric research, both in South Africa and beyond.

  • Aksnes, DW, Rorstad, K, Piro, F, Sivertsen, G 2011 Are female researchers less cited? A large-scale study of Norwegian scientists. Journal of the American Society for Information Science and Technology 62 4 628636 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Beaver, DB 1986 Collaboration and teamwork in physics. Czechoslovak Journal of Physics 1:1418 .

  • Bordons, M, Morillo, F, Fernández, MT, Gómez, I 2003 One step further in the production of bibliometric indicators at the micro level: Differences by gender and professional category of scientists. Scientometrics 57 2 159173 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bornmann, L 2010 Towards an ideal method of measuring research performance: Some comments to the Opthof and Leydesdorff (2010) paper. Journal of Informetrics 4:441443 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Borrego, Á, Barrios, M, Villarroya, A, Ollé, C 2010 Scientific output and impact of postdoctoral scientists: A gender perspective. Scientometrics 83:93101 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Borsuk, RM, Budden, AE, Leimu, R, Aarssen, LW, Lortie, CJ 2009 The influence of author gender, national language and number of authors on citation rate in ecology. The Open Ecology Journal 2:2528.

    • Search Google Scholar
    • Export Citation
  • Boshoff, N 2005 The representation of women academics in higher education in South Africa: Progress in the pipeline?. South African Journal of Higher Education 19 2 359377.

    • Search Google Scholar
    • Export Citation
  • Cole, JR 1979 Fair science: Women in the scientific community Free Press New York.

  • Cole, JR, Cole, S 1973 Social stratification in science University of Chicago Press Chicago.

  • Cole, JR, Zuckerman, H 1984 The productivity puzzle: Persistence and change in patterns of publication of men and women scientists. Advances in Motivation and Achievement 2:217258.

    • Search Google Scholar
    • Export Citation
  • Corley, EA, Sabharwal, M 2010 Scholarly collaboration and productivity patterns in public administration: Analysing recent trends. Public Administration 88 3 627648 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Craig, ID, Plume, AM, McVeigh, ME, Pringle, J, Amin, M 2007 Do open access articles have greater citation impact? A critical review of the literature. Journal of Informetrics 1 3 239248 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Creamer, E. G. (1998). Assessing faculty publication productivity: Issues of equity. ASHE-ERIC Higher Education Report (Vol. 26, No. 2). Washington, DC: Association for the Study of Higher Education.

    • Search Google Scholar
    • Export Citation
  • Cronin, B, Overfelt, K 1994 Citation-based auditing of academic performance. Journal of the American Society for Information Science 45 2 6172 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Davenport, E, Snyder, H 1995 Who cites women? Whom do women cite? An exploration of gender and scholarly citation in sociology. Journal of Documentation 51 4 404410 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Davis, DE, Astin, HS 1987 Reputational standing in academe. The Journal of Higher Education 58:261275 .

  • Demetrulias, DM 1986 Gender differences in co-authorship. Journal of Educational Equity and Leadership 6 2 119127.

  • J Drake HA Mooney F Di Castri R Groves FJ Kruger M Rejmánek M Williamson eds. 1989 Biological invasions: A global perspective Wiley Chichester.

    • Search Google Scholar
    • Export Citation
  • Ferber, MA 1986 Citations: Are they an objective measure of scholarly merit?. Signs: Journal of Women in Culture and Society 11 2 381389 .

  • Flores, LY, Rooney, SC, Heppner, PP, Browne, LD, Wei, M-F 1999 Trend analyses of major contributions in The Counseling Psychologist cited from 1986 to 1996: Impact and implications. The Counseling Psychologist 27 1 7395 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fox, MF 1991 Gender, environmental milieu, and productivity in science H Zuckerman JR Cole JT Bruer eds. The outer circle: Women in the scientific community Norton New York 188204.

    • Search Google Scholar
    • Export Citation
  • García-Pérez, MA 2009 The Hirsch h index in a non-mainstream area: Methodology of the behavioral sciences in Spain. The Spanish Journal of Psychology 12 2 833849.

    • Search Google Scholar
    • Export Citation
  • Garfield, E. (1981). The 1,000 contemporary scientists most-cited 1965-1978 (Part I: The basic list and introduction). Current Contents, 41, 514. [Reprinted in: Garfield, E. (1981-1982). Essays of an information scientist, 5, 269-278].

    • Search Google Scholar
    • Export Citation
  • Gonzalez-Brambila, C, Veloso, FM 2007 The determinants of research output and impact: A study of Mexican researchers. Research Policy 36:10351051 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hammel, EA, Mason, C, Prater, A, Lundy, R 1995 Gender and the academic career in North American Anthropology: Differentiating intramarket from extramarket bias. Current Anthropology 36 2 366380 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Haslam, N, Ban, L, Kaufmann, L, Loughnan, S, Peters, K, Whelan, J, Wilson, S 2008 What makes an article influential? Predicting impact in social and personality psychology. Scientometrics 76 1 169185 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Helmreich, RL, Spence, JT, Beane, WE, Lucker, GW, Matthews, KA 1980 Making it in academic psychology: Personality correlates of attainment. Journal of Personality and Social Psychology 39 5 896908 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Housri, N, Cheung, MC, Koniaris, LG, Zimmers, TA 2008 Scientific impact of women in academic surgery. Journal of Surgical Research 148:1316 .

  • Hunter, LA, Leahey, E 2010 Parenting and research productivity: New evidence and methods. Social Studies of Science 40 3 433451 .

  • Hutson, SR 2002 Gendered citation practices in American Antiquity and other archaeology journals. American Antiquity 67 2 331342 .

  • Hutson, SR 2006 Self-citation in archaeology: Age, gender, prestige, and the self. Journal of Archaeological Method and Theory 13 1 119 .

  • Irvine, J, Martin, BR 1986 Women in radio astronomy—Shooting stars? J Harding eds. Perspectives on gender and science The Falmer Press London 80103.

    • Search Google Scholar
    • Export Citation
  • Kelly, CD, Jennions, MD 2006 The h index and career assessment by numbers. Trends in Ecology & Evolution 21 4 167170 .

  • Kolpin, VW LD Singell Jr 1996 The gender composition and scholarly performance of economics departments: A test for employment discrimination. Industrial and Labor Relations Review 49 3 408423 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Krampen, G 2008 The evaluation of university departments and their scientists: Some general considerations with reference to exemplary bibliometric publication and citation analyses for a Department of Psychology. Scientometrics 76 1 321 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Leahey, E 2007 Not by productivity alone: How visibility and specialization contribute to academic earnings. American Sociological Review 72 4 533561 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Leimu, R, Koricheva, J 2005 What determines the citation frequency of ecological papers?. Trends in Ecology & Evolution 20 1 2832 .

  • Leta, J, Lewison, G 2003 The contribution of women in Brazilian science: A case study in astronomy, immunology and oceanography. Scientometrics 57 3 339353 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lewison, G 2001 The quantity and quality of female researchers: A bibliometric study of Iceland. Scientometrics 52 1 2943 .

  • Lindsey, D 1980 Production and citation measures in the sociology of science: The problem of multiple authorship. Social Studies of Science 10 2 145162 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Long, JS 1992 Measures of sex differences in scientific productivity. Social Forces 71 1 159178.

  • Lutz, C 1990 The erasure of women's writing in sociocultural anthropology. American Ethnologist 17:611627 .

  • MacRoberts, MH, MacRoberts, BR 1987 Problems of citation analysis: a critical review. Journal of the American Society for Information Science 40:342349 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Mauleón, E, Bordons, M 2006 Productivity, impact and publication habits by gender in the area of materials science. Scientometrics 66 1 199218 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Mauleón, E, Bordons, M, Oppenheim, C 2008 The effect of gender on research staff success in life sciences in the Spanish National Research Council. Research Evaluation 17 3 213225 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Mcelhinny, B, Hols, M, Holtzkener, J, Unger, S, Hicks, C 2003 Gender, publication and citation in sociolinguistics and linguistic anthropology: The construction of a scholarly canon. Language in Society 32:299328 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Montpetit, E, Blais, A, Foucault, M 2008 What does it take for a Canadian political scientist to be cited?. Social Science Quarterly 89 3 802816 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • National Advisory Council on Innovation (NACI). (2008). Creating the future South African national system of innovation: Gender, race and SET sector issues. Report by the Science, Engineering and Technology for Women (SET4W), NACI Permanent Sub-Committee. http://www.nacinnovation.biz/about-naci/naci-sub-committees/set4women/set4w-downloads. Accessed 9 March 2011.

    • Search Google Scholar
    • Export Citation
  • Over, R, Moore, D 1980 Research productivity and impact of men and women in psychology departments of Australian universities, 1975–1977. Australian Psychologist 15 3 413418 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Peñas, CS, Willet, P 2006 Gender differences in publication and citation counts in librarianship and information science research. Journal of Information Science 32 5 480485 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Persell, CH 1983 Gender, rewards and research in education. Psychology of Women Quarterly 8 1 3347 .

  • Powell, A, Hassan, TM, Dainty, ARJ, Carter, C 2009 Exploring gender differences in construction research: A European perspective. Construction Management and Economics 27:803807 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Prozesky, HE 2006 Gender differences in the journal publication productivity of South African academic authors. South African Review of Sociology 37 2 87112.

    • Search Google Scholar
    • Export Citation
  • Pyšek, P, Richardson, DM, Jarošik, V 2006 Who cites who in the invasion zoo: Insights from an analysis of the most highly cited papers in invasion ecology. Preslia 78:437468.

    • Search Google Scholar
    • Export Citation
  • Pyšek, P, Richardson, DM, Pergl, J, Jarošík, V, Sixtová, Z, Weber, E 2008 Geographical and taxonomical biases in invasion ecology. Trends in Ecology & Evolution 23:237244 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Qiu, H, Chen, Y-F 2009 Bibliometric analysis of biological invasions research during the period of 1991 to 2007. Scientometrics 81 3 601610 .

  • Reese-Evans, L 2010 Gender and citation in two LIS e-journals: A bibliometric analysis of LIBRES and Information Research. Library and Information Science Research Electronic Journal 20 1 119.

    • Search Google Scholar
    • Export Citation
  • Reskin, BF 1978 Scientific productivity, sex and location in the institution of science. American Journal of Sociology 83 5 12351243 .

  • Richardson, D. M., & Van Wilgen, B. W. (2004). Invasive alien plants in South Africa: How well do we understand the ecological impacts? South African Journal of Science, 100 (Jan/Feb), 4552.

    • Search Google Scholar
    • Export Citation
  • Rousseau, R 1992 Letter to the editor: Why I am not cited or why are multi-authored papers more cited than others?. Journal of Documentation 48:7980 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sandström, U 2009 Combining curriculum vitae and bibliometric analysis: Mobility, gender and research performance. Research Evaluation 18 2 135142 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sonnert, G 1995 What makes a good scientist? Determinants of peer evaluation among biologists. Social Studies of Science 25 1 3555 .

  • Sonnert, G, Holton, GJ 1995 Gender differences in science careers: The Project Access Study Rutgers University Press New Brunswick, NJ.

  • Sooryamoorthy, R 2009 Collaboration and publication: How collaborative are scientists in South Africa?. Scientometrics 80 2 419439 .

  • Stack, S 1994 An analysis of the impacts of books and journal articles. International Review of Modern Sociology 24 2 119125.

  • Symonds, MRE, Gemmell, NJ, Braisher, TL, Gorringe, KL, Elgar, MA 2006 Gender differences in publication output: Towards an unbiased metric of research performance. PLoS ONE 1 2 e127 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Teghtsoonian, M 1974 Distribution of sex by authors and editors of psychological journals, 1970–1972: Are there enough women editors?. American Psychologist 29:262269 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Toutkoushian, RK 1994 Using citations to measure sex discrimination in faculty scales. The Review of Higher Education 18 1 6182.

  • Tregenza, T 2002 Gender bias in the refereeing process?. Trends in Ecology & Evolution 17 8 349350 .

  • Trifunac, MD 2006 A note on publication and citation rates of female academics in earthquake engineering. Soil Dynamics and Earthquake Engineering 26:10631075 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Trimble, V 1985 Some notes on patterns in citations of papers by American astronomers. Quarterly Journal of the Royal Astronomical Society 26:4050.

    • Search Google Scholar
    • Export Citation
  • Trimble, V 1993 Patterns in citations of papers by American astronomers. Quarterly Journal of the Royal Astronomical Society 34:235250.

    • Search Google Scholar
    • Export Citation
  • United Nations Educational, Scientific and Cultural Organization (UNESCO). (2007). Science, technology and gender: An international report (executive summary). Science and technology for development series. Paris: UNESCO Publishing. http://unesdoc.unesco.org/images/0015/001540/154027e.pdf. Accessed 9 March 2011.

    • Search Google Scholar
    • Export Citation
  • AFJ Van Raan 1998 The influence of international collaboration on the impact of research results. Scientometrics 42 3 423428 .

  • Walters, GD 2006 Predicting subsequent citations to articles published in twelve crime-psychology journals: Author impact versus journal impact. Scientometrics 69 3 499510 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Walters, CG, Fry, EH, Chaisson, BD 1990 Women scholars: Closing the publication gap. Research in Higher Education 31 4 355367 .

  • Ward, KB, Gast, J, Grant, L 1992 Visibility and dissemination of women's and men's sociological scholarship. Social Problems 39 3 291298 .

  • Ward, KB, Grant, L 1991 Gender and publishing in sociology. Gender & Society 5 2 207223 .

  • Ward, KB, Grant, L 1996 Gender and academic publishing JC Smart eds. Higher education: Handbook of theory and research xi Agathon Press New York 172212.

    • Search Google Scholar
    • Export Citation
  • Webster, BM 2001 Polish women in science: A bibliometric analysis of Polish science and its publications, 1980–1999. Research Evaluation 10 3 185194 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wennerås, C, Wold, A 1997 Nepotism and sexism in peer-review. Nature 387:341343 .

  • Williamson, M 1996 Biological invasions Chapman and Hall London.