Scientometrics
Volume/Issue:
Volume 92: Issue 2
Citation-based metrics are appropriate tools in journal assessment provided that they are accurate and used in an informed way
Authors:
Henk F. Moed Elsevier, SciVal, Radarweg 29, 1043 NX Amsterdam, The Netherlands

Search for other papers by Henk F. Moed in
Current site
Google Scholar
PubMed Close
,
Lisa Colledge Elsevier, SciVal, Radarweg 29, 1043 NX Amsterdam, The Netherlands

Search for other papers by Lisa Colledge in
Current site
Google Scholar
PubMed Close
,
Jan Reedijk Leiden Institute of Chemistry, Leiden University, P.O. Box 9502, 2300 RA Leiden, The Netherlands
Department of Chemistry, King Saud University, P.O. Box 2455, Riyadh 11451, Saudi Arabia

Search for other papers by Jan Reedijk in
Current site
Google Scholar
PubMed Close
,
Felix Moya-Anegon Scimago, CSIC, CCHS, IPP, C/Albasanz, 26-28, 28037 Madrid, Spain

Search for other papers by Felix Moya-Anegon in
Current site
Google Scholar
PubMed Close
,
Vicente Guerrero-Bote Scimago, Universidad de Extremadura, Plazuela IbnMarwan, 06071 Badajoz, Spain

Search for other papers by Vicente Guerrero-Bote in
Current site
Google Scholar
PubMed Close
,
Andrew Plume Elsevier, Research & Academic Relations, the Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, UK

Search for other papers by Andrew Plume in
Current site
Google Scholar
PubMed Close
, and
Mayur Amin Elsevier, Research & Academic Relations, the Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, UK

Search for other papers by Mayur Amin in
Current site
Google Scholar
PubMed Close
Pages:
367–376
Online Publication Date:
25 Mar 2012
Publication Date:
01 Aug 2012
Article Category:
Research Article
DOI:
https://doi.org/10.1007/s11192-012-0679-8
Keywords:
Journal metrics; Journal performance; Journal impact factor; SNIP; SJR; Citation analysis; Citation linking; Peer review; Crosscheck; Journal editors; Journal publishers
Restricted access

Abstract

In a reply to Jerome K. Vanclay's manuscript “Impact Factor: outdated artefact or stepping-stone to journal certification?” we discuss the value of journal metrics for the assessment of scientific-scholarly journals from a general bibliometric perspective, and from the point of view of creators of new journal metrics, journal editors and publishers. We conclude that citation-based indicators of journal performance are appropriate tools in journal assessment provided that they are accurate, and used with care and competence.

  • Amin, M., & Mabe, M. (2000) SSP 22nd.ing, Baltimore (June, unpublished).

  • Bergstrom, C. (2007). Eigenfactor: Measuring the value and prestige of scholarly journals. College & Research Libraries News, 68 (5). Retrieved April 24, 2008, from www.ala.org/ala/acrl/acrlpubs/crlnews/backissues2007/may07/eigenfactor.cfm.

    • Search Google Scholar
    • Export Citation

  • Bollen, J, Rodriguez, MA H Van De Sompel 2006 Journal Status. Scientometrics 69:669–687 .

  • Bollen, J H Van de Sompel 2008 Usage impact factor: the effects of sample characteristics on usage-based impact metrics. Journal of the American Society for Information Science and Technology 59 1 14 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Braun, T., Glänzel, W., & Schubert, A. (1988). World flash on basic research. Scientometrics, 13, 181–188.

  • Braun, T, Glänzel, W, Schubert, A 2005 A Hirsch-type index for journals. The Scientist 19:8.

  • Colledge, L F De Moya-Anegón Guerrero-Bote, V, López-Illescas, C M El Aisati Moed, HF 2010 SJR and SNIP: two new journal metrics in Elsevier's scopus. UKSG Serials 23:215–221 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • CrossCheck. (2012). http://www.crossref.org/crosscheck/index.html. Accessed 1 Feb 2012.

  • Davis, P. (2011). F1000 journal rankings—The map is not the territory. http://scholarlykitchen.sspnet.org/2011/10/05/f1000-journal-rankings-the-map-is-not-the-territory/. Accessed 1 Feb 2012.

    • Search Google Scholar
    • Export Citation

  • Davis, P. (2012). Size and discipline bias ion F1000 journal rank. http://scholarlykitchen.sspnet.org/2012/01/27/size-and-discipline-bias-in-f1000-journal-rankings/. Accessed 1 Feb 2012.

    • Search Google Scholar
    • Export Citation

  • Garfield, E 1964 The citation index—A new dimension in indexing. Science 144:649–654 .

  • Garfield, E 1972 Citation analysis as a tool in journal evaluation. Science 178:471–479 .

  • Garfield, E. (1985). Uses and misuses of citation frequency. Current comments (October 28). In: Ghostwriting and other essays. Essays of an information scientist (Vol. 8, pp. 403–409). Philadelphia: ISI Press.

    • Search Google Scholar
    • Export Citation

  • Garfield, E 1996 How can impact factors be improved?. British Medical Journal 313:411–413 .

  • Garfield, E. (2005). The agony and the ecstasy: the history and meaning of the journal impact factor. Chicago: International Congress on Peer Review and Biomedical Publication. Retrieved September 16, 2005, from www.garfield.library.upenn.edu/papers/jifchicago2005.pdf).

    • Search Google Scholar
    • Export Citation

  • Glänzel, W 2009 The multi-dimensionality of journal impact. Scientometrics 78:355–374 .

  • Glänzel, W, Moed, HF 2002 Journal impact measures in bibliometric research. Scientometrics 53 2 171–194 .

  • González-Pereira, B, Guerrero-Bote, VP, Moya-Anegón, F 2009 The SJR indicator: A new indicator of journals’ scientific prestige. Journal of Informetrics 4:379–391 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Guerrero-Bote, V. P. & Moya-Anegón, F. (2012). A further step forward in measuring journals’ scientific prestige: The SJR2 indicator. Retrieved January 24, 2012, from arxiv.org/pdf/1201.4639.pdf.

    • Search Google Scholar
    • Export Citation

  • Hirsch, J.E. (2005). An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences, 102, 16569-16572.

    • Search Google Scholar
    • Export Citation

  • Huggett, S. (2012). F1000-Journal rankings: An alternative way to evaluate the scientific impact of scholarly communications. Research Trends, 26. http://www.researchtrends.com/issue26-january-2012/f1000-journal-rankings-an-alternative-way-to-evaluate-the-scientific-impact-of-scholarly-communications/. Accessed 1 Feb 2012.

    • Search Google Scholar
    • Export Citation

  • Leydesdorff, L. & Opthof, T. (2010). Normalization at the field level: fractional counting of citations. Journal of Informetrics 4 (4), 644–646.

    • Search Google Scholar
    • Export Citation

  • Mahapatra, A 2010 Deep impact: Scientific evaluation by the numbers. ACS Chem. Biol. 5:715–717 .

  • Marshakova-Shaikevich, I 1996 The standard impact factor as an evaluation tool of science and scientific journals. Scientometrics 35:283–291 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Moed, H.F. (2005). Citation analysis in research evaluation (p. 346). Dordrecht: Springer. ISBN 1-4020-3713-9.

  • Moed, HF 2010 Measuring contextual citation impact of scientific journals. Journal of Informetrics 4:265–277 .

  • Moed, HF Th N van Leeuwen 1996 Impact factors can mislead. Nature 381:186 .

  • Pinski, G, Narin, F 1976 Citation influence for journal aggregates of scientific publications: theory, with application to the literature of physics. Information Processing and Management 12:297–312 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Pudovkin, A.I., & Garfield, E. (2004). Rank-normalized impact factor. A way to compare journal performance across subject categories. Paper presented at the ASIST meeting. Retrieved November 17, 2004, from http://www.garfield.library.upenn.edu/papers/ asistranknormalization2004.pdf.

    • Search Google Scholar
    • Export Citation

  • Reedijk, J 2012 Citation ethics. Angewandte Chemie International Edition 51 4 828–830 .

  • Reedijk, J. (2012b). Internal note. Leiden (January 2012).

  • Reedijk, J, Moed, HF 2008 Is the impact of journal impact factors decreasing?. J. Documentation 64 2 183–192 .

  • Sen, BK 1992 Documentation note: Normalised impact factor. Journal of Documentation 48:318–325 .

  • Sheldrick, GM 2008 A short history of SHELX. Acta Crystallographica Section A 64:112–122 .

  • SNIP-SJR (2010). Instruction videos. http://www.youtube.com/playlist?list=PLC477F10A4160BA09. Accessed 1 Feb 2012.

  • Spek, AL 2009 Structure validation in chemical crystallography. Acta Crystallographica Section D-Biological Crystallography 65:148–155 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Stringer, MJ, Sales-Pardo, M, Amaral, LAN 2008 Effectiveness of journal ranking schemes as a tool for locating information. PLoS ONE 3 2 e1683 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • TN Van Leeuwen Moed, HF 2002 Development and application of journal impact measures in the Dutch science system. Scientometrics 53:249–266 .

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Van Leeuwen, T.N., Moed, H.F., & Reedijk, J. (1997) JACS still topping angewandte chemie: Beware of erroneous impact factors. Chemical Intelligencer 32–36.

    • Search Google Scholar
    • Export Citation

  • West, J., Althouse, B., Rosvall, M., Bergstrom, T., & Bergstrom, C. (2008). Eigenfactor: Detailed methods. Retrieved April 24, 2008, from www.eigenfactor.org/methods.pdf.

    • Search Google Scholar
    • Export Citation

  • Zitt, M, Small, H 2008 Modifying the journal impact factor by fractional citation weighting: The audience factor. Journal of the American Society for Information Science and Technology 59:1856–1860 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Collapse
  • Expand
Cover Scientometrics
Scientometrics
Print ISSN:
0138-9130
Online ISSN:
1588-2861

To see the editorial board, please visit the website of Springer Nature.

Manuscript submission: http://www.editorialmanager.com/scim/

For subscription options, please visit the website of Springer Nature.

Scientometrics
Language English
Size B5
Year of
Foundation		 1978
Volumes
per Year		 1
Issues
per Year		 12
Founder Akadémiai Kiadó
Founder's
Address		 H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
Publisher Akadémiai Kiadó
Springer Nature Switzerland AG
Publisher's
Address		 H-1117 Budapest, Hungary 1516 Budapest, PO Box 245.
CH-6330 Cham, Switzerland Gewerbestrasse 11.
Responsible
Publisher		 Chief Executive Officer, Akadémiai Kiadó
ISSN 0138-9130 (Print)
ISSN 1588-2861 (Online)

Monthly Content Usage

Abstract Views Full Text Views PDF Downloads
Sep 2024 25 0 0
Oct 2024 141 0 0
Nov 2024 37 0 0
Dec 2024 29 0 0
Jan 2025 36 0 0
Feb 2025 49 0 0
Mar 2025 12 0 0