View More View Less
  • 1 Department of Economics, University of Thessaly, Korai 43, 38333 Volos, Greece
Restricted access

Abstract

This paper by using data envelopment analysis (DEA) and statistical inference evaluates the citation performance of 229 economic journals. The paper categorizes the journals into four main categories (A–D) based on their efficiency levels. The results are then compared to the 27 “core economic journals” as introduced by Diamond (Curr Contents 21(1):4–11, ). The results reveal that after more than 20 years Diamonds’ list of “core economic journals” is still valid. Finally, for the first time the paper uses data from four well-known databases (SSCI, Scopus, RePEc, Econlit) and two quality ranking reports (Kiel Institute internals ranking and ABS quality ranking report) in a DEA setting and in order to derive the ranking of 229 economic journals. The ten economic journals with the highest citation performance are Journal of Political Economy, Econometrica, Quarterly Journal of Economics, Journal of Financial Economics, Journal of Economic Literature, American Economic Review, Review of Economic Studies, Journal of Econometrics, Journal of Finance, Brookings Papers on Economic Activity.

  • Bakkalbasi, N, Bauer, K, Glover, J, Wang, L 2006 Three options for citation tracking: Google Scholar, Scopus and Web of Science. Biomedical Digital Libraries 3 7 18.

    • Search Google Scholar
    • Export Citation
  • Banker, RD, Charnes, A, Cooper, WW 1984 Some models for estimating technical and scale inefficiencies in data envelopment analysis. Management Science 30 9 10781092 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bar-Ilan, J 2010 Citations to the “Introduction to infometrics” indexed by WoS, Scopus and Google Scholar. Scientometrics 82 3 495506 .

  • Bauer, K., & Bakalbassi, N. (2005). An examination of citation counts in a new scholarly communication environment. D-Lib Magazine, 11 (9). http://www.dlib.org/dlib/september05/bauer/09bauer.html.

    • Search Google Scholar
    • Export Citation
  • Boles, J. N. (1967). Efficiency squared—Efficient computation of efficiency indexes. In Western Farm Economic Association Proceedings 1966 (pp. 137142).

    • Search Google Scholar
    • Export Citation
  • Boles, JN 1971 The 1130 Farrell efficiency system—Multiple products, multiple factors Giannini Foundation of Agricultural Economics, University of California Berkeley.

    • Search Google Scholar
    • Export Citation
  • Bollen, J H Van de Sompel 2008 Usage Impact Factor: The effects of sample characteristics on usage-based impact metrics. Journal of the American Society for Information Science and Technology 59 1 136149 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bonaccorsi, A, Daraio, C 2008 The differentiation of the strategic profile of higher education institutions. New positioning indicators based on microdata. Scientometrics 74 1 1537 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bonaccorsi, A, Daraio, C, Simar, L 2006 Advanced indicators of productivity of universities. An application of robust nonparametric methods to Italian data. Scientometrics 66 2 389410 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Burton, MP, Phimister, E 1995 Core journals: A reappraisal of the Diamond list. Economic Journal 105 429 361373 .

  • Charnes, A, Cooper, WW, Rhodes, EL 1978 Measuring the efficiency of decision making units. European Journal of Operational Research 2 6 429444 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Coelli, TJ, Perelman, S 1999 A comparison of parametric and non-parametric distance functions: With applications to European railways. European Journal of Operational Research 117 2 326339 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Coelli, TJ, Rap, DSP, O’Donnell, CJ, Battese, GE 2005 An introduction to efficiency and productivity analysis 2 Springer Science New York.

    • Search Google Scholar
    • Export Citation
  • Cook, WD, Golany, B, Penn, M, Ravin, T 2007 Creating a consensus ranking of proposals from reviewers’ partial ordinal rankings. Computers & Operations Research 34 4 954965 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Cook, WD, Ravin, T, Richardson, AJ 2010 Aggregating incomplete lists of journal rankings: An application to academic accounting journals. Accounting Perspectives 9 3 217235 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Debreu, G 1951 The coefficient of resource utilization. Econometrics 19 3 273292 .

  • Diamond, AM 1989 The core journals of economics. Current Contents 21 1 411.

  • Efron, B 1979 Bootstrap methods: Another look at the jackknife. Annals of Statistics 7 1 116 .

  • Etxebarria, G, Gomez-Uranga, M 2010 Use of Scopus and Google Scholar to measure social sciences production in four major Spanish universities. Scientometrics 82 2 333349 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Farrell, M 1957 The measurement of productive efficiency. Journal of the Royal Statistical Society Series A 120 3 253281 .

  • Førsund, FR, Kittelsen, SAC, Krivonozhko, VE 2009 Farrell revisited—Visualizing properties of DEA production frontiers. Journal of the Operational Research Society 60 11 15351545 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Førsund, FR, Sarafoglou, N 2002 On the origins of data envelopment analysis. Journal of the Productivity Analysis 17 1/2 2340 .

  • Franceschet, M 2010 A comparison of bibliometric indicators for computer science scholars and journals on Web of Science and Google Scholar. Scientometics 83 1 243258 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Garfield, E 1955 Citation indexes to science: A new dimension in documentation through association of ideas. Science 122 3159 108111 .

  • Garfield, E 1979 Citation indexing: Its theory and applications in science, technology and humanities Wiley Interscience New York.

  • Garfield, E. (2005). The agony and the ecstasy—The history and meaning of the journal Impact Factor. In International congress on peer review and biomedical publication, Chicago.

    • Search Google Scholar
    • Export Citation
  • Glanzel, W, Moed, HF 2002 Journal impact measures in bibliometric research. Scientometrics 53 2 171193 .

  • Halkos, G, Tzeremes, N 2007 International competitiveness in the ICT industry: Evaluating the performance of the top 50 companies. Global Economic Review 36 2 167168 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Halkos, G, Tzeremes, N 2010 The effect of foreign ownership on SMEs performance: An efficiency analysis perspective. Journal of Productivity Analysis 34 2 167180 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Harvey, C., Kelly, A., Morris, H., & Rowlinson, M. (2010). Academic journal quality guide, Version 4. The Association of Business Schools.

    • Search Google Scholar
    • Export Citation
  • Hirsch, JE 2005 An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences 102:1656916572 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hoffman, A. J. (1957). Discussion on Mr. Farrell's Paper. Journal of the Royal Statistical Society Series A, 120 (III), 284.

  • Kalaitzidakis, P, Mamuneas, TP, Stengos, T 2003 Rankings of academic journals and institutions in economics. Journal of the European Economic Association 1 6 13461366 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kalaitzidakis, P., Mamuneas T.P., & Stengos, T. (2010). An updated ranking of academic journals in economics, WP 10-15. The Rimini Centre for Economic Analysis.

    • Search Google Scholar
    • Export Citation
  • Kiel (2010). Criteria for research publications. Kiel Institute for World Economy. http://www.ifw-kiel.de/academy/criteria-for-research-publications.

    • Search Google Scholar
    • Export Citation
  • Klavans, R, Boyack, K 2009 Toward a consensus map of science. Journal of the American Society for information science and technology 60 3 455476 .

  • Koczy, L. A., & Strobel, M. (2007). The ranking of economics journals by a tournament method. Mimeo.

  • Kodrzycki, Y. K., & Yu, P. (2006). New approaches to ranking economic journals. Contributions to Economic Analysis and Policy, 5 (1), Art. 24.

    • Search Google Scholar
    • Export Citation
  • Koopmans, TC 1951 An analysis of production as an efficient combination of activities TC Koopmans eds. Activity analysis of production and allocation Wiley New York 3397.

    • Search Google Scholar
    • Export Citation
  • Kousha, K, Thelwall, M 2008 Sources of Google Scholar citations outside the Science Citation Index: A comparison between four science disciplines. Scientometrics 74 2 273294 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Laband, DN, Piette, MJ 1994 The relative impacts of economics journals: 1970–1990. Journal of Economic Literature 32 2 640666.

  • Leydesdorff, L F de Moya-Anegon Guerrero-Bote, VP 2010 Journal maps on the basis of Scopus data: A comparison with Journal Citation Reports of the ISI. Journal of the American Society for Information Science and Technology 61 2 352369.

    • Search Google Scholar
    • Export Citation
  • Liebowitz, SJ, Palmer, JC 1984 Assessing the relative impacts of economics journals. Journal of Economic Literature 22:7788.

  • Liner, GH, Amin, M 2004 Methods of ranking economic journals. Atlantic Economic Journal 32 2 140149 .

  • Lopez-Illescas, C F de Moya-Anegon Moed, HF 2008 Coverage and citation impact of oncological journals in the Web of Science and Scopus. Journal of Infometrics 2:304316 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lovell, CAL, Schmidt, P 1988 A comparison of alternative approaches to the measurement of productive efficiency A Dogramaci R Färe eds. Applications of modern production theory: Efficiency and productivity Kluwer Boston.

    • Search Google Scholar
    • Export Citation
  • Meho, LI, Yang, K 2007 Impact of data sources on citation counts and ranking of LIS faculty: Web of Science versus Scopus and Google Scholar. Journal of the American Society for Information Science and Technology 58 13 21052125 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Moed, H. F. (2010). Measuring contextual citation impact of scientific journals. Journal of Infometrics. doi: .

  • Norris, M, Oppenheim, C 2007 Comparing alternatives to the Web of Science for coverage of the social sciences’ literature. Journal of Infometrics 1 2 161169 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Noruzi, A 2005 Google Scholar: The new generation of citation indexes. Libri 55 4 170180 .

  • Palacio-Huerta, I, Volij, O 2004 The measurement of intellectual influence. Econometrica 72 3 963977 .

  • Pinski, G, Narin, F 1976 Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of Physics. Information Processing & Management 12 5 297312 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Pudovkin, A. I., & Garfield, E. (2004). Rank-normalized Impact Factor: A way to compare journal performance across subject categories. In Proceedings of the 67th ASIS&T annual meeting, 17, November, 2004. http://www.garfield.library.upenn.edu/papers/asistranknormalization2004.pdf.

    • Search Google Scholar
    • Export Citation
  • Pujol, F 2008 Ranking journals following a matching model approach: An application to public economic journals. Journal of Public Economic Theory 10 1 5576 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Rainer, KR, Miller, MD 2005 Examining differences across journal rankings. Communications of the ACM 48 2 9194 .

  • Ritzberger, K 2008 A ranking of journals in economics and related fields. German Economic Review 9 4 402430 .

  • Schneider, F, Ursprung, HW 2008 The 2008 GEA journal-ranking for the economics profession. German Economic Review 9 4 532538 .

  • Shephard, RW 1970 Theory of cost and production function Princeton University Press Princeton.

  • Simar, L, Wilson, PW 1998 Sensitivity analysis of efficiency scores: How to bootstrap in non parametric frontier models. Management Science 44 1 4961 .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Simar, L, Wilson, PW 2000 A general methodology for bootstrapping in non-parametric frontier models. Journal of Applied Statistics 27 6 779802 .

  • Simar, L, Wilson, PW 2002 Non parametric tests of return to scale. European Journal of Operational Research 139 1 115132 .

  • Simar, L, Wilson, P 2008 Statistical interference in nonparametric frontier models: Recent developments and perspectives H Fried CAK Lovell S Schmidt eds. The measurement of productive efficiency and productivity change Oxford University Press New York 421521.

    • Search Google Scholar
    • Export Citation
  • Theussl, S., & Hornik, K. (2009). Journal ratings and their consensus ranking. In Operations research proceedings 2008. Berlin: Springer-Verlag. doi: .

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zitt, M, Small, H 2008 Modifying the journal Impact Factor by fractional citation weighting: The Audience Factor. Journal of the American Society for Information Science and Technology 59 11 18561860 .

    • Crossref
    • Search Google Scholar
    • Export Citation