An index system for evaluating academic papers is constructed and verified based on the empirical analysis of papers that has gained the 6th Chinese Academy of Social Sciences Award for Outstanding Achievements. Some new index, such as paper discipline impact factor, discipline average cited rate per paper and discipline average downloaded rate per paper have been put forward in this paper. The empirical research results show that the ranking of papers calculated by this evaluation index system is in conformity with the awards determined by peer review in general, but still needs to be verified and improved in practice.
Dalkey, N, Helmer, O. An experimental application of the Delphi method to the use of experts. Management Science 1963 9 3 458–467 .
Finkenstaedt, T. Measuring research performance in the humanities. Scientometrics 1990 19 5–6 409–417 .
Forman, EH, Gass, SI. The analytical hierarchy process—an exposition. Operations Research 2001 49 4 469–486 .
Glänzel, W, Thijs, B, Schubert, A, Debackere, K. Subfield-specific normalized relative indicators and a new generation of relational charts: Methodological foundations illustrated on the assessment of institutional research performance. Scientometrics 2009 78 1 165–188 .
Hanney, S, Frame, I, Grant, J, Buxton, M, Young, T, Lewison, G. Using categorizations of citations when assessing the outcomes from health research. Scientometrics 2005 65 3 357–379 .
Jiang, X, Yin, G, Mo, Z 2009 A Guide to the Humanities & Social Science Core Journals in China (2008 Edition) Social Sciences Academic Press Beijing.
Landeta, J. Current validity of the Delphi method in social sciences. Technological Forecasting and Social Change 2006 73 5 467–482 .
Moed, HF, Luwel, M, Nederhof, AJ. Towards research performance in the humanities. Library Trends 2002 50 3 498–520.
Norris, M, Oppenheim, C. Citation counts and the research assessment exercise V. Archaeology and the 2001 RAE. Journal of Documentation 2003 59 6 709–730 .
Saaty, TL. A scaling method for priorities in hierarchical structures. Journal of Mathematical Psychology 1977 15 3 234–281 .
Skulmoski, GJ, Hartman, FT, Krahn, J. The Delphi method for graduate research. The Journal of Information Technology Education 2007 6:1–21.
Vidal, L. A., Marle, F., & Bocquet, J. C. (2010). Using a Delphi process and the analytic hierarchy process (AHP) to evaluate the complexity of projects. Expert Systems with Applications. doi: .
Zhang, L, Zhao, H, Li, Q, Wang, J, Tan, X. Establishment of paper assessment system based on academic disciplinary benchmarks. Scientomerics 2010 84:421–429 .