Philosophers’ appraisals of bibliometric indicators and their use in evaluation: from recognition to knee-jerk rejection

• Published in: Scientometrics 2022-04, Vol.127 (4), p.2085-2103
• Main Authors: Feenstra, Ramón A., Delgado López-Cózar, Emilio
• Format: Article
• Language: English
• Subjects: Bibliometrics; Computer Science; Data points; Evaluation; Indicators; Information Storage and Retrieval; Library Science; Perception; Philosophy; Qualitative analysis; Quality assessment; Rejection
• ISSN: 0138-9130; 1588-2861
• DOI: 10.1007/s11192-022-04265-1

The knowledge and stance of researchers regarding bibliometric indicators is a field of study that has gained weight in recent decades. In this paper we address this issue for the little explored areas of philosophy and ethics, and applied to a context, in this case Spain, where bibliometric indicators are widely used in evaluation processes. The study combines data from a self-administered questionnaire completed by 201 researchers and from 14 in-depth interviews with researchers selected according to their affiliation, professional category, gender and area of knowledge. The survey data suggest that researchers do not consider bibliometric indicators a preferred criterion of quality, while there is a fairly high self-perception of awareness of a number of indicators. The qualitative data points to a generalised perception of a certain rejection of the specific use of indicators, with four main positions being observed: (1) disqualification of the logic of metrics, (2) scepticism about the possibility of assessing quality with quantitative methods, (3) complaints about the incorporation of methods that are considered to belong to other disciplines, and (4) criticism of the consequences that this generates in the discipline of philosophy.