This study is framed in the debate concerning the measurement of academic performance, and particularly the strand of studies that explores the risks associated with the metrification of research. The objective, guided by the conceptual framework of the banality of evil (Arendt, 1964), is to delve into how research evaluation can shape banal and unoriginal evaluative practices. These practices, in turn, can trigger a fatally efficient machine within the academic system and institutions, and among researchers. The paper focuses on examining the recently concluded Research Quality Assessment 2015–2019 (VQR3) exercise in Italy, using an autoethnographic approach. The results highlight the risks stemming from the growing dependence of research quality assessment on automatisms, which can cause its commodification at the cost of intellectual innovation and, eventually, force actors to conform to the rules of the game. This work contributes to the ongoing academic debate by offering an innovative and multilevel (i.e. macro, meso and micro) theoretical perspective. Not only does this perspective conceptualise and present the dynamics, processes, instruments and actors at play in the phenomena under scrutiny but also provides a deeper understanding of the dynamics that promote the widespread application of research evaluation systems, despite their well-known weaknesses and potentially undesirable practical and ethical effects.

A fatally efficient machine. Insights into the ‘banality’ of the research evaluation exercise in Italy / Spanò, Rosanna; Bracci, Enrico; Manes-Rossi, Francesca; Sforza, Vincenzo. - In: CRITICAL PERSPECTIVES ON ACCOUNTING. - ISSN 1045-2354. - 100:(2024). [10.1016/j.cpa.2024.102742]

A fatally efficient machine. Insights into the ‘banality’ of the research evaluation exercise in Italy

Spanò, Rosanna
Primo
;
Manes-Rossi, Francesca
;
2024

Abstract

This study is framed in the debate concerning the measurement of academic performance, and particularly the strand of studies that explores the risks associated with the metrification of research. The objective, guided by the conceptual framework of the banality of evil (Arendt, 1964), is to delve into how research evaluation can shape banal and unoriginal evaluative practices. These practices, in turn, can trigger a fatally efficient machine within the academic system and institutions, and among researchers. The paper focuses on examining the recently concluded Research Quality Assessment 2015–2019 (VQR3) exercise in Italy, using an autoethnographic approach. The results highlight the risks stemming from the growing dependence of research quality assessment on automatisms, which can cause its commodification at the cost of intellectual innovation and, eventually, force actors to conform to the rules of the game. This work contributes to the ongoing academic debate by offering an innovative and multilevel (i.e. macro, meso and micro) theoretical perspective. Not only does this perspective conceptualise and present the dynamics, processes, instruments and actors at play in the phenomena under scrutiny but also provides a deeper understanding of the dynamics that promote the widespread application of research evaluation systems, despite their well-known weaknesses and potentially undesirable practical and ethical effects.
2024
A fatally efficient machine. Insights into the ‘banality’ of the research evaluation exercise in Italy / Spanò, Rosanna; Bracci, Enrico; Manes-Rossi, Francesca; Sforza, Vincenzo. - In: CRITICAL PERSPECTIVES ON ACCOUNTING. - ISSN 1045-2354. - 100:(2024). [10.1016/j.cpa.2024.102742]
File in questo prodotto:
File Dimensione Formato  
A fatally efficient machine.pdf

accesso aperto

Tipologia: Documento in Post-print
Licenza: Dominio pubblico
Dimensione 1.35 MB
Formato Adobe PDF
1.35 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11588/962705
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? 4
social impact