A fuzzy set theory based computational model to represent the quality of inter-rater agreement
Abstract
In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study.
Autore Pugliese
Tutti gli autori
-
E. Ciavolino , S. Salvatore , A. Calcagnì
Titolo volume/Rivista
QUALITY & QUANTITY
Anno di pubblicazione
2014
ISSN
0033-5177
ISBN
Non Disponibile
Numero di citazioni Wos
7
Ultimo Aggiornamento Citazioni
28/04/2018
Numero di citazioni Scopus
9
Ultimo Aggiornamento Citazioni
28/04/2018
Settori ERC
Non Disponibile
Codici ASJC
Non Disponibile
Condividi questo sito sui social