A fuzzy set theory based computational model to represent the quality of inter-rater agreement

Abstract

In this paper we present a method to evaluate the quality of a rater’s judgement, which can integrate and enrich the use of inter-rater agreement as a reliability measure. Our proposal is an integrative one and evaluates the quality of a rater’s performance through an analysis of the profile of that individual rater’s performance. We discuss its rationale on the basis of the interpretation of inter-rater agreement, highlighting some critical issues. For this purpose, we adopt a computational model based on fuzzy set theory, demonstrating its main characteristics with an exemplary case study.


Tutti gli autori

  • E. Ciavolino , S. Salvatore , A. Calcagnì

Titolo volume/Rivista

QUALITY & QUANTITY


Anno di pubblicazione

2014

ISSN

0033-5177

ISBN

Non Disponibile


Numero di citazioni Wos

7

Ultimo Aggiornamento Citazioni

28/04/2018


Numero di citazioni Scopus

9

Ultimo Aggiornamento Citazioni

28/04/2018


Settori ERC

Non Disponibile

Codici ASJC

Non Disponibile