Logo: Deutsches Institut für Internationale Pädagogische Forschung

Publications

Publikationendatenbank

show results

Autor:
Meyer, Christian M.; Mieskes, Margot; Stab, Christian; Gurevych, Iryna:

Titel:
DKPro Agreement
An open-source Java library for measuring inter-rater agreement

Quelle:
In: CNGL (Hrsg.): Proceedings of COLING 2014 Dublin : CNGL (2014) , 105-109

URL des Volltextes:
http://www.aclweb.org/anthology/C/C14/C14-2023.pdf

Sprache:
Englisch

Dokumenttyp:
4. Beiträge in Sammelwerken; Tagungsband/Konferenzbeitrag/Proceedings

Schlagwörter:
Computerlinguistik, Daten, Messung, Messverfahren, Modell, Reliabilität, Software


Abstract(englisch):
In this paper, we introduce a novel Java implementation of multiple inter-rater agreement measures, which we make available as open-source software. Besides assessing the reliability of coding tasks using S, , c., we particularly support unitizing tasks by measuring the agreement of the boundaries of the identified annotation units. We provide a unified interface and data model for both tasks as well as multiple diagnostic devices for analyzing the results. (DIPF/Org.)


DIPF-Abteilung:
Informationszentrum Bildung

Notizen:

last modified Nov 11, 2016