Fast computation of Krippendorff's alpha agreement measure in Python.
CrowdTruth framework for crowdsourcing ground truth for training & evaluation of AI systems
Inter-annotator agreement for Brat annotation projects
Exploring the inter-annotator agreement between ISIC Archive segmentation masks
This repository holds code to annotate textual data using LLMs, and calculate different measures of Inter-Annotator Agreement (IAA).
command line stuff to calculate inter annotator agreement
Digita Literacy for School of Foreign Languages (NRU HSE, 2018)
[MICCAI ISIC 2024] Code for "Segmentation Style Discovery: Application to Skin Lesion Images"
Add a description, image, and links to the inter-annotator-agreement topic page so that developers can more easily learn about it.
To associate your repository with the inter-annotator-agreement topic, visit your repo's landing page and select "manage topics."