The Curation Tool is a web-based platform for collaborative linguistic data annotation and curation. It provides a flexible environment for creating annotation projects, assigning datasets to multiple curators, and systematically evaluating and resolving annotation disagreements.
Annotation interfaces can be configured through reusable project-specific layouts, supporting free-text input, predefined categories, buttons, drop-down menus, and autocomplete fields. Existing datasets can be imported and curated without altering the original input data.
The platform supports different user roles (Admin, Supervisor, and Curator) and provides dedicated workflows for annotation, review, and supervisor adjudication. Progress is saved continuously, individual annotations can be revised, and problematic items can be flagged for review.
For projects involving multiple annotators, the tool automatically identifies agreements and disagreements and provides quantitative measures of inter-annotator agreement, including raw agreement and Krippendorff’s alpha. Supervisors can filter disputed items, adjudicate annotations, and export a final curated dataset.
Additional features include project and curation management, curator assignment, configurable annotation templates, audit and curation logs, and controlled user registration.
The Curation Tool was developped witihin the project B05 of CRC 1629 NegLab in order to faciliate the input of data for the project’s NPI database, NPI Bank.
Try the Curation Tool: https://curation-tool.com
Links
- Curation Tool: https://curation-tool.com
- CRC 1629 Negation in Language and Beyond: https://www.neglab.de/
- Project B05 Negative Polarity Items in non-negative contexts: https://www.english-linguistics.de/sfb1629/b05/
- NPI Bank: https://npibank.neglab.de/