Skip to content

Commit 6e9377a

Browse files
authored
Update README.md
1 parent 9d855b2 commit 6e9377a

File tree

1 file changed

+13
-6
lines changed

1 file changed

+13
-6
lines changed

README.md

Lines changed: 13 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -116,27 +116,33 @@ This summary is based on the results collated on 30 June 2020. We may update the
116116

117117
| Feature | Open Source | Commercial |
118118
|:-|:-:|:-:|
119-
| Active Learning || |
119+
| Active Learning || |
120120
| Annotation progress monitor || |
121121
| Annotation shortcuts || |
122122
| Annotation visualization || |
123123
| Automatically suggesting annotations || |
124124
| Audio annotation support || |
125125
| Available Online (No installation)|| |
126126
| Connecting to external resources (e.g. storage / knowledge base / dictionary) || |
127-
| Customizable annotation tasks/labels (with extra code/schema)|| |
127+
| Customizable annotation tasks/labels (with extra code/schema)|| |
128128
| Customizable annotation view (when annotating) || |
129129
| Drag and drop interactions || |
130130
| Easy setup/installation (e.g Docker) || |
131-
| Export to multiple formats|| |
131+
| Export to multiple formats|| |
132132
| Good UI/UX || |
133-
| Interoperability (e.g. load/combine annotations from other tools)|| |
134-
| Multi-annotator agreement mechanisms/metrics || |
133+
| Interoperability (e.g. load/combine annotations from other tools, integration with other tools)|| |
134+
| Multi-annotator agreement mechanisms/metrics / Automatic evaluation of annotations || |
135135
| Post-Annotation curation || |
136-
| Project Management with collaboration features || |
136+
| Project Management with collaboration features || |
137137
| Python-based || |
138138
| Simple Login/Sign-on || |
139139
| Supports multiple tasks || |
140+
| Communication tools (e.g. annotators interaction with project managers) | ||
141+
|-|-|-|
142+
| Documentation (e.g. forums, example setup) | ||
143+
| Built-in quality control (e.g. screening tests, data cleanup/filer) | ||
144+
| Demo/test small projects with least setup effort | ||
145+
| Access to large/diverse/global pool of annotators | ||
140146

141147

142148
The keywords **flexibility** and **ease**/**easy**/**simple** appears in many of the comments to list the top features for annotation platform. We suggest the following for annotation tools creators to accomodate these feedbacks:
@@ -150,3 +156,4 @@ Another recurring theme in the top feature list includes:
150156
- Respondents highlighting ability to annotate (i) overlapping spans, (ii) discontinuous spans, (iii) corrections to initial tokenizations (iv) entity relation annotations
151157
- In cases where free text annotation is allowed, some sort of respondents highlighted **need for constraints/limitations of free text**
152158

159+

0 commit comments

Comments
 (0)