-
Notifications
You must be signed in to change notification settings - Fork 3k
Description
Is your feature request related to a problem? Please describe.
When annotating long sections in video, audio or time series data, the annotator has to select the entire section for the label even when this is outside the current view (especially with the TimelineLabels, which can only display a limited number of frames). This means he/she has to pause the video, start by selecting the end and drag all the way to the beginning. This interrupts the labeling flow and can be very time consuming. Adding to this is that with the Labels tag, it can be very hard to match the start of the current labels with the end of the previous one.
Describe the solution you'd like
I would like to add two labeling options called the TimelineChoices and TimeSeriesChoices tag for labeling videos and audio data. These tags work as follows: when the content is playing, the annotator can select one or multiple labels (optional via the existing [choice] option) and the frames/samples that pass get the selected labels. This way the annotator can start playing the video and only has to switch between labels during the video without dragging or anything. Via the [selected] options, the default label at the beginning of the video can be selected.
This tag can be added alongside the existing TimelineLabels and TimeSeriesLabels tags and be called TimelineChoices and TimeSeriesChoices and use the Choice tag internally as suggested above. The resulting labels can be shown via the same interface as the current TimelineLabels/TimeSeriesLabels (but only one 'line' is needed in the single choice scenario since each frame/sample can only have one label) . An additional benefit is that labeling in this way, the entire video or audio is labeled with exactly one label without gaps or overlap (in case of the single choice option).
Describe alternatives you've considered
The alternative for this is injecting code inside the existing Label Studio code base, but this is hard to maintain over longer periods.
Additional context
For additional info please reach out to me, I'm more than happy to help!