Thinking Like an Annotator: Generation of Dataset Labeling Instructions

Understand

Large-scale datasets are essential to modern day deep learning.

• Advocates argue that understanding these methods requires dataset transparency (e.g.
• "dataset curation, motivation, composition, collection process, etc...").
• However, almost no one has suggested the release of the detailed definitions and visual category examples provided to annotators - information critical to understanding the structure of the annotations present in each dataset.