VOCALExplore: Pay-as-You-Go Video Data Exploration and Model Building [Technical Report]

Understand

We introduce VOCALExplore, a system designed to support users in building domain-specific models over video datasets.

• VOCALExplore supports interactive labeling sessions and trains models using user-supplied labels.
• VOCALExplore maximizes model quality by automatically deciding how to select samples based on observed skew in the collected labels.
• It also selects the optimal video representations to use when training models by casting feature selection as a rising bandit problem.