TGIF: A New Dataset and Benchmark on Animated GIF Description

Understand

With the recent popularity of animated GIFs on social media, there is need for ways to index them with rich metadata.

• To advance research on animated GIF understanding, we collected a new dataset, Tumblr GIF (TGIF), with 100K animated GIFs from Tumblr and 120K natural language descriptions obtained via crowdsourcing.
• The motivation for this work is to develop a testbed for image sequence description systems, where the task is to generate natural language descriptions for animated GIFs or video clips.
• To ensure a high quality dataset, we developed a series of novel quality controls to validate free-form text input from crowdworkers.