LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts

Understand

We introduce the task of automatic live commenting.

• Live commenting, which is also called `video barrage', is an emerging feature on online video sites that allows real-time comments from viewers to fly across the screen like bullets or roll at the right side of the screen.
• The live comments are a mixture of opinions for the video and the chit chats with other comments.
• Automatic live commenting requires AI agents to comprehend the videos and interact with human viewers who also make the comments, so it is a good testbed of an AI agent's ability of dealing with both dynamic vision and language.