Fetching the paper…

Reading the bibliography…

2018

Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7

Alamri, Huda, Cartillier, Vincent, Lopes, Raphael Gontijo et al.

Original
PDF
Post on X

Understand

Scene-aware dialog systems will be able to have conversations with users about the objects and events around them.

Progress on such systems can be made by integrating state-of-the-art technologies from multiple research areas including end-to-end dialog systems visual dialog, and video description.
We introduce the Audio Visual Scene Aware Dialog (AVSD) challenge and dataset.
In this challenge, which is one track of the 7th Dialog System Technology Challenges (DSTC7) workshop1, the task is to build a system that generates responses in a dialog about an input video

Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7 · Around

Built on

Translating videos to natural language using deep recurrent neural networks
S. Venugopalan, H. Xu, J. Donahue, M. Rohrbach, R. Mooney, and K. Saenko · 2014
Earlier work this paper cites.
VQA: Visual Question Answering
S. Antol, A. Agrawal, J. Lu, M. Mitchell, D. Batra, C. L. Zitnick, and D. Parikh · 2015
Earlier work this paper cites.
The ubuntu dialogue corpus: A large dataset for research in unstructured multi-turn dialogue systems
Original
R. Lowe, N. Pow, I. Serban, and J. Pineau · 2015
Earlier work this paper cites.

Similar

Visual dialog
Original
A. Das, S. Kottur, K. Gupta, A. Singh, D. Yadav, J. M. F. Moura, D. Parikh, and D. Batra · 2016
Cited alongside, same era.
Hollywood in homes: Crowdsourcing data collection for activity understanding
G. A. Sigurdsson, G. Varol, X. Wang, I. Laptev, A. Farhadi, and A. Gupta · 2016
Cited alongside, same era.
Learning cooperative visual dialog agents with deep reinforcement learning
A. Das, S. Kottur, J. M. Moura, S. Lee, and D. Batra · 2017
Cited alongside, same era.

Then

Guesswhat?! visual object discovery through multi-modal dialogue
H. De Vries, F. Strub, S. Chandar, O. Pietquin, H. Larochelle, and A. Courville · 2017
Later among the works it cites.
End-to-end conversation modeling track in DSTC6
Original
C. Hori and T. Hori · 2017
Later among the works it cites.
Attention-based multimodal fusion for video description
C. Hori, T. Hori, T.-Y. Lee, Z. Zhang, B. Harsham, J. R. Hershey, T. K. Marks, and K. Sumi · 2017
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…