Fetching the paper…

Reading the bibliography…

Exploring Anchor-based Detection for Ego4D Natural Language Query · Around

2022

Exploring Anchor-based Detection for Ego4D Natural Language Query

Zheng, Sipeng, Zhang, Qi, Liu, Bei et al.

Original
PDF
Post on X

Understand

In this paper we provide the technique report of Ego4D natural language query challenge in CVPR 2022.

Natural language query task is challenging due to the requirement of comprehensive understanding of video contents.
Most previous works address this task based on third-person view datasets while few research interest has been placed in the ego-centric view by far.
Great progress has been made though, we notice that previous works can not adapt well to ego-centric view datasets e.g., Ego4D mainly because of two reasons: 1) most queries in Ego4D have a excessively small temporal duration (e.g., less than 5 seconds); 2) queries in Ego4D are faced with much more complex video understanding of long-term temporal orders.

Built on

Video co-summarization: Video summarization by visual co-occurrence
Wen-Sheng Chu, Yale Song, and Alejandro Jaimes · 2015
Earlier work this paper cites.
Faster r-cnn: Towards real-time object detection with region proposal networks
Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun · 2015
Earlier work this paper cites.
Tvsum: Summarizing web videos using titles
Yale Song, Jordi Vallmitjana, Amanda Stent, and Alejandro Jaimes · 2015
Earlier work this paper cites.

Similar

Localizing moments in video with natural language
Lisa Anne Hendricks, Oliver Wang, Eli Shechtman, Josef Sivic, Trevor Darrell, and Bryan Russell · 2017
Cited alongside, same era.
Visual translation embedding network for visual relation detection
Hanwang Zhang, Zawlin Kyaw, Shih-Fu Chang, and Tat-Seng Chua · 2017
Cited alongside, same era.
Temporal action detection with structured segment networks
Original
Yue Zhao, Yuanjun Xiong, Limin Wang, Zhirong Wu, Xiaoou Tang, and Dahua Lin · 2017
Cited alongside, same era.

Then

Fine-grained video-text retrieval with hierarchical graph reasoning
Shizhe Chen, Yida Zhao, Qin Jin, and Qi Wu · 2020
Later among the works it cites.
Video swin transformer
Original
Ze Liu, Jia Ning, Yue Cao, Yixuan Wei, Zheng Zhang, Stephen Lin, and Han Hu · 2021
Later among the works it cites.
R3m: A universal visual representation for robot manipulation
Original
Suraj Nair, Aravind Rajeswaran, Vikash Kumar, Chelsea Finn, and Abhinav Gupta · 2022
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…