Fetching the paper…

Reading the bibliography…

2021

Coarse to Fine: Video Retrieval before Moment Localization

Gao, Zijian, Liu, Huanyu, Liu, Jingyu

Original
PDF
Post on X

Understand

The current state-of-the-art methods for video corpus moment retrieval (VCMR) often use similarity-based feature alignment approach for the sake of convenience and speed.

However, late fusion methods like cosine similarity alignment are unable to make full use of the information from both query texts and videos.
In this paper, we combine feature alignment with feature fusion to promote the performance on VCMR.

Coarse to Fine: Video Retrieval before Moment Localization · Around

Built on

Qanet: Combining local convolution with global self-attention for reading comprehension
Original
Adams Wei Yu, David Dohan, Minh-Thang Luong, Rui Zhao, Kai Chen, Mohammad Norouzi, and Quoc V Le · 2018
Earlier work this paper cites.
Temporal localization of moments in video collections with natural language
Original
Victor Escorcia, Mattia Soldan, Josef Sivic, Bernard Ghanem, and Bryan Russell · 2019
Earlier work this paper cites.
Tvr: A large-scale dataset for video-subtitle moment retrieval
Jie Lei, Licheng Yu, Tamara L Berg, and Mohit Bansal · 2020
Earlier work this paper cites.
Hero: Hierarchical encoder for video+ language omni-representation pre-training
Original
Linjie Li, Yen-Chun Chen, Yu Cheng, Zhe Gan, Licheng Yu, and Jingjing Liu · 2020
Earlier work this paper cites.

Similar

A hierarchical multi-modal encoder for moment localization in video corpus
Original
Bowen Zhang, Hexiang Hu, Joonseok Lee, Ming Zhao, Sheide Chammas, Vihan Jain, Eugene Ie, and Fei Sha · 2020
Cited alongside, same era.
Span-based localizing network for natural language video localization
Original
Hao Zhang, Aixin Sun, Wei Jing, and Joey Tianyi Zhou · 2020
Cited alongside, same era.
Value: A multi-task benchmark for video-and-language understanding evaluation
Original
Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Rohit Pillai, Yu Cheng, Luowei Zhou, Xin Eric Wang, William Yang Wang, et al · 2021
Cited alongside, same era.

Then

Consert: A contrastive framework for self-supervised sentence representation transfer
Original
Yuanmeng Yan, Rumei Li, Sirui Wang, Fuzheng Zhang, Wei Wu, and Weiran Xu · 2021
Closest in time.
Video corpus moment retrieval with contrastive learning
Original
Hao Zhang, Aixin Sun, Wei Jing, Guoshun Nan, Liangli Zhen, Joey Tianyi Zhou, and Rick Siow Mong Goh · 2021
Closest in time.
Parallel attention network with sequence matching for video grounding
Original
Hao Zhang, Aixin Sun, Wei Jing, Liangli Zhen, Joey Tianyi Zhou, and Rick Siow Mong Goh · 2021
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…