Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models

Sentence-bert: Sentence embeddings using siamese bert-networks

Original

N Reimers. 2019 · 1908

Earlier work this paper cites.

Meteor: An automatic metric for mt evaluation with improved correlation with human judgments

Satanjeev Banerjee and Alon Lavie. 2005 · 2005

Earlier work this paper cites.

Principal component analysis

Hervé Abdi and Lynne J Williams. 2010 · 2010

Earlier work this paper cites.

Two-stream convolutional networks for action recognition in videos

Karen Simonyan and Andrew Zisserman. 2014 · 2014

Earlier work this paper cites.

Activitynet: A large-scale video benchmark for human activity understanding

Fabian Caba Heilbron, Victor Escorcia, Bernard Ghanem, and Juan Carlos Niebles. 2015 · 2015

Earlier work this paper cites.

Convolutional two-stream network fusion for video action recognition

Christoph Feichtenhofer, Axel Pinz, and Andrew Zisserman. 2016 · 2016

Earlier work this paper cites.

Tall: Temporal activity localization via language query

Jiyang Gao, Chen Sun, Zhenheng Yang, and Ram Nevatia. 2017 · 2017

Earlier work this paper cites.

Video question answering via gradually refined attention over appearance and motion

Dejing Xu, Zhou Zhao, Jun Xiao, Fei Wu, Hanwang Zhang, Xiangnan He, and Yueting Zhuang. 2017 · 2017

Earlier work this paper cites.

Localizing moments in video with temporal language

Lisa Anne Hendricks, Oliver Wang, Eli Shechtman, Josef Sivic, Trevor Darrell, and Bryan Russell. 2018 · 2018

Earlier work this paper cites.

Towards automatic learning of procedures from web instructional videos

Luowei Zhou, Chenliang Xu, and Jason Corso. 2018 · 2018

Earlier work this paper cites.

Activitynet-qa: A dataset for understanding complex web videos via question answering

Zhou Yu, Dejing Xu, Jun Yu, Ting Yu, Zhou Zhao, Yueting Zhuang, and Dacheng Tao. 2019 · 2019

Earlier work this paper cites.

Soda: Story oriented dense video captioning evaluation framework

Soichiro Fujita, Tsutomu Hirao, Hidetaka Kamigaito, Manabu Okumura, and Masaaki Nagata. 2020 · 2020

Earlier work this paper cites.

Frozen in time: A joint video and image encoder for end-to-end retrieval

Max Bain, Arsha Nagrani, Gül Varol, and Andrew Zisserman. 2021 · 2021

Earlier work this paper cites.

Pix2seq: A language modeling framework for object detection

Original

Ting Chen, Saurabh Saxena, Lala Li, David J Fleet, and Geoffrey Hinton. 2021 · 2021

Earlier work this paper cites.

Detecting moments and highlights in videos via natural language queries

Jie Lei, Tamara L Berg, and Mohit Bansal. 2021 · 2021

Earlier work this paper cites.

Learning transferable visual models from natural language supervision

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, and 1 others. 2021 · 2021

Earlier work this paper cites.

Next-qa: Next phase of question-answering to explaining temporal actions

Junbin Xiao, Xindi Shang, Angela Yao, and Tat-Seng Chua. 2021 · 2021

Cited alongside, same era.

Lora: Low-rank adaptation of large language models

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022 · 2022

Cited alongside, same era.

Zero-shot video question answering via frozen bidirectional language models

Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, and Cordelia Schmid. 2022 · 2022

Cited alongside, same era.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, and 1 others. 2023 · 2023

Cited alongside, same era.

Rt-2: Vision-language-action models transfer web knowledge to robotic control

Original

Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Xi Chen, Krzysztof Choromanski, Tianli Ding, Danny Driess, Avinava Dubey, Chelsea Finn, and 1 others. 2023 · 2023

Phi-3 technical report: A highly capable language model locally on your phone

Original

Marah Abdin, Jyoti Aneja, Hany Awadalla, Ahmed Awadallah, Ammar Ahmad Awan, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Jianmin Bao, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Qin Cai, Vishrav Chaudhary, Dong Chen, Dongdong Chen, and 110 others. 2024 · 2024

Closest in time.

Vtg-llm: Integrating timestamp knowledge into video llms for enhanced video temporal grounding

Original

Yongxin Guo, Jingyu Liu, Mingda Li, Xiaoying Tang, Xi Chen, and Bo Zhao. 2024 · 2024

Closest in time.

Chat-univi: Unified visual representation empowers large language models with image and video understanding

Peng Jin, Ryuichi Takanobu, Wancai Zhang, Xiaochun Cao, and Li Yuan. 2024 · 2024

Closest in time.

Language repository for long video understanding

Original

Kumara Kahatapitiya, Kanchana Ranasinghe, Jongwoo Park, and Michael S Ryoo. 2024 · 2024

Closest in time.