VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Grounding

Sample estimate of the entropy of a random vector

Kozachenko, L. F.; and Leonenko, N. N. 1987 · 1987

Earlier work this paper cites.

k-means++: The advantages of careful seeding

Arthur, D.; Vassilvitskii, S.; et al. 2007 · 2007

Earlier work this paper cites.

A unifying view on dataset shift in classification

Moreno-Torres, J. G.; Raeder, T.; Alaiz-Rodríguez, R.; Chawla, N. V.; and Herrera, F. 2012 · 2012

Earlier work this paper cites.

Creating summaries from user videos

Gygli, M.; Grabner, H.; Riemenschneider, H.; and Van Gool, L. 2014 · 2014

Earlier work this paper cites.

ActivityNet: A Large-Scale Video Benchmark for Human Activity Understanding

Fabian Caba Heilbron, B. G., Victor Escorcia; and Niebles, J. C. 2015 · 2015

Earlier work this paper cites.

Tvsum: Summarizing web videos using titles

Song, Y.; Vallmitjana, J.; Stent, A.; and Jaimes, A. 2015 · 2015

Earlier work this paper cites.

Cider: Consensus-based image description evaluation

Vedantam, R.; Lawrence Zitnick, C.; and Parikh, D. 2015 · 2015

Earlier work this paper cites.

Tall: Temporal activity localization via language query

Gao, J.; Sun, C.; Yang, Z.; and Nevatia, R. 2017 · 2017

Earlier work this paper cites.

Localizing Moments in Video with Temporal Language

Hendricks, L. A.; Wang, O.; Shechtman, E.; Sivic, J.; Darrell, T.; and Russell, B. 2018 · 2018

Earlier work this paper cites.

Towards automatic learning of procedures from web instructional videos

Zhou, L.; Xu, C.; and Corso, J. 2018 · 2018

Earlier work this paper cites.

Coin: A large-scale dataset for comprehensive instructional video analysis

Tang, Y.; Ding, D.; Rao, Y.; Zheng, Y.; Zhang, D.; Zhao, L.; Lu, J.; and Zhou, J. 2019 · 2019

Earlier work this paper cites.

SODA: Story oriented dense video captioning evaluation framework

Fujita, S.; Hirao, T.; Kamigaito, H.; Okumura, M.; and Nagata, M. 2020 · 2020

Earlier work this paper cites.

Detecting moments and highlights in videos via natural language queries

Lei, J.; Berg, T. L.; and Bansal, M. 2021 · 2021

Earlier work this paper cites.

Queryd: A video dataset with high-quality text and audio narrations

Oncescu, A.-M.; Henriques, J. F.; Liu, Y.; Zisserman, A.; and Albanie, S. 2021 · 2021

Earlier work this paper cites.

Videoclip: Contrastive pre-training for zero-shot video-text understanding

Original

Xu, H.; Ghosh, G.; Huang, P.-Y.; Okhonko, D.; Aghajanyan, A.; Metze, F.; Zettlemoyer, L.; and Feichtenhofer, C. 2021 · 2021

Earlier work this paper cites.

MERLOT: Multimodal Neural Script Knowledge Models

Zellers, R.; Lu, X.; Hessel, J.; Yu, Y.; Park, J. S.; Cao, J.; Farhadi, A.; and Choi, Y. 2021 · 2021

Cited alongside, same era.

Videomae: Masked autoencoders are data-efficient learners for self-supervised video pre-training

Tong, Z.; Song, Y.; Wang, J.; and Wang, L. 2022 · 2022

Cited alongside, same era.

Internvideo: General video foundation models via generative and discriminative learning

Original

Wang, Y.; Li, K.; Li, Y.; He, Y.; Huang, B.; Zhao, Z.; Zhang, H.; Xu, J.; Liu, Y.; Wang, Z.; et al. 2022 · 2022

Cited alongside, same era.

Gpt-4 technical report

Original

Achiam, J.; Adler, S.; Agarwal, S.; Ahmad, L.; Akkaya, I.; Aleman, F. L.; Almeida, D.; Altenschmidt, J.; Altman, S.; Anadkat, S.; et al. 2023 · 2023

Cited alongside, same era.

Qwen-vl: A frontier large vision-language model with versatile abilities

Original

Video-llama: An instruction-tuned audio-visual language model for video understanding

Original

Zhang, H.; Li, X.; and Bing, L. 2023 · 2023

Later among the works it cites.

Minigpt-4: Enhancing vision-language understanding with advanced large language models

Original

Zhu, D.; Chen, J.; Shen, X.; Li, X.; and Elhoseiny, M. 2023 · 2023

Later among the works it cites.

Vast: A vision-audio-subtitle-text omni-modality foundation model and dataset

Chen, S.; Li, H.; Wang, Q.; Zhao, Z.; Sun, M.; Zhu, X.; and Liu, J. 2024 · 2024

Closest in time.

VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs

Original

Cheng, Z.; Leng, S.; Zhang, H.; Xin, Y.; Li, X.; Chen, G.; Zhu, Y.; Zhang, W.; Luo, Z.; Zhao, D.; et al. 2024 · 2024

Closest in time.

Instructblip: Towards general-purpose vision-language models with instruction tuning