LLMVA-GEBC: Large Language Model with Video Adapter for Generic Event Boundary Captioning

Decoupled weight decay regularization

Original

Ilya Loshchilov and Frank Hutter · 2017

Earlier work this paper cites.

Learning transferable visual models from natural language supervision

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021

Earlier work this paper cites.

Vinvl: Revisiting visual representations in vision-language models

Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, and Jianfeng Gao · 2021

Earlier work this paper cites.

Omnivore: A single model for many visual modalities

Original

Rohit Girdhar, Mannat Singh, Nikhila Ravi, Laurens van der Maaten, Armand Joulin, and Ishan Misra · 2022

Earlier work this paper cites.

Dual-stream transformer for generic event boundary captioning

Original

Xin Gu, Hanhua Ye, Guang Chen, Yufei Wang, Libo Zhang, and Longyin Wen · 2022

Earlier work this paper cites.

Geb+: A benchmark for generic event boundary captioning, grounding and text-based retrieval

Yuxuan Wang, Difei Gao, Licheng Yu, Stan Weixian Lei, Matt Feiszli, and Mike Zheng Shou · 2022

Cited alongside, same era.

Internvideo: General video foundation models via generative and discriminative learning

Original

Yi Wang, Kunchang Li, Yizhuo Li, Yinan He, Bingkun Huang, Zhiyu Zhao, Hongjie Zhang, Jilan Xu, Yi Liu, Zun Wang, et al · 2022

Cited alongside, same era.

Scaling vision transformers

Xiaohua Zhai, Alexander Kolesnikov, Neil Houlsby, and Lucas Beyer · 2022

Cited alongside, same era.

Exploiting context information for generic event boundary captioning

Original

Jinrui Zhang, Teng Wang, Feng Zheng, Ran Cheng, and Ping Luo · 2022

Cited alongside, same era.

Opt: Open pre-trained transformer language models

Original

Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, et al · 2022

Later among the works it cites.

Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models

Original

Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi · 2023

Closest in time.

Dinov2: Learning robust visual features without supervision

Original

Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al · 2023

Closest in time.

Video-llama: An instruction-tuned audio-visual language model for video understanding

Original

Hang Zhang, Xin Li, and Lidong Bing · 2023

Closest in time.