RETTA: Retrieval-Enhanced Test-Time Adaptation for Zero-Shot Video Captioning

D. L. Chen, W. B. Dolan, Collecting highly parallel data for paraphrase evaluation, in: ACL, 2011, pp. 190–200

2011

Earlier work this paper cites.

X. Chen, H. Fang, T. Lin, R. Vedantam, S. Gupta, P. Dollár, C. L. Zitnick, Microsoft COCO captions: Data collection and evaluation server, CoRR abs/1504.00325 (2015)

Original

2015

Earlier work this paper cites.

J. Xu, T. Mei, T. Yao, Y. Rui, MSR-VTT: A large video description dataset for bridging video and language, in: CVPR, 2016, pp. 5288–5296

2016

Earlier work this paper cites.

K. Lee, M. Chang, K. Toutanova, Latent retrieval for weakly supervised open domain question answering, in: A. Korhonen, D. R. Traum, L. Màrquez (Eds.), ACL, Association for Computational Linguistics, 2019, pp. 6086–6096

2019

Earlier work this paper cites.

A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever, et al., Language models are unsupervised multitask learners, OpenAI blog 1 (8) (2019) 9

2019

Earlier work this paper cites.

X. Wang, J. Wu, J. Chen, L. Li, Y.-F. Wang, W. Y. Wang, Vatex: A large-scale, high-quality multilingual dataset for video-and-language research, in: CVPR, 2019, pp. 4581–4591

2019

Earlier work this paper cites.

S. Zhang, Z. Tan, Z. Zhao, J. Yu, K. Kuang, T. Jiang, J. Zhou, H. Yang, F. Wu, Comprehensive information integration modeling framework for video titling, in: KDD, ACM, 2020, pp. 2744–2754

2020

Earlier work this paper cites.

K. Guu, K. Lee, Z. Tung, P. Pasupat, M. Chang, REALM: retrieval-augmented language model pre-training, CoRR abs/2002.08909 (2020)

Original

2020

Earlier work this paper cites.

V. Karpukhin, B. Oguz, S. Min, P. S. H. Lewis, L. Wu, S. Edunov, D. Chen, W. Yih, Dense passage retrieval for open-domain question answering, in: EMNLP, 2020, pp. 6769–6781

2020

Earlier work this paper cites.

B. Y. Lin, W. Zhou, M. Shen, P. Zhou, C. Bhagavatula, Y. Choi, X. Ren, Commongen: A constrained text generation challenge for generative commonsense reasoning, in: T. Cohn, Y. He, Y. Liu (Eds.), EMNLP, Vol. EMNLP 2020 of Findings of ACL, Association for Computational Linguistics, 2020, pp. 1823–1840

2020

Earlier work this paper cites.

H. Chen, J. Li, X. Hu, Delving deeper into the decoder for video captioning, in: G. D. Giacomo, A. Catalá, B. Dilkina, M. Milano, S. Barro, A. Bugarín, J. Lang (Eds.), ECAI, Vol. 325 of Frontiers in Artificial Intelligence and Applications, IOS Press, 2020, pp. 1079–1086

2020

Earlier work this paper cites.

Y. Huo, M. Zhang, G. Liu, H. Lu, Y. Gao, G. Yang, J. Wen, H. Zhang, B. Xu, W. Zheng, Z. Xi, Y. Yang, A. Hu, J. Zhao, R. Li, Y. Zhao, L. Zhang, Y. Song, X. Hong, W. Cui, D. Y. Hou, Y. Li, J. Li, P. Liu, Z. Gong, C. Jin, Y. Sun, S. Chen, Z. Lu, Z. Dou, Q. Jin, Y. Lan, W. X. Zhao, R. Song, J. Wen, Wenlan: Bridging vision and language by large-scale multi-modal pre-training, CoRR abs/2103.06561 (2021)

Original

2021

Earlier work this paper cites.

Z. Zhang, Z. Qi, C. Yuan, Y. Shan, B. Li, Y. Deng, W. Hu, Open-book video captioning with retrieve-copy-generate network, in: CVPR, Computer Vision Foundation / IEEE, 2021, pp. 9837–9846

2021

Earlier work this paper cites.

Y. Tu, C. Zhou, J. Guo, S. Gao, Z. Yu, Enhancing the alignment between target words and corresponding frames for video captioning, Pattern Recognition 111 (2021) 107702

2021

Earlier work this paper cites.

A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark, G. Krueger, I. Sutskever, Learning transferable visual models from natural language supervision, in: ICML, 2021, pp. 8748–8763

2021

Earlier work this paper cites.

J. Perez-Martin, B. Bustos, J. Pérez, Improving video captioning with temporal composition of a visual-syntactic embedding * {}^{\mbox{*}} , in: WACV, IEEE, 2021, pp. 3038–3048

2021

Earlier work this paper cites.

L. Nie, L. Qu, D. Meng, M. Zhang, Q. Tian, A. D. Bimbo, Search-oriented micro-video captioning, in: ACM MM, 2022, pp. 3234–3243

2022

Earlier work this paper cites.

Y. Lu, M. Bartolo, A. Moore, S. Riedel, P. Stenetorp, Fantastically ordered prompts and where to find them: Overcoming few-shot prompt order sensitivity, in: S. Muresan, P. Nakov, A. Villavicencio (Eds.), ACL, Association for Computational Linguistics, 2022, pp. 8086–8098

2022

Cited alongside, same era.

A. Webson, E. Pavlick, Do prompt-based models really understand the meaning of their prompts?, in: M. Carpuat, M. de Marneffe, I. V. M. Ruíz (Eds.), NAACL, Association for Computational Linguistics, 2022, pp. 2300–2344

2022

Cited alongside, same era.

M. Shu, W. Nie, D. Huang, Z. Yu, T. Goldstein, A. Anandkumar, C. Xiao, Test-time prompt tuning for zero-shot generalization in vision-language models, in: S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, A. Oh (Eds.), NeurIPS, 2022

2022

Cited alongside, same era.

Y. Tewel, Y. Shalev, I. Schwartz, L. Wolf, Zerocap: Zero-shot image-to-text generation for visual-semantic arithmetic, in: IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, June 18-24, 2022, IEEE, 2022, pp. 17897–17907

Y. Jo, S. Lee, A. S. Lee, H. Lee, H. Oh, M. Seo, Zero-shot dense video captioning by jointly optimizing text and moment, CoRR abs/2307.02682 (2023)

Original

2023

Later among the works it cites.

H. Zhang, X. Li, L. Bing, Video-llama: An instruction-tuned audio-visual language model for video understanding, in: Y. Feng, E. Lefever (Eds.), EMNLP, Association for Computational Linguistics, 2023, pp. 543–553

2023

Later among the works it cites.

Y. Shi, H. Xu, C. Yuan, B. Li, W. Hu, Z. Zha, Learning video-text aligned representations for video captioning, TOMM 19 (2) (2023) 63:1–63:21

2023

Later among the works it cites.

X. Luo, X. Luo, D. Wang, J. Liu, B. Wan, L. Zhao, Global semantic enhancement network for video captioning, Pattern Recognition 145 (2024) 109906

2024

Closest in time.

Z. Zeng, Y. Xie, H. Zhang, C. Chen, B. Chen, Z. Wang, Meacap: Memory-augmented zero-shot image captioning, in: CVPR, IEEE, 2024, pp. 14100–14110