Inf-MLLM: Efficient Streaming Inference of Multimodal Large Language Models on a Single GPU

Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context

Original

Dai, Z.; Yang, Z.; Yang, Y.; Carbonell, J.; Le, Q. V.; and Salakhutdinov, R. 2019 · 1901

Earlier work this paper cites.

GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question Answering

Original

Hudson, D. A.; and Manning, C. D. 2019 · 1902

Earlier work this paper cites.

Adaptive attention span in transformers

Original

Sukhbaatar, S.; Grave, E.; Bojanowski, P.; and Joulin, A. 2019 · 1905

Earlier work this paper cites.

Compressive Transformers for Long-Range Sequence Modelling

Original

Rae, J. W.; Potapenko, A.; Jayakumar, S. M.; and Lillicrap, T. P. 2019 · 1911

Earlier work this paper cites.

Longformer: The long-document transformer

Original

Beltagy, I.; Peters, M. E.; and Cohan, A. 2020 · 2004

Earlier work this paper cites.

Rethinking attention with performers

Original

Choromanski, K.; Likhosherstov, V.; Dohan, D.; Song, X.; Gane, A.; Sarlos, T.; Hawkins, P.; Davis, J.; Mohiuddin, A.; Kaiser, L.; et al. 2020 · 2009

Earlier work this paper cites.

TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering

Original

Jang, Y.; Song, Y.; Yu, Y.; Kim, Y.; and Kim, G. 2017 · 2017

Earlier work this paper cites.

Flamingo: a visual language model for few-shot learning

Alayrac, J.-B.; Donahue, J.; Luc, P.; Miech, A.; Barr, I.; Hasson, Y.; Lenc, K.; Mensch, A.; Millican, K.; Reynolds, M.; et al. 2022 · 2022

Earlier work this paper cites.

Flashattention: Fast and memory-efficient exact attention with io-awareness

Dao, T.; Fu, D.; Ermon, S.; Rudra, A.; and Ré, C. 2022 · 2022

Earlier work this paper cites.

Cswin transformer: A general vision transformer backbone with cross-shaped windows

Dong, X.; Bao, J.; Chen, D.; Zhang, W.; Yu, N.; Yuan, L.; Chen, D.; and Guo, B. 2022 · 2022

Earlier work this paper cites.

Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation

Li, J.; Li, D.; Xiong, C.; and Hoi, S. 2022 · 2022

Earlier work this paper cites.

Swin transformer v2: Scaling up capacity and resolution

Liu, Z.; Hu, H.; Lin, Y.; Yao, Z.; Xie, Z.; Wei, Y.; Ning, J.; Cao, Y.; Zhang, Z.; Dong, L.; et al. 2022 · 2022

Cited alongside, same era.

Train short, test long: Attention with linear biases enables input length extrapolation

Press, O.; Smith, N. A.; and Lewis, M. 2022 · 2022

Cited alongside, same era.

Pythia: A suite for analyzing large language models across training and scaling

Biderman, S.; Schoelkopf, H.; Anthony, Q. G.; Bradley, H.; O’Brien, K.; Hallahan, E.; Khan, M. A.; Purohit, S.; Prashanth, U. S.; Raff, E.; et al. 2023 · 2023

Cited alongside, same era.

Extending context window of large language models via positional interpolation

Original

Chen, S.; Wong, S.; Chen, L.; and Tian, Y. 2023 · 2023

Cited alongside, same era.

Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality

Chiang, W.-L.; Li, Z.; Lin, Z.; Sheng, Y.; Wu, Z.; Zhang, H.; Zheng, L.; Zhuang, S.; Zhuang, Y.; Gonzalez, J. E.; et al. 2023 · 2023

Cited alongside, same era.

SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models

Original

Gao, P.; Zhang, R.; Liu, C.; Qiu, L.; Huang, S.; Lin, W.; Zhao, S.; Geng, S.; Lin, Z.; Jin, P.; et al. 2024 · 2024

Closest in time.

Chat-univi: Unified visual representation empowers large language models with image and video understanding

Jin, P.; Takanobu, R.; Zhang, C.; Cao, X.; and Yuan, L. 2024 · 2024

Closest in time.

GEAR: An Efficient KV Cache Compression Recipe for Near-Lossless Generative Inference of LLM

Original

Kang, H.; Zhang, Q.; Kundu, S.; Jeong, G.; Liu, Z.; Krishna, T.; and Zhao, T. 2024 · 2024

Closest in time.

How Long Can Open-Source LLMs Truly Promise on Context Length?

Li*, D.; Shao*, R.; Xie, A.; Sheng, Y.; Zheng, L.; Gonzalez, J. E.; Stoica, I.; Ma, X.; and Zhang, H. 2023 · 2024

Closest in time.

Visual instruction tuning

Liu, H.; Li, C.; Wu, Q.; and Lee, Y. J. 2024 · 2024

Closest in time.