NoteLLM-2: Multimodal Large Representation Models for Recommendation

The probabilistic relevance framework: BM25 and beyond

Stephen Robertson, Hugo Zaragoza, et al · 2009

Earlier work this paper cites.

Empirical evaluation of gated recurrent neural networks on sequence modeling

Original

Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. 2014 · 2014

Earlier work this paper cites.

Learning tree-based deep model for recommender systems. In KDD . 1079–1088

Han Zhu, Xiang Li, Pengye Zhang, Guozheng Li, Jie He, Han Li, and Kun Gai. 2018 · 2018

Earlier work this paper cites.

Billion-scale similarity search with GPUs

Jeff Johnson, Matthijs Douze, and Hervé Jégou. 2019 · 2019

Earlier work this paper cites.

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL . 4171–4186

Jacob Devlin Ming-Wei Chang Kenton and Lee Kristina Toutanova. 2019 · 2019

Earlier work this paper cites.

MMGCN: Multi-modal graph convolution network for personalized recommendation of micro-video. In MM . 1437–1445

Yinwei Wei, Xiang Wang, Liqiang Nie, Xiangnan He, Richang Hong, and Tat-Seng Chua. 2019 · 2019

Earlier work this paper cites.

Deepspeed: System optimizations enable training deep learning models with over 100 billion parameters. In KDD . 3505–3506

Jeff Rasley, Samyam Rajbhandari, Olatunji Ruwase, and Yuxiong He. 2020 · 2020

Earlier work this paper cites.

RIVA: a pre-trained tweet multimodal model based on text-image relation for multimodal NER. In COLING . 1852–1862

Lin Sun, Jiquan Wang, Yindu Su, Fangsheng Weng, Yuxuan Sun, Zengwei Zheng, and Yuanyi Chen. 2020 · 2020

Earlier work this paper cites.

Large scale product graph construction for recommendation in e-commerce

Original

Xiaoyong Yang, Yadong Zhu, Yi Zhang, Xiaobo Wang, and Quan Yuan. 2020 · 2020

Earlier work this paper cites.

Multimodal intelligence: Representation learning, information fusion, and applications

Chao Zhang, Zichao Yang, Xiaodong He, and Li Deng. 2020 · 2020

Earlier work this paper cites.

Pre-training with whole word masking for chinese bert

Yiming Cui, Wanxiang Che, Ting Liu, Bing Qin, and Ziqing Yang. 2021 · 2021

Earlier work this paper cites.

OpenCLIP

Gabriel Ilharco, Mitchell Wortsman, Ross Wightman, Cade Gordon, Nicholas Carlini, Rohan Taori, Achal Dave, Vaishaal Shankar, Hongseok Namkoong, John Miller, Hannaneh Hajishirzi, Ali Farhadi, and Ludwig Schmidt. 2021 · 2021

Earlier work this paper cites.

Align before fuse: Vision and language representation learning with momentum distillation

Junnan Li, Ramprasaath Selvaraju, Akhilesh Gotmare, Shafiq Joty, Caiming Xiong, and Steven Chu Hong Hoi. 2021 · 2021

Earlier work this paper cites.

Learning transferable visual models from natural language supervision. In ICML . PMLR, 8748–8763

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021

Earlier work this paper cites.

{Zero-offload}: Democratizing {billion-scale} model training. In USENIX Annual Technical Conference . 551–564

Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, Olatunji Ruwase, Shuangyan Yang, Minjia Zhang, Dong Li, and Yuxiong He. 2021 · 2021

Earlier work this paper cites.

RpBERT: a text-image relation propagation-based BERT model for multimodal NER. In AAAI , Vol. 35. 13860–13868

Lin Sun, Jiquan Wang, Kai Zhang, Yindu Su, and Fangsheng Weng. 2021 · 2021

Earlier work this paper cites.

Why do we click: visual impression-aware news recommendation. In MM . 3881–3890

Jiahao Xun, Shengyu Zhang, Zhou Zhao, Jieming Zhu, Qi Zhang, Jingjie Li, Xiuqiang He, Xiaofei He, Tat-Seng Chua, and Fei Wu. 2021 · 2021

Earlier work this paper cites.

MAPS: multimodal attention for product similarity. In WACV . 3338–3346

Nilotpal Das, Aniket Joshi, Promod Yenigalla, and Gourav Agrwal. 2022 · 2022

Earlier work this paper cites.

A survey on in-context learning

Original

Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Zhiyong Wu, Baobao Chang, Xu Sun, Jingjing Xu, and Zhifang Sui. 2022 · 2022

Earlier work this paper cites.

An empirical study of training end-to-end vision-and-language transformers. In CVPR . 18166–18176

Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang, Lijuan Wang, Chenguang Zhu, Pengchuan Zhang, Lu Yuan, Nanyun Peng, et al · 2022

Earlier work this paper cites.

Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. In ICML . PMLR, 12888–12900

Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. 2022 · 2022

Earlier work this paper cites.

Text and code embeddings by contrastive pre-training

Original

Arvind Neelakantan, Tao Xu, Raul Puri, Alec Radford, Jesse Michael Han, Jerry Tworek, Qiming Yuan, Nikolas Tezak, Jong Wook Kim, Chris Hallacy, et al · 2022

Cited alongside, same era.

Mm-rec: Visiolinguistic model empowered multimodal news recommendation. In SIGIR . 2560–2564

Chuhan Wu, Fangzhao Wu, Tao Qi, Chao Zhang, Yongfeng Huang, and Tong Xu. 2022 · 2022

Cited alongside, same era.

WuDaoCorpora Text

Zhao Xue, Hanyu Zhao, Sha Yuan, and Yequan Wang. 2022 · 2022

Cited alongside, same era.

Coca: Contrastive captioners are image-text foundation models

Original

Jiahui Yu, Zirui Wang, Vijay Vasudevan, Legg Yeung, Mojtaba Seyedhosseini, and Yonghui Wu. 2022b · 2022

Cited alongside, same era.

Qwen technical report

Original

Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, et al · 2023

Pandagpt: One model to instruction-follow them all

Original

Yixuan Su, Tian Lan, Huayang Li, Jialu Xu, Yan Wang, and Deng Cai. 2023 · 2023

Later among the works it cites.

Eva-clip: Improved training techniques for clip at scale

Original

Quan Sun, Yuxin Fang, Ledell Wu, Xinlong Wang, and Yue Cao. 2023 · 2023

Later among the works it cites.

Llama 2: Open foundation and fine-tuned chat models

Original

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al · 2023

Later among the works it cites.

A survey on multimodal large language models

Original

Shukang Yin, Chaoyou Fu, Sirui Zhao, Ke Li, Xing Sun, Tong Xu, and Enhong Chen. 2023 · 2023

Later among the works it cites.