Fetching the paper…
Reading the bibliography…
With collective endeavors, multimodal large language models (MLLMs) are undergoing a flourishing development.
A statistical evaluation of recent full reference image quality assessment algorithms
H.R. Sheikh, M.F. Sabir, and A.C. Bovik · 2006
Earlier work this paper cites.
VQA: Visual question answering
Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, and Devi Parikh · 2015
Earlier work this paper cites.
Photo aesthetics ranking network with attributes and content adaptation
S. Kong, X. Shen, Z. Lin, R. Mech, and C. Fowlkes · 2016
Earlier work this paper cites.
Neural abstract style transfer for chinese traditional painting
Bo Li, Caiming Xiong, Tianfu Wu, Yu Zhou, Lun Zhang, and Rufeng Chu · 2018
Earlier work this paper cites.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019
Earlier work this paper cites.
A comprehensive survey of deep learning for image captioning
MD Zakir Hossain, Ferdous Sohel, Mohd Fairuz Shiratuddin, and Hamid Laga · 2019
Earlier work this paper cites.
Perceptual quality assessment of smartphone photography
Yuming Fang, Hanwei Zhu, Yan Zeng, Kede Ma, and Zhou Wang · 2020
Earlier work this paper cites.
KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessment
Vlad Hosu, Hanhe Lin, Tamas Sziranyi, and Dietmar Saupe · 2020
Earlier work this paper cites.
Blind quality index of depth images based on structural statistics for view synthesis
Yipo Huang, Leida Li, Hancheng Zhu, and Bo Hu · 2020
Earlier work this paper cites.
Artemis: Affective language for visual art
Panos Achlioptas, Maks Ovsjanikov, Kilichbek Haydarov, Mohamed Elhoseiny, and Leonidas Guibas · 2021
Earlier work this paper cites.
Learning the relation between interested objects and aesthetic region for image cropping
Peng Lu, Hao Zhang, Xujun Peng, and Xiaofu Jin · 2021
Earlier work this paper cites.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever · 2021
Earlier work this paper cites.
GLM: General language model pretraining with autoregressive blank infilling
Zhengxiao Du, Yujie Qian, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang, and Jie Tang · 2022
Earlier work this paper cites.
Rethinking image aesthetics assessment: Models, datasets and benchmarks
Shuai He, Yongchang Zhang, Rui Xie, Dongxiang Jiang, and Anlong Ming · 2022
Earlier work this paper cites.
Personalized image aesthetics assessment with rich attributes
Y. Yang, L. Xu, L. Li, N. Qie, Y. Li, P. Zhang, and Y. Guo · 2022
Earlier work this paper cites.
Qwen-VL: A versatile vision-language model for understanding, localization, text reading, and beyond
Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou · 2023
Earlier work this paper cites.
BenchLMM: Benchmarking cross-style visual capability of large multimodal models
Rizhao Cai, Zirui Song, Dayan Guan, Zhenhao Chen, Xing Luo, Chenyu Yi, and Alex Kot · 2023
Earlier work this paper cites.
MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning
Jun Chen, Deyao Zhu, Xiaoqian Shen, Xiang Li, Zechu Liu, Pengchuan Zhang, Raghuraman Krishnamoorthi, Vikas Chandra, Yunyang Xiong, and Mohamed Elhoseiny · 2023
Cited alongside, same era.
ShareGPT4V: Improving large multi-modal models with better captions
Lin Chen, Jisong Li, Xiaoyi Dong, Pan Zhang, Conghui He, Jiaqi Wang, Feng Zhao, and Dahua Lin · 2023
Cited alongside, same era.
EgoPlan-Bench: Benchmarking egocentric embodied planning with multimodal large language models
Yi Chen, Yuying Ge, Yixiao Ge, Mingyu Ding, Bohao Li, Rui Wang, Ruifeng Xu, Ying Shan, and Xihui Liu · 2023
Cited alongside, same era.
InstructBLIP: Towards general-purpose vision-language models with instruction tuning
Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, and Steven Hoi · 2023
Cited alongside, same era.
Aesclip: Multi-attribute contrastive learning for image aesthetics assessment
Xiangfei Sheng, Leida Li, Pengfei Chen, Jinjian Wu, Weisheng Dong, Yuzhe Yang, Liwu Xu, Yaqian Li, and Guangming Shi · 2023
Later among the works it cites.
LLaMA: Open and efficient foundation language models
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample · 2023
Later among the works it cites.
Access the world’s largest open library dataset, 2023
Unsplash · 2023
Later among the works it cites.
DiffusionDB: A large-scale prompt gallery dataset for text-to-image generative models
Zijie J. Wang, Evan Montoya, David Munechika, Haoyang Yang, Benjamin Hoover, and Duen Horng Chau · 2023
Later among the works it cites.
Q-Instruct: Improving low-level visual abilities for multi-modality foundation models
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Probing sentiment-oriented pretraining inspired by human sentiment perception mechanism
Tinglei Feng, Jiaxuan Liu, and Jufeng Yang · 2023
Cited alongside, same era.
Build with gemini, 2023
Google · 2023
Cited alongside, same era.
Explainable and generalizable blind image quality assessment via semantic attribute reasoning
Yipo Huang, Leida Li, Yuzhe Yang, Yaqian Li, and Yandong Guo · 2023
Cited alongside, same era.
Introducing idefics: An open reproduction of state-of-the-art visual language model, 2023
Huggingface · 2023
Cited alongside, same era.
Impressions: Understanding visual semiotics and aesthetic impact
Julia Kruk, Caleb Ziems, and Diyi Yang · 2023
Cited alongside, same era.
LISA: Reasoning segmentation via large language model
Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, and Jiaya Jia · 2023
Cited alongside, same era.
Otter: A multi-modal model with in-context instruction tuning
Bo Li, Yuanhan Zhang, Liangyu Chen, Jinghao Wang, Jingkang Yang, and Ziwei Liu · 2023
Cited alongside, same era.
AGIQA-3K: An open database for ai-generated image quality assessment
Chunyi Li, Zicheng Zhang, Haoning Wu, Wei Sun, Xiongkuo Min, Xiaohong Liu, Guangtao Zhai, and Weisi Lin · 2023
Cited alongside, same era.
Haoning Wu, Zicheng Zhang, Erli Zhang, Chaofeng Chen, Liang Liao, Annan Wang, Kaixin Xu, Chunyi Li, Jingwen Hou, Guangtao Zhai, Geng Xue, Wenxiu Sun, Qiong Yan, and Weisi Lin · 2023
Later among the works it cites.
Q-align: Teaching lmms for visual scoring via discrete text-defined levels
Haoning Wu, Zicheng Zhang, Weixia Zhang, Chaofeng Chen, Liang Liao, Chunyi Li, Yixuan Gao, Annan Wang, Erli Zhang, Wenxiu Sun, Qiong Yan, Xiongkuo Min, Guangtao Zhai, and Weisi Lin · 2023
Later among the works it cites.
The dawn of lmms: Preliminary explorations with gpt-4v(ision)
Zhengyuan Yang, Linjie Li, Kevin Lin, Jianfeng Wang, Chung-Ching Lin, Zicheng Liu, and Lijuan Wang · 2023
Later among the works it cites.
mPLUG-Owl2: Revolutionizing multi-modal large language model with modality collaboration
Qinghao Ye, Haiyang Xu, Jiabo Ye, Ming Yan, Anwen Hu, Haowei Liu, Qi Qian, Ji Zhang, Fei Huang, and Jingren Zhou · 2023
Later among the works it cites.
Towards artistic image aesthetics assessment: a large-scale dataset and a new method
Ran Yi, Haoyuan Tian, Zhihao Gu, Yu-Kun Lai, and Paul L. Rosin · 2023
Later among the works it cites.
TinyGPT-V: Efficient multimodal large language model via small backbones
Zhengqing Yuan, Zhaoxu Li, and Lichao Sun · 2023
Later among the works it cites.
A perceptual quality assessment exploration for aigc images
Zicheng Zhang, Chunyi Li, Wei Sun, Xiaohong Liu, Xiongkuo Min, and Guangtao Zhai · 2023
Later among the works it cites.
Q-boost: On visual quality assessment ability of low-level multi-modality foundation models
Zicheng Zhang, Haoning Wu, Zhongpeng Ji, Chunyi Li, Erli Zhang, Wei Sun, Xiaohong Liu, Xiongkuo Min, Fengyu Sun, Shangling Jui, Weisi Lin, and Guangtao Zhai · 2023
Later among the works it cites.
Judging llm-as-a-judge with mt-bench and chatbot arena
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica · 2023
Later among the works it cites.
Aesthetically relevant image captioning
Zhipeng Zhong, Fei Zhou, and Guoping Qiu · 2023
Later among the works it cites.
MiniGPT-4: Enhancing vision-language understanding with advanced large language models
Deyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li, and Mohamed Elhoseiny · 2023
Later among the works it cites.
Q-Bench: A benchmark for general-purpose foundation models on low-level vision
Haoning Wu, Zicheng Zhang, Erli Zhang, Chaofeng Chen, Liang Liao, Annan Wang, Chunyi Li, Wenxiu Sun, Qiong Yan, Guangtao Zhai, and Weisi Lin · 2024
Closest in time.