Explore the Hallucination on Low-level Perception for MLLMs

N. Murray, L. Marchesotti, and F. Perronnin, “Ava: A large-scale database for aesthetic visual analysis,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE, 2012, pp. 2408–2415

2012

Earlier work this paper cites.

S. Kong, X. Shen, Z. Lin, R. Mech, and C. Fowlkes, “Photo aesthetics ranking network with attributes and content adaptation,” in Proceedings of the European Conference on Computer Vision (ECCV) . Springer, 2016, pp. 662–679

2016

Earlier work this paper cites.

R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang, “The unreasonable effectiveness of deep features as a perceptual metric,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2018, pp. 586–595

2018

Earlier work this paper cites.

V. Hosu, H. Lin, T. Sziranyi, and D. Saupe, “Koniq-10k: An ecologically valid database for deep learning of blind image quality assessment,” IEEE Transactions on Image Processing (TIP) , vol. 29, pp. 4041–4056, 2020

2020

Earlier work this paper cites.

Y. Fang, H. Zhu, Y. Zeng, K. Ma, and Z. Wang, “Perceptual quality assessment of smartphone photography,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2020, pp. 3677–3686

2020

Earlier work this paper cites.

S. Su, V. Hosu, H. Lin, Y. Zhang, and D. Saupe, “Koniq++: Boosting no-reference image quality assessment in the wild by jointly predicting image quality and defects,” in The 32nd British Machine Vision Conference , 2021

2021

Earlier work this paper cites.

H. Touvron, T. Lavril, G. Izacard, X. Martinet, M.-A. Lachaux, T. Lacroix, B. Rozière, N. Goyal, E. Hambro, F. Azhar et al. , “Llama: Open and efficient foundation language models,” arXiv preprint arXiv:2302.13971 , 2023

Original

2023

Earlier work this paper cites.

M. N. Team et al. , “Introducing mpt-7b: A new standard for open-source, commercially usable llms,” 2023

2023

Earlier work this paper cites.

W. Dai, J. Li, D. Li, A. M. H. Tiong, J. Zhao, W. Wang, B. Li, P. Fung, and S. Hoi, “Instructblip: Towards general-purpose vision-language models with instruction tuning,” 2023

2023

Earlier work this paper cites.

B. Li, P. Qi, B. Liu, S. Di, J. Liu, J. Pei, J. Yi, and B. Zhou, “Trustworthy ai: From principles to practices,” ACM Computing Surveys , vol. 55, no. 9, pp. 1–46, 2023

2023

Earlier work this paper cites.

F. Liu, K. Lin, L. Li, J. Wang, Y. Yacoob, and L. Wang, “Mitigating hallucination in large multi-modal models via robust instruction tuning,” in The Twelfth International Conference on Learning Representations , 2023

2023

Earlier work this paper cites.

Y. Li, L. Wang, B. Hu, X. Chen, W. Zhong, C. Lyu, and M. Zhang, “A comprehensive evaluation of gpt-4v on knowledge-intensive visual question answering,” arXiv preprint arXiv:2311.07536 , 2023

Original

2023

Cited alongside, same era.

H. Wu, E. Zhang, L. Liao, C. Chen, J. Hou, A. Wang, W. Sun, Q. Yan, and W. Lin, “Towards explainable in-the-wild video quality assessment: a database and a language-prompted approach,” in Proceedings of the 31st ACM International Conference on Multimedia (ACM MM) , 2023, pp. 1045–1054

2023

Cited alongside, same era.

C. Li, Z. Zhang, H. Wu, W. Sun, X. Min, X. Liu, G. Zhai, and W. Lin, “Agiqa-3k: An open database for ai-generated image quality assessment,” IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) , 2023

2023

Cited alongside, same era.

H. Wu, E. Zhang, L. Liao, C. Chen, J. Hou, A. Wang, W. Sun, Q. Yan, and W. Lin, “Exploring video quality assessment on user generated contents from aesthetic and technical perspectives,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2023, pp. 20 144–20 154

J. Lu, J. Rao, K. Chen, X. Guo, Y. Zhang, B. Sun, C. Yang, and J. Yang, “Evaluation and mitigation of agnosia in multimodal large language models,” arXiv preprint arXiv:2309.04041 , 2023

Original

2023

Later among the works it cites.

H. Liu, C. Li, Q. Wu, and Y. J. Lee, “Visual instruction tuning,” Advances in neural information processing systems , vol. 36, 2024

2024

Closest in time.

Y. Wang, Y. Liao, H. Liu, H. Liu, Y. Wang, and Y. Wang, “Mm-sap: A comprehensive benchmark for assessing self-awareness of multimodal large language models in perception,” arXiv preprint arXiv:2401.07529 , 2024

Original

2024

Closest in time.

J. Xu, X. Liu, Y. Wu, Y. Tong, Q. Li, M. Ding, J. Tang, and Y. Dong, “Imagereward: Learning and evaluating human preferences for text-to-image generation,” Advances in Neural Information Processing Systems , vol. 36, 2024

2024

Closest in time.