Fetching the paper…
Reading the bibliography…
Recent research has offered insights into the extraordinary capabilities of Large Multimodal Models (LMMs) in various general vision and language tasks.
Framing: Toward clarification of a fractured paradigm
Robert M Entman · 1993
Earlier work this paper cites.
Predicting the political alignment of twitter users
Michael D Conover, Bruno Gonçalves, Jacob Ratkiewicz, Alessandro Flammini, and Filippo Menczer · 2011
Earlier work this paper cites.
Social multimedia: highlighting opportunities for search and mining of multimedia data in social media applications
Mor Naaman · 2012
Earlier work this paper cites.
Multimodal sentiment analysis of spanish online videos
Verónica Pérez Rosas, Rada Mihalcea, and Louis-Philippe Morency · 2013
Earlier work this paper cites.
Tracking the development of media frames within and across policy issues
Amber E Boydstun, Dallas Card, Justin H Gross, Philip Resnik, and Noah A Smith · 2014
Earlier work this paper cites.
Visual persuasion: Inferring communicative intents of images
Jungseock Joo, Weixin Li, Francis F Steen, and Song-Chun Zhu · 2014
Earlier work this paper cites.
Sentiment analysis algorithms and applications: A survey
Walaa Medhat, Ahmed Hassan, and Hoda Korashy · 2014
Earlier work this paper cites.
Computational analysis of persuasiveness in social multimedia: A novel dataset and multimodal prediction approach
Sunghyun Park, Han Suk Shim, Moitreya Chatterjee, Kenji Sagae, and Louis-Philippe Morency · 2014
Earlier work this paper cites.
The eyes of the beholder: Gender prediction using images posted in online social networks
Quanzeng You, Sumit Bhatia, Tong Sun, and Jiebo Luo · 2014
Earlier work this paper cites.
A clearer picture: The contribution of visuals and text to framing effects
Thomas E Powell, Hajo G Boomgaarden, Knut De Swert, and Claes H De Vreese · 2015
Earlier work this paper cites.
Robust image sentiment analysis using progressively trained and domain transferred deep networks
Quanzeng You, Jiebo Luo, Hailin Jin, and Jianchao Yang · 2015
Earlier work this paper cites.
A picture tells a thousand words - about you! user interest profiling from user generated visual content
Quanzeng You, Sumit Bhatia, and Jiebo Luo · 2016
Earlier work this paper cites.
Robust visual-textual sentiment analysis: When attention meets tree-structured recursive neural networks
Quanzeng You, Liangliang Cao, Hailin Jin, and Jiebo Luo · 2016
Earlier work this paper cites.
Building a large scale dataset for image emotion recognition: The fine print and the benchmark
Quanzeng You, Jiebo Luo, Hailin Jin, and Jianchao Yang · 2016
Earlier work this paper cites.
Cross-modality consistent regression for joint visual-textual sentiment analysis of social multimedia
Quanzeng You, Jiebo Luo, Hailin Jin, and Jianchao Yang · 2016
Earlier work this paper cites.
Opinion-aware knowledge graph for political ideology detection
Wei Chen, Xiao Zhang, Tengjiao Wang, Bishan Yang, and Yi Li · 2017
Earlier work this paper cites.
Multimodal fusion with recurrent neural networks for rumor detection on microblogs
Zhiwei Jin, Juan Cao, Han Guo, Yongdong Zhang, and Jiebo Luo · 2017
Earlier work this paper cites.
Detection and analysis of 2016 US presidential election related rumors on twitter
Zhiwei Jin, Juan Cao, Han Guo, Yongdong Zhang, Yu Wang, and Jiebo Luo · 2017
Earlier work this paper cites.
Automatic sarcasm detection: A survey
Aditya Joshi, Pushpak Bhattacharyya, and Mark J Carman · 2017
Earlier work this paper cites.
Detecting the hate code on social media
Rijul Magu, Kshitij Joshi, and Jiebo Luo · 2017
Earlier work this paper cites.
Beyond binary labels: political ideology prediction of twitter users
Daniel Preoţiuc-Pietro, Ye Liu, Daniel Hopkins, and Lyle Ungar · 2017
Earlier work this paper cites.
A survey of multimodal sentiment analysis
Mohammad Soleymani, David Garcia, Brendan Jou, Björn Schuller, Shih-Fu Chang, and Maja Pantic · 2017
Earlier work this paper cites.
How polarized have we become? a multimodal classification of trump followers and clinton followers
Yu Wang, Yang Feng, Zhe Hong, Ryan Berger, and Jiebo Luo · 2017
Earlier work this paper cites.
Multisentinet: A deep semantic network for multimodal sentiment analysis
Nan Xu and Wenji Mao · 2017
Earlier work this paper cites.
Visual sentiment analysis by attending on local image regions
Quanzeng You, Hailin Jin, and Jiebo Luo · 2017
Earlier work this paper cites.
Tensor fusion network for multimodal sentiment analysis
Amir Zadeh, Minghai Chen, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency · 2017
Earlier work this paper cites.
Multilingual multi-class sentiment classification using convolutional neural networks
Mohammed Attia, Younes Samih, Ali Elkahky, and Laura Kallmeyer · 2018
Earlier work this paper cites.
Multimodal machine learning: A survey and taxonomy
Tadas Baltrušaitis, Chaitanya Ahuja, and Louis-Philippe Morency · 2018
Earlier work this paper cites.
"factual" or "emotional": Stylized image captioning with adaptive learning and attention
Tianlang Chen, Zhongping Zhang, Quanzeng You, Chen Fang, Zhaowen Wang, Hailin Jin, and Jiebo Luo · 2018
Earlier work this paper cites.
Cross-modality microblog sentiment prediction via bi-layer multimodal hypergraph learning
Rongrong Ji, Fuhai Chen, Liujuan Cao, and Yue Gao · 2018
Earlier work this paper cites.
Determining code words in euphemistic hate speech using word embedding networks
Rijul Magu and Jiebo Luo · 2018
Earlier work this paper cites.
Overview of the 6th author profiling task at pan 2018: multimodal gender identification in twitter
Francisco Rangel, Paolo Rosso, Manuel Montes-y Gómez, Martin Potthast, and Benno Stein · 2018
Earlier work this paper cites.
De-mixing sentiment from code-mixed text
Yash Kumar Lal, Vaibhav Kumar, Mrinal Dhar, Manish Shrivastava, and Philipp Koehn · 2019
Earlier work this paper cites.
A survey on sentiment analysis and opinion mining for social multimedia
Zuhe Li, Yangyu Fan, Bin Jiang, Tao Lei, and Weihua Liu · 2019
Earlier work this paper cites.
r/fakeddit: A new multimodal benchmark dataset for fine-grained fake news detection
Kai Nakamura, Sharon Levy, and William Yang Wang · 2019
Earlier work this paper cites.
On the origin, proliferation and tone of fake news
Shivam B Parikh, Vikram Patil, and Pradeep K Atrey · 2019
Cited alongside, same era.
Demographic inference and representative population estimates from multilingual social media data
Zijian Wang, Scott Hale, David Ifeoluwa Adelani, Przemyslaw Grabowicz, Timo Hartman, Fabian Flöck, and David Jurgens · 2019
Cited alongside, same era.
A survey of sentiment analysis in social media
Lin Yue, Weitong Chen, Xue Li, Wanli Zuo, and Minghao Yin · 2019
Cited alongside, same era.
Detecting hate speech in multi-modal memes
Abhishek Das, Japsimar Singh Wahi, and Siyao Li · 2020
Cited alongside, same era.
Exploring hate speech detection in multimodal publications
Raul Gomez, Jaume Gibert, Lluis Gomez, and Dimosthenis Karatzas · 2020
Cited alongside, same era.
Yunkang Cao, Xiaohao Xu, Chen Sun, Xiaonan Huang, and Weiming Shen · 2023
Closest in time.
A literature survey on multimodal and multilingual automatic hate speech identification
Anusha Chhabra and Dinesh Kumar Vishwakarma · 2023
Closest in time.
Multimodal fake news detection on social media: a survey of deep learning techniques
Carmela Comito, Luciano Caroprese, and Ester Zumpano · 2023
Closest in time.
Holistic analysis of hallucination in gpt-4v (ision): Bias and interference challenges
Chenhang Cui, Yiyang Zhou, Xinyu Yang, Shirley Wu, Linjun Zhang, James Zou, and Huaxiu Yao · 2023
Closest in time.
Instructblip: Towards general-purpose vision-language models with instruction tuning, 2023
Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, and Steven Hoi · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Yingmei Guo, Jinfa Huang, Yanlong Dong, and Mingxing Xu · 2020
Cited alongside, same era.
The hateful memes challenge: Detecting hate speech in multimodal memes
Douwe Kiela, Hamed Firooz, Aravind Mohan, Vedanuj Goswami, Amanpreet Singh, Pratik Ringshia, and Davide Testuggine · 2020
Cited alongside, same era.
Fake news, rumor, information pollution in social media and web: A contemporary survey of state-of-the-arts, challenges and opportunities
Priyanka Meel and Dinesh Kumar Vishwakarma · 2020
Cited alongside, same era.
Fakenewsnet: A data repository with news content, social context, and spatiotemporal information for studying fake news on social media
Kai Shu, Deepak Mahudeswaran, Suhang Wang, Dongwon Lee, and Huan Liu · 2020
Cited alongside, same era.
Detecting cross-modal inconsistency to defend against neural fake news
Reuben Tan, Bryan A Plummer, and Kate Saenko · 2020
Cited alongside, same era.
Timme: Twitter ideology-detection via multi-task multi-relational embedding
Zhiping Xiao, Weiping Song, Haoyan Xu, Zhicheng Ren, and Yizhou Sun · 2020
Cited alongside, same era.
Multimodal mental health analysis in social media
Amir Hossein Yazdavar, Mohammad Saeid Mahdavinejad, Goonmeet Bajaj, William Romine, Amit Sheth, Amir Hassan Monadjemi, Krishnaprasad Thirunarayan, John M Meddar, Annie Myers, Jyotishman Pathak, et al · 2020
Cited alongside, same era.
Closest in time.
Understanding and detecting hateful content using contrastive learning
Felipe González-Pizarro and Savvas Zannettou · 2023
Closest in time.
Language is not all you need: Aligning perception with language models
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Qiang Liu, et al · 2023
Closest in time.
Dismantling hate: Understanding hate speech trends against NBA athletes
Edinam Kofi Klutse, Samuel Nuamah-Amoabeng, Hanjia Lyu, and Jiebo Luo · 2023
Closest in time.
Weakly-supervised 3d spatial reasoning for text-based visual question answering
Hao Li, Jinfa Huang, Peng Jin, Guoli Song, Qi Wu, and Jie Chen · 2023
Closest in time.
Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi · 2023
Closest in time.
A comprehensive study of gpt-4v’s multimodal capabilities in medical imaging
Yingshu Li, Yunyi Liu, Zhanyu Wang, Xinyu Liang, Lingqiao Liu, Lei Wang, Leyang Cui, Zhaopeng Tu, Longyue Wang, and Luping Zhou · 2023
Closest in time.
Mm-vid: Advancing video understanding with gpt-4v (ision)
Kevin Lin, Faisal Ahmed, Linjie Li, Chung-Ching Lin, Ehsan Azarnasab, Zhengyuan Yang, Jianfeng Wang, Lin Liang, Zicheng Liu, Yumao Lu, et al · 2023
Closest in time.
Fuxiao Liu, Tianrui Guan, Zongxia Li, Lichang Chen, Yaser Yacoob, Dinesh Manocha, and Tianyi Zhou · 2023
Closest in time.
Mathvista: Evaluating mathematical reasoning of foundation models in visual contexts
Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chunyuan Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, and Jianfeng Gao · 2023
Closest in time.
Human behavior in the time of covid-19: Learning from big data
Hanjia Lyu, Arsal Imtiaz, Yufei Zhao, and Jiebo Luo · 2023
Closest in time.
Llm-rec: Personalized recommendation via prompting large language models
Hanjia Lyu, Song Jiang, Hanqing Zeng, Yinglong Xia, and Jiebo Luo · 2023
Closest in time.
Computational assessment of hyperpartisanship in news titles
Hanjia Lyu, Jinsheng Pan, Zichen Wang, and Jiebo Luo · 2023
Closest in time.
Uppam: A unified pre-training architecture for political actor modeling based on language
Xinyi Mou, Zhongyu Wei, Qi Zhang, and Xuan-Jing Huang · 2023
Closest in time.
Gpt-4 technical report, 2023
OpenAI · 2023
Closest in time.
Bias or diversity? unraveling semantic discrepancy in us news headlines
Jinsheng Pan, Weihong Qi, Zichen Wang, Hanjia Lyu, and Jiebo Luo · 2023
Closest in time.
Understanding divergent framing of the supreme court controversies: Social media vs. news outlets
Jinsheng Pan, Zichen Wang, Weihong Qi, Hanjia Lyu, and Jiebo Luo · 2023
Closest in time.
Exploring ocr capabilities of gpt-4v (ision): A quantitative and in-depth evaluation
Yongxin Shi, Dezhi Peng, Wenhui Liao, Zening Lin, Xinhong Chen, Chongyu Liu, Yuyi Zhang, and Lianwen Jin · 2023
Closest in time.
Chatgpt-4 outperforms experts and crowd workers in annotating political twitter messages with zero-shot learning, 2023
Petter Törnberg · 2023
Closest in time.
Chaoyi Wu, Jiayu Lei, Qiaoyu Zheng, Weike Zhao, Weixiong Lin, Xiaoman Zhang, Xiao Zhou, Ziheng Zhao, Ya Zhang, Yanfeng Wang, et al · 2023
Closest in time.
Large language models can be used to estimate the latent positions of politicians, 2023
Patrick Y. Wu, Jonathan Nagler, Joshua A. Tucker, and Solomon Messing · 2023
Closest in time.
An early evaluation of gpt-4v (ision)
Yang Wu, Shilong Wang, Hao Yang, Tian Zheng, Hongbo Zhang, Yanyan Zhao, and Bing Qin · 2023
Closest in time.
Detecting political biases of named entities and hashtags on twitter
Zhiping Xiao, Jeffrey Zhu, Yining Wang, Pei Zhou, Wen Hong Lam, Mason A Porter, and Yizhou Sun · 2023
Closest in time.
The dawn of lmms: Preliminary explorations with gpt-4v (ision)
Zhengyuan Yang, Linjie Li, Kevin Lin, Jianfeng Wang, Chung-Ching Lin, Zicheng Liu, and Lijuan Wang · 2023
Closest in time.
Performance of multimodal gpt-4v on usmle with image: Potential for imaging diagnostic support with explanations
Zhichao Yang, Zonghai Yao, Mahbuba Tasmin, Parth Vashisht, Won Seok Jang, Beining Wang, Dan Berlowitz, and Hong Yu · 2023
Closest in time.
Xiang Zhang, Senyu Li, Zijun Wu, and Ning Shi · 2023
Closest in time.
Gpt-4v (ision) as a generalist evaluator for vision-language tasks
Xinlu Zhang, Yujie Lu, Weizhi Wang, An Yan, Jun Yan, Lianke Qin, Heng Wang, Xifeng Yan, William Yang Wang, and Linda Ruth Petzold · 2023
Closest in time.
Mmicl: Empowering vision-language model with multi-modal in-context learning
Haozhe Zhao, Zefan Cai, Shuzheng Si, Xiaojian Ma, Kaikai An, Liang Chen, Zixuan Liu, Sheng Wang, Wenjuan Han, and Baobao Chang · 2023
Closest in time.
Exploring recommendation capabilities of gpt-4v (ision): A preliminary case study
Peilin Zhou, Meng Cao, You-Liang Huang, Qichen Ye, Peiyan Zhang, Junling Liu, Yueqi Xie, Yining Hua, and Jaeboum Kim · 2023
Closest in time.
Multimodal sentiment analysis based on fusion methods: A survey
Linan Zhu, Zhechao Zhu, Chenwei Zhang, Yifei Xu, and Xiangjie Kong · 2023
Closest in time.