Analyzing Modality Robustness in Multimodal Sentiment Analysis

Adversarial robustness may be at odds with simplicity

Original

Preetum Nakkiran. 2019 · 1901

Earlier work this paper cites.

Virtual adversarial training: a regularization method for supervised and semi-supervised learning

Takeru Miyato, Shin-ichi Maeda, Masanori Koyama, and Shin Ishii. 2018 · 1993

Earlier work this paper cites.

Multimodal sentiment intensity analysis in videos: Facial gestures and verbal messages

Amir Zadeh, Rowan Zellers, Eli Pincus, and Louis-Philippe Morency. 2016 · 2016

Earlier work this paper cites.

Multimodal language analysis in the wild: CMU-MOSEI dataset and interpretable dynamic fusion graph

AmirAli Bagher Zadeh, Paul Pu Liang, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency. 2018 · 2018

Earlier work this paper cites.

Is robustness the cost of accuracy? - A comprehensive study on the robustness of 18 deep image classification models

Dong Su, Huan Zhang, Hongge Chen, Jinfeng Yi, Pin-Yu Chen, and Yupeng Gao. 2018 · 2018

Earlier work this paper cites.

Learning factorized multimodal representations

Yao-Hung Hubert Tsai, Paul Pu Liang, Amir Zadeh, Louis-Philippe Morency, and Ruslan Salakhutdinov. 2018 · 2018

Earlier work this paper cites.

BERT: pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Earlier work this paper cites.

Multimodal transformer for unaligned multimodal language sequences

Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, J. Zico Kolter, Louis-Philippe Morency, and Ruslan Salakhutdinov. 2019 · 2019

Cited alongside, same era.

Robustness may be at odds with accuracy

Dimitris Tsipras, Shibani Santurkar, Logan Engstrom, Alexander Turner, and Aleksander Madry. 2019 · 2019

Cited alongside, same era.

Removing bias in multi-modal classifiers: Regularization by maximizing functional entropies

Itai Gat, Idan Schwartz, Alexander G. Schwing, and Tamir Hazan. 2020 · 2020

Cited alongside, same era.

MISA: modality-invariant and -specific representations for multimodal sentiment analysis

Devamanyu Hazarika, Roger Zimmermann, and Soujanya Poria. 2020 · 2020

Cited alongside, same era.

Vision-and-language or vision-for-language? on cross-modal influence in multimodal transformers

Stella Frank, Emanuele Bugliarello, and Desmond Elliott. 2021 · 2021

Cited alongside, same era.

Improving multimodal fusion with hierarchical mutual information maximization for multimodal sentiment analysis

Wei Han, Hui Chen, and Soujanya Poria. 2021b · 2021

Later among the works it cites.

Smil: Multimodal learning with severely missing modality

Mengmeng Ma, Jian Ren, Long Zhao, Sergey Tulyakov, Cathy Wu, and Xi Peng. 2021 · 2021

Later among the works it cites.

A text-centered shared-private framework via cross-modal prediction for multimodal sentiment analysis

Yang Wu, Zijie Lin, Yanyan Zhao, Bing Qin, and Li-Nan Zhu. 2021 · 2021

Later among the works it cites.

Learning modality-specific representations with self-supervised multi-task learning for multimodal sentiment analysis

Wenmeng Yu, Hua Xu, Ziqi Yuan, and Jiele Wu. 2021 · 2021

Later among the works it cites.

Which is making the contribution: Modulating unimodal and cross-modal dynamics for multimodal sentiment analysis

Ying Zeng, Sijie Mai, and Haifeng Hu. 2021 · 2021

Later among the works it cites.