Leveraging Contrastive Learning and Self-Training for Multimodal Emotion Recognition with Limited Labeled Samples

Improved baselines with momentum contrastive learning

Original

Chen, X.; Fan, H.; Girshick, R.; and He, K. 2020b · 2003

Earlier work this paper cites.

Openface: an open source facial behavior analysis toolkit

Baltrušaitis, T.; Robinson, P.; and Morency, L.-P. 2016 · 2016

Earlier work this paper cites.

Representation learning with contrastive predictive coding

Original

Oord, A. v. d.; Li, Y.; and Vinyals, O. 2018 · 2018

Earlier work this paper cites.

Attending to Emotional Narratives

Wu, Z.; Zhang, X.; Zhi-Xuan, T.; Zaki, J.; and Ong, D. C. 2019 · 2019

Earlier work this paper cites.

Denoising diffusion probabilistic models

Ho, J.; Jain, A.; and Abbeel, P. 2020 · 2020

Earlier work this paper cites.

Multimodal sentimental analysis for social media applications: A comprehensive review

Chandrasekaran, G.; Nguyen, T. N.; and Hemanth D, J. 2021 · 2021

Earlier work this paper cites.

Hubert: Self-supervised speech representation learning by masked prediction of hidden units

Hsu, W.-N.; Bolte, B.; Tsai, Y.-H. H.; Lakhotia, K.; Salakhutdinov, R.; and Mohamed, A. 2021 · 2021

Earlier work this paper cites.

[Retracted] Multimodal Emotion Recognition Model Based on a Deep Neural Network with Multiobjective Optimization

Li, M.; Qiu, X.; Peng, S.; Tang, L.; Li, Q.; Yang, W.; and Ma, Y. 2021 · 2021

Earlier work this paper cites.

CTNet: Conversational transformer network for emotion recognition

Lian, Z.; Liu, B.; and Tao, J. 2021 · 2021

Earlier work this paper cites.

Learning transferable visual models from natural language supervision

Radford, A.; Kim, J. W.; Hallacy, C.; Ramesh, A.; Goh, G.; Agarwal, S.; Sastry, G.; Askell, A.; Mishkin, P.; Clark, J.; et al. 2021 · 2021

Cited alongside, same era.

Wenet: Production oriented streaming and non-streaming end-to-end speech recognition toolkit

Original

Yao, Z.; Wu, D.; Wang, X.; Zhang, B.; Yu, F.; Yang, C.; Peng, Z.; Chen, X.; Xie, L.; and Lei, X. 2021 · 2021

Cited alongside, same era.

Former-dfer: Dynamic facial expression recognition transformer

Zhao, Z.; and Liu, Q. 2021 · 2021

Cited alongside, same era.

Analyzing modality robustness in multimodal sentiment analysis

Original

Hazarika, D.; Li, Y.; Cheng, B.; Zhao, S.; Zimmermann, R.; and Poria, S. 2022 · 2022

Cited alongside, same era.

Everything at once-multi-modal fusion transformer for video retrieval

Shvetsova, N.; Chen, B.; Rouditchenko, A.; Thomas, S.; Kingsbury, B.; Feris, R. S.; Harwath, D.; Glass, J.; and Kuehne, H. 2022 · 2022

Mer 2023: Multi-label learning, modality robustness, and semi-supervised learning

Lian, Z.; Sun, H.; Sun, L.; Chen, K.; Xu, M.; Wang, K.; Xu, K.; He, Y.; Li, Y.; Zhao, J.; et al. 2023 · 2023

Later among the works it cites.

Emotion recognition framework using multiple modalities for an effective human–computer interaction

Moin, A.; Aadil, F.; Ali, Z.; and Kang, D. 2023 · 2023

Later among the works it cites.

ZeroPrompt: Streaming Acoustic Encoders are Zero-Shot Masked LMs

Song, X.; Wu, D.; Zhang, B.; Peng, Z.; Dang, B.; Pan, F.; and Wu, Z. 2023 · 2023

Later among the works it cites.

Self-Training with Label-Feature-Consistency for Domain Adaptation

Xin, Y.; Luo, S.; Jin, P.; Du, Y.; and Wang, C. 2023 · 2023

Later among the works it cites.

Exploiting modality-invariant feature for robust multimodal emotion recognition with missing modalities

Zuo, H.; Liu, R.; Zhao, J.; Gao, G.; and Li, H. 2023 · 2023

Later among the works it cites.