Continuous Emotion Recognition using Visual-audio-linguistic information: A Technical Report for ABAW3

S. Zafeiriou, D. Kollias, M. A. Nicolaou, A. Papaioannou, G. Zhao, and I. Kotsia, “Aff-wild: Valence and arousal ‘in-the-wild’challenge,” in Computer Vision and Pattern Recognition Workshops (CVPRW), 2017 IEEE Conference on . IEEE, 2017, pp. 1980–1987

1987

Earlier work this paper cites.

R. Cowie, E. Douglas-Cowie, S. Savvidou*, E. McMahon, M. Sawey, and M. Schröder, “’feeltrace’: An instrument for recording perceived emotion in real time,” in ISCA tutorial and research workshop (ITRW) on speech and emotion , 2000

2000

Earlier work this paper cites.

G. Sandbach, S. Zafeiriou, M. Pantic, and L. Yin, “Static and dynamic 3d facial expression recognition: A comprehensive survey,” Image and Vision Computing , vol. 30, no. 10, pp. 683–697, 2012

2012

Earlier work this paper cites.

B. W. Schuller, Intelligent audio analysis . Springer, 2013

2013

Earlier work this paper cites.

E. Barsoum, C. Zhang, C. C. Ferrer, and Z. Zhang, “Training deep networks for facial expression recognition with crowd-sourced label distribution,” in Proceedings of the 18th ACM International Conference on Multimodal Interaction , 2016, pp. 279–283

2016

Earlier work this paper cites.

M. Valstar, J. Gratch, B. Schuller, F. Ringeval, D. Lalanne, M. Torres Torres, S. Scherer, G. Stratou, R. Cowie, and M. Pantic, “Avec 2016: Depression, mood, and emotion recognition workshop and challenge,” in Proceedings of the 6th international workshop on audio/visual emotion challenge , 2016, pp. 3–10

2016

Earlier work this paper cites.

S. Hershey, S. Chaudhuri, D. P. Ellis, J. F. Gemmeke, A. Jansen, R. C. Moore, M. Plakal, D. Platt, R. A. Saurous, B. Seybold et al. , “Cnn architectures for large-scale audio classification,” in 2017 ieee international conference on acoustics, speech and signal processing (icassp) . IEEE, 2017, pp. 131–135

2017

Earlier work this paper cites.

F. Ringeval, B. Schuller, M. Valstar, J. Gratch, R. Cowie, S. Scherer, S. Mozgai, N. Cummins, M. Schmitt, and M. Pantic, “Avec 2017: Real-life depression, and affect recognition workshop and challenge,” in Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge , 2017, pp. 3–9

2017

Earlier work this paper cites.

S. Bai, J. Z. Kolter, and V. Koltun, “An empirical evaluation of generic convolutional and recurrent networks for sequence modeling,” arXiv preprint arXiv:1803.01271 , 2018

Original

2018

Earlier work this paper cites.

F. Ringeval, B. Schuller, M. Valstar, R. Cowie, H. Kaya, M. Schmitt, S. Amiriparian, N. Cummins, D. Lalanne, A. Michaud et al. , “Avec 2018 workshop and challenge: Bipolar disorder and cross-cultural affect recognition,” in Proceedings of the 2018 on audio/visual emotion challenge and workshop , 2018, pp. 3–13

2018

Cited alongside, same era.

——, “Expression, affect, action unit recognition: Aff-wild2, multi-task learning and arcface,” arXiv preprint arXiv:1910.04855 , 2019

Original

2019

Cited alongside, same era.

D. Kollias, V. Sharmanska, and S. Zafeiriou, “Face behavior a la carte: Expressions, affect and action units in a single network,” arXiv preprint arXiv:1910.11111 , 2019

Original

2019

Cited alongside, same era.

D. Kollias, P. Tzirakis, M. A. Nicolaou, A. Papaioannou, G. Zhao, B. Schuller, I. Kotsia, and S. Zafeiriou, “Deep affect prediction in-the-wild: Aff-wild database and challenge, deep architectures, and beyond,” International Journal of Computer Vision , pp. 1–23, 2019

D. Kollias, V. Sharmanska, and S. Zafeiriou, “Distribution matching for heterogeneous multi-task learning: a large-scale face study,” arXiv preprint arXiv:2105.03790 , 2021

Original

2021

Later among the works it cites.

D. Kollias and S. Zafeiriou, “Affect analysis in-the-wild: Valence-arousal, expressions, action units and a unified framework,” arXiv preprint arXiv:2103.15792 , 2021

Original

2021

Later among the works it cites.

S. Zhang, Y. Ding, Z. Wei, and C. Guan, “Continuous emotion recognition with audio-visual leader-follower attentive fusion,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2021, pp. 3567–3574

2021

Later among the works it cites.

L. Stappen, L. Schumann, B. Sertolli, A. Baird, B. Weigell, E. Cambria, and B. W. Schuller, “Muse-toolbox: The multimodal sentiment analysis continuous annotation fusion and discrete class transformation toolbox,” in Proceedings of the 2nd on Multimodal Sentiment Analysis Challenge , 2021, pp. 75–82