2020

BiERU: Bidirectional Emotional Recurrent Unit for Conversational Sentiment Analysis

Li, Wei, Shao, Wei, Ji, Shaoxiong et al.

Understand

Sentiment analysis in conversations has gained increasing attention in recent years for the growing amount of applications it can serve, e.g., sentiment analysis, recommender systems, and human-robot interaction.

The main difference between conversational sentiment analysis and single sentence sentiment analysis is the existence of context information which may influence the sentiment of an utterance in a dialogue.
How to effectively encode contextual information in dialogues, however, remains a challenge.
Existing approaches employ complicated deep learning structures to distinguish different parties in a conversation and then model the context information.

Built on

S. Wold, K. Esbensen, and P. Geladi, “Principal component analysis,” Chemometrics and intelligent laboratory systems , vol. 2, no. 1-3, pp. 37–52, 1987
1987
Earlier work this paper cites.
B. Partee, “Lexical semantics and compositionality,” An invitation to cognitive science: Language , vol. 1, pp. 311–360, 1995
1995
Earlier work this paper cites.
S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural computation , vol. 9, no. 8, pp. 1735–1780, 1997
1997
Earlier work this paper cites.
M. Schuster and K. K. Paliwal, “Bidirectional recurrent neural networks,” IEEE transactions on Signal Processing , vol. 45, no. 11, pp. 2673–2681, 1997
1997
Earlier work this paper cites.
A. Graves and J. Schmidhuber, “Framewise phoneme classification with bidirectional lstm and other neural network architectures,” Neural networks , vol. 18, no. 5-6, pp. 602–610, 2005
2005
Earlier work this paper cites.
C. Busso, M. Bulut, C.-C. Lee, A. Kazemzadeh, E. Mower, S. Kim, J. N. Chang, S. Lee, and S. S. Narayanan, “IEMOCAP: Interactive emotional dyadic motion capture database,” Language resources and evaluation , vol. 42, no. 4, p. 335, 2008
2008
Earlier work this paper cites.
J. Mitchell and M. Lapata, “Composition in distributional models of semantics,” Cognitive science , vol. 34, no. 8, pp. 1388–1429, 2010
2010
Earlier work this paper cites.
V. Nair and G. E. Hinton, “Rectified linear units improve restricted boltzmann machines,” in Proceedings of the 27th international conference on machine learning (ICML-10) , 2010, pp. 807–814
2010
Earlier work this paper cites.
G. McKeown, M. Valstar, R. Cowie, M. Pantic, and M. Schroder, “The semaine database: Annotated multimodal records of emotionally colored conversations between a person and a limited agent,” IEEE Transactions on Affective Computing , vol. 3, no. 1, pp. 5–17, 2011
2011
Earlier work this paper cites.
B. Schuller, M. Valster, F. Eyben, R. Cowie, and M. Pantic, “AVEC 2012: the continuous audio/visual emotion challenge,” in Proceedings of the 14th ACM international conference on Multimodal interaction . ACM, 2012, pp. 449–456
2012
Earlier work this paper cites.
R. Socher, D. Chen, C. D. Manning, and A. Ng, “Reasoning with neural tensor networks for knowledge base completion,” in Advances in neural information processing systems , 2013, pp. 926–934
2013
Earlier work this paper cites.
R. Socher, A. Perelygin, J. Wu, J. Chuang, C. D. Manning, A. Ng, and C. Potts, “Recursive deep models for semantic compositionality over a sentiment treebank,” in Proceedings of the 2013 conference on empirical methods in natural language processing , 2013, pp. 1631–1642
2013
Earlier work this paper cites.
Y. Kim, “Convolutional neural networks for sentence classification,” arXiv preprint arXiv:1408.5882 , 2014
Original
2014
Earlier work this paper cites.
E. Cambria, H. Wang, and B. White, “Guest editorial: Big social data analysis,” Knowledge-Based Systems , vol. 69, pp. 1–2, 2014
2014
Earlier work this paper cites.
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980 , 2014
Original
2014
Earlier work this paper cites.
K. Cho, B. van Merrienboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Bengio, “Learning phrase representations using rnn encoder–decoder for statistical machine translation,” in Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) , 2014, pp. 1724–1734
2014
Earlier work this paper cites.
N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, “Dropout: a simple way to prevent neural networks from overfitting,” The journal of machine learning research , vol. 15, no. 1, pp. 1929–1958, 2014
2014
Earlier work this paper cites.
S. Sukhbaatar, J. Weston, R. Fergus et al. , “End-to-end memory networks,” in Advances in neural information processing systems , 2015, pp. 2440–2448
2015
Earlier work this paper cites.
A. Zadeh, R. Zellers, E. Pincus, and L.-P. Morency, “Multimodal sentiment intensity analysis in videos: Facial gestures and verbal messages,” IEEE Intelligent Systems , vol. 31, no. 6, pp. 82–88, 2016
2016
Earlier work this paper cites.

Similar

R. Mihalcea and A. Garimella, “What men say, what women hear: Finding gender-specific meaning shades,” IEEE Intelligent Systems , vol. 31, no. 4, pp. 62–67, 2016
2016
Cited alongside, same era.
S. Poria, E. Cambria, D. Hazarika, N. Majumder, A. Zadeh, and L.-P. Morency, “Context-dependent sentiment analysis in user-generated videos,” in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2017, pp. 873–883
2017
Cited alongside, same era.
A. Weichselbraun, S. Gindl, F. Fischer, S. Vakulenko, and A. Scharl, “Aspect-based extraction and analysis of affective knowledge from social media streams,” IEEE Intelligent Systems , vol. 32, no. 3, pp. 80–88, 2017
2017
Cited alongside, same era.
A. Bandhakavi, N. Wiratunga, S. Massie, and P. Deepak, “Lexicon generation for emotion analysis from text,” IEEE Intelligent Systems , vol. 32, no. 1, pp. 102–108, 2017
2017
Cited alongside, same era.
M. Ebrahimi, A. Hossein, and A. Sheth, “Challenges of sentiment analysis for dynamic events,” IEEE Intelligent Systems , vol. 32, no. 5, pp. 70–75, 2017
2017
Cited alongside, same era.
A. Valdivia, V. Luzon, and F. Herrera, “Sentiment analysis in tripadvisor,” IEEE Intelligent Systems , vol. 32, no. 4, pp. 72–77, 2017
2017
Cited alongside, same era.
D. Hazarika, S. Poria, A. Zadeh, E. Cambria, L.-P. Morency, and R. Zimmermann, “Conversational memory network for emotion recognition in dyadic dialogue videos,” in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) , 2018, pp. 2122–2132
2018
Cited alongside, same era.
F. Xu, J. Yu, and R. Xia, “Instance-based domain adaptation via multi-clustering logistic approximation,” IEEE Intelligent Systems , vol. 33, no. 1, pp. 78–88, 2018
2018
Cited alongside, same era.
M. S. Akhtar, A. Ekbal, S. Narayan, and V. Singh, “No, that never happened!! investigating rumors on twitter,” IEEE Intelligent Systems , vol. 33, no. 5, pp. 8–15, 2018
2018
Cited alongside, same era.
D. Mahata, J. Friedrichs, R. R. Shah, and J. Jiang, “Detecting personal intake of medicine from twitter,” IEEE Intelligent Systems , vol. 33, no. 4, pp. 87–95, 2018
2018
Cited alongside, same era.
D. Hazarika, S. Poria, R. Mihalcea, E. Cambria, and R. Zimmermann, “ICON: Interactive conversational memory network for multimodal emotion detection,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing , 2018, pp. 2594–2604
2018
Cited alongside, same era.
N. Majumder, S. Poria, D. Hazarika, R. Mihalcea, A. Gelbukh, and E. Cambria, “DialogueRNN: An attentive rnn for emotion detection in conversations,” in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 33, 2019, pp. 6818–6825
2019
Cited alongside, same era.

Then

P. Zhong, D. Wang, and C. Miao, “Knowledge-enriched transformer for emotion detection in textual conversations,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , 2019, pp. 165–176
2019
Later among the works it cites.
S. Poria, D. Hazarika, N. Majumder, G. Naik, E. Cambria, and R. Mihalcea, “MELD: A multimodal multi-party dataset for emotion recognition in conversations,” in ACL , 2019, pp. 527–536
2019
Later among the works it cites.
A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga et al. , “Pytorch: An imperative style, high-performance deep learning library,” in Advances in Neural Information Processing Systems , 2019, pp. 8024–8035
2019
Later among the works it cites.
Y. Ma, K. L. Nguyen, F. Xing, and E. Cambria, “A survey on empathetic dialogue systems,” Information Fusion , vol. 64, pp. 50–70, 2020
2020
Closest in time.
W. Jiao, M. Lyu, and I. King, “Real-time emotion recognition via attention gated hierarchical memory network,” Proceedings of the AAAI Conference on Artificial Intelligence , vol. 34, no. 05, pp. 8002–8009, Apr. 2020
2020
Closest in time.
L. Zhu, W. Li, Y. Shi, and K. Guo, “Sentivec: Learning sentiment-context vector via kernel optimization function for sentiment analysis,” IEEE Transactions on Neural Networks and Learning Systems , vol. 32, no. 6, pp. 2561–2572, 2020
2020
Closest in time.
E. Ragusa, C. Gianoglio, R. Zunino, and P. Gastaldo, “Image polarity detection on resource-constrained devices,” IEEE Intelligent Systems , vol. 35, no. 6, pp. 50–57, 2020
2020
Closest in time.
A. Esuli, A. Moreo, and F. Sebastiani, “Cross-lingual sentiment quantification,” IEEE Intelligent Systems , vol. 35, no. 3, pp. 106–114, 2020
2020
Closest in time.
J.-W. Bi, Y. Liu, and Z.-P. Fan, “Crowd intelligence: Conducting asymmetric impact-performance analysis based on online reviews.” IEEE Intelligent Systems , vol. 35, no. 2, pp. 92–98, 2020
2020
Closest in time.
J. Du, L. Gui, R. Xu, Y. Xia, and X. Wang, “Commonsense knowledge enhanced memory network for stance classification,” IEEE Intelligent Systems , vol. 35, no. 4, pp. 102–109, 2020
2020
Closest in time.
J. Schuurmans and F. Frasincar, “Intent classification for dialogue utterances,” IEEE Intelligent Systems , vol. 35, no. 1, pp. 82–88, 2020
2020
Closest in time.
B. Zhang, X. Li, X. Xu, K.-C. Leung, Z. Chen, and Y. Ye, “Knowledge guided capsule attention network for aspect-based sentiment analysis,” IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 28, pp. 2538–2551, 2020
2020
Closest in time.
E. Cambria, Y. Li, F. Xing, S. Poria, and K. Kwok, “SenticNet 6: Ensemble application of symbolic and subsymbolic AI for sentiment analysis,” in CIKM , 2020, pp. 105–114
2020
Closest in time.
D. Ghosal, N. Majumder, A. Gelbukh, R. Mihalcea, and S. Poria, “COSMIC: COmmonSense knowledge for eMotion identification in conversations,” in Findings of the Association for Computational Linguistics: EMNLP 2020 . Online: Association for Computational Linguistics, Nov. 2020, pp. 2470–2481
2020
Closest in time.
L. Qin, W. Che, Y. Li, M. Ni, and T. Liu, “Dcr-net: A deep co-interactive relation network for joint dialog act recognition and sentiment classification.” in AAAI , 2020, pp. 8665–8672
2020
Closest in time.
W. Li, L. Zhu, Y. Shi, K. Guo, and E. Cambria, “User reviews: Sentiment analysis using lexicon integrated two-channel cnn-lstm family models,” Applied Soft Computing , vol. 94, p. 106435, 2020
2020
Closest in time.
Y. Susanto, A. G. Livingstone, B. C. Ng, and E. Cambria, “The hourglass model revisited,” IEEE Intelligent Systems , vol. 35, no. 5, pp. 96–102, 2020
2020
Closest in time.
D. Liu, L. Chen, Z. Wang, and G. Diao, “Speech expression multimodal emotion recognition based on deep belief network,” Journal of Grid Computing , vol. 19, no. 2, pp. 1–13, 2021
2021
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…