Fetching the paper…
Reading the bibliography…
We present Text2Gestures, a transformer-based learning method to interactively generate emotive full-body gestures for virtual agents aligned with natural language text inputs.
An approach to environmental psychology
A. Mehrabian and J. A. Russell · 1974
Earlier work this paper cites.
Hand and mind: What gestures reveal about thought
D. McNeill · 1992
Earlier work this paper cites.
Rapid perceptual integration of facial expression and emotional body language
H. K. M. Meeren, C. C. R. J. van Heijnsbergen, and B. de Gelder · 2005
Earlier work this paper cites.
Towards the neurobiology of emotional body language
B. De Gelder · 2006
Earlier work this paper cites.
Body expressions influence recognition of emotions in the face and voice
J. Van den Stock, R. Righart, and B. De Gelder · 2007
Earlier work this paper cites.
Gesture modeling and animation based on a probabilistic re-creation of speaker style
M. Neff, M. Kipp, I. Albrecht, and H.-P. Seidel · 2008
Earlier work this paper cites.
Automated generation of emotive virtual humans
J. H. Chuah, B. Rossen, and B. Lok · 2009
Earlier work this paper cites.
Gesture controllers
S. Levine, P. Krähenbühl, S. Thrun, and V. Koltun · 2010
Earlier work this paper cites.
Body cues, not facial expressions, discriminate between intense positive and negative emotions
H. Aviezer, Y. Trope, and A. Todorov · 2012
Earlier work this paper cites.
Effort-shape and kinematic assessment of bodily expression of emotion during gait
M. M. Gross, E. A. Crane, and B. L. Fredrickson · 2012
Earlier work this paper cites.
Nonverbal communication: Science and applications
D. Matsumoto, M. G. Frank, and H. S. Hwang · 2012
Earlier work this paper cites.
Bodily communication
M. Argyle · 2013
Earlier work this paper cites.
A job interview simulation: Social cue-based interaction with a virtual character
T. Baur, I. Damian, P. Gebhard, K. Porayska-Pomsta, and E. André · 2013
Earlier work this paper cites.
Body movements for affective expression: A survey of automatic recognition and generation
M. Karg, A. Samadani, R. Gorbet, K. Kühnlenz, J. Hoey, and D. Kulić · 2013
Earlier work this paper cites.
Affective body expression perception and recognition: A survey
A. Kleinsmith and N. Bianchi-Berthouze · 2013
Earlier work this paper cites.
Nonverbal communication in human interaction
M. L. Knapp, J. A. Hall, and T. G. Horgan · 2013
Earlier work this paper cites.
Multimodal emotion expressions of virtual agents, mimic and vocal emotion expressions and their effects on emotion recognition
B. Liebold and P. Ohler · 2013
Earlier work this paper cites.
Distributed representations of words and phrases and their compositionality
T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean · 2013
Earlier work this paper cites.
Gesture and speech in interaction: An overview
P. Wagner, Z. Malisz, and S. Kopp · 2013
Earlier work this paper cites.
Simsensei kiosk: A virtual human interviewer for healthcare decision support
D. DeVault, R. Artstein, G. Benn, T. Dey, E. Fast, A. Gainer, K. Georgila, J. Gratch, A. Hartholt, M. Lhommet, et al · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
D. P. Kingma and J. Ba · 2014
Earlier work this paper cites.
GloVe: Global vectors for word representation
J. Pennington, R. Socher, and C. Manning · 2014
Earlier work this paper cites.
The mpi emotional body expressions database for narrative scenarios
E. Volkova, S. De La Rosa, H. H. Bülthoff, and B. Mohler · 2014
Earlier work this paper cites.
Predicting co-verbal gestures: A deep and temporal modeling approach
C.-C. Chiu, L.-P. Morency, and S. Marsella · 2015
Cited alongside, same era.
Social robots and virtual agents as lecturers for video instruction
J. Li, R. Kizilcec, J. Bailenson, and W. Ju · 2015
Cited alongside, same era.
Computational models of emotion, personality, and social relationships for interactions in games: (extended abstract)
A. Chowanda, P. Blanchfield, M. Flintham, and M. Valstar · 2016
Cited alongside, same era.
A deep learning framework for character motion synthesis and editing
D. Holden, J. Saito, and T. Komura · 2016
Cited alongside, same era.
Understanding and predicting bonding in conversations using thin slices of facial expressions and body language
N. Jaques, D. J. McDuff, Y. L. Kim, and R. W. Picard · 2016
Cited alongside, same era.
Learning individual styles of conversational gesture
S. Ginosar, A. Bar, G. Kohavi, C. Chan, A. Owens, and J. Malik · 2019
Later among the works it cites.
Analyzing input and output representations for speech-driven gesture generation
T. Kucherenko, D. Hasegawa, G. E. Henter, N. Kaneko, and H. Kjellström · 2019
Later among the works it cites.
Virtual classmates: Embodying historical learners’ messages as learning companions in a vr classroom through comment mapping
M. Liao, C. Sung, H. Wang, and W. Lin · 2019
Later among the works it cites.
Identifying emotions from walking using affective and deep features
T. Randhavane, A. Bera, K. Kapsaskis, U. Bhattacharya, K. Gray, and D. Manocha · 2019
Later among the works it cites.
Fva: Modeling perceived friendliness of virtual agents using movement characteristics
T. Randhavane, A. Bera, K. Kapsaskis, K. Gray, and D. Manocha · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
D. Roth, J. Lugrin, D. Galakhov, A. Hofmann, G. Bente, M. E. Latoschik, and A. Fuhrmann · 2016
Cited alongside, same era.
Enriching word vectors with subword information
P. Bojanowski, E. Grave, A. Joulin, and T. Mikolov · 2017
Cited alongside, same era.
Predicting head pose from speech with a conditional variational autoencoder
D. Greenwood, S. Laycock, and I. Matthews · 2017
Cited alongside, same era.
Influence of avatar appearance on presence in social vr
P. Heidicker, E. Langbehn, and F. Steinicke · 2017
Cited alongside, same era.
Phase-functioned neural networks for character control
D. Holden, T. Komura, and J. Saito · 2017
Cited alongside, same era.
Audio-driven facial animation by joint end-to-end learning of pose and emotion
T. Karras, T. Aila, S. Laine, A. Herva, and J. Lehtinen · 2017
Cited alongside, same era.
The effect of avatar realism in immersive social virtual realities
M. E. Latoschik, D. Roth, D. Gall, J. Achenbach, T. Waltemate, and M. Botsch · 2017
Cited alongside, same era.
Eva: Generating emotional behavior of virtual agents using expressive features of gait and gaze
T. Randhavane, A. Bera, K. Kapsaskis, R. Sheth, K. Gray, and D. Manocha · 2019
Later among the works it cites.
Speech-driven animation with meaningful behaviors
N. Sadoughi and C. Busso · 2019
Later among the works it cites.
Live: The human role in learning in immersive virtual environments
A. L. Simeone, M. Speicher, A. Molnar, A. Wilde, and F. Daiber · 2019
Later among the works it cites.
Neural state machine for character-scene interactions
S. Starke, H. Zhang, T. Komura, and J. Saito · 2019
Later among the works it cites.
Robots learn social skills: End-to-end learning of co-speech gesture generation for humanoid robots
Y. Yoon, W.-R. Ko, M. Jang, J. Lee, J. Kim, and G. Lee · 2019
Later among the works it cites.
Text guided person image synthesis
X. Zhou, S. Huang, B. Li, Y. Li, J. Li, and Z. Zhang · 2019
Later among the works it cites.
Style transfer for co-speech gesture animation: A multi-speaker conditional-mixture approach
C. Ahuja, D. W. Lee, Y. I. Nakano, and L.-P. Morency · 2020
Later among the works it cites.
Style-controllable speech-driven gesture synthesis using normalising flows
S. Alexanderson, G. E. Henter, T. Kucherenko, and J. Beskow · 2020
Later among the works it cites.
A. Banerjee, U. Bhattacharya, and A. Bera · 2020
Later among the works it cites.
Step: Spatial temporal graph convolutional networks for emotion perception from gaits
U. Bhattacharya, T. Mittal, R. Chandra, T. Randhavane, A. Bera, and D. Manocha · 2020
Later among the works it cites.
Generating emotive gaits for virtual agents using affect-based autoregression
U. Bhattacharya, N. Rewkowski, P. Guhan, N. L. Williams, T. Mittal, A. Bera, and D. Manocha · 2020
Later among the works it cites.
Take an emotion walk: Perceiving emotions from gaits using hierarchical attention pooling and affective mapping
U. Bhattacharya, C. Roncal, T. Mittal, R. Chandra, K. Kapsaskis, K. Gray, A. Bera, and D. Manocha · 2020
Later among the works it cites.
Gesticulator: A framework for semantically-aware speech-driven gesture generation
T. Kucherenko, P. Jonell, S. van Waveren, G. E. Henter, S. Alexandersson, I. Leite, and H. Kjellström · 2020
Later among the works it cites.
M3er: Multiplicative multimodal emotion recognition using facial, textual, and speech cues
T. Mittal, U. Bhattacharya, R. Chandra, A. Bera, and D. Manocha · 2020
Later among the works it cites.
Emoticon: Context-aware multimodal emotion recognition using frege’s principle
T. Mittal, P. Guhan, U. Bhattacharya, R. Chandra, A. Bera, and D. Manocha · 2020
Later among the works it cites.
Panel: Bodily expressed emotion understanding research: A multidisciplinary perspective
J. Z. Wang, N. Badler, N. Berthouze, R. O. Gilmore, K. L. Johnson, A. Lapedriza, X. Lu, and N. Troje · 2020
Later among the works it cites.
Speech gesture generation from the trimodal context of text, audio, and speaker identity
Y. Yoon, B. Cha, J.-H. Lee, M. Jang, J. Lee, J. Kim, and G. Lee · 2020
Later among the works it cites.