Fetching the paper…
Reading the bibliography…
In this work, we investigate a simple and must-known conditional generative framework based on Vector Quantised-Variational AutoEncoder (VQ-VAE) and Generative Pre-trained Transformer (GPT) for human motion generation from textural descriptions.
Simulating humans: computer graphics animation and control
Norman I Badler, Cary B Phillips, and Bonnie Lynn Webber · 1993
Earlier work this paper cites.
Auto-encoding variational bayes
Diederik P Kingma and Max Welling · 2014
Earlier work this paper cites.
Recurrent network models for human dynamics
Katerina Fragkiadaki, Sergey Levine, Panna Felsen, and Jitendra Malik · 2015
Earlier work this paper cites.
Smpl: A skinned multi-person linear model
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black · 2015
Earlier work this paper cites.
The kit whole-body human motion database
Christian Mandery, Ömer Terlemez, Martin Do, Nikolaus Vahrenkamp, and Tamim Asfour · 2015
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Earlier work this paper cites.
A deep learning framework for character motion synthesis and editing
Daniel Holden, Jun Saito, and Taku Komura · 2016
Earlier work this paper cites.
The kit motion-language dataset
Matthias Plappert, Christian Mandery, and Tamim Asfour · 2016
Earlier work this paper cites.
Deep representation learning for human motion prediction and classification
Judith Butepage, Michael J Black, Danica Kragic, and Hedvig Kjellstrom · 2017
Earlier work this paper cites.
A recurrent variational autoencoder for human motion synthesis
Ikhsanul Habibie, Daniel Holden, Jonathan Schwarz, Joe Yearsley, and Taku Komura · 2017
Earlier work this paper cites.
Gans trained by a two time-scale update rule converge to a local nash equilibrium
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter · 2017
Earlier work this paper cites.
Phase-functioned neural networks for character control
Daniel Holden, Taku Komura, and Jun Saito · 2017
Earlier work this paper cites.
On human motion prediction using recurrent neural networks
Julieta Martinez, Michael J Black, and Javier Romero · 2017
Earlier work this paper cites.
Neural discrete representation learning
Aaron Van Den Oord, Oriol Vinyals, et al · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Text2action: Generative adversarial synthesis from language to action
Hyemin Ahn, Timothy Ha, Yunho Choi, Hwiyeon Yoo, and Songhwai Oh · 2018
Earlier work this paper cites.
Hp-gan: Probabilistic 3d human motion prediction via gan
Emad Barsoum, John Kender, and Zicheng Liu · 2018
Earlier work this paper cites.
The challenge of realistic music generation: modelling raw audio at scale
Sander Dieleman, Aaron van den Oord, and Karen Simonyan · 2018
Earlier work this paper cites.
Recurrent transition networks for character locomotion
Félix G Harvey and Christopher Pal · 2018
Earlier work this paper cites.
Generating animated videos of human activities from natural language descriptions
Angela S Lin, Lemeng Wu, Rodolfo Corona, Kevin Tai, Qixing Huang, and Raymond J Mooney · 2018
Earlier work this paper cites.
Quaternet: A quaternion-based recurrent model for human motion
Dario Pavllo, David Grangier, and Michael Auli · 2018
Earlier work this paper cites.
Improving language understanding by generative pre-training
Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al · 2018
Earlier work this paper cites.
Mocogan: Decomposing motion and content for video generation
Sergey Tulyakov, Ming-Yu Liu, Xiaodong Yang, and Jan Kautz · 2018
Earlier work this paper cites.
Mt-vae: Learning motion transformations to generate multimodal human dynamics
Xinchen Yan, Akash Rastogi, Ruben Villegas, Kalyan Sunkavalli, Eli Shechtman, Sunil Hadap, Ersin Yumer, and Honglak Lee · 2018
Earlier work this paper cites.
Language2pose: Natural language grounded pose forecasting
Chaitanya Ahuja and Louis-Philippe Morency · 2019
Earlier work this paper cites.
Human motion prediction via spatio-temporal inpainting
Alejandro Hernandez, Jurgen Gall, and Francesc Moreno-Noguer · 2019
Cited alongside, same era.
Dancing to music
Hsin-Ying Lee, Xiaodong Yang, Ming-Yu Liu, Ting-Chun Wang, Yu-Ding Lu, Ming-Hsuan Yang, and Jan Kautz · 2019
Cited alongside, same era.
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter · 2019
Cited alongside, same era.
Amass: Archive of motion capture as surface shapes
Naureen Mahmood, Nima Ghorbani, Nikolaus F Troje, Gerard Pons-Moll, and Michael J Black · 2019
Cited alongside, same era.
Learning trajectory dependencies for human motion prediction
Wei Mao, Miaomiao Liu, Mathieu Salzmann, and Hongdong Li · 2019
Cited alongside, same era.
Generating diverse high-fidelity images with vq-vae-2
Ali Razavi, Aaron Van den Oord, and Oriol Vinyals · 2019
Cited alongside, same era.
Action-conditioned 3D human motion synthesis with transformer VAE
Mathis Petrovich, Michael J. Black, and Gül Varol · 2021
Later among the works it cites.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021
Later among the works it cites.
Zero-shot text-to-image generation
Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever · 2021
Later among the works it cites.
http://mocap.cs.cmu.edu/
Cmu graphics lab motion capture database · 2022
Later among the works it cites.
Rhythmic gesticulator: Rhythm-aware co-speech gesture synthesis with hierarchical neural embeddings
Tenglong Ao, Qingzhe Gao, Yuke Lou, Baoquan Chen, and Libin Liu · 2022
Later among the works it cites.
TEACH: Temporal Action Compositions for 3D Humans
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Singan: Learning a generative model from a single natural image
Tamar Rott Shaham, Tali Dekel, and Tomer Michaeli · 2019
Cited alongside, same era.
Neural state machine for character-scene interactions
Sebastian Starke, He Zhang, Taku Komura, and Jun Saito · 2019
Cited alongside, same era.
Convolutional sequence generation for skeleton-based action synthesis
Sijie Yan, Zhizhong Li, Yuanjun Xiong, Huahan Yan, and Dahua Lin · 2019
Cited alongside, same era.
A stochastic conditioning scheme for diverse human motion prediction
Sadegh Aliakbarian, Fatemeh Sadat Saleh, Mathieu Salzmann, Lars Petersson, and Stephen Gould · 2020
Cited alongside, same era.
Jukebox: A generative model for music
Prafulla Dhariwal, Heewoo Jun, Christine Payne, Jong Wook Kim, Alec Radford, and Ilya Sutskever · 2020
Cited alongside, same era.
Action2motion: Conditioned generation of 3d human motions
Chuan Guo, Xinxin Zuo, Sen Wang, Shihao Zou, Qingyao Sun, Annan Deng, Minglun Gong, and Li Cheng · 2020
Cited alongside, same era.
Nikos Athanasiou, Mathis Petrovich, Michael J. Black, and Gül Varol · 2022
Later among the works it cites.
Motionmixer: Mlp-based 3d human body pose forecasting
Arij Bouazizi, Adrian Holzbock, Ulrich Kressel, Klaus Dietmayer, and Vasileios Belagiannis · 2022
Later among the works it cites.
Vqgan-clip: Open domain image generation and editing with natural language guidance
Katherine Crowson, Stella Biderman, Daniel Kornis, Dashiell Stander, Eric Hallahan, Louis Castricato, and Edward Raff · 2022
Later among the works it cites.
Generating diverse and natural 3d human motions from text
Chuan Guo, Shihao Zou, Xinxin Zuo, Sen Wang, Wei Ji, Xingyu Li, and Li Cheng · 2022
Later among the works it cites.
Tm2t: Stochastic and tokenized modeling for the reciprocal generation of 3d human motions and texts
Chuan Guo, Xinxin Zuo, Sen Wang, and Li Cheng · 2022
Later among the works it cites.
Back to mlp: A simple baseline for human motion prediction
Wen Guo, Yuming Du, Xi Shen, Vincent Lepetit, Xavier Alameda-Pineda, and Francesc Moreno-Noguer · 2022
Later among the works it cites.
Ganimator: Neural motion synthesis from a single sequence
Peizhuo Li, Kfir Aberman, Zihan Zhang, Rana Hanocka, and Olga Sorkine-Hornung · 2022
Later among the works it cites.
Bailando: 3d dance generation by actor-critic gpt with choreographic memory
Siyao Li, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, and Ziwei Liu · 2022
Later among the works it cites.
Posegpt: Quantization-based 3d human motion generation and forecasting
Thomas Lucas, Fabien Baradel, Philippe Weinzaepfel, and Grégory Rogez · 2022
Later among the works it cites.
TEMOS: Generating diverse human motions from textual descriptions
Mathis Petrovich, Michael J. Black, and Gül Varol · 2022
Later among the works it cites.
Hierarchical text-conditional image generation with clip latents
Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen · 2022
Later among the works it cites.
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2022
Later among the works it cites.
Deepphase: periodic autoencoders for learning motion phase manifolds
Sebastian Starke, Ian Mason, and Taku Komura · 2022
Later among the works it cites.
Real-time controllable motion transition for characters
Xiangjun Tang, He Wang, Bo Hu, Xu Gong, Ruifan Yi, Qilong Kou, and Xiaogang Jin · 2022
Later among the works it cites.
Motionclip: Exposing human motion generation to clip space
Guy Tevet, Brian Gordon, Amir Hertz, Amit H Bermano, and Daniel Cohen-Or · 2022
Later among the works it cites.
Human motion diffusion model
Guy Tevet, Sigal Raab, Brian Gordon, Yonatan Shafir, Amit H Bermano, and Daniel Cohen-Or · 2022
Later among the works it cites.
Executing your commands via motion diffusion in latent space
Chen Xin, Biao Jiang, Wen Liu, Zilong Huang, Bin Fu, Tao Chen, Jingyi Yu, and Gang Yu · 2022
Later among the works it cites.
Motiondiffuse: Text-driven human motion generation with diffusion model
Mingyuan Zhang, Zhongang Cai, Liang Pan, Fangzhou Hong, Xinying Guo, Lei Yang, and Ziwei Liu · 2022
Later among the works it cites.
Avatars grow legs: Generating smooth human motion from sparse tracking inputs with diffusion model
Yuming Du, Robin Kips, Albert Pumarola, Sebastian Starke, Ali Thabet, and Artsiom Sanakoyeu · 2023
Closest in time.