Distributional Reinforcement Learning for Energy-Based Sequential Models

Simple statistical gradient-following algorithms for connectionist reinforcement learning

Ronald J. Williams · 1992

Earlier work this paper cites.

Long short-term memory

Sepp Hochreiter and Jürgen Schmidhuber · 1997

Earlier work this paper cites.

Learning agents for uncertain environments (extended abstract)

Stuart Russell · 1998

Earlier work this paper cites.

Algorithms for inverse reinforcement learning

Andrew Y. Ng and Stuart J. Russell · 2000

Earlier work this paper cites.

Monte Carlo Statistical Methods (Springer Texts in Statistics)

Christian P. Robert and George Casella · 2005

Earlier work this paper cites.

A Tutorial on Energy-Based Learning

Yann LeCun, Sumit Chopra, Raia Hadsell, Marc’Aurelio Ranzato, and Fu Jie Huang · 2006

Earlier work this paper cites.

Adaptive Importance Sampling to Accelerate Training of a Neural Probabilistic Language Model

Y. Bengio and J. S. Senecal · 2008

Earlier work this paper cites.

Log-Linear Models, Logistic Regression and Conditional Random Fields, 2013

Tony Jebara · 2013

Earlier work this paper cites.

Sequence to sequence learning with neural networks

Ilya Sutskever, Oriol Vinyals, and Quoc V. Le · 2014

Earlier work this paper cites.

Human-level control through deep reinforcement learning

Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, et al · 2015

Cited alongside, same era.

Trust region policy optimization

John Schulman, Sergey Levine, Pieter Abbeel, Michael Jordan, and Philipp Moritz · 2015

Cited alongside, same era.

Globally normalized transition-based neural networks

Daniel Andor, Chris Alberti, David Weiss, Aliaksei Severyn, Alessandro Presta, Kuzman Ganchev, Slav Petrov, and Michael Collins · 2016

Cited alongside, same era.

An Actor-Critic Algorithm for Sequence Prediction

Dzmitry Bahdanau, Philemon Brakel, Kelvin Xu, Anirudh Goyal, Ryan Lowe, Joelle Pineau, Aaron Courville, and Yoshua Bengio · 2016

Cited alongside, same era.

Structured prediction energy networks

David Belanger and Andrew McCallum · 2016

Cited alongside, same era.

Deep directed generative models with energy-based probability estimation

Convolutional sequence to sequence learning

Original

Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, and Yann N. Dauphin · 2017

Later among the works it cites.

Tuning recurrent neural networks with reinforcement learning

Natasha Jaques, Shixiang Gu, Dzmitry Bahdanau, Jose Miguel Hernandez Lobato, Richard E. Turner, and Doug Eck · 2017

Later among the works it cites.

Adaptive Importance Sampling (slides)

Art Owen · 2017

Later among the works it cites.

Automatic differentiation in PyTorch

Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer · 2017

Later among the works it cites.

Proximal policy optimization algorithms

John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov · 2017

Later among the works it cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin · 2017