Understand
Acquiring your first language is an incredible feat and not easily duplicated.
- Learning to communicate using nothing but a few pictureless books, a corpus, would likely be impossible even for humans.
- Nevertheless, this is the dominating approach in most natural language processing today.
- As an alternative, we propose the use of situated interactions between agents as a driving force for communication, and the framework of Deep Recurrent Q-Networks for evolving a shared language grounded in the provided environment.
Built on
Language learning with restricted input: Case studies of two hearing children of deaf parents
Sachs, Jacqueline, Bard, Barbara, and Johnson, Marie L · 1981
Earlier work this paper cites.
Reinforcement learning: An introduction , volume 1
Sutton, Richard S and Barto, Andrew G · 1998
Earlier work this paper cites.
Visualizing data using t-sne
Maaten, Laurens van der and Hinton, Geoffrey · 2008
Earlier work this paper cites.
Curriculum learning
Bengio, Yoshua, Louradour, Jérôme, Collobert, Ronan, and Weston, Jason · 2009
Earlier work this paper cites.
Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude
Tieleman, Tijmen and Hinton, Geoffrey · 2012
Earlier work this paper cites.
Similar
Learning phrase representations using RNN encoder-decoder for statistical machine translation
Cho, Kyunghyun, van Merrienboer, Bart, Gülçehre, Çaglar, Bahdanau, Dzmitry, Bougares, Fethi, Schwenk, Holger, and Bengio, Yoshua · 2014
Cited alongside, same era.
Deep recurrent q-learning for partially observable mdps
Hausknecht, Matthew J. and Stone, Peter · 2015
Cited alongside, same era.
Batch normalization: Accelerating deep network training by reducing internal covariate shift
Ioffe, Sergey and Szegedy, Christian · 2015
Cited alongside, same era.
Deep learning face attributes in the wild
Liu, Ziwei, Luo, Ping, Wang, Xiaogang, and Tang, Xiaoou · 2015
Cited alongside, same era.
Learning to communicate with deep multi-agent reinforcement learning
Foerster, Jakob, Assael, Yannis M, de Freitas, Nando, and Whiteson, Shimon
Cited in the paper.
Learning to communicate to solve riddles with deep distributed recurrent q-networks
Foerster, Jakob N., Assael, Yannis M., de Freitas, Nando, and Whiteson, Shimon
Cited in the paper.
Then
Human-level control through deep reinforcement learning
Mnih, Volodymyr, Kavukcuoglu, Koray, Silver, David, Rusu, Andrei A., Veness, Joel, Bellemare, Marc G., Graves, Alex, Riedmiller, Martin, Fidjeland, Andreas K., Ostrovski, Georg, Petersen, Stig, Beattie, Charles, Sadik, Amir, Antonoglou, Ioannis, King, Helen, Kumaran, Dharshan, Wierstra, Daan, Legg, Shane, and Hassabis, Demis · 2015
Later among the works it cites.
Multi-agent cooperation and the emergence of (natural) language
Lazaridou, Angeliki, Peysakhovich, Alexander, and Baroni, Marco · 2016
Closest in time.
Mastering the game of go with deep neural networks and tree search
Silver, David, Huang, Aja, Maddison, Chris J, Guez, Arthur, Sifre, Laurent, Van Den Driessche, George, Schrittwieser, Julian, Antonoglou, Ioannis, Panneershelvam, Veda, Lanctot, Marc, et al · 2016
Closest in time.
Learning multiagent communication with backpropagation
Sukhbaatar, Sainbayar, Szlam, Arthur, and Fergus, Rob · 2016
Closest in time.
Beyond the bibliography
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…