2016

Learning to Play Guess Who? and Inventing a Grounded Language as a Consequence

Jorge, Emilio, Kågebäck, Mikael, Johansson, Fredrik D. et al.

Understand

Acquiring your first language is an incredible feat and not easily duplicated.

  • Learning to communicate using nothing but a few pictureless books, a corpus, would likely be impossible even for humans.
  • Nevertheless, this is the dominating approach in most natural language processing today.
  • As an alternative, we propose the use of situated interactions between agents as a driving force for communication, and the framework of Deep Recurrent Q-Networks for evolving a shared language grounded in the provided environment.

Built on

  • Language learning with restricted input: Case studies of two hearing children of deaf parents

    Sachs, Jacqueline, Bard, Barbara, and Johnson, Marie L · 1981

    Earlier work this paper cites.

  • Reinforcement learning: An introduction , volume 1

    Sutton, Richard S and Barto, Andrew G · 1998

    Earlier work this paper cites.

  • Visualizing data using t-sne

    Maaten, Laurens van der and Hinton, Geoffrey · 2008

    Earlier work this paper cites.

  • Curriculum learning

    Bengio, Yoshua, Louradour, Jérôme, Collobert, Ronan, and Weston, Jason · 2009

    Earlier work this paper cites.

  • Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude

    Tieleman, Tijmen and Hinton, Geoffrey · 2012

    Earlier work this paper cites.

Similar

  • Learning phrase representations using RNN encoder-decoder for statistical machine translation

    Cho, Kyunghyun, van Merrienboer, Bart, Gülçehre, Çaglar, Bahdanau, Dzmitry, Bougares, Fethi, Schwenk, Holger, and Bengio, Yoshua · 2014

    Cited alongside, same era.

  • Deep recurrent q-learning for partially observable mdps

    Original

    Hausknecht, Matthew J. and Stone, Peter · 2015

    Cited alongside, same era.

  • Batch normalization: Accelerating deep network training by reducing internal covariate shift

    Ioffe, Sergey and Szegedy, Christian · 2015

    Cited alongside, same era.

  • Deep learning face attributes in the wild

    Liu, Ziwei, Luo, Ping, Wang, Xiaogang, and Tang, Xiaoou · 2015

    Cited alongside, same era.

  • Learning to communicate with deep multi-agent reinforcement learning

    Foerster, Jakob, Assael, Yannis M, de Freitas, Nando, and Whiteson, Shimon

    Cited in the paper.

  • Learning to communicate to solve riddles with deep distributed recurrent q-networks

    Original

    Foerster, Jakob N., Assael, Yannis M., de Freitas, Nando, and Whiteson, Shimon

    Cited in the paper.

Then

  • Human-level control through deep reinforcement learning

    Mnih, Volodymyr, Kavukcuoglu, Koray, Silver, David, Rusu, Andrei A., Veness, Joel, Bellemare, Marc G., Graves, Alex, Riedmiller, Martin, Fidjeland, Andreas K., Ostrovski, Georg, Petersen, Stig, Beattie, Charles, Sadik, Amir, Antonoglou, Ioannis, King, Helen, Kumaran, Dharshan, Wierstra, Daan, Legg, Shane, and Hassabis, Demis · 2015

    Later among the works it cites.

  • Multi-agent cooperation and the emergence of (natural) language

    Original

    Lazaridou, Angeliki, Peysakhovich, Alexander, and Baroni, Marco · 2016

    Closest in time.

  • Mastering the game of go with deep neural networks and tree search

    Silver, David, Huang, Aja, Maddison, Chris J, Guez, Arthur, Sifre, Laurent, Van Den Driessche, George, Schrittwieser, Julian, Antonoglou, Ioannis, Panneershelvam, Veda, Lanctot, Marc, et al · 2016

    Closest in time.

  • Learning multiagent communication with backpropagation

    Sukhbaatar, Sainbayar, Szlam, Arthur, and Fergus, Rob · 2016

    Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…