Fetching the paper…
Reading the bibliography…
In this document we describe a rationale for a research program aimed at building an open "assistant" in the game Minecraft, in order to make progress on the problems of natural language understanding and learning from dialogue.
Learning to parse database queries using inductive logic programming
John M. Zelle and Raymond J. Mooney · 1996
Earlier work this paper cites.
Torcs, the open racing car simulator
Bernhard Wymann, Eric Espié, Christophe Guionneau, Christos Dimitrakakis, Rémi Coulom, and Andrew Sumner · 2000
Earlier work this paper cites.
Learning to map sentences to logical form: Structured classification with probabilistic categorial grammars
Luke S. Zettlemoyer and Michael Collins · 2005
Earlier work this paper cites.
Learning actions from human-robot dialogues
Rehj Cantrell, Paul Schermerhorn, and Matthias Scheutz · 2011
Earlier work this paper cites.
Learning dependency-based compositional semantics
Percy Liang, Michael Jordan, and Dan Klein · 2011
Earlier work this paper cites.
Understanding natural language commands for robotic navigation and mobile manipulation
Stefanie Tellex, Thomas Kollar, Steven Dickerson, Matthew R Walter, Ashis Gopal Banerjee, Seth Teller, and Nicholas Roy · 2011
Earlier work this paper cites.
Spreadsheet data manipulation using examples
Sumit Gulwani, William R Harris, and Rishabh Singh · 2012
Earlier work this paper cites.
Weakly supervised learning of semantic parsers for mapping instructions to actions
Yoav Artzi and Luke Zettlemoyer · 2013
Earlier work this paper cites.
The arcade learning environment: An evaluation platform for general agents
Marc G Bellemare, Yavar Naddaf, Joel Veness, and Michael Bowling · 2013
Earlier work this paper cites.
Write a classifier: Zero-shot learning using purely textual descriptions
Mohamed Elhoseiny, Babak Saleh, and Ahmed Elgammal · 2013
Earlier work this paper cites.
Learning to parse natural language commands to a robot control system
Cynthia Matuszek, Evan Herbst, Luke Zettlemoyer, and Dieter Fox · 2013
Earlier work this paper cites.
Playing atari with deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller · 2013
Earlier work this paper cites.
The dialog state tracking challenge
Jason Williams, Antoine Raux, Deepak Ramachandran, and Alan Black · 2013
Earlier work this paper cites.
The second dialog state tracking challenge
Matthew Henderson, Blaise Thomson, and Jason D Williams · 2014
Earlier work this paper cites.
Microsoft coco: Common objects in context
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick · 2014
Earlier work this paper cites.
Vqa: Visual question answering
Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C Lawrence Zitnick, and Devi Parikh · 2015
Earlier work this paper cites.
Human-level concept learning through probabilistic program induction
Brenden M Lake, Ruslan Salakhutdinov, and Joshua B Tenenbaum · 2015
Earlier work this paper cites.
User interaction models for disambiguation in programming by example
Mikaël Mayer, Gustavo Soares, Maxim Grechkin, Vu Le, Mark Marron, Oleksandr Polozov, Rishabh Singh, Benjamin Zorn, and Sumit Gulwani · 2015
Earlier work this paper cites.
Never-ending learning
T. Mitchell, W. Cohen, E. Hruschka, P. Talukdar, J. Betteridge, A. Carlson, B. Dalvi, M. Gardner, B. Kisiel, J. Krishnamurthy, N. Lao, K. Mazaitis, T. Mohamed, N. Nakashole, E. Platanios, A. Ritter, M. Samadi, B. Settles, R. Wang, D. Wijaya, A. Gupta, X. Chen, A. Saparov, M. Greaves, and J. Welling · 2015
Earlier work this paper cites.
Neural programmer-interpreters
Scott Reed and Nando De Freitas · 2015
Earlier work this paper cites.
Mazebase: A sandbox for learning from games
Sainbayar Sukhbaatar, Arthur Szlam, Gabriel Synnaeve, Soumith Chintala, and Rob Fergus · 2015
Earlier work this paper cites.
Neural module networks
Jacob Andreas, Marcus Rohrbach, Trevor Darrell, and Dan Klein · 2016
Earlier work this paper cites.
Charles Beattie, Joel Z Leibo, Denis Teplyashin, Tom Ward, Marcus Wainwright, Heinrich Küttler, Andrew Lefrancq, Simon Green, Víctor Valdés, Amir Sadik, et al · 2016
Earlier work this paper cites.
Natural language communication with robots
Yonatan Bisk, Deniz Yuret, and Daniel Marcu · 2016
Earlier work this paper cites.
Language to logical form with neural attention
Li Dong and Mirella Lapata · 2016
Earlier work this paper cites.
Lifelong perceptual programming by example
Alexander L Gaunt, Marc Brockschmidt, Nate Kushman, and Daniel Tarlow · 2016
Earlier work this paper cites.
Terpret: A probabilistic programming language for program induction
Alexander L Gaunt, Marc Brockschmidt, Rishabh Singh, Nate Kushman, Pushmeet Kohli, Jonathan Taylor, and Daniel Tarlow · 2016
Earlier work this paper cites.
Data recombination for neural semantic parsing
Robin Jia and Percy Liang · 2016
Earlier work this paper cites.
The malmo platform for artificial intelligence experimentation
Matthew Johnson, Katja Hofmann, Tim Hutton, and David Bignell · 2016
Earlier work this paper cites.
Exploring the limits of language modeling
Rafal Jozefowicz, Oriol Vinyals, Mike Schuster, Noam Shazeer, and Yonghui Wu · 2016
Earlier work this paper cites.
Vizdoom: A doom-based ai research platform for visual reinforcement learning
Michał Kempka, Marek Wydmuch, Grzegorz Runc, Jakub Toczek, and Wojciech Jaśkowski · 2016
Earlier work this paper cites.
Dialogue learning with human-in-the-loop
J. Li, A. H. Miller, S. Chopra, M. Ranzato, and J. Weston · 2016
Earlier work this paper cites.
Learning through dialogue interactions
J. Li, A. H. Miller, S. Chopra, M. Ranzato, and J. Weston · 2016
Earlier work this paper cites.
Neural symbolic machines: Learning semantic parsers on freebase with weak supervision
Chen Liang, Jonathan Berant, Quoc Le, Kenneth D Forbus, and Ni Lao · 2016
Earlier work this paper cites.
Learning executable semantic parsers for natural language understanding
Percy Liang · 2016
Cited alongside, same era.
A roadmap towards machine intelligence
Tomas Mikolov, Armand Joulin, and Marco Baroni · 2016
Cited alongside, same era.
Learning a natural language interface with neural programmer
Arvind Neelakantan, Quoc V Le, Martin Abadi, Andrew McCallum, and Dario Amodei · 2016
Cited alongside, same era.
Control of memory, active perception, and action in minecraft
Junhyuk Oh, Valliappa Chockalingam, Satinder Singh, and Honglak Lee · 2016
Cited alongside, same era.
Mastering the game of go with deep neural networks and tree search
David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George Van Den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, et al · 2016
Cited alongside, same era.
A deep hierarchical approach to lifelong learning in minecraft
Chen Tessler, Shahar Givony, Tom Zahavy, Daniel J Mankowitz, and Shie Mannor · 2017
Later among the works it cites.
Guiding interaction behaviors for multi-modal grounded language learning
Jesse Thomason, Jivko Sinapov, and Raymond Mooney · 2017
Later among the works it cites.
Elf: An extensive, lightweight and flexible research platform for real-time strategy games
Yuandong Tian, Qucheng Gong, Wenling Shang, Yuxin Wu, and C Lawrence Zitnick · 2017
Later among the works it cites.
Starcraft ii: A new challenge for reinforcement learning
Oriol Vinyals, Timo Ewalds, Sergey Bartunov, Petko Georgiev, Alexander Sasha Vezhnevets, Michelle Yeo, Alireza Makhzani, Heinrich Küttler, John Agapiou, Julian Schrittwieser, et al · 2017
Later among the works it cites.
Naturalizing a programming language via interactive learning
Sida I Wang, Samuel Ginn, Percy Liang, and Christoper D Manning · 2017
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Mastering the game of go with deep neural networks and tree search
David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George Van Den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, et al · 2016
Cited alongside, same era.
Torchcraft: a library for machine learning research on real-time strategy games
Gabriel Synnaeve, Nantas Nardelli, Alex Auvolat, Soumith Chintala, Timothée Lacroix, Zeming Lin, Florian Richoux, and Nicolas Usunier · 2016
Cited alongside, same era.
Fighting zombies in minecraft with deep reinforcement learning
Hiroto Udagawa, Tarun Narasimhan, and Shim-Young Lee · 2016
Cited alongside, same era.
Learning language games through interaction
Sida I Wang, Percy Liang, and Christopher D Manning · 2016
Cited alongside, same era.
Dialog-based language learning
J. E. Weston · 2016
Cited alongside, same era.
Video paragraph captioning using hierarchical recurrent neural networks
Haonan Yu, Jiang Wang, Zhiheng Huang, Yi Yang, and Wei Xu · 2016
Cited alongside, same era.
Learning end-to-end goal-oriented dialog
Antoine Bordes, Y-Lan Boureau, and Jason Weston · 2017
Cited alongside, same era.
Later among the works it cites.
Naturalizing a programming language via interactive learning
Sida I. Wang, Samuel Ginn, Percy Liang, and Christopher D. Manning · 2017
Later among the works it cites.
Mastering the dungeon: Grounded language learning by mechanical turker descent
Zhilin Yang, Saizheng Zhang, Jack Urbanek, Will Feng, Alexander H Miller, Arthur Szlam, Douwe Kiela, and Jason Weston · 2017
Later among the works it cites.
Seq2sql: Generating structured queries from natural language using reinforcement learning
Victor Zhong, Caiming Xiong, and Richard Socher · 2017
Later among the works it cites.
https://www.gamesindustry.biz/articles/2018-10-02-minecraft-exceeds-90-million-monthly-active-users
Minecraft exceeds 90 million monthly active users · 2018
Later among the works it cites.
Deep reinforcement learning with model learning and monte carlo tree search in minecraft
Stephan Alaniz · 2018
Later among the works it cites.
How players speak to an intelligent game character using natural language messages
Fraser Allison, Ewa Luger, and Katja Hofmann · 2018
Later among the works it cites.
Learning interpretable spatial operations in a rich 3d blocks world
Yonatan Bisk, Kevin J Shih, Yejin Choi, and Daniel Marcu · 2018
Later among the works it cites.
Babyai: First steps towards grounded language learning with a human in the loop
Maxime Chevalier-Boisvert, Dzmitry Bahdanau, Salem Lahlou, Lucas Willems, Chitwan Saharia, Thien Huu Nguyen, and Yoshua Bengio · 2018
Later among the works it cites.
Textworld: A learning environment for text-based games
Marc-Alexandre Côté, Ákos Kádár, Xingdi Yuan, Ben Kybartas, Tavian Barnes, Emery Fine, James Moore, Matthew Hausknecht, Layla El Asri, Mahmoud Adada, et al · 2018
Later among the works it cites.
Embodied question answering
Abhishek Das, Samyak Datta, Georgia Gkioxari, Stefan Lee, Devi Parikh, and Dhruv Batra · 2018
Later among the works it cites.
Dialog-to-action: conversational question answering over a large-scale knowledge base
Daya Guo, Duyu Tang, Nan Duan, Ming Zhou, and Jian Yin · 2018
Later among the works it cites.
Training classifiers with natural language explanations
Braden Hancock, Paroma Varma, Stephanie Wang, Martin Bringmann, Percy Liang, and Christopher Ré · 2018
Later among the works it cites.
The alexa meaning representation language
Thomas Kollar, Danielle Berry, Lauren Stuart, Karolina Owczarzak, Tagyoung Chung, Lambert Mathias, Michael Kayser, Bradford Snow, and Spyros Matsoukas · 2018
Later among the works it cites.
Modular architecture for starcraft ii with deep reinforcement learning
Dennis Lee, Haoran Tang, Jeffrey O Zhang, Huazhe Xu, Trevor Darrell, and Pieter Abbeel · 2018
Later among the works it cites.
Towards deep conversational recommendations
Raymond Li, Samira Ebrahimi Kahou, Hannes Schulz, Vincent Michalski, Laurent Charlin, and Chris Pal · 2018
Later among the works it cites.
Exploring the limits of weakly supervised pretraining
Dhruv Mahajan, Ross Girshick, Vignesh Ramanathan, Kaiming He, Manohar Paluri, Yixuan Li, Ashwin Bharambe, and Laurens van der Maaten · 2018
Later among the works it cites.
Sudha Rao and Hal Daumé III · 2018
Later among the works it cites.
Engaging image chat: Modeling personality in grounded dialogue
Kurt Shuster, Samuel Humeau, Antoine Bordes, and Jason Weston · 2018
Later among the works it cites.
Zero-shot learning of classifiers from natural language quantification
Shashank Srivastava, Igor Labutov, and Tom Mitchell · 2018
Later among the works it cites.
Learning to ask questions in open-domain conversational systems with typed decoders
Yansen Wang, Chenyi Liu, Minlie Huang, and Liqiang Nie · 2018
Later among the works it cites.
Airdialogue: An environment for goal-oriented dialogue research
Wei Wei, Quoc Le, Andrew Dai, and Jia Li · 2018
Later among the works it cites.
Building generalizable agents with a realistic and rich 3d environment
Yi Wu, Yuxin Wu, Georgia Gkioxari, and Yuandong Tian · 2018
Later among the works it cites.
Neural-symbolic vqa: Disentangling reasoning from vision and language understanding
Kexin Yi, Jiajun Wu, Chuang Gan, Antonio Torralba, Pushmeet Kohli, and Josh Tenenbaum · 2018
Later among the works it cites.
Interactive grounded language acquisition and generalization in a 2d world
Haonan Yu, Haichao Zhang, and Wei Xu · 2018
Later among the works it cites.
TorchCraftAI v1.1
Jonas Gehring, Zeming Lin, Daniel Haziza, Vegard Mella, Daniel Gant, Nicolas Carion, Dexter Ju, Danielle Rothermel, Laura Gustafson, Eugene Kharitonov, Vasil Khalidov, Florentin Guth, Nantas Nardelli, Nicolas Usunier, and Gabriel Synnaeve · 2019
Closest in time.
Craftassist: A framework for dialogue-enabled interactive agents
Jonathan Gray, Kavya Srinet, Yacine Jernite, Haonan Yu, Zhuoyuan Chen, Demi Guo, Siddharth Goyal, C. Lawrence Zitnick, and Arthur Szlam · 2019
Closest in time.
Learning from dialogue after deployment: Feed yourself, chatbot!
Braden Hancock, Antoine Bordes, Pierre-Emmanuel Mazare, and Jason Weston · 2019
Closest in time.
Habitat: A Platform for Embodied AI Research
Manolis Savva*, Abhishek Kadian*, Oleksandr Maksymets*, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub, Jia Liu, Vladlen Koltun, Jitendra Malik, Devi Parikh, and Dhruv Batra · 2019
Closest in time.