Decentralized Collective World Model for Emergent Communication and Coordination

M. L. Littman, “Markov games as a framework for multi-agent reinforcement learning,” in Machine Learning Proceedings 1994 , W. W. Cohen and H. Hirsh, Eds. San Francisco (CA): Morgan Kaufmann, 1994, pp. 157–163. [Online]. Available: https://www.sciencedirect.com/science/article/pii/B9781558603356500271

1994

Earlier work this paper cites.

M. A. Nowak and D. C. Krakauer, “The evolution of language,” Proceedings of the National Academy of Sciences , vol. 96, no. 14, pp. 8028–8033, 1999. [Online]. Available: https://www.pnas.org/doi/abs/10.1073/pnas.96.14.8028

1999

Earlier work this paper cites.

R. P. N. Rao and D. H. Ballard, “Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects,” Nature Neuroscience , vol. 2, no. 1, pp. 79–87, Jan 1999. [Online]. Available: https://doi.org/10.1038/4580

1999

Earlier work this paper cites.

D. S. Bernstein, R. Givan, N. Immerman, and S. Zilberstein, “The complexity of decentralized control of markov decision processes,” Mathematics of Operations Research , vol. 27, no. 4, pp. 819–840, 2002. [Online]. Available: https://doi.org/10.1287/moor.27.4.819.297

2002

Earlier work this paper cites.

A. Lazaridou and M. Baroni, “Emergent multi-agent communication in the deep learning era,” CoRR , vol. abs/2006.02419, 2020. [Online]. Available: https://arxiv.org/abs/2006.02419

Original

2006

Earlier work this paper cites.

N. Kriegeskorte, M. Mur, and P. A. Bandettini, “Representational similarity analysis - connecting the branches of systems neuroscience,” Frontiers in Systems Neuroscience , vol. 2, 2008. [Online]. Available: https://www.frontiersin.org/journals/systems-neuroscience/articles/10.3389/neuro.06.004.2008

2008

Earlier work this paper cites.

K. Friston, “The free-energy principle: a unified brain theory?” Nature Reviews Neuroscience , vol. 11, no. 2, pp. 127–138, Feb 2010. [Online]. Available: https://doi.org/10.1038/nrn2787

2010

Earlier work this paper cites.

M. Gutmann and A. Hyvärinen, “Noise-contrastive estimation: A new estimation principle for unnormalized statistical models,” in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics , ser. Proceedings of Machine Learning Research, Y. W. Teh and M. Titterington, Eds., vol. 9. Chia Laguna Resort, Sardinia, Italy: PMLR, 13–15 May 2010, pp. 297–304. [Online]. Available: https://proceedings.mlr.press/v9/gutmann10a.html

2010

Earlier work this paper cites.

A. Dafoe, E. Hughes, Y. Bachrach, T. Collins, K. R. McKee, J. Z. Leibo, K. Larson, and T. Graepel, “Open problems in cooperative AI,” CoRR , vol. abs/2012.08630, 2020. [Online]. Available: https://arxiv.org/abs/2012.08630

Original

2012

Earlier work this paper cites.

K. Cho, B. Van Merriënboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Bengio, “Learning phrase representations using rnn encoder-decoder for statistical machine translation,” arXiv preprint arXiv:1406.1078 , 2014

Original

2014

Earlier work this paper cites.

A. S. Roth, “Shared Agency,” in The Stanford Encyclopedia of Philosophy , Summer 2017 ed., E. N. Zalta, Ed. Metaphysics Research Lab, Stanford University, 2017

2017

Earlier work this paper cites.

R. Lowe, Y. WU, A. Tamar, J. Harb, O. Pieter Abbeel, and I. Mordatch, “Multi-agent actor-critic for mixed cooperative-competitive environments,” in Advances in Neural Information Processing Systems , I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, Eds., vol. 30. Curran Associates, Inc., 2017. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2017/file/68a9750337a418a86fe06c1991a1d64c-Paper.pdf

2017

Earlier work this paper cites.

D. Ha and J. Schmidhuber, “Recurrent world models facilitate policy evolution,” in Advances in Neural Information Processing Systems , S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, Eds., vol. 31. Curran Associates, Inc., 2018. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2018/file/2de5d16682c3c35007e4e92982f1a2ba-Paper.pdf

2018

Cited alongside, same era.

D. Hafner, T. Lillicrap, I. Fischer, R. Villegas, D. Ha, H. Lee, and J. Davidson, “Learning latent dynamics for planning from pixels,” arXiv preprint arXiv:1811.04551 , 2018

Original

2018

Cited alongside, same era.

A. van den Oord, Y. Li, and O. Vinyals, “Representation learning with contrastive predictive coding,” 2019. [Online]. Available: https://arxiv.org/abs/1807.03748

Original

2019

Cited alongside, same era.

T. Nakamura, A. Taniguchi, and T. Taniguchi, “Control as probabilistic inference as an emergent communication mechanism in multi-agent reinforcement learning,” CoRR , vol. abs/2307.05004, 2023. [Online]. Available: https://doi.org/10.48550/arXiv.2307.05004

Original

2023

Later among the works it cites.

H. Ebara, T. Nakamura, A. Taniguchi, and T. Taniguchi, “Multi-agent reinforcement learning with emergent communication using discrete and indifferentiable message,” in 2023 15th International Congress on Advanced Applied Informatics Winter (IIAI-AAI-Winter) , 2023, pp. 366–371

2023

Later among the works it cites.

D. Hafner, J. Pasukonis, J. Ba, and T. Lillicrap, “Mastering diverse domains through world models,” 2024. [Online]. Available: https://arxiv.org/abs/2301.04104

Original

2024

Later among the works it cites.

R. Pina, V. De Silva, C. Artaud, and X. Liu, “Fully independent communication in multi-agent reinforcement learning,” in Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems , ser. AAMAS ’24. Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems, 2024, p. 2423–2425