Self-Confirming Transformer for Belief-Conditioned Adaptation in Offline Multi-Agent Reinforcement Learning

Non-Cooperative Games

John Nash. 1951 · 1951

Earlier work this paper cites.

Information and Information Stability of Random Variables and Processes

Mark S. Pinsker. 1964 · 1964

Earlier work this paper cites.

Self-Confirming Equilibrium

Drew Fudenberg and David K Levine. 1993 · 1993

Earlier work this paper cites.

A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner’s Dilemma game

Martin Nowak and Karl Sigmund. 1993 · 1993

Earlier work this paper cites.

Human cooperation in the simultaneous and the alternating Prisoner’s Dilemma: Pavlov versus Generous Tit-for-Tat

C Wedekind and M Milinski. 1996 · 1996

Earlier work this paper cites.

Correlated-Q Learning. In Proceedings of the Twentieth International Conference on Machine Learning (ICML’03, Vol. 20) . 242

Amy Greenwald and Keith Hall. 2003 · 2003

Earlier work this paper cites.

Nash Q-learning for general-sum stochastic games

Junling Hu and Michael P Wellman. 2003 · 2003

Earlier work this paper cites.

Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems

Original

Sergey Levine, Aviral Kumar, George Tucker, and Justin Fu. 2020 · 2005

Earlier work this paper cites.

Causality and batch reinforcement learning: Complementary approaches to planning in unknown domains

Original

James Bannon, Brad Windsor, Wenbo Song, and Tao Li. 2020 · 2006

Earlier work this paper cites.

Sequence to Sequence Learning with Neural Networks. In Advances in Neural Information Processing Systems , Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K.Q. Weinberger (Eds.), Vol. 27. Curran Associates, Inc

Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014 · 2014

Earlier work this paper cites.

Dynamic Games With Asymmetric Information: Common Information Based Perfect Bayesian Equilibria and Sequential Decomposition

Yi Ouyang, Hamidreza Tavafoghi, and Demosthenis Teneketzis. 2016 · 2016

Earlier work this paper cites.

Imitation Learning: A Survey of Learning Methods

Ahmed Hussein, Mohamed Medhat Gaber, Eyad Elyan, and Chrisina Jayne. 2017 · 2017

Earlier work this paper cites.

Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments. In Advances in Neural Information Processing Systems 30 (Advances in Neural Information Processing Systems) . Curran Associates, Inc., 6379–6390

Ryan Lowe, Yi Wu, Aviv Tamar, Jean Harb, OpenAI Pieter Abbeel, and Igor Mordatch. 2017 · 2017

Earlier work this paper cites.

New Winning Strategies for the Iterated Prisoner’s Dilemma

Philippe Mathieu and Jean-Paul Delahaye. 2017 · 2017

Earlier work this paper cites.

Attention is All you Need. In Advances in Neural Information Processing Systems (NeuriPS, Vol. 30)

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Autonomous agents modelling other agents: A comprehensive survey and open problems

Original

Stefano V. Albrecht and Peter Stone. 2018 · 2018

Earlier work this paper cites.

Speech-Transformer: A No-Recurrence Sequence-to-Sequence Model for Speech Recognition. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . 5884–5888

Linhao Dong, Shuang Xu, and Bo Xu. 2018 · 2018

Earlier work this paper cites.

Learning Policy Representations in Multiagent Systems. In Proceedings of the 35th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 80) , Jennifer Dy and Andreas Krause (Eds.). PMLR, 1802–1811

Aditya Grover, Maruan Al-Shedivat, Jayesh Gupta, Yuri Burda, and Harrison Edwards. 2018 · 2018

Earlier work this paper cites.

On First-Order Meta-Learning Algorithms

Original

Alex Nichol, Joshua Achiam, and John Schulman. 2018 · 2018

Earlier work this paper cites.

Improving language understanding by generative pre-training

Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018 · 2018

Earlier work this paper cites.

Reducing overestimation bias in multi-agent domains using double centralized critics

Original

Johannes Ackermann, Volker Gabler, Takayuki Osa, and Masashi Sugiyama. 2019 · 2019

Cited alongside, same era.

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , Jill Burstein, Christy Doran, and Thamar Solorio (Eds.). Association for Computational Linguistics, Minneapolis, Minnesota, 4171–4186

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Cited alongside, same era.

On Convergence Rate of Adaptive Multiscale Value Function Approximation for Reinforcement Learning. In 2019 IEEE 29th International Workshop on Machine Learning for Signal Processing (MLSP) . 1–6

Tao Li and Quanyan Zhu. 2019 · 2019

Cited alongside, same era.

D4rl: Datasets for deep data-driven reinforcement learning

Offline Multi-Agent Reinforcement Learning with Knowledge Distillation. In Advances in Neural Information Processing Systems , Vol. 35. Curran Associates, Inc., 226–237

Wei-Cheng Tseng, Tsun-Hsuan Johnson Wang, Yen-Chen Lin, and Phillip Isola. 2022 · 2022

Later among the works it cites.

Bootstrapped Transformer for Offline Reinforcement Learning. In Advances in Neural Information Processing Systems , Vol. 35. 34748–34761

Kerong Wang, Hanye Zhao, Xufang Luo, Kan Ren, Weinan Zhang, and Dongsheng Li. 2022 · 2022

Later among the works it cites.

Multi-Agent Reinforcement Learning is a Sequence Modeling Problem. In Advances in Neural Information Processing Systems , Vol. 35. Curran Associates, Inc., 16509–16521

Muning Wen, Jakub Kuba, Runji Lin, Weinan Zhang, Ying Wen, Jun Wang, and Yaodong Yang. 2022 · 2022

Later among the works it cites.

Self-Adaptive Driving in Nonstationary Environments through Conjectural Online Lookahead Adaptation

Original

Tao Li, Haozhe Lei, and Quanyan Zhu. 2023b · 2023

Closest in time.