Mastering Chess with a Transformer Model

D. J. Wu, “Accelerating self-play learning in go,” CoRR , vol. abs/1902.10565, 2019. [Online]. Available: http://arxiv.org/abs/1902.10565

Original

1902

Earlier work this paper cites.

N. Shazeer, “GLU variants improve transformer,” CoRR , vol. abs/2002.05202, 2020. [Online]. Available: https://arxiv.org/abs/2002.05202

Original

2002

Earlier work this paper cites.

D. Silver, J. Schrittwieser, K. Simonyan, I. Antonoglou, A. Huang, A. Guez, T. Hubert, L. Baker, M. Lai, A. Bolton et al. , “Mastering the game of go without human knowledge,” Nature , vol. 550, pp. 254–259, 2017. [Online]. Available: https://doi.org/10.1038/nature24270

2017

Earlier work this paper cites.

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,” in NIPS , 2017

2017

Earlier work this paper cites.

N. Shazeer, A. Mirhoseini, K. Maziarz, A. Davis, Q. V. Le, G. E. Hinton, and J. Dean, “Outrageously large neural networks: The sparsely-gated mixture-of-experts layer,” CoRR , vol. abs/1701.06538, 2017. [Online]. Available: http://arxiv.org/abs/1701.06538

Original

2017

Earlier work this paper cites.

D. Silver, T. Hubert, J. Schrittwieser, I. Antonoglou, M. Lai, A. Guez, M. Lanctot, L. Sifre, D. Kumaran, T. Graepel et al. , “A general reinforcement learning algorithm that masters chess, shogi, and go through self-play,” Science , vol. 362, no. 6419, pp. 1140–1144, 2018

2018

Earlier work this paper cites.

P. Izmailov, D. Podoprikhin, T. Garipov, D. Vetrov, and A. Wilson, “Averaging weights leads to wider optima and better generalization,” in 34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018 , ser. 34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018, R. Silva, A. Globerson, and A. Globerson, Eds. Association For Uncertainty in Artificial Intelligence (AUAI), 2018, pp. 876–885

2018

Earlier work this paper cites.

D. Misra, “Mish: A self regularized non-monotonic neural activation function,” arXiv preprint arXiv:1908.08681 , 2019

Original

2019

Earlier work this paper cites.

J. Jumper, R. Evans, A. Pritzel, T. Green, M. Figurnov, O. Ronneberger, K. Tunyasuvunakool, R. Bates, A. Žídek, A. Potapenko et al. , “Highly accurate protein structure prediction with alphafold,” Nature , vol. 596, no. 7873, pp. 583–589, 2021

2021

Cited alongside, same era.

T. McGrath, A. Kapishnikov, N. Tomašev, A. Pearce, M. Wattenberg, D. Hassabis, B. Kim, U. Paquet, and V. Kramnik, “Acquisition of chess knowledge in alphazero,” Proceedings of the National Academy of Sciences , vol. 119, no. 47, p. e2206625119, 2022. [Online]. Available: https://www.pnas.org/doi/abs/10.1073/pnas.2206625119

2022

Cited alongside, same era.

J. Wei, X. Wang, D. Schuurmans, M. Bosma, b. ichter, F. Xia, E. Chi, Q. V. Le, and D. Zhou, “Chain-of-thought prompting elicits reasoning in large language models,” in Advances in Neural Information Processing Systems , S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, Eds., vol. 35. Curran Associates, Inc., 2022, pp. 24 824–24 837. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2022/file/9d5609613524ecf4f15af0f7b31abca4-Paper-Conference.pdf

2022

——, “Other methods implemented in katago,” 2024. [Online]. Available: https://github.com/lightvector/KataGo/blob/master/docs/KataGoMethods.md

2024

Closest in time.

E. Jenner, S. Kapur, V. Georgiev, C. Allen, S. Emmons, and S. Russell, “Evidence of learned look-ahead in a chess-playing neural network,” 2024. [Online]. Available: https://arxiv.org/abs/2406.00877

Original

2024

Closest in time.

OpenAI, “Introducing openai o1-preview,” 12 September 2024. [Online]. Available: https://openai.com/index/introducing-openai-o1-preview/

2024

Closest in time.

DeepMind, “Ai achieves silver-medal standard solving international mathematical olympiad problems,” 25 July 2024. [Online]. Available: https://deepmind.google/discover/blog/ai-solves-imo-problems-at-silver-medal-level/

2024

Closest in time.