Do Deep Neural Networks Capture Compositionality in Arithmetic Reasoning?

The algebraic mind: Integrating connectionism and cognitive science

Gary F Marcus. 2003 · 2003

Earlier work this paper cites.

Neurosymbolic AI: the 3rd wave

Original

Artur S. d’Avila Garcez and Luís C. Lamb. 2020 · 2012

Earlier work this paper cites.

Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks

Brenden M. Lake and Marco Baroni. 2018 · 2018

Earlier work this paper cites.

Adafactor: Adaptive learning rates with sublinear memory cost

Noam Shazeer and Mitchell Stern. 2018 · 2018

Earlier work this paper cites.

DROP: A reading comprehension benchmark requiring discrete reasoning over paragraphs

Dheeru Dua, Yizhong Wang, Pradeep Dasigi, Gabriel Stanovsky, Sameer Singh, and Matt Gardner. 2019 · 2019

Earlier work this paper cites.

A pilot study of a digital skill tree in gameful education

Gustavo F. Tondello and Lennart E. Nacke. 2019 · 2019

Earlier work this paper cites.

Transformers as soft reasoners over language

Peter Clark, Oyvind Tafjord, and Kyle Richardson. 2020 · 2020

Earlier work this paper cites.

Injecting numerical reasoning skills into language models

Mor Geva, Ankit Gupta, and Jonathan Berant. 2020 · 2020

Cited alongside, same era.

Compositionality decomposed: How do neural networks generalise? (extended abstract)

Dieuwke Hupkes, Verna Dankers, Mathijs Mul, and Elia Bruni. 2020 · 2020

Cited alongside, same era.

Measuring compositional generalization: A comprehensive method on realistic data

Daniel Keysers, Nathanael Schärli, Nathan Scales, Hylke Buisman, Daniel Furrer, Sergii Kashubin, Nikola Momchev, Danila Sinopalnikov, Lukasz Stafiniak, Tibor Tihon, Dmitry Tsarkov, Xiao Wang, Marc van Zee, and Olivier Bousquet. 2020 · 2020

Cited alongside, same era.

COGS: A compositional generalization challenge based on semantic interpretation

Najoung Kim and Tal Linzen. 2020 · 2020

Cited alongside, same era.

BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020 · 2020

Cited alongside, same era.

Numerical reasoning in machine reading comprehension tasks: are we there yet?

Hadeel Al-Negheimish, Pranava Madhyastha, and Alessandra Russo. 2021 · 2021

Later among the works it cites.

Investigating numeracy learning ability of a text-to-text transfer model

Kuntal Kumar Pal and Chitta Baral. 2021 · 2021

Later among the works it cites.

Scaling language models: Methods, analysis & insights from training gopher

Original

Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, H. Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant M. Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d’Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew J. Johnson, Blake A. Hechtman, Laura Weidinger, Iason Gabriel, William S. Isaac, Edward Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, and Geoffrey Irving. 2021 · 2021

Later among the works it cites.