Teaching Algorithmic Reasoning via In-context Learning

Understand

Large language models (LLMs) have shown increasing in-context learning capabilities through scaling up model and data size.

• Despite this progress, LLMs are still unable to solve algorithmic reasoning problems.
• While providing a rationale with the final answer has led to further improvements in multi-step reasoning problems, Anil et al.
• 2022 showed that even simple algorithmic reasoning tasks such as parity are far from solved.