Are LLMs the Master of All Trades? : Exploring Domain-Agnostic Reasoning Skills of LLMs

Understand

The potential of large language models (LLMs) to reason like humans has been a highly contested topic in Machine Learning communities.

• However, the reasoning abilities of humans are multifaceted and can be seen in various forms, including analogical, spatial and moral reasoning, among others.
• This fact raises the question whether LLMs can perform equally well across all these different domains.
• This research work aims to investigate the performance of LLMs on different reasoning tasks by conducting experiments that directly use or draw inspirations from existing datasets on analogical and spatial reasoning.