Exploring the psychology of LLMs' Moral and Legal Reasoning

Understand

Large language models (LLMs) exhibit expert-level performance in tasks across a wide range of different domains.

• Ethical issues raised by LLMs and the need to align future versions makes it important to know how state of the art models reason about moral and legal issues.
• In this paper, we employ the methods of experimental psychology to probe into this question.
• We replicate eight studies from the experimental literature with instances of Google's Gemini Pro, Anthropic's Claude 2.1, OpenAI's GPT-4, and Meta's Llama 2 Chat 70b.