Automating IRAC Analysis in Malaysian Contract Law using a Semi-Structured Knowledge Base

Understand

The effectiveness of Large Language Models (LLMs) in legal reasoning is often limited due to the unique legal terminologies and the necessity for highly specialized knowledge.

• These limitations highlight the need for high-quality data tailored for complex legal reasoning tasks.
• This paper introduces LegalSemi, a benchmark specifically curated for legal scenario analysis.
• LegalSemi comprises 54 legal scenarios, each rigorously annotated by legal experts, based on the comprehensive IRAC (Issue, Rule, Application, Conclusion) framework from Malaysian Contract Law.