LLM-based Human Simulations Have Not Yet Been Reliable

Understand

Large Language Models (LLMs) are increasingly employed for simulating human behaviors across diverse domains.

• However, our position is that current LLM-based human simulations remain insufficiently reliable, as evidenced by significant discrepancies between their outcomes and authentic human actions.
• Our investigation begins with a systematic review of LLM-based human simulations in social, economic, policy, and psychological contexts, identifying their common frameworks, recent advances, and persistent limitations.
• This review reveals that such discrepancies primarily stem from inherent limitations of LLMs and flaws in simulation design, both of which are examined in detail.