Collaborating with AI Agents: Field Experiments on Teamwork, Productivity, and Performance

Understand

We examined the mechanisms underlying productivity and performance gains from AI agents using a large-scale experiment on Pairit, a platform we developed to study human-AI collaboration.

• We randomly assigned 2,234 participants to human-human and human-AI teams that produced 11,024 ads for a think tank.
• We evaluated the ads using independent human ratings and a field experiment on X which garnered ~5M impressions.
• We found human-AI teams produced 50% more ads per worker and higher text quality, while human-human teams produced higher image quality, suggesting a jagged frontier of AI agent capability.