LLM-Craft: Robotic Crafting of Elasto-Plastic Objects with Large Language Models

Understand

When humans create sculptures, we are able to reason about how geometrically we need to alter the clay state to reach our target goal.

• We are not computing point-wise similarity metrics, or reasoning about low-level positioning of our tools, but instead determining the higher-level changes that need to be made.
• In this work, we propose LLM-Craft, a novel pipeline that leverages large language models (LLMs) to iteratively reason about and generate deformation-based crafting action sequences.
• We simplify and couple the state and action representations to further encourage shape-based reasoning.