What Foundation Models can Bring for Robot Learning in Manipulation : A Survey

Understand

The realization of universal robots is an ultimate goal of researchers.

• However, a key hurdle in achieving this goal lies in the robots' ability to manipulate objects in their unstructured surrounding environments according to different tasks.
• The learning-based approach is considered an effective way to address generalization.
• The impressive performance of foundation models in the fields of computer vision and natural language suggests the potential of embedding foundation models into manipulation tasks as a viable path toward achieving general manipulation capability.