CLIPSwarm: Generating Drone Shows from Text Prompts with Vision-Language Models

Understand

This paper introduces CLIPSwarm, a new algorithm designed to automate the modeling of swarm drone formations based on natural language.

• The algorithm begins by enriching a provided word, to compose a text prompt that serves as input to an iterative approach to find the formation that best matches the provided word.
• The algorithm iteratively refines formations of robots to align with the textual description, employing different steps for "exploration" and "exploitation".
• Our framework is currently evaluated on simple formation targets, limited to contour shapes.