10 Security and Privacy Problems in Large Foundation Models

Understand

Foundation models--such as GPT, CLIP, and DINO--have achieved revolutionary progress in the past several years and are commonly believed to be a promising approach for general-purpose AI.

• In particular, self-supervised learning is adopted to pre-train a foundation model using a large amount of unlabeled data.
• A pre-trained foundation model is like an ``operating system'' of the AI ecosystem.
• Specifically, a foundation model can be used as a feature extractor for many downstream tasks with little or no labeled training data.