DC-CCL: Device-Cloud Collaborative Controlled Learning for Large Vision Models

Understand

Many large vision models have been deployed on the cloud for real-time services.

• Meanwhile, fresh samples are continuously generated on the served mobile device.
• How to leverage the device-side samples to improve the cloud-side large model becomes a practical requirement, but falls into the dilemma of no raw sample up-link and no large model down-link.
• Specifically, the user may opt out of sharing raw samples with the cloud due to the concern of privacy or communication overhead, while the size of some large vision models far exceeds the mobile device's runtime capacity.