Self-supervised visual learning from interactions with objects

Understand

Self-supervised learning (SSL) has revolutionized visual representation learning, but has not achieved the robustness of human vision.

• A reason for this could be that SSL does not leverage all the data available to humans during learning.
• When learning about an object, humans often purposefully turn or move around objects and research suggests that these interactions can substantially enhance their learning.
• Here we explore whether such object-related actions can boost SSL.