Vision-based Neural Scene Representations for Spacecraft

Understand

In advanced mission concepts with high levels of autonomy, spacecraft need to internally model the pose and shape of nearby orbiting objects.

• Recent works in neural scene representations show promising results for inferring generic three-dimensional scenes from optical images.
• Neural Radiance Fields (NeRF) have shown success in rendering highly specular surfaces using a large number of images and their pose.
• More recently, Generative Radiance Fields (GRAF) achieved full volumetric reconstruction of a scene from unposed images only, thanks to the use of an adversarial framework to train a NeRF.