Lightweight Probabilistic Deep Networks

Understand

Even though probabilistic treatments of neural networks have a long history, they have not found widespread use in practice.

• Sampling approaches are often too slow already for simple networks.
• The size of the inputs and the depth of typical CNN architectures in computer vision only compound this problem.
• Uncertainty in neural networks has thus been largely ignored in practice, despite the fact that it may provide important information about the reliability of predictions and the inner workings of the network.