Efficient Per-Example Gradient Computations

Understand

This technical report describes an efficient technique for computing the norm of the gradient of the loss function for a neural network with respect to its parameters.

• This gradient norm can be computed efficiently for every example.