Checkpoint Ensembles: Ensemble Methods from a Single Training Process

Understand

We present the checkpoint ensembles method that can learn ensemble models on a single training process.

• Although checkpoint ensembles can be applied to any parametric iterative learning technique, here we focus on neural networks.
• Neural networks' composable and simple neurons make it possible to capture many individual and interaction effects among features.
• However, small sample sizes and sampling noise may result in patterns in the training data that are not representative of the true relationship between the features and the outcome.