PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modifications

Understand

PixelCNNs are a recently proposed class of powerful generative models with tractable likelihood.

• Here we discuss our implementation of PixelCNNs which we make available at https://github.com/openai/pixel-cnn.
• Our implementation contains a number of modifications to the original model that both simplify its structure and improve its performance.
• 1) We use a discretized logistic mixture likelihood on the pixels, rather than a 256-way softmax, which we find to speed up training.