Bipartite Conditional Random Fields for Panoptic Segmentation

Understand

We tackle the panoptic segmentation problem with a conditional random field (CRF) model.

• Panoptic segmentation involves assigning a semantic label and an instance label to each pixel of a given image.
• At each pixel, the semantic label and the instance label should be compatible.
• Furthermore, a good panoptic segmentation should have a number of other desirable properties such as the spatial and color consistency of the labeling (similar looking neighboring pixels should have the same semantic label and the instance label).