2020

SOLOv2: Dynamic and Fast Instance Segmentation

Wang, Xinlong, Zhang, Rufeng, Kong, Tao et al.

Understand

In this work, we aim at building a simple, direct, and fast instance segmentation framework with strong performance.

We follow the principle of the SOLO method of Wang et al.
"SOLO: segmenting objects by locations".
Importantly, we take one step further by dynamically learning the mask head of the object segmenter such that the mask head is conditioned on the location.

Built on

Microsoft COCO: common objects in context
Tsung-Yi Lin, Michael Maire, Serge J. Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick · 2014
Earlier work this paper cites.
Spatial transformer networks
Max Jaderberg, Karen Simonyan, Andrew Zisserman, and Koray Kavukcuoglu · 2015
Earlier work this paper cites.
Dynamic filter networks
Xu Jia, Bert De Brabandere, Tinne Tuytelaars, and Luc Van Gool · 2016
Earlier work this paper cites.
Ssd: Single shot multibox detector
Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C Berg · 2016
Earlier work this paper cites.
Fully convolutional instance-aware semantic segmentation
Yi Li, Haozhi Qi, Jifeng Dai, Xiangyang Ji, and Yichen Wei · 2017
Earlier work this paper cites.
Mask R-CNN
Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross B. Girshick · 2017
Earlier work this paper cites.
Associative embedding: End-to-end learning for joint detection and grouping
Alejandro Newell, Zhiao Huang, and Jia Deng · 2017
Earlier work this paper cites.
Semantic instance segmentation with a discriminative loss function
Original
Bert De Brabandere, Davy Neven, and Luc Van Gool · 2017
Earlier work this paper cites.
Sequential grouping networks for instance segmentation
Shu Liu, Jiaya Jia, Sanja Fidler, and Raquel Urtasun · 2017
Earlier work this paper cites.
Deformable convolutional networks
Jifeng Dai, Haozhi Qi, Yuwen Xiong, Yi Li, Guodong Zhang, Han Hu, and Yichen Wei · 2017
Earlier work this paper cites.
Soft-NMS: improving object detection with one line of code
Navaneeth Bodla, Bharat Singh, Rama Chellappa, and Larry Davis · 2017
Earlier work this paper cites.
Focal loss for dense object detection
Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollár · 2017
Earlier work this paper cites.
Feature pyramid networks for object detection
Tsung-Yi Lin, Piotr Dollár, Ross B. Girshick, Kaiming He, Bharath Hariharan, and Serge J. Belongie · 2017
Earlier work this paper cites.
Path aggregation network for instance segmentation
Shu Liu, Lu Qi, Haifang Qin, Jianping Shi, and Jiaya Jia · 2018
Earlier work this paper cites.
Efficient video object segmentation via network modulation
Linjie Yang, Yanran Wang, Xuehan Xiong, Jianchao Yang, and Aggelos K. Katsaggelos · 2018
Earlier work this paper cites.

Similar

An intriguing failing of convolutional neural networks and the coordconv solution
Rosanne Liu, Joel Lehman, Piero Molino, Felipe Petroski Such, Eric Frank, Alex Sergeev, and Jason Yosinski · 2018
Cited alongside, same era.
Group normalization
Yuxin Wu and Kaiming He · 2018
Cited alongside, same era.
Masklab: Instance segmentation by refining object detection with semantic and direction features
Liang-Chieh Chen, Alexander Hermans, George Papandreou, Florian Schroff, Peng Wang, and Hartwig Adam · 2018
Cited alongside, same era.
Yolov3: An incremental improvement
Original
Joseph Redmon and Ali Farhadi · 2018
Cited alongside, same era.
Single-shot refinement neural network for object detection
Shifeng Zhang, Longyin Wen, Xiao Bian, Zhen Lei, and Stan Z Li · 2018
Cited alongside, same era.
YOLACT: Real-time instance segmentation
Daniel Bolya, Chong Zhou, Fanyi Xiao, and Yong Jae Lee · 2019
Cited alongside, same era.
Mask scoring R-CNN
Zhaojin Huang, Lichao Huang, Yongchao Gong, Chang Huang, and Xinggang Wang · 2019
Cited alongside, same era.
TensorMask: A foundation for dense object segmentation
Xinlei Chen, Ross Girshick, Kaiming He, and Piotr Dollar · 2019
Cited alongside, same era.
FCOS: Fully convolutional one-stage object detection
Zhi Tian, Chunhua Shen, Hao Chen, and Tong He · 2019
Cited alongside, same era.
SSAP: Single-shot instance segmentation with affinity pyramid
Naiyu Gao, Yanhu Shan, Yupei Wang, Xin Zhao, Yinan Yu, Ming Yang, and Kaiqi Huang · 2019
Cited alongside, same era.
AdaptIS: Adaptive instance selection network
Konstantin Sofiiuk, Olga Barinova, and Anton Konushin · 2019
Cited alongside, same era.
Adaptive NMS: Refining pedestrian detection in a crowd
Songtao Liu, Di Huang, and Yunhong Wang · 2019
Cited alongside, same era.

Then

LVIS: A dataset for large vocabulary instance segmentation
Agrim Gupta, Piotr Dollar, and Ross Girshick · 2019
Later among the works it cites.
Attention-guided unified network for panoptic segmentation
Yanwei Li, Xinze Chen, Zheng Zhu, Lingxi Xie, Guan Huang, Dalong Du, and Xingang Wang · 2019
Later among the works it cites.
UPSNet: A unified panoptic segmentation network
Yuwen Xiong, Renjie Liao, Hengshuang Zhao, Rui Hu, Min Bai, Ersin Yumer, and Raquel Urtasun · 2019
Later among the works it cites.
Foveabox: Beyond anchor-based object detector
Original
Tao Kong, Fuchun Sun, Huaping Liu, Yuning Jiang, and Jianbo Shi · 2019
Later among the works it cites.
Reppoints: Point set representation for object detection
Ze Yang, Shaohui Liu, Han Hu, Liwei Wang, and Stephen Lin · 2019
Later among the works it cites.
Objects as points
Original
Xingyi Zhou, Dequan Wang, and Philipp Krähenbühl · 2019
Later among the works it cites.
MMDetection: Open mmlab detection toolbox and benchmark
Original
Kai Chen, Jiaqi Wang, Jiangmiao Pang, Yuhang Cao, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, Ziwei Liu, Jiarui Xu, Zheng Zhang, Dazhi Cheng, Chenchen Zhu, Tianheng Cheng, Qijie Zhao, Buyu Li, Xin Lu, Rui Zhu, Yue Wu, Jifeng Dai, Jingdong Wang, Jianping Shi, Wanli Ouyang, Chen Change Loy, and Dahua Lin · 2019
Later among the works it cites.
SOLO: Segmenting objects by locations
Xinlong Wang, Tao Kong, Chunhua Shen, Yuning Jiang, and Lei Li · 2020
Closest in time.
BlendMask: Top-down meets bottom-up for instance segmentation
Hao Chen, Kunyang Sun, Zhi Tian, Chunhua Shen, Yongming Huang, and Youliang Yan · 2020
Closest in time.
Mask encoding for single shot instance segmentation
Rufeng Zhang, Zhi Tian, Chunhua Shen, Mingyu You, and Youliang Yan · 2020
Closest in time.
PolarMask: Single shot instance segmentation with polar representation
Enze Xie, Peize Sun, Xiaoge Song, Wenhai Wang, Xuebo Liu, Ding Liang, Chunhua Shen, and Ping Luo · 2020
Closest in time.
Conditional convolutions for instance segmentation
Zhi Tian, Chunhua Shen, and Hao Chen · 2020
Closest in time.
Centermask: single shot instance segmentation with point representation
Yuqing Wang, Zhaoliang Xu, Hao Shen, Baoshan Cheng, and Lirong Yang · 2020
Closest in time.
How much position information do convolutional neural networks encode?
Md Amirul Islam, Sen Jia, and Neil D. B. Bruce · 2020
Closest in time.
Panoptic-deeplab: A simple, strong, and fast baseline for bottom-up panoptic segmentation
Bowen Cheng, Maxwell Collins, Yukun Zhu, Ting Liu, Thomas Huang, Hartwig Adam, and Liang-Chieh Chen · 2020
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…