scnet

SCNet

SCNet: Training Inference Sample Consistency for Instance Segmentation

Abstract

Cascaded architectures have brought significant performance improvement in object detection and instance segmentation. However, there are lingering issues regarding the disparity in the Intersection-over-Union (IoU) distribution of the samples between training and inference. This disparity can potentially exacerbate detection accuracy. This paper proposes an architecture referred to as Sample Consistency Network (SCNet) to ensure that the IoU distribution of the samples at training time is close to that at inference time. Furthermore, SCNet incorporates feature relay and utilizes global contextual information to further reinforce the reciprocal relationships among classifying, detecting, and segmenting sub-tasks. Extensive experiments on the standard COCO dataset reveal the effectiveness of the proposed method over multiple evaluation metrics, including box AP, mask AP, and inference speed. In particular, while running 38% faster, the proposed SCNet improves the AP of the box and mask predictions by respectively 1.3 and 2.3 points compared to the strong Cascade Mask R-CNN baseline.

Dataset

SCNet requires COCO and COCO-stuff dataset for training. You need to download and extract it in the COCO dataset path. The directory should be like this.

mmdetection
├── mmdet
├── tools
├── configs
├── data
│   ├── coco
│   │   ├── annotations
│   │   ├── train2017
│   │   ├── val2017
│   │   ├── test2017
|   |   ├── stuffthingmaps

Results and Models

The results on COCO 2017val are shown in the below table. (results on test-dev are usually slightly higher than val)

Backbone	Style	Lr schd	Mem (GB)	Inf speed (fps)	box AP	mask AP	TTA box AP	TTA mask AP	Config	Download
R-50-FPN	pytorch	1x	7.0	6.2	43.5	39.2	44.8	40.9	config	model | log
R-50-FPN	pytorch	20e	7.0	6.2	44.5	40.0	45.8	41.5	config	model | log
R-101-FPN	pytorch	20e	8.9	5.8	45.8	40.9	47.3	42.7	config	model | log
X-101-64x4d-FPN	pytorch	20e	13.2	4.9	47.5	42.3	48.9	44.0	config	model | log

Notes

• Training hyper-parameters are identical to those of HTC.
• TTA means Test Time Augmentation, which applies horizontal flip and multi-scale testing. Refer to config.

Citation

We provide the code for reproducing experiment results of SCNet.

@inproceedings{vu2019cascade,
  title={SCNet: Training Inference Sample Consistency for Instance Segmentation},
  author={Vu, Thang and Haeyong, Kang and Yoo, Chang D},
  booktitle={AAAI},
  year={2021}
}