3-VSS.md

3. Deep Learning-based Video Semantic Segmentation

3.1 (Instance-agnostic) VideoSemanticSegmentation (VSS)

3.1.1 Efforts towards More Accurate Segmentation

Year	Publication	Paper Title	Project
2016	CVPR	Feature space optimization for semantic video segmentation	--
2016	ECCV	Joint optical flow and temporally consistent semantic segmentation	--
2017	ICCV	Video scene parsing with predictive feature learning	--
2017	ICCV	Semantic video cnns through representation warping	Code, Project
2018	CVPR	Semantic video segmentation by gated recurrent flow propagation	Code
2018	CVPR	Deep spatio-temporal random fields for efficient video segmentation	Code
2018	ECCV	Efficient uncertainty estimation for semantic segmentation in videos	Code
2020	AAAI	Every frame counts: joint learning of video segmentation and optical flow	--

3.1.2 Efforts towards Faster Segmentation

Year	Publication	Paper Title	Project
2016	ECCV	Clockwork convnets for video semantic segmentation	--
2017	CVPR	Deep feature flow for video recognition	Code
2017	CVPR	Budget-aware deep semantic video segmentation	--
2018	CVPR	Dynamic video segmentation network	Code
2018	CVPR	Low-latency video semantic segmentation	--
2019	CVPR	Accel: A corrective fusion network for efficient semantic segmentation on video	--
2020	CVPR	Temporally distributed networks for fast video semantic segmentation	Code
2020	ECCV	Efficient semantic video segmentation with per-frame inference	Code

3.1.3 Semi-/Weakly-supervised based

Year	Publication	Paper Title	Project
2017	ICCV	Bringing background into the foreground: Making all classes equal in weakly-supervised video semantic segmentation	--
2019	CVPR	Improving semantic segmentation via video propagation and label relaxation	Code, Project
2020	ECCV	Naive-student: Leveraging semi-supervised learning in video sequences for urban scene segmentation	--

3.2 Video Instance Segmentation (VIS)

Year	Publication	Paper Title	Project
2019	arXiv	Learning a spatio-temporal embedding for video instance segmentation	--
2019	CVPR	Mots: Multi-object tracking and segmentation	Code
2019	ICCV	Video instance segmentation	Code
2020	CVPR	Learning multi-object tracking and segmentation from automatic annotations	--
2020	CVPR	Video instance segmentation tracking with a modified vae architecture	--
2020	CVPR	Classifying, segmenting, and tracking object instances in video with mask propagation	--
2020	ECCV	Sipmask: Spatial information preservation for fast image and video instance segmentation	Code
2020	ECCV	Stem-seg: Spatio-temporal embeddings for instance segmentation in videos	Code
2021	AAAI	Compfeat: Comprehensive feature aggregation for video instance segmentation	Code
2021	CVPR	Track to detect and segment: An online multi-object tracker	Code,Project
2021	CVPR	Sg-net: Spatial granularity network for one-stage video instance segmentation	Code
2021	CVPR	End-to-end video instance segmentation with transformers	Code
2021	CVPR	Weakly supervised instance segmentation for videos with temporal mask consistency	--
2021	CVPR	Learning to track instances without video annotations	Project
2021	ICCV	Video instance segmentation with a propose-reduce paradigm	Code
2021	ICCV	Crossover learning for fast online video instance segmentation	Code
2022	PAMI	Video Instance Segmentation using Dynamic Network	Code

3.3 Video Panoptic Segmentation (VPS)

Year	Publication	Paper Title	Project
2020	CVPR	Video panoptic segmentation	--
2021	CVPR	Learning to associate every segment for video panoptic segmentation	--
2021	CVPR	Vipdeeplab: Learning visual perception with depth-aware video panoptic segmentation	Code
2022	CVPR	Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentation	Code