Awesome-Thermal-Segmentation

A curated list of resources for deep semantic/instance/panoptic segmentation for thermal image

Table of contents

• 1. Dataset for RGB-Thermal Segmentation
• 2. Deep RGB-Thermal Segmentation
• 2-1. RGB-Thermal Semantic Segmentation
• 3. Dataset for Thermal Segmentation
• 4. Deep Thermal Segmentation
• 4-1. Thermal Semantic Segmentation

1. Dataset for RGB-Thermal Segmentation

Dataset List

Publication	Title	Sensor	Scene Types	Label Type	Highlight	Dataset Link
IROS 17	Mfnet: Towards real-time semantic segmentation for autonomous vehicles with multispectral scenes	TBA	Outdoor	Semantic Seg	Aligned 820 day, 749 nighttime RGB-T images, 8 classes	Here
ICRA 20	Pst900: Rgbthermal calibration, dataset and segmentation network	TBA	TBA	Semantic Seg	Aligned 894 RGB-T images, 4 classes	Here
IROS 20	Heatnet: Bridging the day-night domain gap in semantic segmentation with thermal images	TBA	TBA	Semantic Seg	32 day, 32 nighttime RGB-T images, 13 classes	Here
RA-L 21	MS-UDA: Multi-Spectral Unsupervised Domain Adaptation for Thermal Image Semantic Segmentation	TBA	Outdoor	Semantic Seg	Aligned 950 Day-Night RGb-T images, 19 classes	Here

---

2. Deep RGB-Thermal Segmentation

2.1 RGB-Thermal Semantic Segmentation

Paper List

Publication	Title	Code	Highlight
IROS 17	Mfnet: Towards real-time semantic segmentation for autonomous vehicles with multispectral scenes	Here	TBA
RA-L 19	Rtfnet: Rgbthermal fusion network for semantic segmentation of urban scenes	Here	TBA
ICRA 20	Pst900: Rgbthermal calibration, dataset and segmentation network	Here	TBA
T-ASE 20	Fuseseg: semantic segmentation of urban scenes based on rgb and thermal data fusion	Here	TBA
IROS 20	Heatnet: Bridging the day-night domain gap in semantic segmentation with thermal images	Here	TBA
IROS 21	FEANet: Feature-Enhanced Attention Network for RGB-Thermal Real-time Semantic Segmentation	Here	TBA
TIP 21	Gmnet: graded-feature multilabel-learning network for rgb-thermal urban scene semantic segmentation	Here	TBA
Applied Intelligence 21	Mmnet: Multimodal multi-stage network for rgb-t image semantic segmentation	Here	TBA
CVPR 21	Abmdrnet: Adaptive-weighted bi-directional modality difference reduction network for rgb-t semantic segmentation	Here	TBA
PRL 21	Attention fusion network for multi-spectral semantic segmentation	Here	TBA
AAAI 22	Edge-aware Guidance Fusion Network for RGB–Thermal SceneParsing	Here	TBA
Neurocomputing 22	CCAFFMNet: Dual-spectral semantic segmentation network with channel-coordinate attention feature fusion module	Here	TBA
TIV 22	MTANet: Multitask-Aware Network with Hierarchical Multimodal Fusion for RGB-T Urban Scene Understanding	Here	TBA
ACPR 22	ARTSeg: Employing Attention for Thermal Images Semantic Segmentation	Here	TBA
Arxiv 22	CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers	Here	TBA

3. Dataset for Thermal Segmentation

Dataset List

Publication	Title	Sensor	Scene Types	Label Type	Highlight	Dataset Link
TNNLS 20	Segmenting objects in day and night: Edge-conditioned cnn for thermal image semantic segmentation	TBA	TBA	Semantic Seg	2168 Real, 5000 synthetic images	Here
Infrared Physics & Technology 21	Mcnet: Multilevel correction network for thermal image semantic segmentation of nighttime driving scene	TBA	Outdoor	TBA	Semantic Seg	Here

---

4. Deep Thermal Segmentation

4.1 Thermal Semantic Segmentation

Paper List

Publication	Title	Code	Highlight
TNNLS 20	Segmenting objects in day and night: Edge-conditioned cnn for thermal image semantic segmentation	Here	TBA
Infrared Physics & Technology 21	Mcnet: Multilevel correction network for thermal image semantic segmentation of nighttime driving scene	Here	TBA
IEEE Access 21	Ftnet: Feature transverse network for thermal image semantic segmentation	Here	TBA

---