DSC-PyTorch

This is a PyTorch implementation of "Direction-Aware Spatial Context Features for Shadow Detection, CVPR'18" and "Direction-Aware Spatial Context Features for Shadow Detection and Removal, T-PAMI'19" based on Xiaowei's DSC (Caffe) written by Tianyu Wang.

The Spacial IRNN is implemented by using CUDA 11.x. The backbone is ResNeXt101 pre-trained on ImageNet and the implementation of loss is from Quanlong Zheng.

Results

Please find the new results at https://github.com/xw-hu/Unveiling-Deep-Shadows.

SBU

Methods	BER	Accuracy
DSC (Caffe)	5.59	0.97
DSC (Our)	5.19	0.95

Pre-trained model is available. You can download from OneDrive and put it into SBU_model folder.

• You can download the ResNeXt101 model from Google Drive and put it in main folder.

Requirements

• PyTorch == 1.8.1 (training and testing)
• Cupy (Installation Guide)
• TensorBoardX
• Python
• progressbar2
• scikit-image
• pydensecrf

Train/Test

1. Clone this repository

git clone https://github.com/stevewongv/DSC-PyTorch.git

2. Train

python3 main.py -a train    # For Shadow Detection
python3 main_sr.py -a train # For Shadow Removal

3. Test

python3 main.py -a test    # For Shadow Detection
python3 main_sr.py -a test # For Shadow Removal

Citations

@InProceedings{Hu_2018_CVPR,      
    author = {Hu, Xiaowei and Zhu, Lei and Fu, Chi-Wing and Qin, Jing and Heng, Pheng-Ann},      
    title = {Direction-Aware Spatial Context Features for Shadow Detection},      
    booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},      
    pages={7454--7462},        
    year = {2018}
}

@article{hu2020direction,
     author = {Hu, Xiaowei and Fu, Chi-Wing and Zhu, Lei and Qin, Jing and Heng, Pheng-Ann},
     title = {Direction-Aware Spatial Context Features for Shadow Detection and Removal},
     journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
     pages={2795--2808},
     year = {2020}
}

Modified DSC module is used in SPANet:

@InProceedings{Wang_2019_CVPR,
  author = {Wang, Tianyu and Yang, Xin and Xu, Ke and Chen, Shaozhe and Zhang, Qiang and Lau, Rynson W.H.},
  title = {Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset},
  booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  month = {June},
  year = {2019}
}

TODO List

• ResNext101 Backbone
• Test on SBU Test Set
• VGG19 Backbone
• Test on ISTD Test Set
• Test on UCF Test Set
• ...