Awesome-Shadow-Removal

Collection of recent shadow removal works. Questions and discussions are most welcome! Upcoming works will be updated on a regular basis, feel free to contact me to add... 👍

Papers and Codes

Supervised-Deep-Learning Algorithm

• CVPR2017 DeshadowNet: A Multi-Context Embedding Deep Network for Shadow Removal [Paper] [Code]

• CVPR2018 Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removal [Paper] [Code]

• ICCV2019 Shadow Removal via Shadow Image Decomposition [Paper] [Code]

• TPAMI2019 Direction-Aware Spatial Context Features for Shadow Detection and Removal [Paper] [Code]

• AAAI2020 RIS-GAN: Explore Residual and Illumination with Generative Adversarial Networks for Shadow Removal [Paper] [Code]

• AAAI2020 Towards Ghost-Free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GAN [Paper] [Code]

• SPL2021 Mask-ShadowNet: Towards Shadow Removal via Masked Adaptive Instance Normalization [Paper] [Code]

• CVPR2021 Auto-Exposure Fusion for Single-Image Shadow Removal [Paper] [Code]

• ICCV2021 CANet: A Context-Aware Network for Shadow Removal [Paper] [Code]

• TPAMI21 Physics-based Shadow Image Decomposition for Shadow Removal [Paper]

• AAAI2022 Efficient Model-Driven Network for Shadow Removal [Paper] [Code]

• Arxiv2022 UnShadowNet: Illumination Critic Guided Contrastive Learning For Shadow Removal [Paper]

• CVPR2022 Bijective Mapping Network for Shadow Removal [Paper] [Code]

• Arxiv2022 CRFormer: A Cross-Region Transformer for Shadow Removal [Paper]

• Arxiv2022 Shadow-Aware Dynamic Convolution for Shadow Removal [Paper] [Code]

• ECCVW2022 CNSNet: A Cleanness-Navigated-Shadow Network for Shadow Removal [Paper]

• ECCV2022 Style-Guided Shadow Removal [Paper] [Code]

• CVPR2023 ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removal [Paper]

• AAAI2023 ShadowFormer: Global Context Helps Image Shadow Removal [Paper] [Code]

• WACV2023 SHARDS: Efficient SHAdow Removal using Dual Stage Network for High-Resolution Images [Paper]

• WACV2023 LRA&LDRA: Rethinking Residual Predictions for Efficient Shadow Detection and Removal [Paper]

• ACMMM2023 FSR-Net: Deep Fourier Network for Shadow Removal [Paper]

• TMM2023 A Boundary-Aware Network for Shadow Removal [Paper]

• TMM2023 A Decoupled Multi-Task Network for Shadow Removal [Paper] [Code]

• TNNLS2023 A Shadow Imaging Bilinear Model and Three-branch Residual Network for Shadow Removal [Code]

• ICCV2023 Leveraging Inpainting for Single-Image Shadow Removal [Paper] [Code]

• AAAI2024 Recasting Regional Lighting for Shadow Removal [Paper]

• AAAI2024 DeS3: Adaptive Attention-driven Self and Soft Shadow Removal using ViT Similarity [Paper] [Code]

• WACV2024 Latent Feature-Guided Diffusion Models for Shadow Removal [Paper] [Code]

• CVPR2024 HomoFormer: Homogenized Transformer for Image Shadow Removal [Paper][Code]

• Arxiv2024 Diff-Shadow: Global-guided Diffusion Model for Shadow Removal [Paper]

• Arxiv2024 SoftShadow: Leveraging Penumbra-Aware Soft Masks for Shadow Removal [Paper]

Unsupervised-Deep-Learning Algorithm

• ICCV2019 Mask-ShadowGAN: Learning to Remove Shadows from Unpaired Data [Paper] [Code]

• ECCV2020 From Shadow Segmentation to Shadow Removal [Paper] [Code]

• CVPR2021 From Shadow Generation to Shadow Removal [Paper] [Code]

• TIP2021 Shadow Removal by a Lightness-Guided Network With Training on Unpaired Data [Paper] [Code]

• Arxiv2021 Self-Supervised Shadow Removal [Paper]

• Arxiv2021 Unsupervised Shadow Removal Using Target Consistency Generative Adversarial Network [Paper]

• ICCV2021 DC-ShadowNet: Single-Image Hard and Soft Shadow Removal Using Unsupervised Domain-Classifier Guided Network [Paper] [Code]

• ICCV2023 Boundary-Aware Divide and Conquer: A Diffusion-based Solution for Unsupervised Shadow Removal [Paper]

Semi-Supervised-Deep-Learning Algorithm

• ICCV2019 ARGAN: Attentive Recurrent Generative Adversarial Network for Shadow Detection and Removal [Paper]

Portrait Shadow Removal

• SIGGRAPH2020 Portrait Shadow Manipulation [Paper] [Code]

• ACM MM2021 Unsupervised Portrait Shadow Removal via Generative Priors [Paper] [Code]

• BMVC2022 Blind Removal of Facial Foreign Shadows [Paper]

Shadow Generation

• AAAI2020 Towards Ghost-Free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GAN [Paper] [Code]

• TCSVT2021 Learning from Synthetic Shadows for Shadow Detection and Removal [Paper] [Code]

• CVPR2021 From Shadow Generation to Shadow Removal [Paper] [Code]

• CVPR2020 Learning to Shadow Hand-Drawn Sketches [Paper] [Code]

• ICCV2021 SmartShadow: Artistic Shadow Drawing Tool for Line Drawings [Paper]

• CVPR2024 Shadow Generation for Composite Image Using Diffusion Model [Paper] [Code]

Application

• ICASSP2020 Shadow removal of text document images by estimating local and global background colors [Paper]

• CVPR2020 BEDSR-Net: A Deep Shadow Removal Network From a Single Document Image [Paper]

• CVPR2022 Shadows Can Be Dangerous: Stealthy and Effective Physical-World Adversarial Attack by Natural Phenomenon [Paper] [Code]

• TGRS2022 Shadow Removal of Hyperspectral Remote Sensing Images With Multiexposure Fusion [Paper]

• AAAI2023 Estimating Reflectance Layer from A Single Image: Integrating Reflectance Guidance and Shadow/Specular Aware Learning [Paper]

Datasets

• ISTD [link]
• ISTD+ [link]
• SRD [Training][Testing]
• USR: Unpaired Shadow Removal Dataset [link]

Shadow Detectors

• CVPR2018 Direction-Aware Spatial Context Features for Shadow Detection [Paper] [Code]
• ECCV2018 Bidirectional Feature Pyramid Network with Recurrent Attention Residual Modules for Shadow Detection [Paper] [Code]
• AAAI2020 Towards Ghost-Free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GAN [Paper] [Code]
• ACM MM2022 Single Image Shadow Detection via Complementary Mechanism [Paper] [Code]
• Arxiv2023 SAM Fails to Segment Anything? -- SAM-Adapter: Adapting SAM in Underperformed Scenes: Camouflage, Shadow, Medical Image Segmentation, and More [Paper] [Code]

Instance Shadow Detectors

• CVPR2020 Instance Shadow Detection [Paper] [Code]
• CVPR2021 Single-Stage Instance Shadow Detection with Bidirectional Relation Learning [Paper] [Code]
• TPAMI2023 Instance Shadow Detection with A Single-Stage Detector [Paper] [Code]
• Arxiv2023 Video Instance Shadow Detection [Paper]

Metrics

• RMSE (Root-Mean-Square Error) [Wiki] [Matlab Code]
• PSNR (Peak Signal-to-Noise Ratio) [Wiki] [Matlab Code] [Python Code]
• SSIM (Structural similarity) [Wiki] [Matlab Code] [Python Code]
• NIQE (Naturalness Image Quality Evaluator) [Web] [Matlab Code] [Python Code]

Citation

If you find this work useful in your research, Please cite the paper as below:

@article{guo2024single,
  title={Single-Image Shadow Removal Using Deep Learning: A Comprehensive Survey},
  author={Guo, Laniqng and Wang, Chong and Wang, Yufei and Huang, Siyu and Yang, Wenhan and Kot, Alex C and Wen, Bihan},
  journal={arXiv preprint arXiv:2407.08865},
  year={2024}
}