Video Rain Streak Removal By Multiscale Convolutional Sparse Coding

project dataset

========================================================= Version 1.0, 28-Apr-2018

The code has been tested with MATLAB 2017b on Windows.

Use of this code is free for research purposes only. Shall not be used for commercial purposes! All copyrights belong to the original authors. The technology has applied for patents. If you want to purchase the patents for commercial purposes, please contact the corresponding author: Deyu Meng, [email protected]. Thank you!

Usage:

1. Unpack the contents of the compressed file to a new directory.

2. Run the DemoY.

Dataset:

Synthetic rain video:

'park.mat', 'highway.mat', 'man.mat', corresponding to Fig. 3-5 in the reference.

Real rain video: 'wall.mat', 'compfinal.mat', 'night.mat' corresponding to Fig. 6-8 in the reference, respectively.

More experiments on real videos are shown in project . The dataset can be downloaded from here .

Acknowledgments

Code partly borrows from:

[1] Wei Wei, Liyuan Yi, Qi Xie, Qian Zhao, Deyu Meng, Zongben Xu, Should We Encode Rain Streaks in Video as Deterministic or Stochastic? ICCV, 2017.

[2] Shuhang Gu, Deyu Meng, Wangmeng Zuo, Lei Zhang. Joint Convolutional Analysis and Synthesis Sparse Representation for Single Image Layer Separation. ICCV, 2017. Thanks for sharing!

Reference and Our latest paper

We propose a new online rain/snow removal method from surveillance videos by fully encoding the dynamic statistics of both rain/snow and background scenes in a video along time into the model, and realizing it with an online mode to make it potentially available to handle constantly coming streaming video sequence.

Minghan Li, Xiangyong Cao, Qian Zhao, Lei Zhang, Deyu Meng

Please go to the Homepage to obtain more information about our work.

@inproceedings{li2018video,
  title={Video rain streak removal by multiscale convolutional sparse coding},
  author={Li, Minghan and Xie, Qi and Zhao, Qian and Wei, Wei and Gu, Shuhang and Tao, Jing and Meng, Deyu},
  booktitle={Proceedings of the IEEE conference on computer vision and pattern recognition},
  pages={6644--6653},
  year={2018}
}
@article{Li2021OnlineRR,
  title={Online Rain/Snow Removal From Surveillance Videos},
  author={Minghan Li and Xiangyong Cao and Q. Zhao and L. Zhang and Deyu Meng},
  journal={IEEE Transactions on Image Processing},
  year={2021},
  volume={30},
  pages={2029-2044}
}

Contact

If you have any questions, please feel free to contact Minghan Li([email protected]).