Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ljzycmd committed Apr 2, 2022
1 parent e6507de commit e1dd0aa
Showing 1 changed file with 8 additions and 5 deletions.
13 changes: 8 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,5 @@
# BS-RSC

(This Repo is under construction)

[CVPR2022] Learning Adaptive Warping for Real-World Rolling Shutter Correction

> This paper proposes the first real-world rolling shutter (RS) correction dataset, BS-RSC, and a corresponding model to correct the RS frames in a distorted video. Mobile devices in the consumer market with CMOS-based sensors for video capture often result in rolling shutter effects when relative movements occur during the video acquisition process, calling for RS effect removal techniques. However, current state-of-the-art RS correction methods often fail to remove RS effects in real scenarios since the motions are various and hard to model. To address this issue, we propose a real-world RS correction dataset BS-RSC. Real distorted videos with corresponding ground truth are recorded simultaneously via a well-designed beam-splitter-based acquisition system. BS-RSC contains various motions of both camera and objects in dynamic scenes. Further, an RS correction model with adaptive warping is proposed. Our model can warp the learned RS features into global shutter counterparts adaptively with predicted multiple displacement fields. These warped features are aggregated and then reconstructed into high-quality global shutter frames in a coarse-to-fine strategy. Experimental results demonstrate the effectiveness of the proposed method, and our dataset can improve the model's ability to remove the RS effects in the real world.
Expand All @@ -10,13 +8,14 @@

We contribute the first real-world RSC dataset BS-RSC with various motions collected by a well-designed beam-splitter acquisition system, bridging the gap for real-world RSC tasks.

[[Download](https://drive.google.com/file/d/1h7UP1kci8zbg3TQp37J-imrvzlh2X6zn/view?usp=sharing)]
[[Download](https://drive.google.com/file/d/1Yp0kZJ6LGBmt1_kx92PtXaoJo6W2r9mW/view?usp=sharing)]

## Adaptive Warping

We propose an adaptive warping module to exploit high-quality GS frame restoration features better to mitigate inaccurate RS motion estimation and warping problems.
We propose an adaptive warping module to exploit **multiple motion fileds strategy** and **adaptive warping based on self-attention mechanism** for high-quality GS frame restoration, mitigating inaccurate RS motion estimation and warping problems in existing CNN-based RSC methods.

## Visual Results

Visual comparison on BS-RSC

<img src="./docs/results_on_bsrsc.png">
Expand All @@ -25,7 +24,7 @@ Visual comparison on existing synthetic RSC dataset Fastec-RS

<img src="./docs/results_on_fastecrs.png">

## ...
## (This Repo is under construction)

## Citation

Expand All @@ -39,3 +38,7 @@ If the proposed model and dataset are useful for your research, please consider
year={2022}
}
```

## Contact

If you have any questions about our project, please feel free to contact me at `mingdengcao [AT] gmail.com`.

0 comments on commit e1dd0aa

Please sign in to comment.