Single Image Raindrop Removal Using a Non-Local Operator and Feature Maps in the Frequency Domain

Shinya Ezumi, Masaaki Ikehara

研究成果: Article査読

2 被引用数 (Scopus)


Taking a photo on a rainy day may result in a photo with raindrops. Images containing raindrops have a significant impact on the visual impression and accuracy when applied to image recognition systems. Thus, an automatic high-quality raindrop removal method is desired for outdoor image processing systems as well as for acquiring good-looking images. Several existing methods have been proposed to tackle this problem, but they often fail to keep global consistency and generate unnatural patterns. In this paper, we tackle this problem by introducing a non-local operator. The non-local operator combines features in distant locations with matrix multiplication and enables consistency in distant locations. In addition, high-frequency components such as edges are more affected in images with raindrops. Inspired by the nature that high-frequency components can be separated from other components in the frequency domain, we also propose to process feature maps in the frequency domain, which are obtained by the fast Fourier transform operation and processed by several convolution layers. Experimental results show that our method effectively removes raindrops and achieves state-of-the-art performance.

ジャーナルIEEE Access
出版ステータスPublished - 2022

ASJC Scopus subject areas

  • 工学一般
  • 材料科学一般
  • 電子工学および電気工学
  • コンピュータサイエンス一般


「Single Image Raindrop Removal Using a Non-Local Operator and Feature Maps in the Frequency Domain」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。