In this paper, we propose a method of reflection removal that reduces high intensity reflection for single image. Various methods of reflection removal have been proposed, but they fail to reduce the high reflections due to their assumption. To tackle this issue, the proposed method detects the target areas with high reflections by the proposed convolutional neural network (CNN) model and estimates their background information by inpainting. It is observed that the reflection is strongly blurred because of its physical property, and hence the proposed CNN model utilizes edge features of pixels for the detection. In simulation, we compare state-of-the-art methods of reflection removal with and without the proposed method for natural images, and the proposed method improves peak signal-to-noise ratio and perceptual quality.