2020

Two-Stage Single Image Reflection Removal with Reflection-Aware Guidance

Li, Yu, Liu, Ming, Yi, Yaling et al.

Understand

Removing undesired reflection from an image captured through a glass surface is a very challenging problem with many practical application scenarios.

For improving reflection removal, cascaded deep models have been usually adopted to estimate the transmission in a progressive manner.
However, most existing methods are still limited in exploiting the result in prior stage for guiding transmission estimation.
In this paper, we present a novel two-stage network with reflection-aware guidance (RAGNet) for single image reflection removal (SIRR).

Built on

Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber · 1997
Earlier work this paper cites.
Separation of transparent layers using focus
Yoav Y. Schechner, Nahum Kiryati, and Ronen Basri · 2000
Earlier work this paper cites.
Layer extraction from multiple images containing reflections and transparency
Richard Szeliski, Shai Avidan, and Padmanabhan Anandan · 2000
Earlier work this paper cites.
Separating transparent layers through layer information exchange
Bernard Sarel and Michal Irani · 2004
Earlier work this paper cites.
Removing photography artifacts using gradient projection and flash-exposure sampling
Amit Agrawal, Ramesh Raskar, Shree K. Nayar, and Yuanzhen Li · 2005
Earlier work this paper cites.
User assisted separation of reflections from a single image using a sparsity prior
Anat Levin and Yair Weiss · 2007
Earlier work this paper cites.
The pascal visual object classes (voc) challenge
Mark Everingham, Luc Van Gool, Christopher KI Williams, John Winn, and Andrew Zisserman · 2010
Earlier work this paper cites.
Blind separation of superimposed moving images using image statistics
Kun Gai, Zhenwei Shi, and Changshui Zhang · 2012
Earlier work this paper cites.
Image-based rendering for scenes with reflections
Sudipta N Sinha, Johannes Kopf, Michael Goesele, Daniel Scharstein, and Richard Szeliski · 2012
Earlier work this paper cites.
Separating reflective and fluorescent components using high frequency illumination in the spectral domain
Ying Fu, Antony Lam, Imari Sato, Takahiro Okabe, and Yoichi Sato · 2013
Earlier work this paper cites.
Exploiting reflection change for automatic reflection removal
Yu Li and Michael S. Brown · 2013
Earlier work this paper cites.
Generative adversarial nets
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio · 2014
Earlier work this paper cites.
Robust separation of reflection from multiple images
Xiaojie Guo, Xiaochun Cao, and Yi Ma · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
Original
Diederik P Kingma and Jimmy Ba · 2014
Earlier work this paper cites.

Similar

Single image layer separation using relative smoothness
Yu Li and Michael S. Brown · 2014
Cited alongside, same era.
Very deep convolutional networks for large-scale image recognition
Original
Karen Simonyan and Andrew Zisserman · 2014
Cited alongside, same era.
U-net: Convolutional networks for biomedical image segmentation
Olaf Ronneberger, Philipp Fischer, and Thomas Brox · 2015
Cited alongside, same era.
Reflection removal using ghosting cues
YiChang Shih, Dilip Krishnan, Fredo Durand, and William T. Freeman · 2015
Cited alongside, same era.
Reflection removal for in-vehicle black box videos
Christian Simon and In Kyu Park · 2015
Cited alongside, same era.
A computational approach for obstruction-free photography
Tianfan Xue, Michael Rubinstein, Ce Liu, and William T Freeman · 2015
Cited alongside, same era.
Perceptual losses for real-time style transfer and super-resolution
Justin Johnson, Alexandre Alahi, and Li Fei-Fei · 2016
Cited alongside, same era.
Automatic reflection removal using gradient intensity and motion cues
Chao Sun, Shuaicheng Liu, Taotao Yang, Bing Zeng, Zhengning Wang, and Guanghui Liu · 2016
Cited alongside, same era.
Depth of field guided reflection removal
Renjie Wan, Boxin Shi, Ah-Hwee Tan, and Alex C. Kot · 2016
Cited alongside, same era.
Robust optical flow estimation of double-layer images under transparency or reflection
Jiaolong Yang, Hongdong Li, Yuchao Dai, and Robby T. Tan · 2016
Cited alongside, same era.
Single image reflection suppression
Nikolaos Arvanitopoulos, Radhakrishna Achanta, and Sabine Susstrunk · 2017
Cited alongside, same era.
A generic deep architecture for single image reflection removal and image smoothing
Qingnan Fan, Jiaolong Yang, Gang Hua, Baoquan Chen, and David Wipf · 2017
Cited alongside, same era.

Then

Benchmarking single-image reflection removal algorithms
Renjie Wan, Boxin Shi, Ling-Yu Duan, Ah-Hwee Tan, and Alex C. Kot · 2017
Later among the works it cites.
Image inpainting for irregular holes using partial convolutions
Guilin Liu, Fitsum A. Reda, Kevin J. Shih, Ting-Chun Wang, Andrew Tao, and Bryan Catanzaro · 2018
Later among the works it cites.
Partial convolution based padding
Original
Guilin Liu, Kevin J Shih, Ting-Chun Wang, Fitsum A Reda, Karan Sapra, Zhiding Yu, Andrew Tao, and Bryan Catanzaro · 2018
Later among the works it cites.
Region-aware reflection removal with unified content and gradient priors
Renjie Wan, Boxin Shi, Ling-Yu Duan, Ah-Hwee Tan, Wen Gao, and Alex C Kot · 2018
Later among the works it cites.
Separating reflection and transmission images in the wild
Patrick Wieschollek, Orazio Gallo, Jinwei Gu, and Jan Kautz · 2018
Later among the works it cites.
Seeing deeply and bidirectionally: A deep learning approach for single image reflection removal
Jie Yang, Dong Gong, Lingqiao Liu, and Qinfeng Shi · 2018
Later among the works it cites.
Single image reflection separation with perceptual losses
Xuaner Zhang, Ren Ng, and Qifeng Chen · 2018
Later among the works it cites.
Pytorch: An imperative style, high-performance deep learning library
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al · 2019
Later among the works it cites.
Reflection removal using a dual-pixel sensor
Abhijith Punnappurath and Michael S. Brown · 2019
Later among the works it cites.
Single image reflection removal exploiting misaligned training data and network enhancements
Kaixuan Wei, Jiaolong Yang, Ying Fu, David Wipf, and Hua Huang · 2019
Later among the works it cites.
Image inpainting with learnable bidirectional attention maps
Chaohao Xie, Shaohui Liu, Chao Li, Ming-Ming Cheng, Wangmeng Zuo, Xiao Liu, Shilei Wen, and Errui Ding · 2019
Later among the works it cites.
Single image reflection removal through cascaded refinement
Chao Li, Yixiao Yang, Kun He, Stephen Lin, and John E. Hopcroft · 2020
Closest in time.
Polarized reflection removal with perfect alignment in the wild
Chenyang Lei, Xuhua Huang, Mengdi Zhang, Qiong Yan, Wenxiu Sun, and Qifeng Chen · 2020
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…