Deep spectral reflectance and illuminant estimation from self-interreflections. 2019

Rada Deeb, and Joost Van de Weijer, and Damien Muselet, and Mathieu Hebert, and Alain Tremeau

In this work, we propose a convolutional neural network based approach to estimate the spectral reflectance of a surface and spectral power distribution of light from a single RGB image of a V-shaped surface. Interreflections happening in a concave surface lead to gradients of RGB values over its area. These gradients carry a lot of information concerning the physical properties of the surface and the illuminant. Our network is trained with only simulated data constructed using a physics-based interreflection model. Coupling interreflection effects with deep learning helps to retrieve the spectral reflectance under an unknown light and to estimate spectral power distribution of this light as well. In addition, it is more robust to the presence of image noise than classical approaches. Our results show that the proposed approach outperforms state-of-the-art learning-based approaches on simulated data. In addition, it gives better results on real data compared to other interreflection-based approaches.

UI MeSH Term Description Entries

Related Publications

Rada Deeb, and Joost Van de Weijer, and Damien Muselet, and Mathieu Hebert, and Alain Tremeau
June 2018, Applied optics,
Rada Deeb, and Joost Van de Weijer, and Damien Muselet, and Mathieu Hebert, and Alain Tremeau
March 2024, Journal of the Optical Society of America. A, Optics, image science, and vision,
Rada Deeb, and Joost Van de Weijer, and Damien Muselet, and Mathieu Hebert, and Alain Tremeau
January 2021, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Rada Deeb, and Joost Van de Weijer, and Damien Muselet, and Mathieu Hebert, and Alain Tremeau
December 1977, Applied optics,
Rada Deeb, and Joost Van de Weijer, and Damien Muselet, and Mathieu Hebert, and Alain Tremeau
October 2007, Applied optics,
Rada Deeb, and Joost Van de Weijer, and Damien Muselet, and Mathieu Hebert, and Alain Tremeau
November 2007, Guang pu xue yu guang pu fen xi = Guang pu,
Rada Deeb, and Joost Van de Weijer, and Damien Muselet, and Mathieu Hebert, and Alain Tremeau
January 2024, Optics express,
Rada Deeb, and Joost Van de Weijer, and Damien Muselet, and Mathieu Hebert, and Alain Tremeau
July 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Rada Deeb, and Joost Van de Weijer, and Damien Muselet, and Mathieu Hebert, and Alain Tremeau
November 2020, Journal of the Optical Society of America. A, Optics, image science, and vision,
Rada Deeb, and Joost Van de Weijer, and Damien Muselet, and Mathieu Hebert, and Alain Tremeau
January 2002, Journal of vision,
Copied contents to your clipboard!