LSD: Real-Time Relighting Algorithm

A novel relighting algorithm has been developed that uses a compact representation of a large set of images of the scene that correspond to different lighting conditions. Unlike previous relighting algorithms, this one exploits not only image correlations over the illumination dimensions but also coherences over the spatial dimensions of the image. This enables the algorithm to achieve high quality relighting in real time. It can render 640x480 images of scenes under complex and varying illuminations at 15 frames per second using a 2GHz processor. This algorithm was used to develop a Lighting Sensitive Display that can render a 3D scene such that it always appears to be lit by the real environment that the display resides in.

The relighting algorithm has been re-implemented and made publicly available by Sebastian Enrique and Ravi Ramamoorthi of Columbia's Computer Graphics Laboratory. It can be downloaded from here.

Related Publications

"Lighting Sensitive Display,"
S.K. Nayar, P.N. Belhumeur and T.E. Boult,
ACM Transactions on Graphics,
Vol.23, No.4, pp.963-979, Oct, 2004.
[PDF] [bib] [©]


"Lighting Sensitive Display,"
S.K. Nayar, P.N. Belhumeur and T.E. Boult,
Proceedings of ACM SIGGRAPH, Technical Sketch,
Vol.23, No.4, pp.963-979,
Oct, 2004.
[PDF] [bib] [©]