Programmable Imaging: Micro-Mirror Arrays |
 | In this project, we develop the notion of a programmable imaging system.
Such an imaging system provides a human user or a vision system significant
control over the radiometric and geometric characteristics of the system. This
flexibility is achieved using a programmable array of micro-mirrors. The
orientations of the mirrors of the array can be controlled with high precision
over space and time. This enables the system to select and modulate rays from
the scene's light field based on the needs of the application at hand.
We have implemented a programmable imaging system that uses a digital
micro-mirror device (DMD), which is used in digital light processing. Although
the mirrors of this device can only be positioned in one of two states, we show
that our system can be used to implement a wide variety of imaging functions,
including, high dynamic range imaging, feature detection and object
recognition. We also show how a micro-mirror array that allows full control
over the orientations of its mirrors can be used to instantly change the field
of view and resolution characteristics of the imaging system. |
Publications
"Programmable Imaging: Towards a Flexible Camera,"
S. K. Nayar, V. Branzoi, and T. E. Boult,
International Journal on Computer Vision,
Oct. 2006.
[PDF] [bib] [©]
"Programmable Imaging using a Digital Micromirror Array,"
S.K. Nayar, V. Branzoi and T. Boult,
IEEE Conference on Computer Vision and Pattern Recognition (CVPR),
Vol. I, pp. 436-443, Jun. 2004.
[PDF] [bib] [©]
|
Images
 |
|
Programmable Imaging:
The optics and computational module of a programmable imaging system can be
controlled via software to perform a wide range of imaging functionalities.
This allows a single physical imaging system to emulate a variety of
specialized cameras.
|
| |
|
|
 |
|
Programmable Imaging Using a Micro-Mirror Array:
If the orientations of the individual mirrors can be controlled with high
precision and speed, scene rays can be selected and modulated in a variety of
ways, each leading to a different imaging system. The end result is a single
imaging system that can perform the functions of a wide range of specialized
cameras.
|
| |
|
|
 |
|
Digital Micromirror Array:
Our implementation of programmable imaging uses a digital micro-mirror device
(DMD) developed by Texas Instruments. The most recent DMDs have more than a
million mirrors, each mirror roughly 14x14 microns in size. The mirrors can be
oriented with high precision and speed at +10 or -10 degrees.
|
| |
|
|
 |
|
Imaging Through a DMD:
The scene image is focused onto the DMD plane. The image reflected by the DMD
is re-imaged onto a CCD. The programmable controller captures CCD images and
outputs DMD (modulation) images.
|
| |
|
|
 |
|
Prototype System:
A re-engineered LP-400 Infocus projector in which the projector lens is used
as an imaging lens that focuses the scene onto the DMD. The image reflected by
the DMD is then re-imaged by a CCD camera. Camera images are processed and DMD
modulation images are generated using a PC.
|
| |
|
|
 |
|
Examples of Modulation:
Examples that show how image irradiance is modulated with high resolution
using the DMD.
|
| |
|
|
|
Video
 |
|
CVPR 2004 Video:
This video describes the prototype programmable imaging system and shows its
applications to high dynamic range imaging, feature detection and object
recognition. (With narration)
|
| |
|
|
|
Slides
CVPR 2004 presentation With videos (zip file)
|
Programmable Imaging: Controllable Apertures
Coded Rolling Shutter Photography:
Flexible Space-Time Sampling
Adaptive Dynamic Range Imaging
Appearance Matching
High Dynamic Range Imaging: Assorted Pixels
High Dynamic Range Imaging: Multiple Exposures
Catadioptric Cameras for 360 Degree Imaging
|
|
|
