Programmable Imaging: Micro-Mirror Arrays |
 |
In this project, we develop the notion of a programmable imaging system. Such an imaging system provides a human user or a vision system significant control over the radiometric and geometric characteristics of the system. This flexibility is achieved using a programmable array of micro-mirrors. The orientations of the mirrors of the array can be controlled with high precision over space and time. This enables the system to select and modulate rays from the scene's light field based on the needs of the application at hand.
We have implemented a programmable imaging system that uses a digital micro-mirror device (DMD), which is used in digital light processing. Although the mirrors of this device can only be positioned in one of two states, we show that our system can be used to implement a wide variety of imaging functions, including, high dynamic range imaging, feature detection and object recognition. We also show how a micro-mirror array that allows full control over the orientations of its mirrors can be used to instantly change the field of view and resolution characteristics of the imaging system.
|
Publications
print_paperentry_byid: more than 2 or no entry matches.
print_paperentry_byid: more than 2 or no entry matches.
|
Pictures
 |
|
Programmable Imaging:
The optics and computational module of a programmable imaging system can be controlled via software to perform a wide range of imaging functionalities. This allows a single physical imaging system to emulate a variety of specialized cameras.
|
 |
|
Programmable Imaging Using a Micro-Mirror Array:
If the orientations of the individual mirrors can be controlled with high precision and speed, scene rays can be selected and modulated in a variety of ways, each leading to a different imaging system. The end result is a single imaging system that can perform the functions of a wide range of specialized cameras.
|
 |
|
Digital Micromirror Array:
Our implementation of programmable imaging uses a digital micro-mirror device (DMD) developed by Texas Instruments. The most recent DMDs have more than a million mirrors, each mirror roughly 14x14 microns in size. The mirrors can be oriented with high precision and speed at +10 or -10 degrees.
|
 |
|
Imaging Through a DMD:
The scene image is focused onto the DMD plane. The image reflected by the DMD is re-imaged onto a CCD. The programmable controller captures CCD images and outputs DMD (modulation) images.
|
 |
|
Prototype System:
A re-engineered LP-400 Infocus projector in which the projector lens is used as an imaging lens that focuses the scene onto the DMD. The image reflected by the DMD is then re-imaged by a CCD camera. Camera images are processed and DMD modulation images are generated using a PC.
|
 |
|
Examples of Modulation:
Examples that show how image irradiance is modulated with high resolution using the DMD.
|
|
Videos
 |
|
CVPR 2004 Video:
This video describes the prototype programmable imaging system and shows its applications to high dynamic range imaging, feature detection and object recognition. (With narration)
|
|
Slides
CVPR 2004 presentation With videos (zip file)
|
Related Projects
Adaptive Dynamic Range Imaging
Appearance Matching
High Dynamic Range Imaging: Assorted Pixels
High Dynamic Range Imaging: Multiple Exposures
Catadioptric Cameras for 360 Degree Imaging
|
