Vision through Fog and Haze |
 |
|
Conventional vision systems are designed to perform in clear weather. Needless to say, in any outdoor application, there is no escape from "bad" weather. Images taken in poor weather conditions suffer from severe color and contrast degradation. Furthermore, this degradation worsens exponentially with distance making it impossible to acquire meaningful images of scenes that are not near the imaging system. Thus, computer vision systems must include mechanisms that enable them to function (even if somewhat less reliably) in the presence of haze, fog, rain, hail and snow. In this project, we are studying the visual manifestations of different weather conditions. For this, we draw on what is already known about atmospheric optics, and identify effects caused by bad weather that can be turned to our advantage. Since the atmosphere modulates the information carried from a scene point to the observer, it can be viewed as a mechanism of visual information coding. We exploit two fundamental scattering models, attenuation and airlight, to describe the colors, contrasts and polarizations of scene points observed through bad weather. Then, we use these models to develop methods for recovering pertinent scene properties, such as three-dimensional structure, from one or two images taken under poor weather conditions.
|
Publications
print_paperentry_byid: more than 2 or no entry matches.
print_paperentry_byid: more than 2 or no entry matches.
print_paperentry_byid: more than 2 or no entry matches.
print_paperentry_byid: more than 2 or no entry matches.
print_paperentry_byid: more than 2 or no entry matches.
print_paperentry_byid: more than 2 or no entry matches.
print_paperentry_byid: more than 2 or no entry matches.
print_paperentry_byid: more than 2 or no entry matches.
print_paperentry_byid: more than 2 or no entry matches.
print_paperentry_byid: more than 2 or no entry matches.
|
Pictures
 |
|
Depth of Light Sources from Attenuation:
This picture shows results of an experiment where two night images of light sources under different weather conditions are used to compute the relative depths of the sources.
|
 |
|
Structure from Airlight:
This picture shows results of an experiment where a single image of a scene captured on a very foggy day is used to compute three-dimensional scene structure.
|
 |
|
Contrast Restoration:
While airlight increases the apparent brightness of the scene with distance, attenuation decreases the actual scene radiance with distance. We take into account both airlight and attenuation to model the contrast loss in images. This
picture shows the results of applying our contrast restoration algorithm to two images taken in different but unknown misty conditions.
|
 |
|
Weather and Polarization:
The natural light scattered by atmospheric particles (airlight) is partially polarized. We exploit this fact to remove haze from images. Note that optical filtering alone cannot remove the haze effects, except in very restricted situations. This picture shows how our method uses only two images taken through a polarizer at different orientations to completely remove the effects of haze. This method works instantly, without relying on changes in weather conditions. As a by-product, the method yields a range map of the scene.
|
|
Videos
 |
|
Video Summary:
This video shows several applications of the deweathering models and algorithms we have developed (use Apple Quicktime 6.0).
|
|
Slides
CVPR 2003 presentation With videos (zip file)
ECCV 2002 presentation
CVPR 2001 presentation (Removing Weather)
CVPR 2001 presentation (Instant Dehazing)
CVPR 2000 presentation
ICCV 1999 presentation
|
Related Projects
Detection and Removal of Rain
Selecting Camera Parameters for Rain Removal
Participating Media: Single Scattering Model
Participating Media: Multiple Scattering Model
|
|
