Tony Jebara
- - DyPERS
|
Tony Jebara
- - DyPERS
|
|
 
Home
Research
Papers
Resumé
Recent
Hobbies
Trips
Links |
|
|
|
||||||
|
|
|
|
||||||
|
Dynamic Personal Enhanced Reality System main investigators: Tony Jebara, Bernt Schiele, Nuria Oliver and Alex Pentland DyPERS, 'Dynamic Personal Enhanced Reality System', is a wearable system which uses augmented reality and computer vision to autonomously retrieve 'media memories' based on associations with real objects the user encounters. These are evoked as audio and video clips taken by the user and overlayed on top of real objects the user looks at. The user's visual and auditory scene is stored in real-time by the system (upon request) and is then associated (by user input) with a snap shot of a visual object. The object acts as a key which is detected by a real-time vision system when it is in view, triggering DyPERS to play back the appropriate audio-visual sequence. The vision system is a probabilistic algorithm which is capable of discriminating between hundreds of everyday objects under varying viewing conditions (lighting, pose changes, etc.). The record-and-associate paradigm of the system has many potential applications. Results of the use of the system in a museum's tour scenario are described.
|
||||||||
|
|
DyPERS Movie, October 1998 (27 Meg)
