My research is in augmented reality for procedural tasks, with particular
interest in maintaining and repairing mechanical systems. I'm also exploring interaction and display techniques that leverage the natural affordances
and deterministic visual cues available in these typically complex and feature rich environments.
My research spans the areas of augmented reality, 3D graphics, 3D Gaming Engine application
program interfaces, and computer-supported collaborative work.
This project explores the use of mobile augmented reality technology to aid
in the repair and maintenance of physical systems. The objective of this work is to research
the design and development of experimental augmented reality systems for maintenance job aiding.
This project explores how real time computer graphics, overlaid on and registered with the actual
repaired equipment, can significantly increase the productivity, accuracy, and safety of
maintenance personnel. Heads-up, motion-tracked displays augment the user's physical view
of the system with information such as sub-component labeling, guided maintenance steps,
real time diagnostic data, and safety warnings. The virtualization of the user and
maintenance environment allows off-site collaborators to monitor and assist with repairs.
Additionally, the integration of real-world knowledge bases with detailed 3D models provides
opportunities to use the system as a maintenance simulator/training tool.
This project features the design and implementation of prototypes integrating the very latest
in motion tracking, mobile computing, wireless networking, 3D modeling, 3D Game Engine SDK's
and human-machine interface technologies.
This work was recently funded by the Air Force Research Laboratory Human Effectiveness Directorate,
Warfighter Readiness Research Division Logistics Readiness Branch (AFRL/HEAL).
ARMAR project homepage
Check out my portfolio of past projects, code and other items here.
Steve Henderson and Steve Feiner, "Evaluating the Benefits of Augmented Reality Documentation for Maintenance and Repair," IEEE Transactions on Visualization and Computer Graphics, vol. 17(1), 2011. (accepted)
Steve Henderson and Steve Feiner, "Opportunistic Tangible User Interfaces for Augmented Reality," IEEE Transactions on Visualization and Computer Graphics, vol. 16(1), 2010.
Steve Henderson and Steve Feiner, "Evaluating the Benefits of Augmented Reality for Task Localization in Maintenance of an Armored Personnel Carrier Turret", International Symposium on Mixed and Augmented Reality (ISMAR '09), October 2009, pp. 135-144. (recipient Best Paper Award)
Steve Henderson, Steven Feiner, "Opportunistic Controls: Leveraging Natural Affordances as Tangible User Interfaces for Augmented Reality", ACM Virtual Reality Software and Technology (VRST) 2008, Ovtober 2008, pp. 211-218. (recipient Best Paper Award)
Steve Henderson, Steve Feiner, "Augmented and Mixed Reality for Training," The PSI Handbook of Virtual Environments for Training and Education, Ed. Dylan Schmorrow, Joseph Cohn, and Denise Nicholson", Praeger Security International, Westport, CT, May 2008.
Steve Henderson, Steve Feiner, "Augmented Reality for Maintenance and Repair (ARMAR)", Technical Report 86500526647, United States Air Force Research Lab, Jul 2007.
See my vitae for works published prior to coming to Columbia