Paper Reading #13: Combining Multiple Depth Cameras and Projectors for Interactions On, Above, and Between Surfaces

Reference Information
Combining Multiple Depth Cameras and Projectors for Interactions On, Above, and Between Surfaces
Andrew D. Wilson and Hrvoje Benko
Presented at UIST'10, October 3-6, 2010, New York, New York, USA

Author Bios
Andrew D. Wilson is a senior researcher at Microsoft Research. He was a Cornell Undergrad and earned his Masters and PhD from the MIT Media Lab.
Hrovje Benko has a PhD from Columbia University, he is a researcher at Microsoft Researc.

Summary
Hypothesis
Is LightSpace a usable and better way to interact with applications in 3D space?

Methods
LightSpace was tested at a convention where it was made available for public use. Several hundred people tested and used the system and were encouraged to play and explore the capabilities of LightSpace. The interactions were observed by the researchers in order to obtain usability data and insight into how to make the system more functional and intuitive.

Results
The researchers found that the effective maximum for the system was  six people at a time, however to operate smoothly it was best to keep it at three or below. The reasons for setting limits on users is that the more users that are present the more points the system has to keep track of and the higher the likelihood that users block each others movements from the camera. Users also discovered new ways to use the system that hadn't been done before.

Contents
LightSpace uses multiple projectors and depth cameras to created a simulated environment and allow for multiple interactions.The researchers chose to use their equipment to track, study, and use 4 main interactions: simulated interactive surfaces, through-body transitions between surfaces, picking up objects, and spatial menus.


Discussion
The LightSpace system is an amazing ideas and something that has been the dream of science fiction fans ever since the holodeck was featured on Star Trek. Advances in technology similar to LightSpace could one day make these fantasies a reality. The system that these researchers developed is a great step in that direction for a couple different reasons but the most important is that it takes a great idea and improves upon it by making it portable. The ability for this to be possibly wheeled into lecture hall at the beginning of a day, calibrated, used for various classes and lectures, and then taken to a different location the next day is a big boon for this system if it is ever commercialized.