BrightShadow is a new sensor architecture for robust gesture recognition that uses a combination of a high-speed camera and synchronous LED illumination.　This sensor looks at shadows cast by a user’s hand for recognizing position. The position of the hand can be robustly recognized by independently tracking multiple shadows and by using multiple light sources with time-synchronous modulation with the camera. We also developed a multi-finger tracking system that uses similar modulated illumination from multiple light positions. We expect that these sensing configurations can be naturally integrated into our daily environments as LED lighting becomes more commonplace.

Time-Synchronous illumination

BrightShadow multi-finger detection

References

• Jun Rekimoto, “BrightShadow: Shadow Sensing with Synchronous Illuminations for Robust Gesture Recognition”, CHI2008 extended abstracts, pp.2769-2773, 2008. PDF