Designing user-, hand-, and handpart-aware tabletop interactions
Recent work in multi-touch tabletop interaction introduced many novel techniques that let people manipulate digital content through touch. Yet most only detect touch blobs. This ignores richer interactions that would be possible if we could identify (1) which part of the hand, (2) which side of the hand, and (3) which person is actually touching the surface. Fiduciary-tagged gloves were previously introduced as a simple but reliable technique for providing this information. The problem is that its low-level programming model hinders the way developers could rapidly explore new kinds of user- and handpart-aware interactions. We contribute the TOUCHID toolkit to solve this problem. It allows rapid prototyping of expressive multi-touch interactions that exploit the aforementioned characteristics of touch input. TOUCHID provides an easy-to-use event-driven API. It also provides higher-level tools that facilitate development: a glove configurator to rapidly associate particular glove parts to handparts; and a posture configurator and gesture configurator for register-ing new hand postures and gestures for the toolkit to recognize. We illustrate TOUCHID’s expressiveness by showing how we developed a suite of techniques (which we consider a secondary contribution) that exploits knowledge of which handpart is touching the surface.
Nicolai Marquardt (PhD)
Saul Greenberg (Supervisor)
Download and documentation
|Marquardt, N., Kiemer, J., Ledo, D., Boring, S. and Greenberg, S. (2011) |
Designing User-, Hand-, and Handpart-Aware Tabletop Interactions with the TOUCHID Toolkit. In ACM International Conference on Interactive Tabletops and Surfaces-ITS'2011. (Kobe, Japan), ACM Press, 10 pages, November 13-16. Include video figure, duration 3:42 minutes. Earlier version as: Report 2011-1004-163 + video (July, 2011).