Designing User-, Hand-, and Handpart-Aware Tabletop Interactions with the TOUCHID Toolkit

Marquardt, N., Kiemer, J., Ledo, D., Boring, S. and Greenberg, S. (2011)
Designing User-, Hand-, and Handpart-Aware Tabletop Interactions with the TOUCHID Toolkit. In ACM International Conference on Interactive Tabletops and Surfaces-ITS'2011. (Kobe, Japan), ACM Press, 10 pages, November 13-16. Include video figure, duration 3:42 minutes. Earlier version as: Report 2011-1004-163 + video (July, 2011).

View Publication and Related Materials

PDF PaperPDF Paper (2011-TouchID.ITS.pdf)
Video FileVideo File (2011-TouchID.ITS.mp4)

Abstract

Recent work in multi-touch tabletop interaction introduced many novel techniques that let people manipulate digital content through touch. Yet most only detect touch blobs. This ignores richer interactions that would be possible if we could identify (1) which part of the hand, (2) which side of the hand, and (3) which person is actually touching the surface. Fiduciary-tagged gloves were previously introduced as a simple but reliable technique for providing this information. The problem is that its low-level programming model hinders the way developers could rapidly explore new kinds of user- and handpart-aware interactions.We contribute the TOUCHID toolkit to solve this problem. It allows rapid prototyping of expressive multi-touch interactions that exploit the aforementioned characteristics of touch input. TOUCHID provides an easy-to-use event-driven API as well as higher-level tools that facilitate development: a glove configurator to rapidly associate particular glove parts to handparts; and a posture configurator and gesture configurator for registering new hand postures and gestures for the toolkit to recognize. We illustrate TOUCHID's expressiveness by showing how we developed a suite of techniques that exploits knowledge of which handpart is touching the surface.

Keywords

Surfaces, tabletop, interaction, touch, postures, gestures, gloves, fiduciary tags, multi user, toolkit

Bibtex entry

@INPROCEEDINGS { 2011-TouchID.ITS,
CLASS = { CONFARTICLE },
AUTHOR = { Marquardt, N. and Kiemer, J. and Ledo, D. and Boring, S. and Greenberg, S. },
TITLE = { Designing User-, Hand-, and Handpart-Aware Tabletop Interactions with the TOUCHID Toolkit },
YEAR = { 2011 },
MONTH = { November 13-16 },
BOOKTITLE = { ACM International Conference on Interactive Tabletops and Surfaces-ITS'2011 },
PAGES = { 10 pages },
PUBLISHER = { ACM Press },
ADDRESS = { Kobe, Japan },
NOTE = { Include video figure, duration 3:42 minutes. Earlier version as: Report 2011-1004-163 + video (July, 2011) },
KEYWORDS = { Surfaces, tabletop, interaction, touch, postures, gestures, gloves, fiduciary tags, multi user, toolkit },
}