An Augmented Reality System for Teaching Sequential Tasks to a Household Robot

Fung, R. , Hashimoto, S. , Inami, M. and Igarashi, T. (2011)
An Augmented Reality System for Teaching Sequential Tasks to a Household Robot. In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (Ro-Man 2011). (Atlanta, Georgia), IEEE Press, 6 pages, July 31-Aug 3. Includes video figure.

View Publication and Related Materials

PDF PaperPDF Paper (2011-TasksToRobots.Roman.pdf)
Video FileVideo File (2011-TasksToRobots.Roman.mp4)

Abstract

We present a method of instructing a sequential task to a household robot using a hand-held augmented reality device. The user decomposes a high-level goal such as "prepare a drink" into steps such as delivering a mug under a kettle and pouring hot water into the mug. The user takes a photograph of each step using the device and annotates it with necessary information via touch operation. The resulting sequence of annotated photographs serves as a reference for review and reuse at a later time. We created a working prototype system with various types of robots and appliances.

Bibtex entry

@INPROCEEDINGS { 2011-TasksToRobots.Roman,
CLASS = { CONFARTICLE },
AUTHOR = { Fung, R. and Hashimoto, S. and Inami, M. and Igarashi, T. },
TITLE = { An Augmented Reality System for Teaching Sequential Tasks to a Household Robot },
BOOKTITLE = { Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (Ro-Man 2011) },
YEAR = { 2011 },
MONTH = { July 31-Aug 3 },
PAGES = { 6 pages },
PUBLISHER = { IEEE Press },
ADDRESS = { Atlanta, Georgia },
NOTE = { Includes video figure },
}