TouchMe: An augmented reality interface for remote robot control

Sunao Hashimoto, Akihiko Ishida, Masahiko Inami, Takeo Igarashi

Research output: Contribution to journalArticlepeer-review

16 Citations (Scopus)


General remote-control robots are manipulated by joysticks or game pads. These are difficult for inexperienced users, however, because the relationship between user input and the resulting robot movement may not be intuitive, e.g., tilting the joystick to the right to rotate the robot left. To solve this problem, we propose a touch-based interface called TouchMe for controlling a robot remotely from a third-person point of view. This interface allows the user to directly manipulate individual parts of a robot by touching it as seen by a camera. Our system provides intuitive operation allowing the user to use it with minimal training. In this paper, we describe TouchMe interaction and prototype implementation. We also introduce three types of movement for controlling the robot in response to user interaction and report on results of an empirical comparison of these methods.

Original languageEnglish
Pages (from-to)529-537
Number of pages9
JournalJournal of Robotics and Mechatronics
Issue number3
Publication statusPublished - 2013 Jun
Externally publishedYes


  • Augmented reality
  • Direct manipulation
  • Remote robot control
  • Third-person view
  • Touch screen

ASJC Scopus subject areas

  • Computer Science(all)
  • Electrical and Electronic Engineering


Dive into the research topics of 'TouchMe: An augmented reality interface for remote robot control'. Together they form a unique fingerprint.

Cite this