Human machine interface with augmented reality for the network based mobile robot

Abstract

The human-machine interface is an essential part of intelligent robotic system. Through the human-machine interface, human being can interact with the robot. Especially, in tele-robotics environment, the human-machine interface can be developed with remarkable extended functionality. In this paper, we propose a human-machine interface with augmented reality for the network based mobile robot. Generally, we can take some meaningful information from human's motion such as movement of head or fingers. So, it is very useful to take these motions as input for systems. We synchronize head motion of human being and the camera motion of the mobile robot using visual information. So user of the mobile robot can monitor environment of the mobile robot as eyesight of mobile robot. Then we use gesture recognition for control the mobile robot. In the implemented framework, the user can monitor what happens in environment as eyesight of mobile robot and control the mobile robot easily and intuitively by using gesture.