Smart Advisor : Real-time Information Provider with Mobile Augmented Reality

Abstract

This paper presents a mobile-based real-time information providing system with augmented reality, called Smart Advisor. Smart Advisor can make users' life convenient by informing necessary information and actions in advance by recognizing and tracking the interest object captured by the camera in mobile devices. Specifically, the proposed system will be helpful to the elderly/disabled users with vulnerable decision-making ability. For robust recognition in various environments, an object matching technique based on binary descriptors is applied with adaptive illumination compensation in limited search window. Then, the camera pose is reliably estimated by RANSAC and inverse-homography calculation. This system can be applicable to various areas, such as medical treatment, education, and game through the interlocking with the Internet of Things (IoT).