MobileHelper: Remote guiding using smart mobile devices, hand gestures and augmented reality




Kostia, Robert
Zhu, Dingyun
Huang, Weidong
Alem, Leila
Gedeon, Tamas (Tom)

Journal Title

Journal ISSN

Volume Title


Conference Organising Committee


Due to the rapid development in wearable computing, gestural interaction and augmented reality in recent years, remote collaboration has been seen as a fast growing field with many advanced designs and implementations for a wide range of applications. Most of existing remote guiding or collaboration solutions still rely on specifically designed hardware systems on both helper and worker side with limitations on usage, mobility, flexibility and portability. Considering widespread deployment of smart mobile devices such as smartphones and tablets in the past a few years, it already provides us numerous potentials of migrating conventional remote guiding solutions to such powerful platforms with the possibility of overcoming many existing issues and limits. In this paper, we introduce MobileHelper, a remote guiding prototype that is developed on a tablet device with the feature of allowing helpers to use hand gestures to guide the remote worker for various physical tasks. The interface used on the worker side integrates a near eye display to support mobility and real time representations of the helper's hand gestures using augmented reality technologies. We present the design and features of MobileHelper along with the description of detailed implementation of the prototype system. Stable system performance is also reported from our preliminary internal test runs.





SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications, SA 2013


Conference paper

Book Title

Entity type

Access Statement

License Rights



Restricted until