Customizable Haptic and Multi-touch Gesture Interfaces On Handheld Devices for Tele-operated Robots

International Journal of P2P Network Trends and Technology (IJPTT)          
© 2012 by IJPTT Journal
Volume-2 Issue-5                           
Year of Publication : 2012
Authors : P. Thamarai, P.Rachelin Sujae


P. Thamarai, P.Rachelin Sujae "Customizable Haptic and Multi-touch Gesture Interfaces On Handheld Devices for Tele-operated Robots". International Journal of P2P Network Trends and Technology (IJPTT), V2(5):20-23 September - October 2012, ISSN:2249-2615, Published by Seventh Sense Research Group.


This paper presents a solution to control mobile robots by using customizable haptic and multi-touch gesture interface son handheld devices. Images coming from a camera allow both to automatically and manually control the robot. Recent advances indigital tabletop touch-and gestureactivated screens have allowed for small group collaboration. The newest generation screens simultaneously support multiple users, multiple contact points per user, and gesture recognition. To the authors’ knowledge, this technology has never been applied to robot control.


[1] Courtemanche A., Micire M., and Yanco H.“Human-Robot Interaction using a Multi-Touch Display”.2nd Ann. IEEE Tabletop Workshop, 2007.
[2] Kato J., Sakamoto D., Inami M., and Igarashi T.”Multi-touch interface for controlling multiple mobile robots”. Proc. of the 27th Int. Conf. on Human Factors in Computing Systems, Boston,,pages 3443-3448, 2009.
[3] Fong T. W., Thorpe C., and Glass B.”PdaDriver: A Handheld System for Remote Driving". IEEE Int. Conf. on Advanced Robotics, July 2003.
[4] Paravati G., Donna Bianco M., Sanna A., and Lamberti F.”A multitouch solution to build personalized interfaces for the control of remote applications“. 2nd Int. Conf. UCMedia, Palma de Mallorca, Sept. 2010.
[5] Ahn H.S., Sa I.K., Choi J.I.”PDA-based mobile robot system with remote monitoring for home environment“. Consumer Electronics, IEEE Transactions on , vol.55, no.3, pp.1487-1495, August 2009.
[6] Paravati G., Sanna, A., Pralio, B., Lamberti, F.”A Genetic Algorithm for Target Tracking in FLIR Video Sequences Using Intensity Variation Function”. Instrumentation and Measurement, IEEE Transactions on, vol.58, no.10, pp.3457-3467, Oct. 2009.
[7] Wilson A.D., Izadi S., Hilliges O., Garcia-Mendoza A., Kirk D.”Bringing physics to the surface“. In ACM symposium on user interface software and technology, ACM, N.Y., USA, pp 67-76, 2008.


We envision that an interactive multi-touch screen display for robot control would improve human-robot interaction (HRI) and increase efficiency.