Virtual robot arm controlled by hand gestures via Leap Motion Sensor

Abstract

This paper proposes a LabVIEW instrument aimed to design and control a 3D virtual robot arm using hand gestures translated into commands with the help of Leap Motion Controller. In order to acquire signals and translate them into basic swipe gesture commands, a LabVIEW toolkit was used. The application is useful for providing assistance for people with disabilities who cannot move or lack strong muscle strength. They can use the virtual simulation for training purpose in order to achieve the ability to control a real robot arm. Moreover, they have a visual feedback that sustains and adjusts their movements. The 3D model is a robot arm placed on a flat surface. Translation along two perpendicular directions in the base plan is allowed and also the rotation of its joints. The virtual robot arm can provide several benefits regarding moving to a target, grasping it and bringing it to the patient.