Real-Time and Embedded Detection of Hand Gestures with an IMU-Based Glove†

Journal Title: Informatics - Year 2018, Vol 5, Issue 2

Abstract

This article focuses on the use of data gloves for human-computer interaction concepts, where external sensors cannot always fully observe the user’s hand. A good concept hereby allows to intuitively switch the interaction context on demand by using different hand gestures. The recognition of various, possibly complex hand gestures, however, introduces unintentional overhead to the system. Consequently, we present a data glove prototype comprising a glove-embedded gesture classifier utilizing data from Inertial Measurement Units (IMUs) in the fingertips. In an extensive set of experiments with 57 participants, our system was tested with 22 hand gestures, all taken from the French Sign Language (LSF) alphabet. Results show that our system is capable of detecting the LSF alphabet with a mean accuracy score of 92% and an F1 score of 91%, using complementary filter with a gyroscope-to-accelerometer ratio of 93%. Our approach has also been compared to the local fusion algorithm on an IMU motion sensor, showing faster settling times and less delays after gesture changes. Real-time performance of the recognition is shown to occur within 63 milliseconds, allowing fluent use of the gestures via Bluetooth-connected systems.

Authors and Affiliations

Chaithanya Kumar Mummadi, Frederic Philips Peter Leo, Keshav Deep Verma, Shivaji Kasireddy, Philipp M. Scholl, Jochen Kempfle and Kristof Van Laerhoven

Keywords

Related Articles

A Hybrid Approach to Recognising Activities of Daily Living from Object Use in the Home Environment

Accurate recognition of Activities of Daily Living (ADL) plays an important role in providing assistance and support to the elderly and cognitively impaired. Current knowledge-driven and ontology-based techniques model...

Data Governance in the Sustainable Smart City

The wisdom of ‘smart’ development increasingly shapes urban sustainability in Europe and beyond. Yet, the ‘smart city’ paradigm has been critiqued for favouring technological solutions and business interests over socia...

Thinking about The Information Age

“It is a pleasure to open the Information Age exhibition today at the @ScienceMuseum and I hope people will enjoy visiting. Elizabeth R.” The museum proudly claims that the exhibition had been several years in planning...

AVIST: A GPU-Centric Design for Visual Exploration of Large Multidimensional Datasets

This paper presents the Animated VISualization Tool (AVIST), an exploration-oriented data visualization tool that enables rapidly exploring and filtering large time series multidimensional datasets. AVIST highlights in...

Skills and Vacancy Analysis with Data Mining Techniques

Through recognizing the importance of a qualified workforce, skills research has become one of the focal points in economics, sociology, and education. Great effort is dedicated to analyzing labor demand and supply, an...

Download PDF file
  • EP ID EP44132
  • DOI https://doi.org/10.3390/informatics5020028
  • Views 267
  • Downloads 0

How To Cite

Chaithanya Kumar Mummadi, Frederic Philips Peter Leo, Keshav Deep Verma, Shivaji Kasireddy, Philipp M. Scholl, Jochen Kempfle and Kristof Van Laerhoven (2018). Real-Time and Embedded Detection of Hand Gestures with an IMU-Based Glove†. Informatics, 5(2), -. https://www.europub.co.uk/articles/-A-44132