The spread of IoT and wearable devices is bringing out gesture interfaces as a solution for a more natural and immediate human-machine interaction. The "Seamless" project is an industrial research and development experience, aimed to build a virtual environment where data collected by IoT sensors can be navigated through a gesture interface and virtual reality tools. This paper presents the portion of the project concerning gesture analysis, focused on the problem of automatically understanding a set of hand gestures, in order to give commands through a wearable control device. The tackled issue is to build a real time gesture recognition system based on inertial data, that can easily adapt to different users and to an extensible set of gestures. This gesture data variability is addressed by means of a supervised Machine Learning approach, that allows adapting the system response to different gestures and to various ways of performing them by different people. A context-aware adapter allows interfacing the gesture recognition system to various applications.

Gesture Recognition in an IoT environment: a Machine Learning-based Prototype

Fugini M.;Finocchi J.
2021

Abstract

The spread of IoT and wearable devices is bringing out gesture interfaces as a solution for a more natural and immediate human-machine interaction. The "Seamless" project is an industrial research and development experience, aimed to build a virtual environment where data collected by IoT sensors can be navigated through a gesture interface and virtual reality tools. This paper presents the portion of the project concerning gesture analysis, focused on the problem of automatically understanding a set of hand gestures, in order to give commands through a wearable control device. The tackled issue is to build a real time gesture recognition system based on inertial data, that can easily adapt to different users and to an extensible set of gestures. This gesture data variability is addressed by means of a supervised Machine Learning approach, that allows adapting the system response to different gestures and to various ways of performing them by different people. A context-aware adapter allows interfacing the gesture recognition system to various applications.
Future of Information and Communication Conference, FICC 2021
978-3-030-73099-4
Human-Machine Interaction, Inertial Measurement Unit, Gesture Recognition, Machine Learning, Neural Networks, Context Aware Architecture.
File in questo prodotto:
File Dimensione Formato  
FICC_Gestures_CR.pdf

accesso aperto

: Post-Print (DRAFT o Author’s Accepted Manuscript-AAM)
Dimensione 960.79 kB
Formato Adobe PDF
960.79 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11311/1207805
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact