Data integration by two-sensors in a LEAP-based Virtual Glove for human-system interaction

• Type: Article in International Scientific Journal
• Date: 2021-05

Authors

Giuseppe Placidi (Author) Other; Danilo Avola (Author) Other; Luigi Cinque (Author) Other; Matteo Polsinelli (Author) Other; Eleni Theodoridou (Author) Other; João Manuel R. S. Tavares (Author) FEUP

Journal

Title: Multimedia Tools and Applications

Pages: 18263-18277

ISSN: 1380-7501

Publisher: Springer Nature

Indexing

ISI Web of Knowledge - 0 Citations

ISI Web of Science

Scopus - 0 Citations

Scientific classification

FOS: Engineering and technology

CORDIS: Technological sciences

Other information

Authenticus ID: P-00T-H14

DOI: 10.1007/s11042-020-10296-8

Abstract (EN): Virtual Glove (VG) is a low-cost computer vision system that utilizes two orthogonal LEAP motion sensors to provide detailed 4D hand tracking in real-time. VG can find many applications in the field of human-system interaction, such as remote control of machines or tele-rehabilitation. An innovative and efficient data-integration strategy, based on the velocity calculation, for selecting data from one of the LEAPs at each time, is proposed for VG. The position of each joint of the hand model, when obscured to a LEAP, is guessed and tends to flicker. Since VG uses two LEAP sensors, two spatial representations are available each moment for each joint: the method consists of the selection of the one with the lower velocity at each time instant. Choosing the smoother trajectory leads to VG stabilization and precision optimization, reduces occlusions (parts of the hand or handling objects obscuring other hand parts) and/or, when both sensors are seeing the same joint, reduces the number of outliers produced by hardware instabilities. The strategy is experimentally evaluated, in terms of reduction of outliers with respect to a previously used data selection strategy on VG, and results are reported and discussed. In the future, an objective test set has to be imagined, designed, and realized, also with the help of an external precise positioning equipment, to allow also quantitative and objective evaluation of the gain in precision and, maybe, of the intrinsic limitations of the proposed strategy. Moreover, advanced Artificial Intelligence-based (AI-based) real-time data integration strategies, specific for VG, will be designed and tested on the resulting dataset.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 15