Shadow Dexterous Hand Control via MediaPipe and BioIK Integration

• Type: Article in International Conference Proceedings Book
• Date: 2025

Authors

Santos, B (Author) Other; Gil Manuel Gonçalves (Author) FEUP; Pinto, VH (Author) Other

Conference proceedings International

Title: 2025 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Pages: 15-20

2025 International Conference on Autonomous Robot Systems and Competitions-ICARSC-Annual

Funchal, PORTUGAL, APR 02-03, 2025

Indexing

ISI Web of Knowledge - 0 Citations

Scopus - 0 Citations

Other information

Authenticus ID: P-018-X9D

DOI: 10.1109/icarsc65809.2025.10970167

Abstract (EN): This paper presents a study on the teleoperation of an anthropomorphic robotic hand. The proposed system integrates MediaPipe for human hand tracking and BioIK for translating the captured data to the robotic hand. Two methods for acquiring three-dimensional hand positions are evaluated: direct estimation via MediaPipe and a stereo vision-based technique. Experimental results reveal that the stereo technique significantly improves the accuracy and fidelity of the hand position replication, albeit at the cost of increased teleoperation instability. The algorithm achieves an end-to-end delay of one second, ensuring real-time usability within certain constraints. The system's effectiveness is further validated through successful object-grasping experiments, highlighting its potential for advanced teleoperation applications.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 6