Shadow Dexterous Hand Control via MediaPipe and BioIK Integration

• Tipo: Artigo em Livro de Atas de Conferência Internacional
• Data: 2025

Autores

Santos, B (Autor) Outra; Gil Manuel Gonçalves (Autor) FEUP; Pinto, VH (Autor) Outra

Ata de Conferência Internacional

Título: 2025 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Páginas: 15-20

2025 International Conference on Autonomous Robot Systems and Competitions-ICARSC-Annual

Funchal, PORTUGAL, APR 02-03, 2025

Indexação

ISI Web of Knowledge - 0 Citações

Scopus - 0 Citações

Outras Informações

ID Authenticus: P-018-X9D

DOI: 10.1109/icarsc65809.2025.10970167

Abstract (EN): This paper presents a study on the teleoperation of an anthropomorphic robotic hand. The proposed system integrates MediaPipe for human hand tracking and BioIK for translating the captured data to the robotic hand. Two methods for acquiring three-dimensional hand positions are evaluated: direct estimation via MediaPipe and a stereo vision-based technique. Experimental results reveal that the stereo technique significantly improves the accuracy and fidelity of the hand position replication, albeit at the cost of increased teleoperation instability. The algorithm achieves an end-to-end delay of one second, ensuring real-time usability within certain constraints. The system's effectiveness is further validated through successful object-grasping experiments, highlighting its potential for advanced teleoperation applications.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 6