Modeling of video projectors in OpenGL for implementing a spatial augmented reality teaching system for assembly operations

• Type: Article in International Conference Proceedings Book
• Date: 2019

Authors

Carlos M. Costa (Author) Other; Germano Veiga (Author) FEUP; Armando Jorge Sousa (Author) FEUP; Luís Rocha (Author) FEUP; António Augusto de Sousa (Author) FEUP; Rui Rodrigues (Author) FEUP; Ulrike Thomas (Author) Other

Conference proceedings International

Title: 2019 19TH IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC 2019)

Pages: 84-91

19th IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC)

Gondomar, PORTUGAL, APR 24-26, 2019

Indexing

ISI Web of Knowledge - 5 Citations

Scopus - 7 Citations

Other information

Authenticus ID: P-00Q-TAY

DOI: 10.1109/icarsc.2019.8733617

Abstract (EN): Teaching complex assembly and maintenance skills to human operators usually requires extensive reading and the help of tutors. In order to reduce the training period and avoid the need for human supervision, an immersive teaching system using spatial augmented reality was developed for guiding inexperienced operators. The system provides textual and video instructions for each task while also allowing the operator to navigate between the teaching steps and control the video playback using a bare hands natural interaction interface that is projected into the workspace. Moreover, for helping the operator during the final validation and inspection phase, the system projects the expected 3D outline of the final product. The proposed teaching system was tested with the assembly of a starter motor and proved to be more intuitive than reading the traditional user manuals. This proof of concept use case served to validate the fundamental technologies and approaches that were proposed to achieve an intuitive and accurate augmented reality teaching application. Among the main challenges were the proper modeling and calibration of the sensing and projection hardware along with the 6 DoF pose estimation of objects for achieving precise overlap between the 3D rendered content and the physical world. On the other hand, the conceptualization of the information flow and how it can be conveyed on-demand to the operator was also of critical importance for ensuring a smooth and intuitive experience for the operator.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 8