Live Assessment of Beat Tracking for Robot Audition

• Type: Article in International Conference Proceedings Book
• Date: 2012

Authors

oliveira, jl (Author) Other; ince, g (Author) Other; nakamura, k (Author) Other; nakadai, k (Author) Other; okuno, hg (Author) Other; reis, lp (Author) FEUP; gouyon, f (Author) FEUP

Conference proceedings International

Title: 2012 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS)

Pages: 992-997

25th IEEE\RSJ International Conference on Intelligent Robots and Systems (IROS)

Algarve, PORTUGAL, OCT 07-12, 2012

Indexing

ISI Web of Knowledge - 5 Citations

Scopus - 8 Citations

Scientific classification

FOS: Engineering and technology > Electrical engineering, Electronic engineering, Information engineering

Other information

Authenticus ID: P-005-42V

DOI: 10.1109/iros.2012.6386100

Abstract (EN): In this paper we propose the integration of an online audio beat tracking system into the general framework of robot audition, to enable its application in musically-interactive robotic scenarios. To this purpose, we introduced a state-recovery mechanism into our beat tracking algorithm, for handling continuous musical stimuli, and applied different multi-channel preprocessing algorithms (e. g., beamforming, ego noise suppression) to enhance noisy auditory signals lively captured in a real environment. We assessed and compared the robustness of our audio beat tracker through a set of experimental setups, under different live acoustic conditions of incremental complexity. These included the presence of continuous musical stimuli, built of a set of concatenated musical pieces; the presence of noises of different natures (e. g., robot motion, speech); and the simultaneous processing of different audio sources on-the-fly, for music and speech. We successfully tackled all these challenging acoustic conditions and improved the beat tracking accuracy and reaction time to music transitions while simultaneously achieving robust automatic speech recognition.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 6