A New Multi-Modal Database for Developing Speech Recognition Systems for an Assistive Technology Application

• Type: Article in International Conference Proceedings Book
• Date: 2004

Authors

António Moura (Author) Other; Diamantino Freitas (Author) FEUP; Vitor Pêra (Author) FEUP

Conference proceedings International

Title: TSD 2004

Pages: 385-392

Seventh International Conference on TEXT, SPEECH and DIALOGUE

Brno, Czech Republic, 8 a 11 de Setembro de 2004

Other information

Resumo (PT): Artigo publicado na TSD 2004 - Seventh International Conference on TEXT, SPEECH and DIALOGUE, Brno, Czech Republic, 8-11 de Setembro de 2004

Abstract (EN): In this paper we report on the acquisition and content of a new database intended for developing audio-visual speech recognition systems. This database supports a speaker dependent continuous speech recognition task, based on a small vocabulary, and was captured in the European Portuguese language. Along with the collected multi-modal speech materials, the respective orthographic transcription and time-alignment files are supplied. The package also includes data on stochastic language models and the generative grammar associated to the collected spoken sentences. The application addressed by this database, which consists of voice control of a basic scientific calculator, has the particularity of being designed for a person with a specific motor impairment, namely muscular dystrophy. This specificity is a remarkable characteristic, given the lack of such kind of data resources for developing assistive systems based on audio-visual speech recognition technology.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 8