Neural network models for whisper to normal speech conversion

• Tipo: Artigo em Revista Científica Internacional
• Data: 2025

Autores

Yamamura, F (Autor) Outra; Scalassara, R (Autor) Outra; Oliveira, A (Autor) Outra; Aníbal Ferreira (Autor) FEUP

Revista

Título: U.Porto Journal of Engineering

Vol. 11

Páginas: 116-129

Editora: Universidade do Porto. Faculdade de Engenharia

Indexação

Scopus - 0 Citações

Outras Informações

ID Authenticus: P-018-HWJ

DOI: 10.24840/2183-6493_0011-001_002739

Abstract (EN): Whispers are common and essential for secondary communication. Nonetheless, individuals with aphonia, including laryngectomees, rely on whispers as their primary means of communication. Due to the distinct features between whispered and regular speech, debates have emerged in the field of speech recognition, highlighting the challenge of effectively converting between them. This study investigates the characteristics of whispered speech and proposes a system for converting whispered vowels into normal ones. The system is developed using multilayer perceptron networks and two types of generative adversarial networks. Three metrics are analyzed to evaluate the performance of the system: mel-cepstral distortion, root mean square error of the fundamental frequency, and accuracy with f1-score of a vowel classifier. Overall, the perceptron networks demonstrated better results, with no significant differences observed between male and female voices or the presence/absence of speech silence, except for improved accuracy in estimating the fundamental frequency during the conversion process. © 2025, Universidade do Porto - Faculdade de Engenharia. All rights reserved.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 13