HMM-based speech synthesis system with expressive Indonesian speech corpus

Elok Anggrayni, Dhany Arifianto

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


In this paper, we present a result of HMM-based speech synthesis system applied to Indonesian expressive speech scorpus. The purpose is to observe speech quality of synthesized speech, conversely. Firstly, we selected expressive Indonesian conversation from movie, novel, and drama transcript. We developed speech database based on phonetically balanced sentence set in which consist of 33 Indonesian phonemes and its IPA symbols and formed 655 sentences. Three expressive styles were applied, namely happiness, sadness, and anger. We hired four professional theater artist to utter the sentences. Segmentation and labeling was performed by manual to create transcription. Variation is given in kind of expressive style and training data amount. The expressive style-dependent decision trees achieve prosodic conversion. The objective and subjective evaluation process are also analyzed. In objective test is using MCD method earn the best score for happiness expressive style with score 4.2 in 82 training data. Then for sadness with score 5.13 in 81 training data and 5.18 for anger in 80 training data. Subjective test with Mean Opinion Score obtain naturalness for happiness, anger, and sadness with score 3.51, 3.38, and 3,0, respectively. The result shown that quality of the synthetic speech is high in term of naturalness.

Original languageEnglish
Title of host publicationProceedings of the 23rd International Congress on Acoustics
Subtitle of host publicationIntegrating 4th EAA Euroregio 2019
EditorsMartin Ochmann, Vorlander Michael, Janina Fels
PublisherInternational Commission for Acoustics (ICA)
Number of pages8
ISBN (Electronic)9783939296157
Publication statusPublished - 2019
Externally publishedYes
Event23rd International Congress on Acoustics: Integrating 4th EAA Euroregio, ICA 2019 - Aachen, Germany
Duration: 9 Sept 201923 Sept 2019

Publication series

NameProceedings of the International Congress on Acoustics
ISSN (Print)2226-7808
ISSN (Electronic)2415-1599


Conference23rd International Congress on Acoustics: Integrating 4th EAA Euroregio, ICA 2019


  • Expressive Indonesian speech scorpus
  • HMM
  • Speech synthesis


Dive into the research topics of 'HMM-based speech synthesis system with expressive Indonesian speech corpus'. Together they form a unique fingerprint.

Cite this