Skip to main navigation Skip to search Skip to main content

A statistical sample-based approach to GMM-based voice conversion using tied-covariance acoustic models

Research output: Contribution to journal › Article › peer-review

Abstract

This paper presents a novel statistical sample-based approach for Gaussian Mixture Model (GMM)-based Voice Conversion (VC). Although GMM-based VC has the promising flexibility of model adaptation, quality in converted speech is significantly worse than that of natural speech. This paper addresses the problem of inaccurate modeling, which is one of the main reasons causing the quality degradation. Recently, we have proposed statistical sample-based speech synthesis using rich context models for high-quality and flexible Hidden Markov Model (HMM)-based Text-To-Speech (TTS) synthesis. This method makes it possible not only to produce high-quality speech by introducing ideas from unit selection synthesis, but also to preserve flexibility of the original HMM-based TTS. In this paper, we apply this idea to GMM-based VC. The rich context models are first trained for individual joint speech feature vectors, and then we gather them mixture by mixture to form a Rich context-GMM (R-GMM). In conversion, an iterative generation algorithm using R-GMMs is used to convert speech parameters, after initialization using over-trained probability distributions. Because the proposed method utilizes individual speech features, and its formulation is the same as that of conventional GMMbased VC, it makes it possible to produce high-quality speech while keeping flexibility of the original GMM-based VC. The experimental results demonstrate that the proposed method yields significant improvements in term of speech quality and speaker individuality in converted speech.

Original languageEnglish
Pages (from-to)2490-2498
Number of pages9
JournalIEICE Transactions on Information and Systems
VolumeE99D
Issue number10
DOIs
Publication statusPublished - 2016 Oct
Externally publishedYes

Keywords

  • GMM-based voice conversion
  • Rich context model
  • Sample-based speech synthesis
  • Speech parameter conversion

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'A statistical sample-based approach to GMM-based voice conversion using tied-covariance acoustic models'. Together they form a unique fingerprint.

Cite this