[hts-users:04526] adaptation failed in HTS-demo_CMU-ARCTIC-ADAPT
- Subject: [hts-users:04526] adaptation failed in HTS-demo_CMU-ARCTIC-ADAPT
- From: Zhen Wei <zhwei@xxxxxxxxxxxxx>
- Date: Mon, 12 Jun 2017 01:51:36 +0800
- Authentication-results: mailgw.mains.nitech.ac.jp; dkim=pass (2048-bit key) header.d=nwpu-aslp-org.20150623.gappssmtp.com header.i=@nwpu-aslp-org.20150623.gappssmtp.com header.b=fRo0MDvq
- Delivered-to: hts-users@xxxxxxxxxxxxxxx
- Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nwpu-aslp-org.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=ARV+1WadKmMVGFTm60oT6QvQGEWH59LQXK5Ldin1yXA=; b=fRo0MDvq9k28JFTBhfCMmR1fQ41EbSOLDtYU1VlpUCYP36IM1AiYWVSkIYzVTy7BXV P3Jz3PfCwVIxWc+gamxVXH8Rn5jNvRpAXwm6WNa+Q/NSD0ogNY0T2CxQBhfR4ZEpLDdO QTGBv6oi8vdDceboDyYZAYrDn/BD6vVfvL9Zm2Vol2wKyR5b0cd9lMJFc9DAtFcxYdcF zwfagk8P48KqA6qpth325L4q9wbb7aT43Yum/K1MaG/LBIs/v7lFx82IQYSj5G8YjN9r /J+klrrELxVs19syqLpOfSA5sapRxkh41O7GS5XNi1rs76S51P8K98+i2h9VVqTVKj5X sBNw==
Hi all!
These days I use HTS-demo_CMU-ARCTIC-ADAPT but vctk database to do the hmm adaptation. the labels and cmp (25d-mgc+delta+delta delta, 5d-bap+delta+delta delta, 1d-lf0+delta+delta delta,1d-u/v, 94d in total) of all speakers are prepared outside this demo by myself, so the f0 range is uniform for male and uniform for female.
The procedure with all the switches on except FALGN MCDGV MKUNG (useGV=0) can go through successfully, but the results are not expected ones. The results of SI and SAT should be the average voice, but my results sound that you can specify the man voice and women voice in one sentence, which means that they seem to be hard to merge with each other. Meanwhile, the results of SI+dec_feat3 and SAT+dec_feat3 should be the adaptive results, but my results sound have no difference with SI and SAT, which means that the adaptation training failed.
Some configuration is listed as follows:
$usestraight = '1';
@SET = ('cmp','dur');
if(!$usestraight){
@cmp = ('mgc','lf0');
}else{
@cmp = ('mgc','lf0','bap');
%mdlf = ('mgc' => '1.0', # tree size control param. for MDL
'lf0' => '1.0',
'bap' => '1.0',
'dur' => '1.0');
%mocc = ('mgc' => '10.0', # minimum occupancy counts
'lf0' => '10.0',
'bap' => '10.0',
'dur' => ' 5.0');
%gam = ('mgc' => '000', # stats load threshold
'lf0' => '000',
'bap' => '000',
'dur' => '000');
%msdi = ('mgc' => '0', # msd information
'lf0' => '1',
'bap' => '0',
'dur' => '0');
%ordr = ('mgc' => '25', # feature order
'lf0' => '1',
'bap' => '5',
'dur' => '5');
# Speaker adaptation Setting ============
$spkrPat = "\"*/*_*\""; # speaker name pattern
# regression classes
%dect = ('mgc' => '500.0', # occupancy thresholds for regression classes (dec)
'lf0' => '100.0', # set thresholds in less than adpt and satt
'bap' => '100.0',
'dur' => '100.0');
$nClass = 32; # number of regression classes (reg)
# transforms
%nblk = ('mgc' => '3', # number of blocks for transforms
'lf0' => '1',
'bap' => '3',
'dur' => '1');
%band = ('mgc' => '25', # band width for transforms
'lf0' => '1',
'bap' => '5',
'dur' => '0');
$bias{'cmp'} = 'TRUE'; # use bias term for MLLRMEAN/CMLLR
$bias{'dur'} = 'TRUE';
$tran = 'feat'; # transformation kind (mean -> MLLRMEAN, cov -> MLLRCOV, or feat -> CMLLR)
# adaptation
%adpt = ('mgc' => '500.0', # occupancy thresholds for adaptation
'lf0' => '100.0',
'bap' => '100.0',
'dur' => '100.0');
$tknd{'adp'} = 'dec'; # tree kind (dec -> decision tree or reg -> regression tree (k-means))
$dcov = 'FALSE'; # use diagonal covariance transform for MLLRMEAN
$usemaplr = 'TRUE'; # use MAPLR adaptation for MLLRMEAN/CMLLR
$usevblr = 'FALSE'; # use VBLR adaptation for MLLRMEAN
$sprior = 'TRUE'; # use structural prior for MAPLR/VBLR with regression class tree
$priorscale = 1.0; # hyper-parameter for SMAPLR adaptation
$nAdapt = 3; # number of iterations to reestimate adaptation xforms
$addMAP = 1; # apply additional MAP estimation after MLLR adaptation
$maptau{'cmp'} = 50.0; # hyper-parameters for MAP adaptation
$maptau{'dur'} = 50.0;
# speaker adaptive training
%satt = ('mgc' => '10000.0', # occupancy thresholds for adaptive training
'lf0' => '2000.0',
'bap' => '2000.0',
'dur' => '5000.0');
$tknd{'sat'} = 'dec'; # tree kind (dec -> decision tree or reg -> regression tree (k-means))
$nSAT = 3; # number of SAT iterations
I'm really sorry to bother you! Can anyone help me with these problems? I don't know why these happened cause I just changed the data and modify some path according to the data.
Best regards,
zhen wei
- Follow-Ups
-
- [hts-users:04527] Re: adaptation failed in HTS-demo_CMU-ARCTIC-ADAPT, Heiga ZEN (Byung Ha CHUN)