*Subject*: [hts-users:03243] Re: duration modeling and dur file*From*: Keiichiro Oura <uratec@xxxxxxxxxxxxxxx>*Date*: Tue, 17 Apr 2012 01:10:53 +0900*Cc*: uratec <uratec@xxxxxxxxxxxx>*Delivered-to*: hts-users@xxxxxxxxxxxxxxx*Dkim-signature*: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=5FS0dW4WD8SCsreV1U7EHNssX3z8a4J3V8k7HJ4X0Po=; b=SiWh0BWEoIUILmbMnPCjy/xNieLJFXm0eHWIk8PEh49RnLq8oqt/t0zWwSpzUMm+dd br9VncEDy8OWE1/LdinkgCnpyzUnuva8neWQhAkkBdsZWe31RroT6xYnsg/jB1hO/lyu d6nejRYQJ+Gfe/kdu6gGX36Fw/pbtK+hWuMiGZ/F9vzGvPufWJGagoLvbzXwc+1AVwK9 kYuUjZChylw+7tk5AlxAzTe1Iu+9HCPA5RvoVC6Awr2FkcQ8P7LyQT2V918u7+fWd6Io LJdaI3Hhe0NnYuFR4rBI9B5J4PQbTDMXpOToRT7g+Ofn1gB+zuFzIwzho1CS57BHrAbF uIcQ==

Please, tell me your HMGenS options and config files.

Regards,

Keiichiro Oura

2012/4/16 Heamin Lee <oasistony@xxxxxxxxxxx>

Thanks for your answer.

I applied speaker adaptation for the duration models too.

Now I can understand that transform matrices make the difference.

However, it is more serious problem that state durations are set to “1” for all states without considering mean…

Do you have any solution or idea for this problem?

*.dur

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33.state[2]: duration=1 (frame), mean=1.313743e+00

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33.state[3]: duration=1 (frame), mean=2.475758e+00

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33.state[4]: duration=1 (frame), mean=3.064046e+00

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33.state[5]: duration=1 (frame), mean=3.948951e+00

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33.state[6]: duration=1 (frame), mean=3.052463e+00

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33: duration=5 (frame), mean=1.385496e+01

From:ura228@xxxxxxxxx [mailto:ura228@xxxxxxxxx]On Behalf OfKeiichiro Oura

Sent:Monday, April 16, 2012 3:54 PMTo:hts-users@xxxxxxxxxxxxxxxCc:uratecSubject:[hts-users:03240] Re: duration modeling and dur file

Hi,

Do you apply speaker adaptation for the duration models?

I expect that the transform matrices of speaker adaptation make the difference.

Regards,

Keiichiro Oura

2012/4/16 Heamin Lee <oasistony@xxxxxxxxxxx>

Hello,

I am using HTS-2.2 for Speaker adaptation.

In HMGenS after adaptation, the output files are mgc, lf0, bap, dur. And I found that mgc, lf0, bap are generated through dur file.

In the paper, Hidden Semi-Markov Model Based Speech Synthesis System, I’ve understood that state durations are, after all, determined by state duration mean vector.

So I expected that the mean of *.dur file is same as a mean vector of duration model.

However, the mean in the *.dur file is little different from a mean of duration model, for example, 1.313743e+00 is mean of * .dur file, 1.306419e+00 is mean of duration model.

Why it is different? Is there another algorithm to generate duration mean vector or something wrong with this process?

And more important problem is that sometimes the duration is set to “1” for all states without considering the mean.

Below is the problem, and this problem does not appear in the speech without adaptation. Why does this problem occurs?

*.dur

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33.state[2]: duration=1 (frame), mean=1.313743e+00

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33.state[3]: duration=1 (frame), mean=2.475758e+00

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33.state[4]: duration=1 (frame), mean=3.064046e+00

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33.state[5]: duration=1 (frame), mean=3.948951e+00

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33.state[6]: duration=1 (frame), mean=3.052463e+00

AX^P-WW+L=R@2_2/A:2/B:3-2-&14-20|WW/C:2/D:2/E:3+&7/F:4/H:12=33: duration=5 (frame), mean=1.385496e+01

Duration model

~s "dur_s2_1623"

<STREAM> 1

<MEAN> 1

1.306419e+00

<VARIANCE> 1

1.695042e-01

<GCONST> 6.299961e-02

<STREAM> 2

<MEAN> 1

2.176778e+00

<VARIANCE> 1

1.851734e+00

<GCONST> 2.454000e+00

<STREAM> 3

<MEAN> 1

3.774895e+00

<VARIANCE> 1

1.702917e+01

<GCONST> 4.672805e+00

<STREAM> 4

<MEAN> 1

5.540838e+00

<VARIANCE> 1

3.468322e+01

<GCONST> 5.384133e+00

<STREAM> 5

<MEAN> 1

2.440767e+00

<VARIANCE> 1

8.953208e+00

<GCONST> 4.029889e+00

**Follow-Ups****[hts-users:03244] Re: duration modeling and dur file**,*Heamin Lee*

**References****[hts-users:03239] duration modeling and dur file**,*Heamin Lee***[hts-users:03240] Re: duration modeling and dur file**,*Keiichiro Oura***[hts-users:03241] Re: duration modeling and dur file**,*Heamin Lee*

- Prev by Subject:
**[hts-users:03242] FWD:** - Next by Subject:
**[hts-users:03244] Re: duration modeling and dur file** - Previous by thread:
**[hts-users:03241] Re: duration modeling and dur file** - Next by thread:
**[hts-users:03244] Re: duration modeling and dur file**