Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Converting Enunu to NNSVS #179

Open
Surgbc opened this issue Dec 15, 2022 · 3 comments
Open

Converting Enunu to NNSVS #179

Surgbc opened this issue Dec 15, 2022 · 3 comments
Labels
question Further information is requested

Comments

@Surgbc
Copy link

Surgbc commented Dec 15, 2022

I have used the provided script to convert some Enunu model to the format required by NNSVS. But not all models work in NNSVS, giving only silent audio.

For instance the trainer of AICHI has told me that: a.i.chi was trained on the ENUNU training kit so he will *only work alongside the plug-in!* Should this be the case?

@Surgbc Surgbc changed the title Concerting Enunu to NNSVS Converting Enunu to NNSVS Dec 15, 2022
@r9y9
Copy link
Collaborator

r9y9 commented Dec 15, 2022

Could you describe detailed steps to reproduce? I believe it should work merely with NNSVS.

@Surgbc
Copy link
Author

Surgbc commented Dec 16, 2022

I have created a notebook:

Open In Colab

It has a comparison also of the outputs for the Ritsu model which is also converted from ENUNU and Yoko for both a Japanese song and an English song.

@r9y9
Copy link
Collaborator

r9y9 commented Dec 17, 2022

It looks like something is wrong with the full-context extraction.

  contexts = pysinsy.extract_fullcontext(file_)
  labels = hts.HTSLabelFile.create_from_contexts(contexts)

This part only works correct if the full-context labels for training are consistent with Sinsy's format. For Ritsu, you'd need to use https://github.com/oatsu-gh/utaupy to get full-context labels from UST. I'm not sure about a.i.chi.

@r9y9 r9y9 added the question Further information is requested label Jan 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants