[SVS] VISinger Plus

[jerryuhoo]

What?

Use pre-trained SSL models as additional input information for VISinger 2.

Why?

SVS enhancement.

See also

@ftshijt

[ftshijt]

Many thanks for the great work. I left a few comments to further improve it~

[jerryuhoo]

I have resolved all comments. Please review when you have time @ftshijt, many thanks!

[ftshijt]

Many thanks for your contribution!

A few minor comments as below. Also, it would be super helpful if you could add unit tests along with the new setup.

[ftshijt]

Since it is a sub-module of the gan_svs model, we may not need to manually add the device setup?

[ftshijt]

After fixing the issue, we can safely merge the PR.

[ftshijt]

Also, please fix the import CI error in the import test.

[codecov]

Codecov Report

Attention: Patch coverage is 19.44444% with 29 lines in your changes are missing coverage. Please review.

Project coverage is 54.27%. Comparing base (5180c85) to head (2cf7402).
Report is 13 commits behind head on master.

❗ Current head 2cf7402 differs from pull request most recent head 154148d

Please upload reports for the commit 154148d to get more accurate results.

Files	Patch %	Lines
espnet2/tasks/gan_svs.py	0.00%	14 Missing ⚠️
espnet2/gan_svs/espnet_model.py	0.00%	8 Missing ⚠️
espnet2/gan_svs/vits/vits.py	45.45%	6 Missing ⚠️
espnet2/gan_svs/vits/generator.py	50.00%	1 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           master    #5741       +/-   ##
===========================================
+ Coverage   32.51%   54.27%   +21.76%     
===========================================
  Files         768      767        -1     
  Lines       70372    70338       -34     
===========================================
+ Hits        22878    38173    +15295     
+ Misses      47494    32165    -15329     

Flag	Coverage Δ
test_integration_espnet2	?
test_python_espnet2	52.63% <19.44%> (?)
test_python_espnetez	?
test_utils	20.91% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[ftshijt]

Many thanks for the update and your great contribution! I will merge the PR, but please remember to submit another PR for CI test in the second stage.