NaturalSpeech support

[MaxMax2016]

NaturalSpeech is based on vits. NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality https://arxiv.org/abs/2205.04421

[WeberJulian]

That would indeed be a great addition +1

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. You might also look our discussion channels.

[king-dahmanus]

yes, even the sound of that makes me want to breeth fire untill I fry my last braincell. As far as hunting for tts model open source implementations went, this one hasn't been implemented yet. I'm pretty sure I hunted enough, though I can always redo the process to maybe discover what little new implementations rise between the scouts. +1 @dtx525942103

[erogol]

Natural Speech is more of a finetuning regime for VITS. I am not sure it's worth the effort but if anyone is willing to give it a try, I am here for help

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. You might also look our discussion channels.

[ganesh-rao]

yes, even the sound of that makes me want to breeth fire untill I fry my last braincell. As far as hunting for tts model open source implementations went, this one hasn't been implemented yet. I'm pretty sure I hunted enough, though I can always redo the process to maybe discover what little new implementations rise between the scouts. +1 @dtx525942103

@heatz123 has done it here: https://github.com/heatz123/naturalspeech

[erogol]

someone is interested in pulling it into 🐸TTS?

[ganesh-rao]

@lucidrains appears to be implementing naturalspeech2 at an incredible pace here: https://github.com/lucidrains/naturalspeech2-pytorch

Might it be worth including the model in 🐸?