Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there any interest in providing a model trained in Brazilian Portuguese? #160

Closed
Edresson opened this issue Apr 19, 2019 · 16 comments
Closed

Comments

@Edresson
Copy link
Contributor

Hello, I recently developed a dataset for voice synthesis in Brazilian Portuguese using my own voice, called TTS-Porguese Corpus, the base has approximately 10 hours of talk, is available at: https://github.com/Edresson/TTS-Portuguese-Corpus

I have already successfully trained the DCTTS model in the dataset.

I created a branch in my repository to support the dataset in this repository, see here: https://github.com/Edresson/TTS/tree/TTS-Portuguese

In initial tests the model unfortunately did not converge, at the moment I'm out of time, and machine to train the model.

  Is anyone interested in training/adjusting the hyperparameters of the model to get a TTS model in Portuguese?

@erogol
Copy link
Contributor

erogol commented Apr 20, 2019

Unfortunately not at the moment. Maybe later on.

@erogol erogol closed this as completed Apr 20, 2019
@Edresson
Copy link
Contributor Author

Hello, I trained the model with the TTS -Portuguese Corpus. Provide a demo here: https://colab.research.google.com/drive/1OZ7T5fqR-QPyN5O6HFetkOeHNCKbdGsA

@erogol
Copy link
Contributor

erogol commented Aug 19, 2019

would you mind if I link your model on our released models https://github.com/mozilla/TTS/wiki/Released-Models

@erogol
Copy link
Contributor

erogol commented Aug 19, 2019

@Edresson have you tried universal wavernn trained here https://github.com/erogol/WaveRNN? It sounds already good to me but that might improve the results with neural vocoder.

@Edresson
Copy link
Contributor Author

Edresson commented Aug 19, 2019

@erogol you can link my models.
I trained two models. The first model was trained only under the TTS-Portuguese corpus (demo link ). The second model was trained using transfer learning (with the model iter-120K | LJSpeech | commit: bf7590) demo link

About WaveRNN I had been trying to train at TTS-Portuguese Corpus, however, I didn't get good results (I wasn't using transfer learning ). It would be interesting to try its implementation.

@erogol
Copy link
Contributor

erogol commented Aug 20, 2019

@Edresson which version trained better, the one with transfer learning or the other?

@Edresson
Copy link
Contributor Author

@erogol the version with transfer learning is better.

@Edresson
Copy link
Contributor Author

Edresson commented Aug 24, 2019

I will try to use Universal WaveRNN.

@Edresson
Copy link
Contributor Author

Edresson commented Oct 9, 2019

@erogol @reuben New pretreined model added to Colab Notebook ( link ). The notebook generates audio synthesized by the WaveRNN and Griffin-Lim vocoder. WaveRNN audios sound better.
Some issues in stop token loss have been fixed, now the model correctly predicts the pronunciation time of each sentence. I believe it will be the final model for the TTS-Portuguese Corpus. If I have new results I will add it here.

Below the details of the model if you want to add it on the released models page.

Audio Sample
Pretrained Model: Tacotron-iter-381000
Details Model: Tacotron + Universal WaveRNN for Brazilian Portuguese
Commit: Branch
Dataset: TTS-Portuguese

Note: The model was trained using transfer learning ( with the model iter-120K | LJSpeech | commit: bf7590 )

@pedroalmeida415
Copy link

Hey guys, I was looking for a way to clone a League of Legends character's voice

After some days doing a lot of research, I'm still stuck at where to even begin with

Was wondering if any of you might have any leads for me

Thank you nonetheless!

@Edresson @blue-fish @erogol

@Cris140
Copy link

Cris140 commented Dec 14, 2021

Hey @pedroalmeida415, I'm developing a website with cloned voices, there will be some voices from League of Legends as well.
We have a discord in which we can talk about it and help you train the models.
Here's it: https://discord.gg/EUQX5Qfhnm

@pedroalmeida415
Copy link

Hey @Cris140 sorry for the delay

could you please send me an invite again? would be glad to help with what I can as well

thanks

@Cris140
Copy link

Cris140 commented Feb 6, 2022

There you go: https://discord.gg/YCShCG2G

@juant8001
Copy link

Hey, can you send me a invite ? I really interested on this

@bebezento
Copy link

@Cris140 Olá Cris140, ainda com o servidor no discord?

@Cris140
Copy link

Cris140 commented Oct 17, 2022

@bebezento Com certeza, aqui um novo link: https://discord.com/invite/4npUee2XMk

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants