Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

New model: AudioCraft for audio generation #429

Open
PABannier opened this issue Aug 2, 2023 · 2 comments
Open

New model: AudioCraft for audio generation #429

PABannier opened this issue Aug 2, 2023 · 2 comments
Assignees
@PABannier
Labels
help wanted Extra attention is needed model Model specific

Comments

@PABannier
Copy link
Contributor

Meta just released their new open-source model AudioCraft consisting of three pieces: MusicGen, AudioGen and Encodec.
Given encodec.cpp is already implemented, we should be able to implement it AudioCraft fairly easily with ggml.

I've already opened an issue in bark.cpp and plan to implement it as soon as i'm finished with bark.

Source: https://ai.meta.com/blog/audiocraft-musicgen-audiogen-encodec-generative-ai-audio/
@ggerganov ggerganov added help wanted Extra attention is needed model Model specific labels Aug 3, 2023
@ggerganov
Copy link
Owner

Awesome! Did they release the weights too?

@Green-Sky
Copy link
Contributor

Green-Sky commented Aug 3, 2023 •
edited
Loading

Awesome! Did they release the weights too?

some:
https://huggingface.co/facebook/audiogen-medium
https://huggingface.co/facebook/musicgen-small
https://huggingface.co/facebook/musicgen-medium
https://huggingface.co/facebook/musicgen-melody
https://huggingface.co/facebook/musicgen-large

edit: but i am not sure if those where uploaded by hf staff or fb directly
edit2: their gh repo points to the hf repos

CCLDArjun pushed a commit to CCLDArjun/ggml that referenced this issue Dec 18, 2023
@sw @prusnak
Revert "Delete SHA256SUMS for now" (ggerganov#429)
a50e39c 
* Revert "Delete SHA256SUMS for now (ggerganov#416)"

This reverts commit 8eea5ae.

* Remove ggml files until they can be verified
* Remove alpaca json
* Add also model/tokenizer.model to SHA256SUMS + update README

---------

Co-authored-by: Pavol Rusnak <pavol@rusnak.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@PABannier PABannier

Labels
help wanted Extra attention is needed model Model specific
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ggerganov @Green-Sky @PABannier