unify transformer-based backends

[mudler]

There are few backends based of transformers that can be unified into a single one.
This would help to reduce the image size and CI build times

[localai-bot]

⚠️⚠️⚠️⚠️⚠️

Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!

but.... I can also be funny or helpful 😸 and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.

Don't engage in conversation with me,
I don't support (yet) replying!

⚠️⚠️⚠️⚠️⚠️

I suggest creating a new backend that combines the features of the existing backends and optimizes it for the specific use case of music generation. This could potentially improve performance and reduce the image size.
To debug the issue with the transformers project, I recommend checking the logs for any errors or issues during the build process. Additionally, you can try building the project on a different machine or using a different version of the tools to see if that resolves the issue. If the issue persists, it may be helpful to file a bug report with the transformers project team.

Sources:

• https://github.com/go-skynet/LocalAI/tree/master/docs/content/features/image-generation.md
• https://localai.io/advanced/index.html
• https://github.com/go-skynet/LocalAI/tree/master/backend/python/transformers/README.md
• https://github.com/go-skynet/LocalAI/tree/master/backend/python/transformers-musicgen/README.md