-
Notifications
You must be signed in to change notification settings - Fork 1.2k
add elevenlabs scribe #3280
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
add elevenlabs scribe #3280
Conversation
|
I cannot merge if the pr was not tested. pls get back to me with the test results. this pr is clean. nice job. thanks man. |
It was fully tested, don't worry. I've been running it on my custom backend for a few weeks now. |
|
I can't sadly test backend/scripts/stt/k_compare_transcripts_perfor mance.py as I don't have the funds to test all of then. If you want me to test it, please get back to me on discord with the elevenlabs API key. |
|
Thank you all on your support |
|
Scribe v2 is real-time but does not support diarization, scribe v1 supports diarization but is not real-time |
Thats a good point, i did not check before migrating to v2. Sorry about that. |
|
Also there are a few issues in code, elevenlabs_socket, elevenlabs_socket1, elevenlabs_socket2, you'd probably want to replace elevenlabs_socket and its instances with elevenlabs_socket1 |
Got it, will it be merged if fixed? |
I did also implement backend/scripts/stt/k_compare_transcripts_performance.py but i could not test it yet.
This pull request introduces ElevenLabs Scribe as a new speech-to-text (STT) integration, making it available as a selectable transcription service alongside existing providers. The changes span environment configuration, requirements, core streaming logic, database storage, performance testing, and include a new integration test script. The main updates focus on supporting ElevenLabs Scribe throughout the backend pipeline, enabling its use for real-time and batch transcription.
ElevenLabs Scribe Integration
elevenlabsPython package torequirements.txtand theELEVENLABS_API_KEYenvironment variable to.env.templatefor authentication and configuration. [1] [2]process_audio_elevenlabs), updated service selection logic to prioritize ElevenLabs when configured, and mapped supported languages. [1] [2] [3]Database and Performance Testing
Testing and Validation
test_elevenlabs_stt.py) to verify ElevenLabs Scribe connectivity, service selection, and basic audio streaming functionality.