Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added ultravox service #1331

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

milo157
Copy link

@milo157 milo157 commented Mar 4, 2025

Creating a Ultravox Service compatible with Pipecat

This PR creates a Ultravox service that runs a Ultravox model of your choice. This replaces the STT and LLM components with the Ultravox model giving great latency results!

In order to run Ultravox you need to use a GPU (We recommend Cerebrium)

What was tested:

  • End-to-end pipeline
  • Metrics implementation to track TTFB

What was not tested:

  • I am unsure of how the service scales based on concurrency limitations of the Ultravox model you select

@kwindla
Copy link
Contributor

kwindla commented Mar 10, 2025

It's fantastic to have Ultravox support in Pipecat!

Question: does Ultravox also output audio? Can this service be configurable to output only text frames, only audio frames, or both?

Is it possible to add a single-file example in the examples/foundational/ directory that shows how to use this service?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants