Repository navigation
feat(stt): transcribe with omp's own speech-to-text models, including a ChatGPT/Codex subscription - #249
Open
andrebrait wants to merge 2 commits into
Open
feat(stt): transcribe with omp's own speech-to-text models, including a ChatGPT/Codex subscription#249andrebrait wants to merge 2 commits into
andrebrait wants to merge 2 commits into
Conversation
…stdio Without OMP_WEB_STT_ENDPOINT, OMP_WEB_STT_MODEL names an omp speech-to-text model (e.g. openai-codex/codex-transcribe on a ChatGPT subscription). Jobs run through a shared, idle-killed omp auth-gateway stdio child, so omp-web never touches credentials and needs no API key or separate STT server.
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
Voice input needed an OpenAI-compatible STT endpoint (
OMP_WEB_STT_ENDPOINT): an API key or a separately hosted STT server. Users with a ChatGPT/Codex subscription already logged in to omp could not dictate with it.Changes
OMP_WEB_STT_ENDPOINTunset and setOMP_WEB_STT_MODELto an omp speech-to-text model, such asopenai-codex/codex-transcribe(ChatGPT subscription, added in can1357/oh-my-pi#15391). An endpoint, when set, still wins, so existing setups are unchanged.omp auth-gateway stdio(lib/omp/auth-gateway.ts): one shared child, started on first use and stopped after 5 minutes idle, sending base64 JSON requests. omp-web never reads omp's credential store. A crashed child rejects its in-flight jobs and the next job respawns it; a child that never reports ready is killed after 60 seconds.Verification
npm test: 1356 pass, 0 fail.lib/stt-omp-gateway.test.mjsruns real jobs against a stub omp that speaks the stdio protocol: a transcript, an upstream error, a crash (error carries omp's stderr, next job respawns the gateway), and the format following the browser's file name (webm,mp4). The 501 test now clears both variables.tsc --noEmitclean; eslint has no errors.OMP_WEB_STT_MODEL=openai-codex/codex-transcribetranscribed the Whisper JFK clip correctly, 5.9 s cold (gateway start) and 1.1 s warm.Needs an omp release that includes can1357/oh-my-pi#15391 for the Codex model; other omp STT models (for example
openai/whisper-1with an OpenAI key in omp) also need itsauth-gateway stdioselector fix.