Skip to content

Audio input instead of typing #1982

Description

@nshiab

What would you like to be added?

Amazing work.

But I would love to be able to talk with the agent instead of typing all the time.

I use Copilot in VS Code most of the time, and it's a feature that I love about it.

Thanks. :)

Why is this needed?

Speaking is often faster than typing.

Additional context

No response

Activity

  1. added
    priority/p2Important but can be addressed in a future release.
    and removed
    status/need-triageIssues that need to be triaged by the triage automation.
    on Jun 26, 2025
  2. olufuwatayo commented on Jun 26, 2025

    @olufuwatayo

    I use dictation inbuilt for mac and i added keyboard shortcut once i press Control keys twice it shows the audio and I do STT.
    https://support.apple.com/en-uz/guide/mac-help/mh40584/mac

    I have not tried it on windows but you can check this https://support.microsoft.com/en-us/windows/use-voice-typing-to-talk-instead-of-type-on-your-pc-fec94565-c4bd-329d-e59a-af033fa5689f

  3. xied-ctrl commented on Jun 26, 2025

    @xied-ctrl

    You can get very high quality voice to text by using a 3rd party with OpenAI whisper large integration.

  4. getvoicemode commented on Jun 30, 2025

    @getvoicemode

    Hey @nshiab! 👋

    Great suggestion! I've got some exciting news - Voice Mode already provides exactly what you're looking for with Gemini CLI!

    Voice Mode + Gemini CLI = 🎤✨

    Check out our demo video showing Voice Mode working seamlessly with Gemini CLI!

    What you get:

    ✅ Full voice conversations - Talk to Gemini, hear responses back
    ✅ Natural speaking - No push-to-talk, just speak naturally
    ✅ Smart silence detection - Automatically knows when you're done
    ✅ High-quality STT - Uses OpenAI Whisper (as @xied-ctrl suggested!) or local alternatives

    Quick setup:

    # Set your OpenAI API key (for STT/TTS)
    export OPENAI_API_KEY=your-key
    
    # Configure Voice Mode in your .gemini/settings.json
    # See our full Gemini CLI setup guide:
    # https://github.com/mbailey/voicemode/blob/main/docs/integrations/gemini-cli/README.md
    
    # Start Gemini CLI
    gemini
    
    # Then type 'converse' to start voice mode

    Then just say: "Let's have a voice conversation" and you're speaking with Gemini! 🎙️

    Why it's better than OS dictation:

    As @olufuwatayo mentioned, OS dictation works, but Voice Mode offers:

    • Two-way voice - Hear Gemini's responses too
    • Context-aware - Gemini can ask clarifying questions verbally
    • Faster workflow - No switching between dictation and reading

    Bonus features:

    • Local STT option - Use Whisper.cpp for privacy
    • Multiple voices - Choose how Gemini sounds
    • Emotional speech - Gemini can express excitement, concern, etc.

    Speaking really is faster than typing - and with Voice Mode, the entire conversation flows naturally!

    Would love to hear your feedback after trying it out!

  5. nshiab commented on Jul 2, 2025

    @nshiab
    Author

    Very interesting! Thank you all for these suggestions!

  6. jacob314 commented on Jul 31, 2025

    @jacob314
    Contributor
  7. 4 remaining items

  8. automateyournetwork commented on Aug 22, 2025

    @automateyournetwork

    I have been working on this

    using MCP + custom slash commands

    Commands
    https://github.com/automateyournetwork/GeminiCLI_Slash_Talk

    Matching MCP
    https://github.com/automateyournetwork/Talk_MCP_for_Gemini_CLI

    Video in action:
    https://youtu.be/beVxnNnEmro

  9. ghost removed on Oct 30, 2025
  10. fayerman-source commented on Feb 19, 2026

    @fayerman-source
    Contributor

    My PR #18499 introduces an experimental version of voice input. It handles recording and transcription within the CLI application.

  11. added
    area/agentIssues related to Core Agent, Tools, Memory, Sub-Agents, Hooks, Agent Quality
    kind/customer-issueIssues that were reported by customers
    priority/p3Backlog - a good idea but not currently a priority.
    on May 9, 2026
  12. gemini-cli commented on May 9, 2026

    @gemini-cli
    Contributor

    Assigned area/agent based on content keywords. Marked as kind/customer-issue with priority/p3.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/agentIssues related to Core Agent, Tools, Memory, Sub-Agents, Hooks, Agent Qualitykind/customer-issueIssues that were reported by customerspriority/p3Backlog - a good idea but not currently a priority.status/bot-triaged🔒 maintainer only⛔ Do not contribute. Internal roadmap item.

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions