[WIP] Add ai SDK tool handling for terminal commands

[Copilot]

• Analyze the existing codebase structure and post-processing implementation
• Understand the current LLM integration (uses async-openai in Rust backend)
• Install AI SDK v6 beta package (ai@6.0.0-beta.131, @ai-sdk/openai@3.0.0-beta.82)
• Create tool definitions for terminal, command execution, and file opening
• Add a TypeScript-based post-processing module using AI SDK with tools
• Create Tauri commands for shell operations (open_terminal, execute_shell_command, open_path)
• Add ai_sdk_tools_enabled setting to enable/disable the feature
• Create UI toggle for AI SDK Tools in post-processing settings
• Integrate the new post-processing flow with event-based communication between Rust and TypeScript
• Add paste_text_and_hide_overlay and hide_overlay_and_reset_tray commands
• Verify TypeScript compilation (pre-existing errors not related to changes)
• Verify frontend build succeeds
• Run code review and address feedback
  • Add shell escaping function for safe path handling
  • Add path validation to prevent null byte injection
  • Add dangerous command pattern blocking in execute_shell_command
  • Add security logging for shell command execution
  • Fix dummy API key issue (use undefined instead)
  • Improve type safety for tool results with defensive checking

Original prompt

using ai SDK latest version, version 6 beta, on the post process please add aisdk tool handling so that we could open the terminal or execute some commands based on what was ask in the voice command

---

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Preview	Comments	Updated (UTC)
echo-web	Error			Dec 4, 2025 6:27pm