Move Tool Descriptions to System Prompt for Improved Agent Mode

[Josh-Dum]

Validations

• I believe this is a way to improve. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that requests the same enhancement

Problem

Continue’s documentation states that tool descriptions are included in the user chat prompt. This may reduce agent mode performance compared to tools like GitHub Copilot and Cursor, which place tool descriptions in the system prompt. More the community around agent implementation with tools seems to agree that tool description must be put in the system prompt.

Problem :
Agent Mode: Inconsistent tool context may hinder autonomous task execution (e.g., multi-file edits).
Competitor Gap: GitHub Copilot’s system prompt approach enables precise tool usage (VS Code Blog), and Cursor excels in seamless edits (4sysops).

Solution

Move tool descriptions to the system prompt to:

Enhance agent mode autonomy and reliability.
Align with competitors’ performance.

Are there reasons for keeping tool descriptions in user prompts? Would this change fit Continue’s roadmap? Thanks for considering!

[RomneyDa]

@Josh-Dum see #5809

[RomneyDa]

@Josh-Dum update, bumping this today