Skip to content

Commit 21b723c

Browse files
committed
docs: Enhance MCP tools section in README with server-side management details
Signed-off-by: Eden Reich <eden.reich@gmail.com>
1 parent a9a3de6 commit 21b723c

File tree

1 file changed

+9
-4
lines changed

1 file changed

+9
-4
lines changed

README.md

Lines changed: 9 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -236,15 +236,20 @@ if response.choices[0].message.tool_calls:
236236
### Listing Available MCP Tools
237237

238238
```python
239-
# List available MCP tools works when MCP_ENABLE and MCP_EXPOSE are set on the gateway
239+
# List available MCP tools (requires MCP_ENABLE and MCP_EXPOSE to be set on the gateway)
240240
tools = client.list_tools()
241241
print("Available tools:", tools)
242242
```
243243

244-
Currently the SDK only supports listing tools, this is useful when you have a UI application and you want to display to the user what tools are connected and available, because the tools themselves live on the server the client doesn't need to instruct the LLM to use them.
245-
They will be inferred and injected automatically to the request by the Inference Gateway server and the client will receive the final response.
244+
**Server-Side Tool Management**
246245

247-
When you send a chat completion as a streaming request and you have MCP servers configured, you would see the tool calls in the response stream, but you don't need to do anything special in the client code, it just let you know that the LLM wants to call a tool on the server. This simplify the client code and allows you to focus on the LLM interaction without worrying about tool management.
246+
The SDK currently supports listing available MCP tools, which is particularly useful for UI applications that need to display connected tools to users. The key advantage is that tools are managed server-side:
247+
248+
- **Automatic Tool Injection**: Tools are automatically inferred and injected into requests by the Inference Gateway server
249+
- **Simplified Client Code**: No need to manually manage or configure tools in your client application
250+
- **Transparent Tool Calls**: During streaming chat completions with configured MCP servers, tool calls appear in the response stream - no special handling required except optionally displaying them to users
251+
252+
This architecture allows you to focus on LLM interactions while the gateway handles all tool management complexities behind the scenes.
248253

249254
### Custom HTTP Configuration
250255

0 commit comments

Comments
 (0)