Open
Description
Describe the bug
SSE connections to fastapi_mcp fail intermittently when deployed with multiple pods on GKE. Cursor client sometimes gets tools successfully, sometimes fails with 404 errors. The issue disappears when using single pod deployment.
To Reproduce
- Deploy fastapi_mcp service with multiple pods on GKE
- Configure Cursor client to connect via SSE
- Try to retrieve tools multiple times
- Observe intermittent failures (404 errors)
Expected: Consistent successful connections
Actual: Random failures due to load balancer routing requests to different pods
System Info
- Platform: Google Kubernetes Engine (GKE)
- Deployment: Multi-pod with load balancing
- Connection: Server-Sent Events (SSE)
- Client: Cursor IDE
- Issue: WebSocket long connections broken by pod switching