add per-variant endpoint concurrency with least-loaded dispatch #895

Bugbot Review

Bugbot Analysis Progress (12m 12s elapsed)

✅ Gathered PR context (2s)
✅ Completed bug detection (12m 6s)
✅ Posted analysis results (4s)

Final Result: Bugbot completed review and found 1 potential issue.

Request ID: serverGenReqId_b30cd5b4-19c9-4c2c-83dc-a28dd2bce00f

Cursor Bugbot has reviewed your changes and found 1 potential issue.

^{Bugbot Autofix is OFF. To automatically fix reported issues with Cloud Agents, enable Autofix in the Cursor dashboard.}