[Feature]: more local llm support other than ollama

### Summary

support more openai compatible services such as vllm or sglang

### Problem to solve

support more openai compatible services such as vllm or sglang

### Proposed solution

support more openai compatible services such as vllm or sglang

### Alternatives considered

_No response_

### Impact

Dailiy

### Evidence/examples

_No response_

### Additional information

_No response_