enhance(client): new impl of model serving

[jialeicui]

Description

TODO:

• support custom serving without online eval support (e.g. use gradio as input or output)
• support online eval in console
• support other inference types components

chat.mp4

Modules

• UI
• Controller
• Agent
• Client
• Python-SDK
• Others

Checklist

• run code format and lint check
• add unit test
• add necessary doc

[codecov]

Codecov Report

Attention: 19 lines in your changes are missing coverage. Please review.

Comparison is base (ee53554) 82.96% compared to head (4d3c7ae) 91.70%.
Report is 6 commits behind head on main.

Files	Patch %	Lines
client/starwhale/api/_impl/service/service.py	72.05%	19 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main    #2978      +/-   ##
============================================
+ Coverage     82.96%   91.70%   +8.74%     
============================================
  Files           557      127     -430     
  Lines         30354    15159   -15195     
  Branches       1827       61    -1766     
============================================
- Hits          25183    13902   -11281     
+ Misses         4366     1255    -3111     
+ Partials        805        2     -803     

Flag	Coverage Δ
console	72.09% <ø> (ø)
controller	?
standalone	91.99% <76.82%> (-0.07%)	⬇️
unittests	91.70% <76.82%> (-0.07%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[anda-ren]

LGTM