feat(controller): online eval support gc

[jialeicui]

Description

Online eval support garbage collection

• removes the workloads that reached the max TTL
• removes the oldest workload when there are pending workloads
  • prevent removing the workloads that not reached the min TTL

Modules

• UI
• Controller
• Agent
• Client
• Python-SDK
• Others

Checklist

• run code format and lint check
• add unit test
• add necessary doc

[codecov]

Codecov Report

Merging #1695 (8f65c60) into main (63fd2ef) will decrease coverage by 8.19%.
The diff coverage is 75.51%.

@@             Coverage Diff              @@
##               main    #1695      +/-   ##
============================================
- Coverage     82.32%   74.12%   -8.20%     
- Complexity     1932     1952      +20     
============================================
  Files           351      272      -79     
  Lines         18801     9311    -9490     
  Branches       1005     1025      +20     
============================================
- Hits          15478     6902    -8576     
+ Misses         2909     1985     -924     
- Partials        414      424      +10     

Flag	Coverage Δ
controller	74.12% <75.51%> (+0.04%)	⬆️
standalone	?
unittests	?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...ale/mlops/schedule/k8s/ContainerOverwriteSpec.java	100.00% <ø> (ø)
...ava/ai/starwhale/mlops/schedule/k8s/K8sClient.java	67.53% <66.66%> (+2.25%)	⬆️
...tarwhale/mlops/domain/job/ModelServingService.java	76.16% <70.43%> (-7.37%)	⬇️
...n/java/ai/starwhale/mlops/common/ProxyServlet.java	66.66% <100.00%> (+0.56%)	⬆️
...le/mlops/domain/job/mapper/ModelServingMapper.java	100.00% <100.00%> (ø)
...i/starwhale/mlops/schedule/k8s/K8sJobTemplate.java	88.88% <100.00%> (+1.38%)	⬆️
...in/java/ai/starwhale/mlops/common/TarFileUtil.java	44.57% <0.00%> (-1.21%)	⬇️
client/starwhale/api/_impl/service.py
client/starwhale/utils/cli.py
client/starwhale/base/view.py
... and 79 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

[goldenxinxing]

LGTM