Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] [API Server] Allow autoscaling in python api server client #2029

Open
1 of 2 tasks
smit-kiri opened this issue Mar 20, 2024 · 4 comments
Open
1 of 2 tasks
Assignees
Labels
apiserver enhancement New feature or request

Comments

@smit-kiri
Copy link

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Description

I see that API Server does support autoscaling, but that is unavailable in python api server client.

It would be very useful to add this capability

Use case

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!
@smit-kiri smit-kiri added enhancement New feature or request triage labels Mar 20, 2024
@kevin85421
Copy link
Member

cc @tedhtchang @blublinsky @z103cb

@blublinsky
Copy link
Contributor

Oh yes, Cluster spec is missing:

    "enableInTreeAutoscaling": true,
    "autoscalerOptions": {
        "upscalingMode": "Default",
        "idleTimeoutSeconds": 30,
        "cpu": "500m",
        "memory": "512Mi"
    },

parameters. Can get to it in a couple of weeks

@anyscalesam
Copy link
Contributor

OK to assign to you @blublinsky to track next step?

@blublinsky
Copy link
Contributor

Sure, but I need my current PR to be merged first. It has been sitting there for several months now

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
apiserver enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants