Skip to content

Move replica parallelism API configurations to separate key #1090

Closed
@deliahu

Description

@deliahu

Description

Move workers_per_replica and threads_per_worker configurations out of autoscaling and into a different key, since these configurations apply to batch prediction and local APIs as well.

Unblocks #960

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions