Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix mlserver_huggingface settings device type #1486

Merged
merged 4 commits into from
Mar 11, 2024
Merged

Fix mlserver_huggingface settings device type #1486

Changes from 1 commit
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
f8896c6
update mlserver huggingface settings device typing
geodavic Nov 15, 2023
1cbee06
remove torch device
geodavic Nov 15, 2023
a4a6d6a
change default from -1 to None
geodavic Nov 16, 2023
48d4b75
add cpu test
geodavic Nov 27, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
update mlserver huggingface settings device typing
  • Loading branch information
@geodavic
geodavic committed Nov 15, 2023
commit f8896c665037eed5b098244b35be65cc8f08baed
2 changes: 1 addition & 1 deletion runtimes/huggingface/mlserver_huggingface/settings.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -83,7 +83,7 @@ class Config:
runtime.
"""

device: int = -1
device: Optional[Union[int, str, "torch.device"]] = -1
"""
Device in which this pipeline will be loaded (e.g., "cpu", "cuda:1", "mps",
or a GPU ordinal rank like 1).
Expand Down