Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update GPU vendor options #33

Merged
merged 1 commit into from
Oct 17, 2023
Merged

Conversation

xorJane
Copy link
Contributor

@xorJane xorJane commented Oct 17, 2023

Hello! I noticed that --gpu-vendor nvidia was not working, so I updated the possible GPU vendors listed in cloud-select/cloudselect/main/schemas.py to match those I was seeing in .cloud-select/cache/aws/instances.json.

I can now filter for NVIDIA, AMD, or Habana GPUs:

$ cloud-select instance --cloud aws --gpus-min 2 --gpu-vendor NVIDIA
Update function for aws returned no results, will use previous data.
Update function for aws returned no results, will use previous data.
                                  Cloud Instances Selected
┏━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━┳━━━━━━┳━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━┓
┃ Cloud ┃ Name          ┃ Memory  ┃ Price   ┃ Cpus ┃ Gpus ┃ Region    ┃ Description        ┃
┡━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━━━━╇━━━━━━╇━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━┩
│ aws   │ g5g.16xlarge  │ 131072  │ 2.744   │ 64   │ 2    │ us-east-1 │ 64 vCPUs, 128.0... │
│ aws   │ p4d.24xlarge  │ 1179648 │ 32.7726 │ 96   │ 8    │ us-east-1 │ 96 vCPUs, 1.1 T... │
│ aws   │ p5.48xlarge   │ 2097152 │ 98.32   │ 192  │ 8    │ us-east-1 │ 192 vCPUs, 2.0 ... │
│ aws   │ g4dn.12xlarge │ 196608  │ 3.912   │ 48   │ 4    │ us-east-1 │ 48 vCPUs, 192.0... │
│ aws   │ p2.8xlarge    │ 499712  │ 7.2     │ 32   │ 8    │ us-east-1 │ 32 vCPUs, 488.0... │
│ aws   │ p3dn.24xlarge │ 786432  │ 31.212  │ 96   │ 8    │ us-east-1 │ 96 vCPUs, 768.0... │
│ aws   │ p3.16xlarge   │ 499712  │ 24.48   │ 64   │ 8    │ us-east-1 │ 64 vCPUs, 488.0... │
│ aws   │ g5.12xlarge   │ 196608  │ 5.672   │ 48   │ 4    │ us-east-1 │ 48 vCPUs, 192.0... │
│ aws   │ g4dn.metal    │ 393216  │         │ 96   │ 8    │ us-east-1 │ 96 vCPUs, 384.0... │
│ aws   │ g3.16xlarge   │ 499712  │ 4.56    │ 64   │ 4    │ us-east-1 │ 64 vCPUs, 488.0... │
│ aws   │ p2.16xlarge   │ 749568  │ 14.4    │ 64   │ 16   │ us-east-1 │ 64 vCPUs, 732.0... │
│ aws   │ p3.8xlarge    │ 249856  │ 12.24   │ 32   │ 4    │ us-east-1 │ 32 vCPUs, 244.0... │
│ aws   │ g5.48xlarge   │ 786432  │ 16.288  │ 192  │ 8    │ us-east-1 │ 192 vCPUs, 768.... │
│ aws   │ g5g.metal     │ 131072  │         │ 64   │ 2    │ us-east-1 │ 64 vCPUs, 128.0... │
│ aws   │ g3.8xlarge    │ 249856  │ 2.28    │ 32   │ 2    │ us-east-1 │ 32 vCPUs, 244.0... │
│ aws   │ g5.24xlarge   │ 393216  │ 8.144   │ 96   │ 4    │ us-east-1 │ 96 vCPUs, 384.0... │
└───────┴───────────────┴─────────┴─────────┴──────┴──────┴───────────┴────────────────────┘
*Price in USD/hour
$ cloud-select instance --cloud aws --gpus-min 2 --gpu-vendor AMD
Update function for aws returned no results, will use previous data.
Update function for aws returned no results, will use previous data.
                                Cloud Instances Selected
┏━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━┳━━━━━━━┳━━━━━━┳━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━┓
┃ Cloud ┃ Name          ┃ Memory ┃ Price ┃ Cpus ┃ Gpus ┃ Region    ┃ Description        ┃
┡━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━╇━━━━━━━╇━━━━━━╇━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━┩
│ aws   │ g4ad.16xlarge │ 262144 │ 3.468 │ 64   │ 4    │ us-east-1 │ 64 vCPUs, 256.0... │
│ aws   │ g4ad.8xlarge  │ 131072 │ 1.734 │ 32   │ 2    │ us-east-1 │ 32 vCPUs, 128.0... │
└───────┴───────────────┴────────┴───────┴──────┴──────┴───────────┴────────────────────┘
*Price in USD/hour
$ cloud-select instance --cloud aws --gpus-min 2 --gpu-vendor Habana
Update function for aws returned no results, will use previous data.
Update function for aws returned no results, will use previous data.
                                 Cloud Instances Selected
┏━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━┳━━━━━━┳━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━┓
┃ Cloud ┃ Name         ┃ Memory ┃ Price    ┃ Cpus ┃ Gpus ┃ Region    ┃ Description        ┃
┡━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━╇━━━━━━╇━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━┩
│ aws   │ dl1.24xlarge │ 786432 │ 13.10904 │ 96   │ 8    │ us-east-1 │ 96 vCPUs, 768.0... │
└───────┴──────────────┴────────┴──────────┴──────┴──────┴───────────┴────────────────────┘
*Price in USD/hour

Hopefully this helps!

@vsoch
Copy link
Member

vsoch commented Oct 17, 2023

Awesome!

@vsoch
Copy link
Member

vsoch commented Oct 17, 2023

I suspect the lowercase nvidia was from GCP. We aren't doing much work there so I'm good using the AWS set (and figuring out extending it later).

@vsoch vsoch merged commit d1eeaea into converged-computing:main Oct 17, 2023
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants