Support downloading model weights on the fly from HF #166
Description
Is your feature request related to a problem? Please describe.
For non-Vector users, they might prefer to download weights on the fly as opposed to manually downloading weights and mounting a directory
Describe the solution you'd like
Support on-the-fly model weights download in parallel to using cached model weights
Additional context
Originally posted by @rohan-uiuc in #74