Skip to content

Commit

Permalink
Making safetensors a core dependency. (#23254)
Browse files Browse the repository at this point in the history
* Making `safetensors` a core dependency.

To be merged later, I'm creating the PR so we can try it out.

* Update setup.py

* Remove duplicates.

* Even more redundant.
  • Loading branch information
Narsil authored May 23, 2023
1 parent abf691a commit 9e8d706
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -321,7 +321,6 @@ def run(self):
"protobuf", # Can be removed once we can unpin protobuf
"sacremoses",
"rjieba",
"safetensors",
"beautifulsoup4",
)
+ extras["retrieval"]
Expand Down Expand Up @@ -425,6 +424,7 @@ def run(self):
deps["regex"], # for OpenAI GPT
deps["requests"], # for downloading models over HTTPS
deps["tokenizers"],
deps["safetensors"],
deps["tqdm"], # progress bars in model download and training scripts
]

Expand Down

0 comments on commit 9e8d706

Please sign in to comment.