Skip to content

Commit

Permalink
chore: bump version and add gpu dependency
Browse files Browse the repository at this point in the history
  • Loading branch information
davidberenstein1957 committed Aug 26, 2024
1 parent 879c67d commit cd5fa9a
Show file tree
Hide file tree
Showing 3 changed files with 35 additions and 2 deletions.
9 changes: 9 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,12 +8,21 @@ This repository contains code to run faster feature extractors using tools like
[![PyPi downloads](https://static.pepy.tech/personalized-badge/fast-sentence-transformers?period=total&units=international_system&left_color=grey&right_color=orange&left_text=pip%20downloads)](https://pypi.org/project/fast-sentence-transformers/)
[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg?style=flat-square)](https://github.com/ambv/black)

> [Phillip Schmid](https://www.philschmid.de/optimize-sentence-transformers): "We successfully quantized our vanilla Transformers model with Hugging Face and managed to accelerate our model latency from 25.6ms to 12.3ms or 2.09x while keeping 100% of the accuracy on the stsb dataset.
> But I have to say that this isn't a plug and play process you can transfer to any Transformers model, task or dataset.""
## Install

```bash
pip install fast-sentence-transformers
```

Or, for GPU support:

```bash
pip install fast-sentence-transformers[gpu]
```

## Quickstart

```python
Expand Down
22 changes: 21 additions & 1 deletion poetry.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 5 additions & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[tool.poetry]
name = "fast-sentence-transformers"
version = "0.4.1"
version = "0.5"
description = "This repository contains code to run faster sentence-transformers. Simply, faster, sentence-transformers."
authors = ["David Berenstein <david.m.berenstein@gmail.com>"]
license = "MIT"
Expand All @@ -27,6 +27,10 @@ classifiers = [
python = ">=3.8,<3.13"
sentence-transformers = ">=3,<4"
optimum = {extras = ["onnxruntime"], version = ">1.10,<2"}
setuptools = ">69"

[tool.poetry.extras]
gpu = ["onnxruntime-gpu"]

[tool.poetry.dev-dependencies]
pytest = "^7.0.1"
Expand Down

0 comments on commit cd5fa9a

Please sign in to comment.