Skip to content

Commit bdef909

Browse files
authored
Expose show_progress_bar (#236)
Address #232 Now **kwargs are being passed from `hf.embed()` and `hf.embed_many()` to the underlying `model.encode()` ``` from redisvl.utils.vectorize import HFTextVectorizer from tqdm.auto import tqdm hf = HFTextVectorizer(model="sentence-transformers/all-MiniLM-L6-v2") # Embed a sentence test = hf.embed("This is a test sentence.", show_progress_bar=True) #progress bar would show test = hf.embed("This is a test sentence.") #progress bar would show (default behavior as before) test = hf.embed("This is a test sentence.", show_progress_bar=False) #progress bar would NOT show # Uncomment to see vector embedding output print(test[:10]) ```
1 parent 376742a commit bdef909

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

redisvl/utils/vectorize/text/huggingface.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -99,7 +99,7 @@ def embed(
9999

100100
if preprocess:
101101
text = preprocess(text)
102-
embedding = self._client.encode([text])[0]
102+
embedding = self._client.encode([text], **kwargs)[0]
103103
return self._process_embedding(embedding.tolist(), as_buffer, **kwargs)
104104

105105
def embed_many(
@@ -135,7 +135,7 @@ def embed_many(
135135

136136
embeddings: List = []
137137
for batch in self.batchify(texts, batch_size, preprocess):
138-
batch_embeddings = self._client.encode(batch)
138+
batch_embeddings = self._client.encode(batch, **kwargs)
139139
embeddings.extend(
140140
[
141141
self._process_embedding(embedding.tolist(), as_buffer, **kwargs)

0 commit comments

Comments
 (0)