Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Enables offline /score for embedding models #12021

Merged
merged 13 commits into from
Jan 28, 2025
Merged

[FEATURE] Enables offline /score for embedding models #12021

Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
9b0ce65
[FEATURE] Enables offline /score for embedding models
gmarinho2 Jan 21, 2025
74cd2dd
Merge branch 'upstream_main'
gmarinho2 Jan 21, 2025
590ab4d
Changes variable name and uses tuple instead of list.
gmarinho2 Jan 21, 2025
f219024
Separates scoring logic and makes small ajustments
gmarinho2 Jan 22, 2025
47211e5
Separates scoring logic and makes small ajustments
gmarinho2 Jan 22, 2025
1a89033
Moves scoring functions declaration to llm class
gmarinho2 Jan 22, 2025
db7919b
Completes embedding_score function signature
gmarinho2 Jan 23, 2025
41b11be
Passes new parameters to self.encode() in embeddind_score
gmarinho2 Jan 23, 2025
b57e01a
Adds type annotations for the parameters
gmarinho2 Jan 23, 2025
4956eae
Minor adjustments
gmarinho2 Jan 23, 2025
f8b8d8c
Minor adjustments in embedding_score
gmarinho2 Jan 23, 2025
cd835de
trigger ci
gmarinho2 Jan 24, 2025
0e95ead
trigger ci
gmarinho2 Jan 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'upstream_main' 
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
  • Loading branch information
@gmarinho2
gmarinho2 committed Jan 21, 2025
commit 74cd2dd114b71590a8ef0787262192ea0e8f2186
2 changes: 2 additions & 0 deletions vllm/entrypoints/llm.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,8 @@
from typing import (Any, Callable, ClassVar, Dict, List, Optional, Sequence,
Tuple, Type, Union, cast, overload)

import cloudpickle
import torch.nn as nn
import torch
from tqdm import tqdm
from typing_extensions import TypeVar, deprecated
Expand Down
Loading
You are viewing a condensed version of this merge commit. You can view the full changes here.