Skip to content

[8.19] Add Hugging Face Rerank support (#127966) #128455

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

Evgenii-Kazannik
Copy link
Contributor

Backport

This will backport the following commits from main to 8.19:

Questions ?

Please refer to the Backport tool documentation

* Add Hugging Face Rerank support

* Address comments

* Add transport version

* Add transport version

* Add to inference service and crud IT rerank tests

* Refactor slightly / error message

* correct 'testGetConfiguration' test case

* apply suggestions

* fix tests

* apply suggestions

* [CI] Auto commit changes from spotless

* add changelog information

---------

Co-authored-by: elasticsearchmachine <infra-root+elasticsearchmachine@elastic.co>
(cherry picked from commit c7cf850)

# Conflicts:
#	server/src/main/java/org/elasticsearch/TransportVersions.java
@elasticsearchmachine elasticsearchmachine added needs:triage Requires assignment of a team area label v8.19.0 external-contributor Pull request authored by a developer outside the Elasticsearch team labels May 26, 2025
@prwhelan prwhelan added :ml Machine learning backport Team:ML Meta label for the ML team >enhancement and removed needs:triage Requires assignment of a team area label labels May 27, 2025
@jonathan-buttner jonathan-buttner self-assigned this May 27, 2025
var inference = infer(inferenceEntityId, input);
assertNonEmptyInferenceResults(inference, 1, TaskType.RERANK);
// TODO: investigate score calculation inconsistency affecting this assertion. Uncomment when fixed
// assertEquals(inference, infer(inferenceEntityId, input));
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I looked into this, I'm not sure why the test is working on main 🤔 I'll put up a PR to make the inference results deterministic.

@jonathan-buttner jonathan-buttner merged commit e1c93cc into elastic:8.19 May 27, 2025
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport >enhancement external-contributor Pull request authored by a developer outside the Elasticsearch team :ml Machine learning Team:ML Meta label for the ML team v8.19.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants