mcp 1111111 #8
Description
Overview
We will run the benchmarks from the PR using the OpenSearch CDK and OSB and compare the runs for every workload with mainline ( containing Lucene 9 ) to ensure there are no regressions in search or indexing. Lucene 10 has introduced explicit vectorization for comparing vectors and decoding postings, so we should ensure the benchmarks are run on data nodes that have CPU supporting SIM-D capabilities.
We should note down any improvements and try to correlate with changes in Lucene 10 that could have caused them.
We might encounter cases where we are using a older Lucene API which has a faster alternative available in Lucene 10. Any performance regression needs to be fixed before we can go ahead with preparing the RC for OpenSearch Version 3.0
Related component
Other
To Reproduce
Compare performance report of runs with daily runs of mainline.
Expected behavior
There should be no performance regression in search or indexing.
Any improvements should be noted explicitly.