[BUG] Performance Comparison of OS 3.0 Lucene 10 with Mainline

[expani]

Describe the bug

We will run the benchmarks from the PR using the OpenSearch CDK and OSB and compare the runs for every workload with mainline ( containing Lucene 9 ) to ensure there are no regressions in search or indexing. Lucene 10 has introduced explicit vectorization for comparing vectors and decoding postings, so we should ensure the benchmarks are run on data nodes that have CPU supporting SIM-D capabilities.

We should note down any improvements and try to correlate with changes in Lucene 10 that could have caused them.

We might encounter cases where we are using a older Lucene API which has a faster alternative available in Lucene 10. Any performance regression needs to be fixed before we can go ahead with preparing the RC for OpenSearch Version 3.0

Related component

Other

To Reproduce

Compare performance report of runs with daily runs of mainline.

Expected behavior

There should be no performance regression in search or indexing.
Any improvements should be noted explicitly.

Additional Details

No response

[expani]

@reta @rishabh6788 We can use this issue for any discussions related to Lucene 10 perf tests.

Created it separately as the PR was getting crowded with lots of comments.