[backport 3.1] Fixing concurrency bug on writer

[amitgalitz]

Description

Porting #1508

Check List

• Commits are signed per the DCO using --signoff.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[codecov]

Codecov Report

Attention: Patch coverage is 88.88889% with 1 line in your changes missing coverage. Please review.

Project coverage is 81.59%. Comparing base (5db65e6) to head (35461ff).
Report is 1 commits behind head on 3.1.

Files with missing lines	Patch %	Lines
...g/opensearch/timeseries/ratelimit/BatchWorker.java	75.00%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff            @@
##                3.1    #1520   +/-   ##
=========================================
  Coverage     81.59%   81.59%           
- Complexity     6022     6025    +3     
=========================================
  Files           536      536           
  Lines         24377    24381    +4     
  Branches       2488     2490    +2     
=========================================
+ Hits          19890    19894    +4     
- Misses         3239     3244    +5     
+ Partials       1248     1243    -5     

Flag	Coverage Δ
plugin	81.59% <88.88%> (+<0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
...ain/java/org/opensearch/ad/task/ADTaskManager.java	75.79% <100.00%> (ø)
...timeseries/ratelimit/RateLimitedRequestWorker.java	72.41% <100.00%> (ø)
...arch/timeseries/ratelimit/SingleRequestWorker.java	80.00% <100.00%> (+1.73%)	⬆️
...g/opensearch/timeseries/ratelimit/BatchWorker.java	92.00% <75.00%> (-3.66%)	⬇️

... and 10 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.