-
Couldn't load subscription status.
- Fork 2.3k
Fix file-based ingestion flaky test #19757
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: Varun Bharadwaj <varunbharadwaj1995@gmail.com>
e53f9c5 to
101da07
Compare
|
❌ Gradle check result for 101da07: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
|
❌ Gradle check result for 101da07: Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #19757 +/- ##
============================================
- Coverage 73.19% 73.03% -0.17%
+ Complexity 70946 70851 -95
============================================
Files 5735 5735
Lines 324654 324655 +1
Branches 46962 46962
============================================
- Hits 237643 237111 -532
- Misses 67875 68408 +533
Partials 19136 19136 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
…e file (opensearch-project#19757) Signed-off-by: Varun Bharadwaj <varunbharadwaj1995@gmail.com>
Description
File-based ingestion is a test implementation, mainly for local testing.
FileBasedIngestionSingleNodeTests.testFileIngestionFromLatestPointerhas been marked a flaky test. The reason for this is the file-based consumer doesn't track the last read line if the start point is beyond the number of lines in the file. This results in reading the entire file in the next iteration, causing the flaky test.The flaky test could be reproduced locally with some changes, and this PR fixes this bug.
Related Issues
Resolves #19723
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.