Skip to content

Conversation

@varunbharadwaj
Copy link
Contributor

@varunbharadwaj varunbharadwaj commented Oct 24, 2025

Description

File-based ingestion is a test implementation, mainly for local testing. FileBasedIngestionSingleNodeTests.testFileIngestionFromLatestPointer has been marked a flaky test. The reason for this is the file-based consumer doesn't track the last read line if the start point is beyond the number of lines in the file. This results in reading the entire file in the next iteration, causing the flaky test.

The flaky test could be reproduced locally with some changes, and this PR fixes this bug.

Related Issues

Resolves #19723

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@varunbharadwaj varunbharadwaj requested a review from a team as a code owner October 24, 2025 07:04
@github-actions github-actions bot added >test-failure Test failure from CI, local build, etc. autocut flaky-test Random test failure that succeeds on second run labels Oct 24, 2025
@varunbharadwaj varunbharadwaj changed the title Fix file-based ingestion bug Fix file-based ingestion flaky test Oct 24, 2025
Signed-off-by: Varun Bharadwaj <varunbharadwaj1995@gmail.com>
@github-actions
Copy link
Contributor

❌ Gradle check result for 101da07: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@github-actions
Copy link
Contributor

❌ Gradle check result for 101da07:

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@github-actions
Copy link
Contributor

✅ Gradle check result for 101da07: SUCCESS

@codecov
Copy link

codecov bot commented Oct 24, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 73.03%. Comparing base (0c89456) to head (101da07).
⚠️ Report is 4 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff              @@
##               main   #19757      +/-   ##
============================================
- Coverage     73.19%   73.03%   -0.17%     
+ Complexity    70946    70851      -95     
============================================
  Files          5735     5735              
  Lines        324654   324655       +1     
  Branches      46962    46962              
============================================
- Hits         237643   237111     -532     
- Misses        67875    68408     +533     
  Partials      19136    19136              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@andrross andrross merged commit f773503 into opensearch-project:main Oct 24, 2025
35 of 39 checks passed
lawofcycles pushed a commit to lawofcycles/OpenSearch that referenced this pull request Oct 24, 2025
…e file (opensearch-project#19757)

Signed-off-by: Varun Bharadwaj <varunbharadwaj1995@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

autocut flaky-test Random test failure that succeeds on second run >test-failure Test failure from CI, local build, etc.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[AUTOCUT] Gradle Check Flaky Test Report for FileBasedIngestionSingleNodeTests

2 participants