Skip to content

[v25.2.x] rptest: Enable fast uploads in datalake test #28498

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
vbotbuildovich wants to merge 1 commit into
base: v25.2.x
Choose a base branch
from
Open

[v25.2.x] rptest: Enable fast uploads in datalake test #28498

vbotbuildovich wants to merge 1 commit into from
+3 −1

Conversation

@vbotbuildovich
Copy link
Collaborator

@vbotbuildovich vbotbuildovich commented Nov 12, 2025

Backport of PR #28492

@Lazin @vbotbuildovich
rptest: Enable fast uploads in datalake test
d2c0c69 
The test expects uplads to happen in 10 minutes. The problem is that it
create different number of partitions in docker and on a dedicated
machine (100 vs 1000). With 1000 partitions the chance that one
partition will receive not enough data to roll a segment is relatively
high.

The fix is to force uploads and to increase the amount of data on a
dedicated node.

Signed-off-by: Evgeny Lazin <4lazin@gmail.com>
(cherry picked from commit e8e0a17)
@vbotbuildovich vbotbuildovich added this to the v25.2.x-next milestone Nov 12, 2025
@vbotbuildovich vbotbuildovich added the kind/backport PRs targeting a stable branch label Nov 12, 2025
@vbotbuildovich vbotbuildovich requested a review from Lazin November 12, 2025 18:22
@vbotbuildovich
Copy link
Collaborator Author

vbotbuildovich commented Nov 12, 2025

CI test results

test results on build#76149
test_class test_method test_arguments test_kind job_url test_status passed reason test_history
MaintenanceTest test_maintenance_sticky {"use_rpk": true} integration https://buildkite.com/redpanda/redpanda/builds/76149#019a7969-41ee-4a35-82cb-c16be1a33075 FLAKY 19/21 upstream reliability is '100.0'. current run reliability is '90.47619047619048'. drift is 9.52381 and the allowed drift is set to 50. The test should PASS https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=MaintenanceTest&test_method=test_maintenance_sticky
RandomNodeOperationsTest test_node_operations {"cloud_storage_type": 1, "compaction_mode": "chunked_sliding_window", "enable_failures": false, "mixed_versions": true, "with_iceberg": false} integration https://buildkite.com/redpanda/redpanda/builds/76149#019a7963-4440-4951-b6cb-f2c28cf05ce6 FLAKY 18/21 upstream reliability is '100.0'. current run reliability is '85.71428571428571'. drift is 14.28571 and the allowed drift is set to 50. The test should PASS https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=RandomNodeOperationsTest&test_method=test_node_operations
RandomNodeOperationsTest test_node_operations {"cloud_storage_type": 1, "compaction_mode": "chunked_sliding_window", "enable_failures": true, "mixed_versions": true, "with_iceberg": false} integration https://buildkite.com/redpanda/redpanda/builds/76149#019a7963-443c-4bf2-8c3f-b2d0025e9338 FLAKY 20/21 upstream reliability is '100.0'. current run reliability is '95.23809523809523'. drift is 4.7619 and the allowed drift is set to 50. The test should PASS https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=RandomNodeOperationsTest&test_method=test_node_operations

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Lazin Lazin Awaiting requested review from Lazin

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

kind/backport PRs targeting a stable branch

Projects

None yet

Milestone

v25.2.x-next

Development

Successfully merging this pull request may close these issues.

2 participants

@vbotbuildovich @Lazin