Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data, Flink, Spark: Test deletes with format-version=3 #11538

Merged
merged 1 commit into from
Nov 17, 2024

Conversation

nastra
Copy link
Contributor

@nastra nastra commented Nov 13, 2024

this is part of #11122

@@ -441,12 +441,6 @@ public void testPartitionSpecEvolutionRemovalV2() {
assertThat(tasks).hasSize(expectedScanTaskCount(3));
}

private DeleteFile posDelete(Table table, DataFile dataFile) {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this addresses #11485 (comment)

@nastra nastra changed the title Data, MR, Spark: Test deletes with format-version=3 Spark: Test deletes with format-version=3 Nov 13, 2024
Copy link
Contributor

@amogh-jahagirdar amogh-jahagirdar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor naming comment + some questions on some cases where we're only testing v2, but I think we may as well start testing v3?

@nastra nastra force-pushed the reader-delete-tests branch from 86955f4 to b8534f2 Compare November 14, 2024 07:21
@github-actions github-actions bot added the flink label Nov 14, 2024
@nastra nastra force-pushed the reader-delete-tests branch from b8534f2 to bbd0810 Compare November 14, 2024 07:27
@nastra nastra changed the title Spark: Test deletes with format-version=3 Data, Flink, Spark: Test deletes with format-version=3 Nov 14, 2024
@nastra nastra force-pushed the reader-delete-tests branch from bbd0810 to bccbc14 Compare November 14, 2024 09:25
@nastra nastra merged commit b38951d into apache:main Nov 17, 2024
49 checks passed
@nastra nastra deleted the reader-delete-tests branch November 17, 2024 16:20
zachdisc pushed a commit to zachdisc/iceberg that referenced this pull request Dec 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants