Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sync upstream #5

Closed
wants to merge 1,182 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1182 commits
Select commit Hold shift + click to select a range
fe2f593
Infra: Build Iceberg REST fixture docker image for `arm64` architectu…
Fokko Dec 11, 2024
af5e156
Docs: fix typos in spec (#11759)
xxchan Dec 12, 2024
587620b
Spark 3.4,3.5: Fix issue when views group by an ordinal (#11729)
Ppei-Wang Dec 12, 2024
5c00b29
Spark: Remove deprecated SparkAppenderFactory (#11727)
ajantha-bhat Dec 12, 2024
6c05f35
Core: Log where the missing metadata file is located for Hadoop (#11643)
manuzhang Dec 12, 2024
3053540
Core: Use HEAD request to check if view exists (#11760)
nastra Dec 12, 2024
1e126e2
Core: Use HEAD request to check if namespace exists (#11761)
nastra Dec 12, 2024
a3dcfd1
Hive: Optimize tableExists API in hive catalog (#11597)
dramaticlly Dec 12, 2024
540d6a6
GCS: Suppress JavaUtilDate in OAuth2RefreshCredentialsHandler (#11773)
ebyhr Dec 13, 2024
c2fd77a
Flink: Add RowConverter for Iceberg Source (#11301)
abharath9 Dec 14, 2024
bcf7b63
Spark 3.5: Fix assertion mismatch in PartitionedWritesTestBase/TestRe…
wzx140 Dec 15, 2024
fd739b3
Build: Bump nessie from 0.101.0 to 0.101.2 (#11791)
dependabot[bot] Dec 15, 2024
592b604
Core: Add missing REST endpoint definitions (#11756)
ajreid21 Dec 16, 2024
1851ca1
Build: Bump software.amazon.awssdk:bom from 2.29.29 to 2.29.34 (#11793)
dependabot[bot] Dec 16, 2024
2a5b089
Spark: Read DVs when reading from .position_deletes table (#11657)
nastra Dec 16, 2024
f40ec20
Core: Add TableUtil to provide access to a table's format version (#1…
nastra Dec 16, 2024
16cc4e9
Build: Bump mkdocs-material from 9.5.47 to 9.5.48 (#11790)
dependabot[bot] Dec 16, 2024
791d0fa
Spark 3.4: Add REST catalog to Spark integration tests (#11698)
nastra Dec 16, 2024
57ea310
Parquet: Implement defaults for generic data (#11785)
rdblue Dec 16, 2024
b9b61b1
Avro: Support default values for generic data (#11786)
rdblue Dec 16, 2024
ac865e3
REST: Use `apache/iceberg-rest-fixture` docker image (#11673)
ajantha-bhat Dec 17, 2024
5c170ae
docs: Default value of table level distribution-mode should be not se…
manuzhang Dec 17, 2024
3adcd89
Docs: Fix Spark catalog `table-override` description (#11684)
manuzhang Dec 17, 2024
ce7a4b4
API: Add missing deprecations (#11734)
Fokko Dec 17, 2024
ed06c9c
Core, Spark 3.5: Fix test failures due to timeout (#11654)
manuzhang Dec 17, 2024
a6cfc12
Auth Manager API part 1: HTTPRequest, HTTPHeader (#11769)
adutra Dec 17, 2024
e3628c1
Flink: make `StatisticsOrRecord` to be correctly serialized and deser…
huyuanfeng2018 Dec 18, 2024
b428fbc
Spark 3.4,3.5: Use correct identifier in view DESCRIBE cmd (#11751)
Ppei-Wang Dec 18, 2024
204a49c
Use try-with-resources in TestParallelIterable (#11810)
sopel39 Dec 18, 2024
7e1a4c9
Spark 3.5: Support default values in Parquet reader (#11803)
rdblue Dec 18, 2024
d0effc6
Data: Fix Parquet and Avro defaults date/time representation (#11811)
rdblue Dec 18, 2024
91a1505
Revert "Support WASB scheme in ADLSFileIO (#11504)" (#11812)
mrcnc Dec 18, 2024
88a2596
Core, Spark, Flink, Hive: Remove unused failsafe dependency from core…
amogh-jahagirdar Dec 19, 2024
3535240
Docs: Change to Flink directory for instructions (#11031)
liuml07 Dec 19, 2024
7033667
Spark 3.5: Support default values in vectorized reads (#11815)
rdblue Dec 19, 2024
ed36a9f
Spark 3.5: Remove numbers from assert description in TestRewritePosit…
TQJADE Dec 20, 2024
cdf748e
Auth Manager API part 2: AuthManager (#11809)
adutra Dec 20, 2024
dea2fd1
Core: Add Variant implementation to read serialized objects (#11415)
rdblue Dec 20, 2024
cd187c5
Spark: Test reading default values in Spark (#11832)
rdblue Dec 21, 2024
dbf26d7
Build: Bump datamodel-code-generator from 0.26.3 to 0.26.4 (#11856)
dependabot[bot] Dec 22, 2024
4ceb96d
Build: Bump mkdocs-awesome-pages-plugin from 2.9.3 to 2.10.0 (#11855)
dependabot[bot] Dec 22, 2024
b0a119c
Build: Bump mkdocs-material from 9.5.48 to 9.5.49 (#11854)
dependabot[bot] Dec 22, 2024
5c5d7c9
Build: Bump io.netty:netty-buffer from 4.1.115.Final to 4.1.116.Final…
dependabot[bot] Dec 22, 2024
bbf5d6f
Build: Bump software.amazon.awssdk:bom from 2.29.34 to 2.29.39 (#11851)
dependabot[bot] Dec 22, 2024
556969a
Build: Bump guava from 33.3.1-jre to 33.4.0-jre (#11850)
dependabot[bot] Dec 22, 2024
e0ccebc
Build: Bump junit from 5.11.3 to 5.11.4 (#11849)
dependabot[bot] Dec 22, 2024
e4d9c1d
Build: Bump org.assertj:assertj-core from 3.26.3 to 3.27.0 (#11847)
dependabot[bot] Dec 22, 2024
12d7ee5
Build: Bump nessie from 0.101.2 to 0.101.3 (#11852)
dependabot[bot] Dec 22, 2024
f7748f2
Build: Bump junit-platform from 1.11.3 to 1.11.4 (#11848)
dependabot[bot] Dec 22, 2024
55f10ca
Doc: Add status page for different implementations. (#11772)
liurenjie1024 Dec 23, 2024
ca3db93
Upgrade to Gradle 8.12 (#11861)
jbonofre Dec 23, 2024
dbd7d1c
Build: Fix ignoring `.asf.yaml` in PR (#11860)
manuzhang Dec 23, 2024
c6d9e0c
Gradle: Update `gradlew` with better `APP_HOME` definition (#11869)
jbonofre Dec 24, 2024
d6d3cf5
Core, Spark: Avoid deprecated methods in Guava Files (#11865)
ebyhr Dec 24, 2024
1b5886d
Core: Don't clear snapshotLog in `TableMetadata.removeRef` (#11779)
ebyhr Dec 24, 2024
4eb9f7f
Core: Replace deprecated Schema.toString with SchemaFormatter (#11867)
ebyhr Dec 25, 2024
bb27030
Build: Fix ignoring `license-check.yml` in PR (#11873)
manuzhang Dec 25, 2024
fc3f705
API: Replace deprecated `asList` with `asInstanceOf` (#11875)
ebyhr Dec 26, 2024
de54a08
Flink: Avoid RANGE mode broken chain when write parallelism changes (…
huyuanfeng2018 Dec 27, 2024
607e2fb
Update `README.md` with `iceberg-cpp` (#11882)
gabeiglio Dec 28, 2024
0029d6a
Build: Bump software.amazon.awssdk:bom from 2.29.39 to 2.29.43 (#11886)
dependabot[bot] Dec 29, 2024
3fa8a46
Build: Bump mkdocs-awesome-pages-plugin from 2.10.0 to 2.10.1 (#11885)
dependabot[bot] Dec 29, 2024
7f14032
Core: Fix typo in HadoopTableOperations (#11880)
okumin Dec 29, 2024
e3f50e5
Revert "Hive: close the fileIO client when closing the hive catalog (…
Fokko Dec 30, 2024
ab6365d
Docs: Add history to Hive's metadata tables (#11902)
okumin Jan 2, 2025
3b00043
Doc: Fix format of Hive (#11892)
ebyhr Jan 3, 2025
4d35682
Flink: Backport #11662 Fix range distribution npe when value is null …
Guosmilesmile Jan 3, 2025
c0d6d42
Spark: Change delete file granularity to file in Spark 3.5 (#11478)
amogh-jahagirdar Jan 3, 2025
dbfefb0
Bump Apache Spark to 3.5.4 (#11731)
pan3793 Jan 3, 2025
fcd5dd9
Kafka-connect-runtime: remove code duplications in integration tests …
wombatu-kun Jan 4, 2025
8e2ffb3
Flink: Backport #11557 to Flink 1.19 and 1.18 (#11834)
huyuanfeng2018 Jan 6, 2025
fc923b3
replace legacy converter with new (#11838)
abharath9 Jan 6, 2025
b9da638
Docs: Improve wording (#11916)
hgeraldino Jan 7, 2025
9b2a632
Build: Bump software.amazon.awssdk:bom from 2.29.43 to 2.29.45 (#11910)
dependabot[bot] Jan 7, 2025
a6f4160
Build: Bump org.xerial:sqlite-jdbc from 3.47.1.0 to 3.47.2.0 (#11907)
dependabot[bot] Jan 7, 2025
e1d2271
Hive: Optimize viewExists API in hive catalog (#11813)
dramaticlly Jan 7, 2025
f129588
Core: Add support for view-default property in catalog (#11064)
ebyhr Jan 7, 2025
7c4c379
Build: Bump io.delta:delta-standalone_2.12 from 3.2.1 to 3.3.0 (#11909)
dependabot[bot] Jan 7, 2025
07ab53e
Build: Bump org.assertj:assertj-core from 3.27.0 to 3.27.2 (#11908)
dependabot[bot] Jan 7, 2025
1cbc163
Doc: Add missing fields to metadata tables in Spark page (#11897)
ebyhr Jan 7, 2025
67e084c
API: Support removeUnusedSpecs in ExpireSnapshots (#10755)
advancedxy Jan 7, 2025
39a4cfd
Spark 3.5: Implement RewriteTablePath (#11555)
szehon-ho Jan 8, 2025
df54790
Infra: Add manuzhang to collaborators (#11927)
manuzhang Jan 8, 2025
72dcce9
Site: Put a CFP Banner on the Homepage (#11942)
RussellSpitzer Jan 9, 2025
3dbb5cc
Parquet: Use compatible column name to set Parquet bloom filter (#11799)
huaxingao Jan 10, 2025
97b5b39
Core: Allow adding files to multiple partition specs in FastAppend (#…
anuragmantri Jan 10, 2025
a100e6a
Avro: Add writers for the internal object model (#11919)
ajantha-bhat Jan 10, 2025
c7910bb
Core: Fix possible deadlock in ParallelIterable (#11781)
sopel39 Jan 11, 2025
7792896
Hive: Remove Hive runtime (#11801)
manuzhang Jan 13, 2025
a9d320e
Build: Bump software.amazon.awssdk:bom from 2.29.45 to 2.29.50 (#11949)
dependabot[bot] Jan 13, 2025
f7d40f0
Core,Rest: Read the max connection from properties (#11522)
munendrasn Jan 13, 2025
dc47b85
docs: Use the YAML multi-line indicator (#11552)
neodon Jan 13, 2025
95424ab
API: Fix `sizeBytes` parameter of `ScanTask` (#11941)
engraving-knife Jan 13, 2025
1726565
Build: Bump io.delta:delta-spark_2.12 from 3.2.1 to 3.3.0 (#11911)
dependabot[bot] Jan 13, 2025
af8c9d6
Build: Bump net.snowflake:snowflake-jdbc from 3.20.0 to 3.21.0 (#11792)
dependabot[bot] Jan 13, 2025
5fd16b5
Build: Bump com.google.cloud:libraries-bom from 26.51.0 to 26.52.0 (#…
dependabot[bot] Jan 13, 2025
472ec6c
Core: Add tests for catalogs supporting empty namespaces (#9890)
nastra Jan 13, 2025
3247964
Spec: Add cross-region bucket access property to config (#11260)
munendrasn Jan 13, 2025
c98d0d0
Core: Move namespace/table/view validation into try-catch block (#11960)
hantangwangd Jan 14, 2025
5b259e2
Docs: Update docs link about Apache Doris and update vendors list (#1…
morningman Jan 14, 2025
c0bd4bf
docs: update `README.md` fix brand name `macOS` (#11964)
jbampton Jan 14, 2025
cf8b354
Core: Fix loading a table in CachingCatalog with Metadata table name …
gaborkaszab Jan 14, 2025
8cd5b19
Open-API: Bump to OpenAPI 3.1 (#11955)
Fokko Jan 14, 2025
c31d5d5
Build: Bump openapi-generator plugin from 6.6.0 to 7.10.0 (#11970)
nastra Jan 15, 2025
5d05cd4
Run `java-ci` on changes in `open-api/**` (#11972)
Fokko Jan 15, 2025
978189c
AWS, Core, GCP: Support relative credential endpoint / pass OAuth2 to…
nastra Jan 15, 2025
101e650
Doc: Add Hive DELETE ORPHAN-FILES example (#11896)
ebyhr Jan 15, 2025
a0a1c00
Spark 3.4: Add view support to SparkSessionCatalog (#11797)
nastra Jan 15, 2025
d96901b
Spark 3.4: Backport rewriting historical file-scoped deletes (#11273)…
amogh-jahagirdar Jan 15, 2025
167d450
API: Support sanitizing a `Literal<?>` (#11943)
dmgkeke Jan 16, 2025
a0777bc
Auth Manager API part 3: OAuth2 Manager (#11844)
adutra Jan 16, 2025
b128bba
Spark: Fix flaky tests `withSnapshotIsolation` (#11974)
manuzhang Jan 16, 2025
246439a
Spark: Fix empty scan issue when start timestamp retrieves root snaps…
lliangyu-lin Jan 16, 2025
d97ac3e
Spark 3.4: Backport support for default values (#11987)
rdblue Jan 17, 2025
49f41f5
Doc: Add missing content value to manifests table (#11989)
ebyhr Jan 17, 2025
4d0f40c
Spark: Fix Puffin suffix for DVs (#11986)
amogh-jahagirdar Jan 17, 2025
f895b33
Spec: Add added-rows field to Snapshot (#11976)
RussellSpitzer Jan 17, 2025
bed7c33
API: add hashcode cache in StructType (#11764)
wzx140 Jan 17, 2025
1a69ff8
Build: Bump mkdocs-material from 9.5.49 to 9.5.50 (#12005)
dependabot[bot] Jan 19, 2025
4e00a31
Build: Bump datamodel-code-generator from 0.26.4 to 0.26.5 (#12004)
dependabot[bot] Jan 19, 2025
7e0cd3f
Revert "API: add hashcode cache in StructType (#11764)" (#12007)
Fokko Jan 19, 2025
3203a23
Build: Bump io.netty:netty-buffer from 4.1.116.Final to 4.1.117.Final…
dependabot[bot] Jan 19, 2025
894c7ca
Build: Bump org.apache.datasketches:datasketches-java (#12000)
dependabot[bot] Jan 19, 2025
6a608a5
Build: Bump org.xerial:sqlite-jdbc from 3.47.2.0 to 3.48.0.0 (#12001)
dependabot[bot] Jan 19, 2025
7b95e17
Build: Bump org.assertj:assertj-core from 3.27.2 to 3.27.3 (#12002)
dependabot[bot] Jan 19, 2025
c19223d
Build: Bump com.google.cloud:libraries-bom from 26.52.0 to 26.53.0 (#…
dependabot[bot] Jan 19, 2025
2832543
Spark: Don't skip tests in TestSelect for SparkSessionCatalog (#11824)
manuzhang Jan 20, 2025
41b458b
Core: List namespaces/tables when testing identifier with a dot (#11991)
nastra Jan 20, 2025
b07455a
Azure: Support WASB scheme in ADLSFileIO (#11830)
mrcnc Jan 20, 2025
1743247
Docs: Update Footer Copyright Year (#12011)
omkenge Jan 21, 2025
445687d
Spec: Clarify `next-row-id` (#12018)
Fokko Jan 21, 2025
8dee55d
Flink: Upgrade Flink version 1.19.0 => 1.19.1 (#12021)
mxm Jan 21, 2025
6eef780
Update notice files to reference 2025 (#12013)
amogh-jahagirdar Jan 21, 2025
e13a87f
Spark 3.4: Backport writing DVs to Spark 3.4 (#12019)
amogh-jahagirdar Jan 21, 2025
5b13760
Spark 3.3: Backport support for default values (#11988)
rdblue Jan 21, 2025
ab9e05e
Doc: Fix expired links on vendor page (#12045)
ebyhr Jan 22, 2025
8d7ad4a
Docs: Add RisingWave to the Vendors page (#12043)
hengm3467 Jan 22, 2025
9a46890
Build: Nightly build for Iceberg REST fixtures (#12008)
Fokko Jan 22, 2025
5091e57
ORC: Fail when initial default support is required. (#12026)
rdblue Jan 22, 2025
e86d25f
Core: Add missing default HEAD endpoints and V1_COMMIT_TRANSACTION (#…
ebyhr Jan 22, 2025
be6e9da
Spark 3.5: Refactor delete logic in batch reading (#11933)
huaxingao Jan 22, 2025
84c8db4
AWS, Core, Delta: Remove redundant charset lookup (#12057)
ebyhr Jan 23, 2025
5ce3344
Remove `slf4j-api` reference in `LICENSE` (#12052)
jbonofre Jan 23, 2025
ce2af52
Adding Crunchy Data to Iceberg Vendors list (#12020)
elizabeth-christensen Jan 23, 2025
908bdc3
Flink 1.20: Support default values in Parquet reader (#11839)
jbonofre Jan 23, 2025
17bda20
Flink: Backport default values support in Parquet reader on Flink v1.…
jbonofre Jan 23, 2025
a7ed3ca
Spark 3.5: Fix Javadoc in ColumnarBatchUtil (#12058)
huaxingao Jan 24, 2025
2e2b728
Core, Spark: Rewrite data files with high delete ratio (#11825)
nastra Jan 24, 2025
026a9b0
Core, Spark: Include content offset/size in PositionDeletesTable (#11…
nastra Jan 24, 2025
681ff57
Core: Retain current view version during expiration (#12067)
nastra Jan 24, 2025
72a165a
Spark 3.5: Procedure to rewrite table path (#11931)
dramaticlly Jan 24, 2025
80a5ef1
Spark: Disable rewriting position deletes for V3 tables (#12048)
nastra Jan 24, 2025
a04220a
API: Add `UnknownType` (#12012)
Fokko Jan 24, 2025
6e2bc9a
Spark: Fix typo in `NoSuchTableException` (#12091)
baolsen Jan 24, 2025
da1ea10
Spark 3.4: Refactor delete logic in batch reading (#12061)
huaxingao Jan 24, 2025
2256663
Spec, OpenAPI: Adds EnableRowLineage Metadata Update (#12050)
RussellSpitzer Jan 24, 2025
c0c1b15
Spec: Document Snapshot Summary Optional Fields for Standardization (…
HonahX Jan 24, 2025
67c52b5
Parquet: Add readers and writers for the internal object model (#11904)
ajantha-bhat Jan 24, 2025
d693f83
Spark 3.5: Fix broadcasting specs in RewriteTablePath (#11982)
manuzhang Jan 24, 2025
8ce1b32
Build: Upgrade to Gradle 8.12.1 (#12093)
jbonofre Jan 25, 2025
645ef83
Spark 3.4: Backport Spark actions and procedures for RewriteTablePath…
dramaticlly Jan 27, 2025
55c2909
Core: Add metadataFileLocation in TableUtil (#12082)
dramaticlly Jan 27, 2025
e370888
Build: Bump actions/stale from 9.0.0 to 9.1.0 (#12110)
dependabot[bot] Jan 27, 2025
b7de28e
OpenAPI: Deprecate `snapshot-id` of `SetStatisticsUpdate` (#12010)
c-thiel Jan 27, 2025
2fa6cd8
Spark 3.5: Make ColumnVectorWithFilter generic and refactor batch loa…
aokolnychyi Jan 27, 2025
af00d1f
Spec: Adds in missing ChangeLog Field IDs - Reassigns Row Lineage Fie…
RussellSpitzer Jan 27, 2025
e1d2401
OpenAPI: Changes for freshness-aware table loading (#11946)
gaborkaszab Jan 28, 2025
491d906
Core: Check referencedDataFile existence for DV (#12088)
ebyhr Jan 28, 2025
69c7bea
Build: Bump software.amazon.awssdk:bom from 2.29.50 to 2.30.6 (#12109)
dependabot[bot] Jan 28, 2025
fdac0a0
Build: Bump org.openapitools:openapi-generator-gradle-plugin (#12108)
dependabot[bot] Jan 28, 2025
d7f5be4
Docs: Add IBM to Iceberg vendors list (#12101)
alileclerc Jan 28, 2025
4f6c711
Build: Bump nessie from 0.101.3 to 0.102.2 (#12107)
dependabot[bot] Jan 28, 2025
61241ed
Core: Update variant class visibility (#12105)
rdblue Jan 28, 2025
8e456ae
Parquet: Clean up Parquet generic and internal readers (#12102)
rdblue Jan 28, 2025
e89798e
Build: Bump scala-collection-compat from 2.12.0 to 2.13.0 (#12121)
manuzhang Jan 29, 2025
e9afab4
Core: Fix typo in Javadoc URL for Roaring spec (#12126)
Fokko Jan 29, 2025
53d2aca
Docs: Fix spacing in How To Release Vote Section (#12123)
kevinjqliu Jan 29, 2025
c787134
Spec: Fix minor typo in `_last_updated_sequence_number` docs (#12128)
smaheshwar-pltr Jan 29, 2025
5da8f5f
Spec: Add variant type (#10831)
aihuaxu Jan 29, 2025
2a0d5e8
Core, Spark: Make view metadata path configurable by `write.metadata.…
tomtongue Jan 30, 2025
02c8b2d
Core: Support removing keys from EnvironmentContext (#12103)
rshkv Jan 30, 2025
bdcd9c3
OpenAPI: add initial/write defaults to schema (#12094)
danielcweeks Jan 31, 2025
d0244cb
AWS: Fix LICENSE and NOTICE in aws-bundle jar (#12142)
jbonofre Jan 31, 2025
40334f5
Spark 3.4: Support Comet Parquet readers (#9841)
huaxingao Jan 31, 2025
0ec9fa3
Azure: Fix NOTICE and LICENSE in the azure-bundle (#12143)
jbonofre Feb 1, 2025
c5822c4
Spark 3.4, 3.5: Iceberg / DataFusion Comet integration (#12147)
huaxingao Feb 1, 2025
cae7d1b
Spark 3.5: Remove use of File.Separator in RewriteTablePath (#12066)
manuzhang Feb 1, 2025
1fcd6a9
API, Core: Metadata Row Lineage (#11948)
RussellSpitzer Feb 1, 2025
9feca0c
Spec: Fix current-version-id in view-spec.md example (#12146)
ldsantos0911 Feb 1, 2025
1e85193
Data: Open file using stats in scan (#12151)
bryanck Feb 2, 2025
1687b26
Build: Bump nessie from 0.102.2 to 0.102.4 (#12153)
dependabot[bot] Feb 2, 2025
1c0c783
Build: Bump mkdocs-material from 9.5.50 to 9.6.1 (#12157)
dependabot[bot] Feb 2, 2025
63acabc
Build: Bump software.amazon.awssdk:bom from 2.30.6 to 2.30.11 (#12156)
dependabot[bot] Feb 2, 2025
9694c54
Build: Bump net.snowflake:snowflake-jdbc from 3.21.0 to 3.22.0 (#12155)
dependabot[bot] Feb 2, 2025
46dfd95
Build: Bump me.champeau.jmh:jmh-gradle-plugin from 0.7.2 to 0.7.3 (#1…
dependabot[bot] Feb 2, 2025
f6faa58
Build: Bump com.azure:azure-sdk-bom from 1.2.30 to 1.2.31 (#12154)
dependabot[bot] Feb 2, 2025
507e2a9
Spark: Make delete file ratio configurable (#12148)
MichaelDeSteven Feb 3, 2025
1afa0e7
Core: Remove `TableMetadata::Builder::resetMainBranch` (#12149)
smaheshwar-pltr Feb 4, 2025
da20029
Spark: Update benchmark instructions (#12171)
Fokko Feb 4, 2025
e406e3d
Spark: Test metadata tables with format-version=3 (#12135)
nastra Feb 4, 2025
cac6886
Docs: Fix latest and nightly link on javadoc (#12023)
jbonofre Feb 4, 2025
eb286de
Variants: Implement toString (#12138)
rdblue Feb 4, 2025
2510fba
Core: Refactor to enable moving Variant interfaces to API. (#12167)
rdblue Feb 4, 2025
d990dbc
Flink: Add null check to writers to prevent resurrecting null values …
mxm Feb 5, 2025
585a338
Bump the versions of `site/mkdocs.yml` (#12180)
Fokko Feb 5, 2025
9981025
Bump Nessie to 0.120.5 to include updated License/Notice (#12186)
amogh-jahagirdar Feb 6, 2025
3bd04be
API: Null check for auto-unboxed field-id (#12165)
danielcweeks Feb 6, 2025
1f17363
Build: Remove Jitpack (#12170)
Fokko Feb 6, 2025
a05b2b5
Hive: Use correct classloader to load SQL script (#12140)
2MD Feb 6, 2025
c153741
Fix NOTICE and LICENSE in the spark-runtime jar (#12160)
jbonofre Feb 6, 2025
be0da5a
Fix NOTICE and LICENSE in the gcp-bundle jar (#12144)
jbonofre Feb 6, 2025
9b1d18f
Auth Manager API part 4: RESTClient, HTTPClient (#11992)
adutra Feb 6, 2025
a803643
Fix NOTICE and LICENSE in the flink-runtime jar (#12145)
jbonofre Feb 6, 2025
c2ea3c2
Flink: Update LICENSE/NOTICE in flink-runtime Jars (#12188)
jbonofre Feb 6, 2025
81c4aee
Spark 3.3, 3.4: Update LICENSE/NOTICE for spark-runtime (#12189)
jbonofre Feb 6, 2025
bc10617
Docs: Minor improvements to Spark Procedures (#12190)
smaheshwar-pltr Feb 7, 2025
e91655b
Core: Exclude deleted content file in RewriteTablePathUtil copy plan …
dramaticlly Feb 7, 2025
44aca93
Spark 3.4: Remove use of File.Separator in RewriteTablePath (#12173)
manuzhang Feb 7, 2025
a89f1f9
AWS, Core: SigV4 Auth Manager (#11995)
adutra Feb 7, 2025
7a8db16
Core: Fix RewriteTablePath Incremental Replication (#12172)
barronfuentes Feb 8, 2025
d935460
Spark 3.5: Support Statistics Files in RewriteTablePath (#11929)
dramaticlly Feb 8, 2025
f29131e
Build: Bump com.gradleup.shadow:shadow-gradle-plugin from 8.3.5 to 8.…
dependabot[bot] Feb 9, 2025
dda964e
Build: Bump mkdocs-material from 9.6.1 to 9.6.3 (#12205)
dependabot[bot] Feb 9, 2025
1d9fefe
Build: Bump datamodel-code-generator from 0.26.5 to 0.27.2 (#12204)
dependabot[bot] Feb 9, 2025
c277c20
Fix LICENSE and NOTICE for the kafka-connect-runtime distributions (#…
jbonofre Feb 9, 2025
2af78e2
Build: Bump software.amazon.awssdk:bom from 2.30.11 to 2.30.16 (#12208)
dependabot[bot] Feb 10, 2025
8e75087
Build: Bump com.google.cloud:libraries-bom from 26.53.0 to 26.54.0 (#…
dependabot[bot] Feb 10, 2025
17cbb24
Build: Bump org.xerial:sqlite-jdbc from 3.48.0.0 to 3.49.0.0 (#12206)
dependabot[bot] Feb 10, 2025
964c01b
Build: Bump org.apache.httpcomponents.client5:httpclient5 (#12209)
dependabot[bot] Feb 10, 2025
6b89fa1
Docs: Fix expire_snapshots output (#12213)
manuzhang Feb 10, 2025
7add0f3
Build: Update LICENSE/NOTICE files with last dependency updates (#12214)
jbonofre Feb 10, 2025
3e6da2e
Docs: Update spark-quickstart note (#11996)
xxchan Feb 10, 2025
20b18ac
Spec: Support geo type (#10981)
szehon-ho Feb 10, 2025
a212e99
Build: skip scheduled docker image publish workflows on forks (#12218)
dramaticlly Feb 11, 2025
31e9dc7
Docs: Add missing types to the spec v3 summary (#12219)
wgtmac Feb 11, 2025
8839c9b
Spec: Typo - missing be (#12229)
RussellSpitzer Feb 11, 2025
b09d36b
support rewrite on specified target branch
zinking Oct 11, 2023
32fe1da
fix styles
zinking Oct 11, 2023
89a184c
address comments
zinking Oct 11, 2023
b0e55b2
Update spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/action…
zinking Oct 11, 2023
ac98b0e
address comments
zinking Oct 11, 2023
6e20369
address comments
zinking Oct 11, 2023
e9c5ef7
address comments
zinking Oct 12, 2023
82fdd4c
fix styles
zinking Feb 28, 2024
a38c678
fix comments for pr
amitgilad3 Aug 29, 2024
b41e0aa
remove unused code
amitgilad3 Aug 29, 2024
31ee234
keep old method signature for backwards compatability (#2)
amitgilad3 Sep 2, 2024
800d0cf
1. fix docs
amitgilad3 Oct 30, 2024
f77b9fb
fix indentation
amitgilad3 Oct 30, 2024
2be0893
Merge branch 'rewrite_branch' into rewrite_branch_2
amitgilad3 Feb 12, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
9 changes: 7 additions & 2 deletions .asf.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,12 @@ github:

protected_branches:
main:
required_pull_request_reviews:
required_approving_review_count: 1

required_linear_history: true

del_branch_on_merge: true

features:
wiki: true
Expand All @@ -46,12 +51,12 @@ github:
- jun-he
- marton-bod
- samarthjain
- findepi
- SreeramGarlapati
- samredai
- gaborkaszab
- bitsondatadev
- ajantha-bhat
- jbonofre
- manuzhang
ghp_branch: gh-pages
ghp_path: /

Expand Down
3 changes: 3 additions & 0 deletions .baseline/checkstyle/checkstyle-suppressions.xml
Original file line number Diff line number Diff line change
Expand Up @@ -48,4 +48,7 @@

<!-- Referencing guava classes should be allowed in classes within bundled-guava module -->
<suppress files="org.apache.iceberg.GuavaClasses" id="BanUnrelocatedGuavaClasses"/>

<!-- Suppress checks for CometColumnReader -->
<suppress files="org.apache.iceberg.spark.data.vectorized.CometColumnReader" checks="IllegalImport"/>
</suppressions>
41 changes: 27 additions & 14 deletions .baseline/checkstyle/checkstyle.xml
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,14 @@
<property name="format" value="Preconditions\.checkArgument\([^;]+%d[^;]+\);"/>
<property name="message" value="Preconditions.checkArgument does not support %d. use %s instead"/>
</module>
<module name="RegexpMultiline">
<property name="format" value="^\s*import\s+static\s+(?!\Qorg.assertj.core.api.Assertions.\E).*\.assertThatThrownBy;"/>
<property name="message" value="assertThatThrownBy() should be statically imported from org.assertj.core.api.Assertions"/>
</module>
<module name="RegexpMultiline">
<property name="format" value="^\s*import\s+\Qorg.assertj.core.api.Assertions;\E" />
<property name="message" value="org.assertj.core.api.Assertions should only be used with static imports" />
</module>
<module name="SuppressionFilter"> <!-- baseline-gradle: README.md -->
<property name="file" value="${config_loc}/checkstyle-suppressions.xml"/>
</module>
Expand Down Expand Up @@ -145,11 +153,12 @@
org.apache.spark.sql.functions.*,
org.apache.spark.sql.connector.iceberg.write.RowLevelOperation.Command.*,
org.apache.spark.sql.connector.write.RowLevelOperation.Command.*,
org.junit.Assert.*"/>
org.junit.Assert.*,
org.assertj.core.api.Assertions.*,
org.assertj.core.api.Assumptions.*"/>
</module>
<module name="ClassTypeParameterName"> <!-- Java Style Guide: Type variable names -->
<property name="format" value="(^[A-Z][0-9]?)$|([A-Z][a-zA-Z0-9]*[T]$)"/>
<message key="name.invalidPattern" value="Class type name ''{0}'' must match pattern ''{1}''."/>
</module>
<module name="CovariantEquals"/> <!-- Java Coding Guidelines: Override ``Object#equals`` consistently -->
<module name="DefaultComesLast"/> <!-- Java Style Guide: The default case is present -->
Expand Down Expand Up @@ -271,12 +280,13 @@
</module>
<module name="InnerAssignment"/> <!-- Java Coding Guidelines: Inner assignments: Not used -->
<module name="MemberName"> <!-- Java Style Guide: Non-constant field names -->
<property name="format" value="^[a-z][a-zA-Z0-9]+$"/>
<message key="name.invalidPattern" value="Member name ''{0}'' must match pattern ''{1}''."/>
<property name="format" value="^[a-z][a-zA-Z0-9]++$"/>
</module>
<module name="ConstantName">
<property name="format" value="^[A-Z][A-Z0-9]*+(_[A-Z0-9]++)*+$"/>
</module>
<module name="MethodName"> <!-- Java Style Guide: Method names -->
<property name="format" value="^[a-z][a-zA-Z0-9_]+$"/>
<message key="name.invalidPattern" value="Method name ''{0}'' must match pattern ''{1}''."/>
<property name="format" value="^[a-z][a-zA-Z0-9_]++$"/>
</module>
<module name="MethodParamPad"/> <!-- Java Style Guide: Horizontal whitespace -->
<module name="MissingDeprecated"/> <!-- Java Coding Guide: Deprecate per annotation and Javadoc -->
Expand All @@ -294,8 +304,7 @@
<module name="PackageAnnotation"/> <!-- Java Style Guide: Package statement -->
<module name="PackageDeclaration"/> <!-- Java Style Guide: Package statement -->
<module name="PackageName"> <!-- Java Style Guide: Package names -->
<property name="format" value="^[a-z]+(\.[a-z][a-z0-9]*)*$"/>
<message key="name.invalidPattern" value="Package name ''{0}'' must match pattern ''{1}''."/>
<property name="format" value="^[a-z]++(\.[a-z][a-z0-9]*+)*+$"/>
</module>
<module name="ParameterAssignment"/> <!-- Java Coding Guidelines: Final variables and parameters -->
<module name="ParenPad"/> <!-- Java Style Guide: Horizontal whitespace -->
Expand Down Expand Up @@ -405,6 +414,9 @@
<property name="format" value="@Test\(.*expected.*\)"/>
<property name="message" value="Prefer using Assertions.assertThatThrownBy(...).isInstanceOf(...) instead."/>
</module>
<module name="IllegalToken">
<property name="tokens" value="LITERAL_ASSERT"/>
</module>
<module name="IllegalImport">
<property name="id" value="BanExpectedExceptionUsage"/>
<property name="illegalClasses" value="org.junit.rules.ExpectedException"/>
Expand All @@ -415,6 +427,11 @@
<property name="illegalPkgs" value="org.hamcrest"/>
<message key="import.illegal" value="Prefer using org.assertj.core.api.Assertions instead."/>
</module>
<module name="IllegalImport">
<property name="id" value="BanJUnit5Assertions"/>
<property name="illegalPkgs" value="org.junit.jupiter.api.Assertions"/>
<message key="import.illegal" value="Prefer using org.assertj.core.api.Assertions instead."/>
</module>
<module name="RegexpSinglelineJava">
<property name="ignoreComments" value="true"/>
<property name="format" value="@Json(S|Des)erialize"/>
Expand All @@ -434,7 +451,6 @@
<message key="todo.match" value="There must be whitespace at the beginning of all comments."/>
</module>
<module name="TypeName"> <!-- Java Style Guide: Class names -->
<message key="name.invalidPattern" value="Type name ''{0}'' must match pattern ''{1}''."/>
</module>
<module name="TypecastParenPad"/> <!-- Java Style Guide: Horizontal whitespace -->
<module name="UnusedImports"> <!-- Java Style Guide: No unused imports -->
Expand Down Expand Up @@ -470,23 +486,20 @@
<module name="LocalFinalVariableName"/> <!-- Java Style Guide: Local variable names -->
<module name="LocalVariableName"> <!-- Java Style Guide: Local variable names -->
<property name="tokens" value="VARIABLE_DEF"/>
<property name="format" value="^[a-z][a-zA-Z0-9]+$"/>
<property name="format" value="^[a-z][a-zA-Z0-9]++$"/>
<property name="allowOneCharVarInForLoop" value="true"/>
<message key="name.invalidPattern" value="Local variable name ''{0}'' must match pattern ''{1}''."/>
</module>
<module name="MethodLength"/> <!-- Java Coding Guide: Methods and functions: focused, crisp, concise -->
<module name="MethodTypeParameterName"> <!-- Java Style Guide: Type variable names -->
<property name="format" value="(^[A-Z][0-9]?)$|([A-Z][a-zA-Z0-9]*[T]$)"/>
<message key="name.invalidPattern" value="Method type name ''{0}'' must match pattern ''{1}''."/>
</module>
<module name="NestedForDepth">
<property name="max" value="2"/>
</module>
<module name="NestedTryDepth"/> <!-- Java Coding Guide: Try/catch blocks: never nested -->
<module name="NonEmptyAtclauseDescription"/> <!-- Java Style Guide: At-clauses -->
<module name="ParameterName"> <!-- Java Style Guide: Parameter names -->
<property name="format" value="^[a-z][a-zA-Z0-9]+$"/>
<message key="name.invalidPattern" value="Parameter name ''{0}'' must match pattern ''{1}''."/>
<property name="format" value="^[a-z][a-zA-Z0-9]++$"/>
<property name="ignoreOverridden" value="true"/>
</module>

Expand Down
1 change: 0 additions & 1 deletion .gitattributes
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,6 @@
/build/** export-ignore
/examples export-ignore
/examples/** export-ignore
jitpack.yml export-ignore
/docs export-ignore
/docs/** export-ignore

25 changes: 16 additions & 9 deletions .github/ISSUE_TEMPLATE/iceberg_bug_report.yml
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,14 @@ body:
description: What Apache Iceberg version are you using?
multiple: false
options:
- "1.4.3 (latest release)"
- "1.7.1 (latest release)"
- "1.7.0"
- "1.6.1"
- "1.6.0"
- "1.5.2"
- "1.5.1"
- "1.5.0"
- "1.4.3"
- "1.4.2"
- "1.4.1"
- "1.4.0"
Expand All @@ -38,14 +45,6 @@ body:
- "1.2.0"
- "1.1.0"
- "1.0.0"
- "0.14.1"
- "0.14.0"
- "0.13.1"
- "0.13.0"
- "0.12.1"
- "0.12.0"
- "0.11.1"
- "0.11.0"
- "main (development)"
validations:
required: false
Expand Down Expand Up @@ -81,3 +80,11 @@ body:
You can include files by dragging and dropping them here.
validations:
required: true
- type: checkboxes
attributes:
label: Willingness to contribute
description: The Apache Iceberg community encourages bug fix contributions. Would you or another member of your organization be willing to contribute a fix for this bug to the Apache Iceberg codebase?
options:
- label: I can contribute a fix for this bug independently
- label: I would be willing to contribute a fix for this bug with guidance from the Iceberg community
- label: I cannot contribute a fix for this bug at this time
10 changes: 9 additions & 1 deletion .github/ISSUE_TEMPLATE/iceberg_improvement.yml
Original file line number Diff line number Diff line change
Expand Up @@ -50,4 +50,12 @@ body:
- Hive
- Other
validations:
required: false
required: false
- type: checkboxes
attributes:
label: Willingness to contribute
description: The Apache Iceberg community encourages contributions. Would you or another member of your organization be willing to contribute this improvement/feature to the Apache Iceberg codebase?
options:
- label: I can contribute this improvement/feature independently
- label: I would be willing to contribute this improvement/feature with guidance from the Iceberg community
- label: I cannot contribute this improvement/feature at this time
50 changes: 50 additions & 0 deletions .github/ISSUE_TEMPLATE/iceberg_proposal.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
#

---
name: Iceberg Improvement Proposal
description: Propose a Spec change or major feature
labels: ["proposal"]
body:
- type: markdown
attributes:
value: "Please see documentation site for information on [contributing proposals](https://iceberg.apache.org/contribute/#apache-iceberg-improvement-proposals)"
- type: textarea
attributes:
label: Proposed Change
description: Please describe the proposal and elaborate on the use case and motivation
validations:
required: true
- type: input
attributes:
label: Proposal document
description: |
Link to the proposal document. Google Docs is preferred format to allow for public
comment and sharing
- type: checkboxes
attributes:
label: Specifications
description: Which specifications are affected by this proposal?
options:
- label: Table
- label: View
- label: REST
- label: Puffin
- label: Encryption
- label: Other
13 changes: 9 additions & 4 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,19 +24,24 @@ updates:
schedule:
interval: "weekly"
day: "sunday"
ignore:
- dependency-name: "*"
update-types: ["version-update:semver-major"]
- package-ecosystem: "gradle"
directory: "/"
schedule:
interval: "weekly"
day: "sunday"
open-pull-requests-limit: 50
ignore:
- dependency-name: "*"
update-types: ["version-update:semver-major"]
- package-ecosystem: "pip"
directory: "/"
schedule:
interval: "weekly"
day: "sunday"
open-pull-requests-limit: 5
- ignore:
dependency-name: "*"
update-types: ["version-update:semver-major"]

ignore:
- dependency-name: "*"
update-types: ["version-update:semver-major"]
11 changes: 0 additions & 11 deletions .github/labeler.yml
Original file line number Diff line number Diff line change
Expand Up @@ -26,8 +26,6 @@ INFRA:
'.gitignore',
'baseline.gradle',
'deploy.gradle',
'jitpack.yml',
'travis.yml',
'.baseline/**/*',
'.github/**/*',
'dev/**/*'
Expand Down Expand Up @@ -100,10 +98,7 @@ ORC:
HIVE:
- changed-files:
- any-glob-to-any-file: [
'hive3/**/*',
'hive-metastore/**/*',
'hive-runtime/**/*',
'hive3-orc-bundle/**/*'
]

DATA:
Expand All @@ -130,12 +125,6 @@ MR:
'mr/**/*'
]

PIG:
- changed-files:
- any-glob-to-any-file: [
'pig/**/*'
]

AWS:
- changed-files:
- any-glob-to-any-file: [
Expand Down
7 changes: 6 additions & 1 deletion .github/workflows/api-binary-compatibility.yml
Original file line number Diff line number Diff line change
Expand Up @@ -22,11 +22,16 @@ on:
push:
branches:
- 'main'
- '0.**'
- '0.*'
- '1.*'
- '2.*'
tags:
- 'apache-iceberg-**'
pull_request:
paths:
- '.github/workflows/api-binary-compatibility.yml'
- '*.gradle'
- 'gradle*'
- 'api/**'
- '.palantir/revapi.yml'

Expand Down
Loading