Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug report] Iceberg REST server failed to write GCS data with both Gravitino GCP bundle jar and Iceberg GCP bundle jar #6165

Closed
FANNG1 opened this issue Jan 9, 2025 · 0 comments · Fixed by #6168
Assignees
Labels
0.8.0 Release v0.8.0 bug Something isn't working

Comments

@FANNG1
Copy link
Contributor

FANNG1 commented Jan 9, 2025

Version

main branch

Describe what's wrong

Iceberg REST server failed to write GCS data

Error message and/or stacktrace

Caused by: java.lang.NoSuchMethodError: 'com.google.api.services.storage.model.StorageObject com.google.api.services.storage.model.StorageObject.setCustomTime(com.google.api.client.util.DateTime)'
	at com.google.cloud.storage.JsonConversions.blobInfoEncode(JsonConversions.java:232) ~[iceberg-gcp-bundle-1.5.2.jar:?]
	at com.google.cloud.storage.Conversions$SimpleCodec.encode(Conversions.java:144) ~[iceberg-gcp-bundle-1.5.2.jar:?]
	at com.google.cloud.storage.StorageImpl.writer(StorageImpl.java:673) ~[iceberg-gcp-bundle-1.5.2.jar:?]
	at com.google.cloud.storage.StorageImpl.writer(StorageImpl.java:95) ~[iceberg-gcp-bundle-1.5.2.jar:?]
	at org.apache.iceberg.gcp.gcs.GCSOutputStream.openStream(GCSOutputStream.java:114) ~[iceberg-gcp-1.5.2.jar:?]
	at org.apache.iceberg.gcp.gcs.GCSOutputStream.<init>(GCSOutputStream.java:74) ~[iceberg-gcp-1.5.2.jar:?]
	at org.apache.iceberg.gcp.gcs.GCSOutputFile.createOrOverwrite(GCSOutputFile.java:62) ~[iceberg-gcp-1.5.2.jar:?]
	at org.apache.iceberg.TableMetadataParser.internalWrite(TableMetadataParser.java:125) ~[iceberg-core-1.5.2.jar:?]
	at org.apache.iceberg.TableMetadataParser.overwrite(TableMetadataParser.java:115) ~[iceberg-core-1.5.2.jar:?]

How to reproduce

  1. place gravitino-gcp-bundle jar and iceberg-gcp-bundle jar to the classpath of Iceberg REST server
  2. try create table

Additional context

iceberg-gcp-bundle use new google APIs while gravitino-gcp-bundle use old google APIs, there are some compatibility problems.

@FANNG1 FANNG1 added the bug Something isn't working label Jan 9, 2025
@FANNG1 FANNG1 changed the title [Bug report] Iceberg REST server failed to write GCS data [Bug report] Iceberg REST server failed to write GCS data with both Gravitino GCP bundle jar and Iceberg GCP bundle jar Jan 9, 2025
@jerryshao jerryshao added the 0.8.0 Release v0.8.0 label Jan 10, 2025
@FANNG1 FANNG1 closed this as completed in 74ef660 Jan 10, 2025
@FANNG1 FANNG1 self-assigned this Jan 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0.8.0 Release v0.8.0 bug Something isn't working
Projects
None yet
2 participants