Skip to content

Commit 5cf8db7

Browse files
committed
Partition evolution in Unity supported for external Iceberg engines
1 parent 002955c commit 5cf8db7

File tree

1 file changed

+3
-8
lines changed

1 file changed

+3
-8
lines changed

modules/manage/pages/iceberg/iceberg-topics-databricks-unity.adoc

Lines changed: 3 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -27,13 +27,9 @@ endif::[]
2727
* Workspace admin privileges to complete the steps to create a Unity Catalog storage credential and external location that connects your cluster's Tiered Storage bucket to Databricks.
2828

2929
== Limitations
30+
31+
The following data types are not currently supported for managed Iceberg tables:
3032

31-
* Databricks Managed Iceberg tables do not currently support partition evolution. If you define a xref:manage:iceberg/about-iceberg-topics.adoc#use-custom-partitioning[custom partitioning] scheme for an Iceberg topic, you must not change it later.
32-
+
33-
The cluster property config_ref:iceberg_default_partition_spec,true,properties/cluster-properties[`iceberg_default_partition_spec`] defines the cluster-wide partitioning scheme, by default configured to `(hour(redpanda.timestamp))`. To use a different cluster-wide default, configure this property before creating any Iceberg-enabled topics. You must only override the default partitioning scheme on the topic level for new Iceberg topics that do not yet contain data.
34-
* The following data types are not currently supported for managed Iceberg tables:
35-
+
36-
--
3733
|===
3834
| Iceberg type | Equivalent Avro type
3935

@@ -42,8 +38,7 @@ The cluster property config_ref:iceberg_default_partition_spec,true,properties/c
4238
| time | time-millis, time-micros
4339

4440
|===
45-
--
46-
+
41+
4742
There are no limitations for Protobuf types.
4843

4944
== Create a Unity Catalog storage credential

0 commit comments

Comments
 (0)