Skip to content

Commit 31f5f40

Browse files
committed
Add guidance on managing kafka_internal/tx usage
1 parent e85752b commit 31f5f40

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

modules/manage/pages/cluster-maintenance/disk-utilization.adoc

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -163,6 +163,24 @@ For periodic offset expiration, set the retention duration of consumer group off
163163

164164
Redpanda supports group offset deletion with the Kafka OffsetDelete API through rpk with the xref:reference:rpk/rpk-group/rpk-group-offset-delete.adoc[`rpk group offset-delete`] command. The offset delete API provides finer control over culling consumer offsets. For example, it enables the manual removal of offsets that are tracked by Redpanda within the `__consumer_offsets` topic. The offsets requested to be removed will be removed only if either the group in question is in a dead state, or the partitions being deleted have no active subscriptions.
165165

166+
== Manage transaction coordinator disk usage
167+
168+
Redpanda uses the internal topic `kafka_internal/tx` to store transaction metadata for exactly-once and transactional producers. Over time, this topic can consume an excessive disk space in niche use cases that generate a large number of transactional sessions.
169+
170+
You can manage the disk usage of `kafka_internal/tx` by tuning the following cluster properties:
171+
172+
* config_ref:transaction_coordinator_delete_retention_ms,true,properties/cluster-properties[`transaction_coordinator_delete_retention_ms`]. Default: `604800000` (7 days).
173+
* config_ref:transactional_id_expiration_ms,true,properties/cluster-properties[`transactional_id_expiration_ms`]. Default: `604800000` (7 days).
174+
175+
<<monitor-disk-space,Monitor disk usage>> of `kafka_internal/tx` using your storage metrics and decrease the values of these properties as needed to mitigate unbounded growth and manage storage consumption of the internal topic more effectively.
176+
177+
To adjust these properties, run:
178+
179+
[,bash]
180+
----
181+
rpk cluster config set transaction_coordinator_delete_retention_ms=<milliseconds> transactional_id_expiration_ms=<milliseconds>
182+
----
183+
166184
== Configure segment size
167185

168186
The `log_segment_size` property specifies the size of each log segment within the partition. Redpanda closes segments after they exceed this size and messages begin filling a new segment.

0 commit comments

Comments
 (0)