Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
4d81a54
DOC-1407 single source additions for Cloud (#1139)
micheleRP Jun 13, 2025
77c5eca
Doc-1378 Compaction robustness
Feediver1 Jun 6, 2025
e2d7bdb
Doc-1378 Compaction robustness
Feediver1 Jun 6, 2025
fc7c163
cluster prop updates
Feediver1 Jun 6, 2025
1b26b4b
Update modules/reference/pages/properties/cluster-properties.adoc
Feediver1 Jun 6, 2025
7cb7b3b
Update modules/reference/pages/properties/cluster-properties.adoc
Feediver1 Jun 6, 2025
92f70f4
Apply suggestions from code review
Feediver1 Jun 12, 2025
68359d1
Apply suggestions from code review
Feediver1 Jun 12, 2025
ce4b7d2
Update modules/reference/pages/properties/cluster-properties.adoc
Feediver1 Jun 13, 2025
327cae1
Update modules/manage/pages/cluster-maintenance/compaction-settings.adoc
Feediver1 Jun 13, 2025
cbe4854
Apply suggestions from code review
Feediver1 Jun 13, 2025
2bc9011
Apply suggestions from code review
Feediver1 Jul 11, 2025
b715fed
Update modules/reference/pages/properties/cluster-properties.adoc
Feediver1 Jul 14, 2025
5bb86b0
fixed tagging
Feediver1 Jul 16, 2025
edaae58
review feedback, tagging updates
Feediver1 Jul 17, 2025
12433f3
Merge branch 'beta' into Compaction
Feediver1 Jul 17, 2025
f03724d
update table
Feediver1 Jul 17, 2025
373591f
incorporate doc feedback
Feediver1 Jul 18, 2025
9f3d991
put in correct prop category
Feediver1 Jul 18, 2025
aef92de
fix link destination
Feediver1 Jul 18, 2025
70cb90b
tag fix
Feediver1 Jul 18, 2025
9dd09e4
ugh
Feediver1 Jul 18, 2025
e3771c2
modified head levels
Feediver1 Jul 18, 2025
ba4f8a1
AI updates
Feediver1 Jul 18, 2025
4b8d898
link updates
Feediver1 Jul 18, 2025
cd93a50
review feedback
Feediver1 Jul 18, 2025
de0b698
Update local-antora-playbook.yml
Feediver1 Jul 18, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions modules/manage/pages/cluster-maintenance/compaction-settings.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,22 @@ Where:
| xref:reference:cluster-properties.adoc#log_compaction_interval_ms[`log_compaction_interval_ms`]
| Cluster
| Compaction frequency in milliseconds.

| xref:reference:cluster-properties.adoc#max_compaction_lag_ms[`max_compaction_lag_ms`]
| Cluster
| The maximum amount of time in milliseconds that a message remains ineligible for compaction. Use to guarantee the maximum delay between the time a message is written and the time the message becomes eligible for compaction. This setting is useful for ensuring that messages are compacted within a predictable timeframe.

| xref:reference:cluster-properties.adoc#min_compaction_lag_ms[`min_compaction_lag_ms`]
| Cluster
| The minimum time in milliseconds that a message remains uncompacted in the log. Use to guarantee the minimum length of time that must pass after a message is written before it could be compacted. For example, to provide a lower bound on how long each message will remain in the (uncompacted) head.

| xref:reference:properties/topic-properties.adoc#max.compaction.lag.ms[`max.compaction.lag.ms`]
| Topic
| The maximum amount of time in milliseconds that a message remains ineligible for compaction. Use to guarantee the maximum delay between the time a message is written and the time the message becomes eligible for compaction.

| xref:reference:properties/topic-properties.adoc#min.compaction.lag.ms[`min.compaction.lag.ms`]
| Topic
| The minimum time in milliseconds that a message remains uncompacted in the log. Use to guarantee the minimum length of time that must pass after a message is written before it could be compacted. For example, to provide a lower bound on how long each message will remain in the (uncompacted) head.
|===

Redpanda runs a scan every `log_compaction_interval_ms`. During each scan:
Expand Down
44 changes: 43 additions & 1 deletion modules/reference/pages/properties/cluster-properties.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -3705,6 +3705,26 @@ Maximum compacted segment size after consolidation.

---

=== max_compaction_lag_ms

For a compacted topic, the maximum time a message remains ineligible for compaction. The topic property `max.compaction.lag.ms` overrides this property.

*Unit:* milliseconds

*Requires restart:* No

*Visibility:* `user`

*Type:* integer

*Accepted values:* [`1`, `9223372036854`]

*Default:* `9223372036854`

*Related topics*: xref:reference:properties/topic-properties.adoc#max.compaction.lag.ms[`max.compaction.lag.ms`]

---

=== max_concurrent_producer_ids

Maximum number of active producer sessions. When the threshold is passed, Redpanda terminates old sessions. When an idle producer corresponding to the terminated session wakes up and produces, its message batches are rejected, and an out of order sequence error is emitted. Consumers don't affect this setting.
Expand Down Expand Up @@ -3950,7 +3970,29 @@ The minimum ratio between the number of bytes in dirty segments and the total nu

---

// tag::minimum_topic_replications[]
=== min_compaction_lag_ms

The minimum amount of time (in ms) that a log segment must remain unaltered before it can be compacted in a compact topic.

*Unit:* milliseconds

*Requires restart:* No

*Visibility:* `user`

*Type:* integer

*Accepted values:* [`0`, `9223372036854`]

*Default:* `0`

*Related topics*:

- xref:reference:properties/topic-properties.adoc#min.compaction.lag.ms[`min.compaction.lag.ms`]

---

[[minimum_topic_replications]]
=== minimum_topic_replications

ifdef::env-cloud[]
Expand Down
Loading