Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: msq autocompaction #16681

Merged
merged 28 commits into from
Oct 17, 2024
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
7d5c8d3
docs: msq autocompaction docs
317brian Jul 2, 2024
63bc906
cleanup
317brian Jul 2, 2024
4c204e7
Merge branch 'master' into msq-autocompact-docs
317brian Jul 2, 2024
0f96df3
Merge branch 'master' into msq-autocompact-docs
317brian Sep 18, 2024
d118847
update for overlord-based autocompact
317brian Sep 19, 2024
b698acf
parallelism
317brian Sep 19, 2024
0699168
update list in ki
317brian Sep 19, 2024
c58b26b
update supervisor docs
317brian Sep 20, 2024
5e08d07
fix typos
317brian Sep 20, 2024
802af43
Apply suggestions from code review
317brian Sep 27, 2024
30db2ba
address comments
317brian Sep 27, 2024
56ede75
fix typo
317brian Sep 30, 2024
ea6c767
address comments
317brian Oct 1, 2024
9defd6e
Apply suggestions from code review
317brian Oct 3, 2024
4fe38a7
address comments
317brian Oct 3, 2024
790dcf0
fix link etc
317brian Oct 4, 2024
ae5829b
update aggregator section
317brian Oct 7, 2024
ba1434a
fix link
317brian Oct 8, 2024
1dfbb6b
Merge branch 'master' into msq-autocompact-docs
317brian Oct 9, 2024
52dfd51
Apply suggestions from code review
317brian Oct 10, 2024
a0e2b61
Update docs/data-management/automatic-compaction.md
317brian Oct 15, 2024
3e1bbf3
Apply suggestions from code review
317brian Oct 15, 2024
82baf46
Apply suggestions from code review
317brian Oct 15, 2024
632da59
address review comments
317brian Oct 15, 2024
390dd6a
Apply suggestions from code review
317brian Oct 16, 2024
1ea4fbd
update config page
317brian Oct 16, 2024
9667d59
fix link
317brian Oct 16, 2024
7fda723
update spelling file
317brian Oct 16, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Apply suggestions from code review
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
  • Loading branch information
317brian and vtlim authored Oct 15, 2024
commit 82baf46c233cf49933c5e392f75b14bad9266c89
2 changes: 1 addition & 1 deletion docs/ingestion/supervisor.md
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ The following table outlines the high-level configuration options for a supervis

|Property|Type|Description|Required|
|--------|----|-----------|--------|
|`type`|String|The supervisor type. For streaming ingestion, this can be either `kafka`, `kinesis` or `rabbit`. For automatic compaction, set the type to `autocompact`. |Yes|
|`type`|String|The supervisor type. For streaming ingestion, this can be either `kafka`, `kinesis`, or `rabbit`. For automatic compaction, set the type to `autocompact`. |Yes|
|`spec`|Object|The container object for the supervisor configuration. For automatic compaction, this is the same as the compaction configuration. |Yes|
|`spec.dataSchema`|Object|The schema for the indexing task to use during ingestion. See [`dataSchema`](../ingestion/ingestion-spec.md#dataschema) for more information.|Yes|
|`spec.ioConfig`|Object|The I/O configuration object to define the connection and I/O-related settings for the supervisor and indexing tasks.|Yes|
Expand Down
2 changes: 1 addition & 1 deletion docs/multi-stage-query/known-issues.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ where native engine has a non-empty `leafOperator`.

## Automatic compaction

<!--This list also exists in data-management/automatic-compaction-->
<!-- If you update this list, also update data-management/automatic-compaction.md -->

The following known issues and limitations affect automatic compaction with the MSQ task engine:
317brian marked this conversation as resolved.
Show resolved Hide resolved

Expand Down
Loading