Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cdc: Incorrect/outdated changefeed limitations section #114644

Open
miretskiy opened this issue Nov 17, 2023 · 1 comment
Open

cdc: Incorrect/outdated changefeed limitations section #114644

miretskiy opened this issue Nov 17, 2023 · 1 comment
Labels
A-cdc Change Data Capture A-docs C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. T-cdc

Comments

@miretskiy
Copy link
Contributor

miretskiy commented Nov 17, 2023

Stumbled upon known limitations page
https://www.cockroachlabs.com/docs/v23.1/create-and-configure-changefeeds#known-limitations,
and noticed that we have few out of date limitations listed there:

  • Webhook sinks only support emitting JSON. Tracking GitHub Issue — that’s not true; CSV also supported
  • There is no concurrency configurability for webhook sinks. Tracking GitHub Issue — not true, we have changefeed.sink_io_workers setting to control this.
  • Using a cloud storage sink only works with JSON and emits newline-delimited json files. Tracking GitHub Issue — CSV and Parquet also supported.
  • If a changefeed with on_error='pause(https://www.cockroachlabs.com/docs/v23.1/create-changefeed#on-error) is running when a watched table truncated ... angefeed will pause but will not be able to resume reads from that table.... I'm not sure it's a limitation; I think it's working as intended. Perhaps this whole on_error=pause should be deprecated/removed.

Jira issue: CRDB-33610

@miretskiy miretskiy added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. A-docs A-cdc Change Data Capture T-cdc labels Nov 17, 2023
Copy link

blathers-crl bot commented Nov 17, 2023

cc @cockroachdb/cdc

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-cdc Change Data Capture A-docs C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. T-cdc
Projects
None yet
Development

No branches or pull requests

1 participant