Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[extension](kettle) add kettle plugins to write doris #41295

Merged
merged 5 commits into from
Oct 11, 2024

Conversation

JNSimba
Copy link
Member

@JNSimba JNSimba commented Sep 25, 2024

Proposed changes

add kettle plugins to write doris
Implementation principle:

  1. Receive data from upstream
  2. Serialize it into data that can be written by Doris
  3. Cache this data in the memory buffer
  4. After reaching the threshold of Maximum rows/bytes, write it to Doris through Stream Load.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@JNSimba
Copy link
Member Author

JNSimba commented Sep 25, 2024

run buildall

@JNSimba
Copy link
Member Author

JNSimba commented Sep 25, 2024

run buildall

@JNSimba
Copy link
Member Author

JNSimba commented Sep 26, 2024

run buildall

…/steps/dorisstreamloader/messages/messages_en_US.properties

Co-authored-by: Mingyu Chen <morningman.cmy@gmail.com>
@JNSimba
Copy link
Member Author

JNSimba commented Oct 11, 2024

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Oct 11, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@JNSimba JNSimba merged commit 46d6f6f into apache:master Oct 11, 2024
28 of 29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants