Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BugFix] Resolve Delete Semantics Data Loss in Flink SQL for StarRocks 3.1 #365

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

andystenhe
Copy link

In the 3.1 storage-computation separated version, using the INSERT INTO statement in Flink SQL will lose data with Delete semantics.

What type of PR is this:

  • [v] BugFix
  • Feature
  • Enhancement
  • Refactor
  • UT
  • Doc
  • Tool

Which issues of this PR fixes :

Fixes #364

Problem Summary(Required) :

In the storage-computation separated version, the primary key information is not stored in the information_schema.COLUMNS table, causing the Flink connector to fail to detect the primary key and assume that the StarRocks table does not support writing Flink delete rowkind data.

Solution: Determine whether to support delete semantics based on the primary key declaration in the Flink table.

Checklist:

  • I have added test cases for my bug fix or my new feature
  • This pr will affect users' behaviors
  • This pr needs user documentation (for new or modified features or behaviors)
  • I have added documentation for my new feature or new function

@CLAassistant
Copy link

CLAassistant commented May 24, 2024

CLA assistant check
All committers have signed the CLA.

@andystenhe andystenhe changed the title [BugFix] 修复在存算分离版本中, flink 写入主键表丢失delete rowkind的数据 [BugFix] Resolve Delete Semantics Data Loss in Flink SQL for StarRocks 3.1 May 24, 2024
…e of the "insert into" statement in Flink SQL will lose the data with Delete semantics.

Signed-off-by: andystenhe <andystenhe@hotmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants