Skip to content

JSON column breaks changefeed  #3624

Closed
@ivanrubanau

Description

What did you do?

I'm trying to replicate table with json column. Here is table definition:

CREATE TABLE `sample_table` (
                                    `id` bigint(20) unsigned primary key NOT NULL AUTO_INCREMENT,
                                    `json_payload` json DEFAULT NULL
)

I have changefeed configured to post updates to Kafka in AVRO format.

If I add row with json_payload equals NULL, everything works as expected, I can see updates in proper Kafka topic.

What did you expect to see?

If I add row with any valid JSON as json_payload column value, I expect to see proper event in Kafka topic.

What did you see instead?

Instead of emitting event, changefeed goes to broken state and stops replicating any future events as well.

Only suspicious thing that I found in logs is

[DEBUG] [client.go:635] ["region failed"] [regionID=7013] [error="[CDC:ErrEventFeedAborted]single event feed aborted"]

Versions of the cluster

Upstream TiDB cluster version (execute SELECT tidb_version(); in a MySQL client):

Release Version: v5.2.2
Edition: Community
Git Commit Hash: da1c21fd45a4ea5900ac16d2f4a248143f378d18
Git Branch: heads/refs/tags/v5.2.2
UTC Build Time: 2021-10-20 06:08:33
GoVersion: go1.16.4
Race Enabled: false
TiKV Min Version: v3.0.0-60965b006877ca7234adaced7890d7b029ed1306
Check Table Before Drop: false

TiCDC version (execute cdc version):

Release Version: v5.2.2
Git Commit Hash: a04ddac9fe83c8bdff267e4c44150060ea05f5ec
Git Branch: heads/refs/tags/v5.2.2
UTC Build Time: 2021-10-29 03:21:45
Go Version: go version go1.16.4 linux/amd64
Failpoint Build: false

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions