enhance: make serialization be part of sync task to support file format change

[tedxu]

See #38945

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[codecov]

Codecov Report

Attention: Patch coverage is 64.80836% with 101 lines in your changes missing coverage. Please review.

Project coverage is 81.01%. Comparing base (7261128) to head (441f943).
Report is 17 commits behind head on master.

Files with missing lines	Patch %	Lines
internal/flushcommon/syncmgr/pack_writer.go	58.41%	74 Missing and 15 partials ⚠️
internal/flushcommon/syncmgr/storage_serializer.go	57.14%	5 Missing and 1 partial ⚠️
internal/flushcommon/syncmgr/task.go	78.94%	2 Missing and 2 partials ⚠️
internal/flushcommon/syncmgr/meta_writer.go	75.00%	0 Missing and 1 partial ⚠️
internal/flushcommon/syncmgr/options.go	95.65%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master   #38946      +/-   ##
==========================================
+ Coverage   80.98%   81.01%   +0.02%     
==========================================
  Files        1407     1408       +1     
  Lines      198693   198627      -66     
==========================================
- Hits       160921   160915       -6     
+ Misses      32102    32052      -50     
+ Partials     5670     5660      -10     

Components	Coverage Δ
Client	79.50% <ø> (ø)
Core	69.56% <ø> (ø)
Go	82.94% <64.80%> (+0.02%)	⬆️

Files with missing lines	Coverage Δ
internal/datanode/importv2/util.go	65.21% <100.00%> (-0.07%)	⬇️
internal/flushcommon/writebuffer/write_buffer.go	70.84% <100.00%> (-2.54%)	⬇️
internal/storage/data_codec.go	77.72% <100.00%> (+0.02%)	⬆️
pkg/metrics/datanode_metrics.go	100.00% <ø> (ø)
internal/flushcommon/syncmgr/meta_writer.go	79.16% <75.00%> (ø)
internal/flushcommon/syncmgr/options.go	92.85% <95.65%> (-7.15%)	⬇️
internal/flushcommon/syncmgr/task.go	92.92% <78.94%> (+10.55%)	⬆️
internal/flushcommon/syncmgr/storage_serializer.go	48.22% <57.14%> (-13.45%)	⬇️
internal/flushcommon/syncmgr/pack_writer.go	58.41% <58.41%> (ø)

... and 44 files with indirect coverage changes

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu cpp-unit-test check failed, comment rerun cpp-unit-test can trigger the job again.

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu cpp-unit-test check failed, comment rerun cpp-unit-test can trigger the job again.

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[tedxu]

rerun go-sdk

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[tedxu]

/run-cpu-e2e

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[tedxu]

rerun go-sdk

[mergify]

@tedxu go-sdk check failed, comment rerun go-sdk can trigger the job again.

[tedxu]

/run-cpu-e2e

[tedxu]

rerun go-sdk

[congqixia]

/lgtm

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia, tedxu

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [congqixia,tedxu]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment