[Enhancement]: Merge insert message of multi partitions in one shard as one message.

[chyezh]

Is there an existing issue for this?

• I have searched the existing issues

What would you like to be added?

• Current Milvus split insert message on one shard at partition-wise.
• When enabling partittion-key, one insert opeartion of one shard will be split into N message in wal. It's low performance when the partition num is huge, such as 1024. Make a huge write-multiply.

We need to refactor the insert message format, make one shard insert message into one message to prevent low performance insert operation.

Why is this needed?

No response

Anything else?

No response

[chyezh]

/assign

[xiaofan-luan]

agree, we should insert as one shard one message. Partition can be handled after written into WAL