Skip to content

Wrong size of remote backup reported if upload was resumed #526

@mmolinac

Description

@mmolinac

I uploaded a full backup to a remote location (GCS). Size is about 2.5 TB.
I use the --resumable option to be able to retry if a communication error or other kind arises.
That was the case, and after four attempts, it succeeded.
However, the reported size of the remote backup is wrong:

# /usr/bin/clickhouse-backup --config /etc/clickhouse-backup/config.gcs.yml list remote | tail -1
reporting-shard_01-full-20221002-0312   2.60GiB    03/10/2022 16:23:21   remote             gzip, regular

However, we can clearly see that this is not the case:

$ gsutil du -hc gs://mybucket/reporting_shard_01/reporting-shard_01-full-20221002-0312 | tail -2
2.49 TiB     gs://mybucket/reporting_shard_01/reporting-shard_01-full-20221002-0312/
2.49 TiB     total

Product version is:

# clickhouse-backup --version
Version:	 2.0.0
Git Commit:	 93f6c2f168b63db4ab7c8cd51fcc317884752b84
Build Date:	 2022-09-04

I understand that maybe the last uploaded piece of data is being computed for the total size, instead of the whole sum.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions