Fault enabling replication

[sabaini]

Two test clusters on nodes tst-0 and tst-1

I have imported a remote on tst-1 into my cluster, giving it a name like this:

ubuntu@tst-1:~$ sudo microceph remote import --local-name tst0 tst0 <token>

I can see the remote from the tst-1 machine:

ubuntu@tst-1:~$ sudo ceph -s --cluster tst0 --id tst0
  cluster:
    id:     28260466-321a-44c2-b2aa-d8998d3c0fd7
    health: HEALTH_WARN
            1 pool(s) do not have an application enabled
 
  services:
    mon: 1 daemons, quorum tst-0 (age 25m)
    mgr: tst-0(active, since 24m)
    osd: 3 osds: 3 up (since 24m), 3 in (since 24m)
 
  data:
    pools:   2 pools, 33 pgs
    objects: 3 objects, 577 KiB
    usage:   81 MiB used, 5.9 GiB / 6 GiB avail
    pgs:     33 active+clean

I have created a remote on the other end as well:

ubuntu@tst-0:~$ sudo ceph -s --cluster tst1 --id tst1
  cluster:
    id:     0a429727-8cf3-412f-b850-90343906716a
    health: HEALTH_WARN
            1 pool(s) do not have an application enabled
 
  services:
    mon: 1 daemons, quorum tst-1 (age 28m)
    mgr: tst-1(active, since 28m)
    osd: 3 osds: 3 up (since 27m), 3 in (since 27m)
 
  data:
    pools:   2 pools, 33 pgs
    objects: 3 objects, 577 KiB
    usage:   81 MiB used, 5.9 GiB / 6 GiB avail
    pgs:     33 active+clean

But I can't enable rbd replication:

ubuntu@tst-1:~$ sudo microceph replication enable rbd rbd --remote tst0
Error: failed to process enable_replication request for rbd: failed to import peer bootstrap token: Failed to run: rbd mirror pool peer bootstrap import --site-name tst0 --direction rx-tx rbd /var/snap/microceph/1355/conf/rbd_mirror/tst0_peer_keyring --cluster tst0 --id tst0: exit status 22 (2025-05-15T13:39:19.814+0000 7f14775ff680 -1 librbd::api::Mirror: peer_bootstrap_import: cannot import token for duplicate site name
rbd: failed to import peer bootstrap token)

[syncronize-issues-to-jira]

Thank you for reporting your feedback to us!

The internal ticket has been created: https://warthogs.atlassian.net/browse/CEPH-1308.

This message was autogenerated

[UtkarshBhatthere]

ubuntu@tst-1:~$ sudo microceph remote import --local-name tst0 tst0 <token> the remote add command needs 2 parameters, a flagged param (local-name) and an unflagged one (which is remote name). Both should not be same.

The bootstrap error says cannot import token for duplicate site name.

I think we should add a CLI change to move both site names to flagged params.

[sabaini]

The docs around importing remotes and enabling rbd could use some TLC too

https://canonical-microceph.readthedocs-hosted.com/en/latest/how-to/import-remote-cluster/

https://canonical-microceph.readthedocs-hosted.com/en/latest/how-to/configure-rbd-mirroring/

[panagiotisevaggelou]

Hi @sabaini, @UtkarshBhatthere ,
I've opened a PR that adds a validation to prevent using the same value for --local-name and the remote cluster name. This avoids the replication error caused by duplicate site names.

The fix keeps the current CLI unchanged for compatibility. I'm open to feedback if switching to fully flagged parameters is preferred.