[BUG] [TC-CADMIN-1.9] ECM commissioning retry counter is incrementing faster than expected

[adamb-q]

Reproduction steps

Platform: qpg, chip-tool x64

Running CADMIN 1.9 shows that using ECM commissioning counter is incrementing faster than expected, which causes test failure earlier than on 20th retry. When using BCM the issue is not happening - 1 failure per 1 attempt. Attaching logs from CADMIN 1.9 and 1.10 for reference.

Bug prevalence

Every time

GitHub hash of the SDK that was being used

7e69c66

Platform

other

Platform Version(s)

qpg

Anything else?

TC_CADMIN_1_9.1675432562.log
TC_CADMIN_1_9.1675432562_DUT.log
[TC-CADMIN-1.10]_[061nwOu0]_CHIPTool_log.log
TC_CADMIN_1_10.1675433327_DUT.log

[bzbarsky-apple]

@adamb-q Is this a duplicate of #24928 ?

[adamb-q]

@bzbarsky-apple I applied the --discover-once true flag, and it looks better, but still the log output from chip-tool gives the correct output only on 1st attempt, I mean Failed to verify peer's MAC. This can happen when setup code is incorrect. The next steps differ, can I assume that it is correct behavior also? Attaching logs with the discover-once flag set.

TC_CADMIN_1_9.1676278577_DUT.log
TC_CADMIN_1_9.1676278577.log

[bzbarsky-apple]

That sounds like #22547 ?

[adamb-q]

Yes, looks relevant. When waiting ~50s between retries test would pass, but it exceeds 900s and commissioning window closes.