Skip to content

Conversation

fabian-imig
Copy link
Contributor

@fabian-imig fabian-imig commented Aug 6, 2025

Summary

Implements the changes necessary to fix issues found in Matter 1.5 TE1, skip ranges of steps instead of single steps..

Testplan PR:

Related issues

Testing

-> closure-app (362022f)
-> mfg-closure-dut

@github-actions github-actions bot added the tests label Aug 6, 2025
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a clean refactoring across multiple test files (TC_CLCTRL_4_2.py, TC_CLCTRL_4_3.py, TC_CLCTRL_4_4.py). The repeated calls to self.skip_step() have been consolidated into a single self.mark_step_range_skipped() call. This significantly improves code readability and maintainability by making the intent to skip a range of test steps more explicit and concise. The changes are consistent and well-executed.

Copy link

github-actions bot commented Aug 6, 2025

PR #40465: Size comparison from 3176ce8 to 40dd661

Full report (33 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, nrfconnect, psoc6, qpg, stm32, telink, tizen)
platform target config section 3176ce8 40dd661 change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1104428 1104428 0 0.0
RAM 179058 179058 0 0.0
bl702 lighting-app bl702+eth FLASH 657054 657054 0 0.0
RAM 134921 134921 0 0.0
bl702+wifi FLASH 834846 834846 0 0.0
RAM 124541 124541 0 0.0
bl706+mfd+rpc+littlefs FLASH 1066676 1066676 0 0.0
RAM 117349 117349 0 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 896114 896114 0 0.0
RAM 105644 105644 0 0.0
lighting-app bl702l+mfd+littlefs FLASH 979828 979828 0 0.0
RAM 109828 109828 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 766848 766848 0 0.0
RAM 103320 103320 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 778452 778452 0 0.0
RAM 108488 108488 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 724120 724120 0 0.0
RAM 96884 96884 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 708436 708436 0 0.0
RAM 97092 97092 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 550602 550602 0 0.0
RAM 205080 205080 0 0.0
lock CC3235SF_LAUNCHXL FLASH 582910 582910 0 0.0
RAM 205296 205296 0 0.0
efr32 lock-app BRD4187C FLASH 957840 957840 0 0.0
RAM 126512 126512 0 0.0
BRD4338a FLASH 752392 752384 -8 -0.0
RAM 251856 251856 0 0.0
window-app BRD4187C FLASH 1050460 1050452 -8 -0.0
RAM 122708 122708 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 909684 909684 0 0.0
RAM 152824 152824 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1657900 1657900 0 0.0
RAM 211144 211144 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1579460 1579460 0 0.0
RAM 208416 208416 0 0.0
light cy8ckit_062s2_43012 FLASH 1450604 1450604 0 0.0
RAM 197144 197144 0 0.0
lock cy8ckit_062s2_43012 FLASH 1482940 1482940 0 0.0
RAM 224856 224856 0 0.0
qpg lighting-app qpg6200+debug FLASH 819560 819560 0 0.0
RAM 127600 127600 0 0.0
lock-app qpg6200+debug FLASH 756836 756836 0 0.0
RAM 118552 118552 0 0.0
stm32 light STM32WB5MM-DK FLASH 466532 466532 0 0.0
RAM 141320 141320 0 0.0
telink bridge-app tl7218x FLASH 703720 703720 0 0.0
RAM 93544 93544 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl3218x FLASH 795510 795510 0 0.0
RAM 43960 43960 0 0.0
light-app-ota-shell-factory-data tl7218x FLASH 783916 783916 0 0.0
RAM 100848 100848 0 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 711514 711514 0 0.0
RAM 54180 54180 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 748108 748108 0 0.0
RAM 77336 77336 0 0.0
light-switch-app-ota-factory-data tl3218x_retention FLASH 724834 724834 0 0.0
RAM 36936 36936 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 604776 604776 0 0.0
RAM 112512 112512 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 819520 819524 4 0.0
RAM 99100 99100 0 0.0
tizen all-clusters-app arm unknown 5184 5184 0 0.0
FLASH 1767812 1767812 0 0.0
RAM 92212 92212 0 0.0
chip-tool-ubsan arm unknown 20772 20772 0 0.0
FLASH 21107706 21107706 0 0.0
RAM 9181408 9181408 0 0.0

@fabian-imig fabian-imig changed the title CLCTRL - use ranged based step skip [Closures] TC-CLCTRL-4.3 fix and minor changes Aug 6, 2025
Copy link

codecov bot commented Aug 6, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 50.89%. Comparing base (9f409ce) to head (cac9eb9).

Additional details and impacted files
@@           Coverage Diff           @@
##           master   #40465   +/-   ##
=======================================
  Coverage   50.89%   50.89%           
=======================================
  Files        1341     1341           
  Lines       98435    98435           
  Branches    12724    12724           
=======================================
+ Hits        50094    50095    +1     
+ Misses      48341    48340    -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Copy link

github-actions bot commented Aug 6, 2025

PR #40465: Size comparison from 3176ce8 to 42ea1fe

Full report (4 builds for cc32xx, nrfconnect, stm32)
platform target config section 3176ce8 42ea1fe change % change
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 550602 550602 0 0.0
RAM 205080 205080 0 0.0
lock CC3235SF_LAUNCHXL FLASH 582910 582910 0 0.0
RAM 205296 205296 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 909684 909684 0 0.0
RAM 152824 152824 0 0.0
stm32 light STM32WB5MM-DK FLASH 466532 466532 0 0.0
RAM 141320 141320 0 0.0

@fabian-imig fabian-imig marked this pull request as ready for review August 7, 2025 09:25
Copy link

github-actions bot commented Aug 7, 2025

PR #40465: Size comparison from 3176ce8 to 536044f

Increases above 0.2%:

platform target config section 3176ce8 536044f change % change
nxp contact mcxw71+release FLASH 627120 630368 3248 0.5
lock mcxw71+release FLASH 737312 740552 3240 0.4
Full report (57 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section 3176ce8 536044f change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1104428 1104638 210 0.0
RAM 179058 179066 8 0.0
bl702 lighting-app bl702+eth FLASH 657054 657270 216 0.0
RAM 134921 134929 8 0.0
bl702+wifi FLASH 834846 835062 216 0.0
RAM 124541 124541 0 0.0
bl706+mfd+rpc+littlefs FLASH 1066676 1066882 206 0.0
RAM 117349 117349 0 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 896114 896064 -50 -0.0
RAM 105644 105652 8 0.0
lighting-app bl702l+mfd+littlefs FLASH 979828 979778 -50 -0.0
RAM 109828 109828 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 766848 766888 40 0.0
RAM 103320 103320 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 778452 778492 40 0.0
RAM 108488 108488 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 724120 724096 -24 -0.0
RAM 96884 96884 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 708436 708460 24 0.0
RAM 97092 97092 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 550602 550586 -16 -0.0
RAM 205080 205080 0 0.0
lock CC3235SF_LAUNCHXL FLASH 582910 582942 32 0.0
RAM 205296 205296 0 0.0
efr32 lock-app BRD4187C FLASH 957840 957856 16 0.0
RAM 126512 126512 0 0.0
BRD4338a FLASH 752392 752336 -56 -0.0
RAM 251856 251856 0 0.0
window-app BRD4187C FLASH 1050460 1050388 -72 -0.0
RAM 122708 122708 0 0.0
esp32 all-clusters-app c3devkit DRAM 102288 102288 0 0.0
FLASH 1750338 1750406 68 0.0
IRAM 83862 83862 0 0.0
m5stack DRAM 121156 121156 0 0.0
FLASH 1698878 1698870 -8 -0.0
IRAM 117051 117051 0 0.0
linux air-purifier-app debug unknown 4864 4864 0 0.0
FLASH 2590376 2589408 -968 -0.0
RAM 116808 116632 -176 -0.2
all-clusters-app debug unknown 5688 5688 0 0.0
FLASH 5979354 5978596 -758 -0.0
RAM 534808 534664 -144 -0.0
all-clusters-minimal-app debug unknown 5536 5536 0 0.0
FLASH 5205732 5204914 -818 -0.0
RAM 228088 227912 -176 -0.1
bridge-app debug unknown 5568 5568 0 0.0
FLASH 4592066 4591278 -788 -0.0
RAM 208432 208272 -160 -0.1
camera-app debug unknown 8992 8992 0 0.0
FLASH 6793899 6791499 -2400 -0.0
RAM 231968 231840 -128 -0.1
camera-controller debug unknown 9216 9216 0 0.0
FLASH 13643819 13643643 -176 -0.0
RAM 668992 668960 -32 -0.0
chip-tool debug unknown 6264 6264 0 0.0
FLASH 13694443 13694275 -168 -0.0
RAM 655872 655848 -24 -0.0
chip-tool-ipv6only arm64 unknown 40736 40736 0 0.0
FLASH 12721623 12721479 -144 -0.0
RAM 690848 690824 -24 -0.0
closure-app debug unknown 5536 5536 0 0.0
FLASH 4573782 4573026 -756 -0.0
RAM 200328 200184 -144 -0.1
fabric-admin debug unknown 5944 5944 0 0.0
FLASH 12039218 12039050 -168 -0.0
RAM 654920 654888 -32 -0.0
fabric-bridge-app debug unknown 4816 4816 0 0.0
FLASH 4390914 4390190 -724 -0.0
RAM 194096 193904 -192 -0.1
fabric-sync debug unknown 5056 5056 0 0.0
FLASH 5475861 5475125 -736 -0.0
RAM 493936 493760 -176 -0.0
lighting-app debug+rpc+ui unknown 6280 6280 0 0.0
FLASH 5478081 5477361 -720 -0.0
RAM 209744 209584 -160 -0.1
lock-app debug unknown 5496 5496 0 0.0
FLASH 4619614 4618858 -756 -0.0
RAM 196952 196760 -192 -0.1
ota-provider-app debug unknown 4856 4856 0 0.0
FLASH 4249684 4248866 -818 -0.0
RAM 185552 185360 -192 -0.1
ota-requestor-app debug unknown 4736 4736 0 0.0
FLASH 4312896 4312110 -786 -0.0
RAM 188376 188184 -192 -0.1
shell debug unknown 4312 4312 0 0.0
FLASH 2932371 2932355 -16 -0.0
RAM 148584 148504 -80 -0.1
thermostat-no-ble arm64 unknown 9976 9976 0 0.0
FLASH 4227567 4226559 -1008 -0.0
RAM 226568 226416 -152 -0.1
tv-app debug unknown 5824 5824 0 0.0
FLASH 5804229 5803477 -752 -0.0
RAM 618312 618104 -208 -0.0
tv-casting-app debug unknown 5352 5352 0 0.0
FLASH 11833349 11832741 -608 -0.0
RAM 772528 772400 -128 -0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 909684 909708 24 0.0
RAM 152824 152824 0 0.0
nxp contact mcxw71+release FLASH 627120 630368 3248 0.5
RAM 64012 64076 64 0.1
lock mcxw71+release FLASH 737312 740552 3240 0.4
RAM 65096 65160 64 0.1
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1657900 1657828 -72 -0.0
RAM 211144 211144 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1579460 1579428 -32 -0.0
RAM 208416 208416 0 0.0
light cy8ckit_062s2_43012 FLASH 1450604 1450532 -72 -0.0
RAM 197144 197144 0 0.0
lock cy8ckit_062s2_43012 FLASH 1482940 1482868 -72 -0.0
RAM 224856 224856 0 0.0
qpg lighting-app qpg6200+debug FLASH 819560 819560 0 0.0
RAM 127600 127600 0 0.0
lock-app qpg6200+debug FLASH 756836 756900 64 0.0
RAM 118552 118552 0 0.0
stm32 light STM32WB5MM-DK FLASH 466532 466564 32 0.0
RAM 141320 141320 0 0.0
telink bridge-app tl7218x FLASH 703720 703840 120 0.0
RAM 93544 93544 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl3218x FLASH 795510 795632 122 0.0
RAM 43960 43960 0 0.0
light-app-ota-shell-factory-data tl7218x FLASH 783916 784038 122 0.0
RAM 100848 100848 0 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 711514 711632 118 0.0
RAM 54180 54180 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 748108 748226 118 0.0
RAM 77336 77336 0 0.0
light-switch-app-ota-factory-data tl3218x_retention FLASH 724834 724952 118 0.0
RAM 36936 36936 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 604776 604898 122 0.0
RAM 112512 112512 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 819520 819646 126 0.0
RAM 99100 99100 0 0.0
tizen all-clusters-app arm unknown 5184 5184 0 0.0
FLASH 1767812 1767372 -440 -0.0
RAM 92212 92100 -112 -0.1
chip-tool-ubsan arm unknown 20772 20772 0 0.0
FLASH 21107706 21107330 -376 -0.0
RAM 9181408 9181228 -180 -0.0

@fabian-imig fabian-imig requested a review from sorenmr August 7, 2025 10:51
Copy link

github-actions bot commented Aug 7, 2025

PR #40465: Size comparison from 3176ce8 to 85c60c4

Full report (4 builds for cc32xx, nrfconnect, stm32)
platform target config section 3176ce8 85c60c4 change % change
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 550602 550586 -16 -0.0
RAM 205080 205080 0 0.0
lock CC3235SF_LAUNCHXL FLASH 582910 582942 32 0.0
RAM 205296 205296 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 909684 909708 24 0.0
RAM 152824 152824 0 0.0
stm32 light STM32WB5MM-DK FLASH 466532 466564 32 0.0
RAM 141320 141320 0 0.0

Copy link

github-actions bot commented Aug 7, 2025

PR #40465: Size comparison from 3176ce8 to 7c4b955

Full report (33 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, nrfconnect, psoc6, qpg, stm32, telink, tizen)
platform target config section 3176ce8 7c4b955 change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1104428 1104638 210 0.0
RAM 179058 179066 8 0.0
bl702 lighting-app bl702+eth FLASH 657054 657270 216 0.0
RAM 134921 134929 8 0.0
bl702+wifi FLASH 834846 835062 216 0.0
RAM 124541 124541 0 0.0
bl706+mfd+rpc+littlefs FLASH 1066676 1066882 206 0.0
RAM 117349 117349 0 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 896114 896064 -50 -0.0
RAM 105644 105652 8 0.0
lighting-app bl702l+mfd+littlefs FLASH 979828 979778 -50 -0.0
RAM 109828 109828 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 766848 766888 40 0.0
RAM 103320 103320 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 778452 778492 40 0.0
RAM 108488 108488 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 724120 724096 -24 -0.0
RAM 96884 96884 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 708436 708460 24 0.0
RAM 97092 97092 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 550602 550586 -16 -0.0
RAM 205080 205080 0 0.0
lock CC3235SF_LAUNCHXL FLASH 582910 582942 32 0.0
RAM 205296 205296 0 0.0
efr32 lock-app BRD4187C FLASH 957840 957856 16 0.0
RAM 126512 126512 0 0.0
BRD4338a FLASH 752392 752336 -56 -0.0
RAM 251856 251856 0 0.0
window-app BRD4187C FLASH 1050460 1050388 -72 -0.0
RAM 122708 122708 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 909684 909708 24 0.0
RAM 152824 152824 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1657900 1657828 -72 -0.0
RAM 211144 211144 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1579460 1579428 -32 -0.0
RAM 208416 208416 0 0.0
light cy8ckit_062s2_43012 FLASH 1450604 1450532 -72 -0.0
RAM 197144 197144 0 0.0
lock cy8ckit_062s2_43012 FLASH 1482940 1482868 -72 -0.0
RAM 224856 224856 0 0.0
qpg lighting-app qpg6200+debug FLASH 819560 819560 0 0.0
RAM 127600 127600 0 0.0
lock-app qpg6200+debug FLASH 756836 756900 64 0.0
RAM 118552 118552 0 0.0
stm32 light STM32WB5MM-DK FLASH 466532 466564 32 0.0
RAM 141320 141320 0 0.0
telink bridge-app tl7218x FLASH 703720 703840 120 0.0
RAM 93544 93544 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl3218x FLASH 795510 795632 122 0.0
RAM 43960 43960 0 0.0
light-app-ota-shell-factory-data tl7218x FLASH 783916 784038 122 0.0
RAM 100848 100848 0 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 711514 711632 118 0.0
RAM 54180 54180 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 748108 748226 118 0.0
RAM 77336 77336 0 0.0
light-switch-app-ota-factory-data tl3218x_retention FLASH 724834 724952 118 0.0
RAM 36936 36936 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 604776 604898 122 0.0
RAM 112512 112512 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 819520 819646 126 0.0
RAM 99100 99100 0 0.0
tizen all-clusters-app arm unknown 5184 5184 0 0.0
FLASH 1767812 1767372 -440 -0.0
RAM 92212 92100 -112 -0.1
chip-tool-ubsan arm unknown 20772 20772 0 0.0
FLASH 21107706 21107330 -376 -0.0
RAM 9181408 9181228 -180 -0.0

Copy link

github-actions bot commented Aug 7, 2025

PR #40465: Size comparison from 3176ce8 to f45c3e7

Increases above 0.2%:

platform target config section 3176ce8 f45c3e7 change % change
nxp contact mcxw71+release FLASH 627120 630368 3248 0.5
lock mcxw71+release FLASH 737312 740552 3240 0.4
Full report (57 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section 3176ce8 f45c3e7 change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1104428 1104638 210 0.0
RAM 179058 179066 8 0.0
bl702 lighting-app bl702+eth FLASH 657054 657270 216 0.0
RAM 134921 134929 8 0.0
bl702+wifi FLASH 834846 835062 216 0.0
RAM 124541 124541 0 0.0
bl706+mfd+rpc+littlefs FLASH 1066676 1066882 206 0.0
RAM 117349 117349 0 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 896114 896064 -50 -0.0
RAM 105644 105652 8 0.0
lighting-app bl702l+mfd+littlefs FLASH 979828 979778 -50 -0.0
RAM 109828 109828 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 766848 766888 40 0.0
RAM 103320 103320 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 778452 778492 40 0.0
RAM 108488 108488 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 724120 724096 -24 -0.0
RAM 96884 96884 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 708436 708460 24 0.0
RAM 97092 97092 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 550602 550586 -16 -0.0
RAM 205080 205080 0 0.0
lock CC3235SF_LAUNCHXL FLASH 582910 582942 32 0.0
RAM 205296 205296 0 0.0
efr32 lock-app BRD4187C FLASH 957840 957856 16 0.0
RAM 126512 126512 0 0.0
BRD4338a FLASH 752392 752336 -56 -0.0
RAM 251856 251856 0 0.0
window-app BRD4187C FLASH 1050460 1050388 -72 -0.0
RAM 122708 122708 0 0.0
esp32 all-clusters-app c3devkit DRAM 102288 102288 0 0.0
FLASH 1750338 1750406 68 0.0
IRAM 83862 83862 0 0.0
m5stack DRAM 121156 121156 0 0.0
FLASH 1698878 1698870 -8 -0.0
IRAM 117051 117051 0 0.0
linux air-purifier-app debug unknown 4864 4864 0 0.0
FLASH 2590376 2589408 -968 -0.0
RAM 116808 116632 -176 -0.2
all-clusters-app debug unknown 5688 5688 0 0.0
FLASH 5979354 5978596 -758 -0.0
RAM 534808 534664 -144 -0.0
all-clusters-minimal-app debug unknown 5536 5536 0 0.0
FLASH 5205732 5204914 -818 -0.0
RAM 228088 227912 -176 -0.1
bridge-app debug unknown 5568 5568 0 0.0
FLASH 4592066 4591278 -788 -0.0
RAM 208432 208272 -160 -0.1
camera-app debug unknown 8992 8992 0 0.0
FLASH 6793899 6791499 -2400 -0.0
RAM 231968 231840 -128 -0.1
camera-controller debug unknown 9216 9216 0 0.0
FLASH 13643819 13644939 1120 0.0
RAM 668992 668960 -32 -0.0
chip-tool debug unknown 6264 6264 0 0.0
FLASH 13694443 13694275 -168 -0.0
RAM 655872 655848 -24 -0.0
chip-tool-ipv6only arm64 unknown 40736 40736 0 0.0
FLASH 12721623 12721479 -144 -0.0
RAM 690848 690824 -24 -0.0
closure-app debug unknown 5536 5536 0 0.0
FLASH 4573782 4573052 -730 -0.0
RAM 200328 200184 -144 -0.1
fabric-admin debug unknown 5944 5944 0 0.0
FLASH 12039218 12039050 -168 -0.0
RAM 654920 654888 -32 -0.0
fabric-bridge-app debug unknown 4816 4816 0 0.0
FLASH 4390914 4390190 -724 -0.0
RAM 194096 193904 -192 -0.1
fabric-sync debug unknown 5056 5056 0 0.0
FLASH 5475861 5475125 -736 -0.0
RAM 493936 493760 -176 -0.0
lighting-app debug+rpc+ui unknown 6280 6280 0 0.0
FLASH 5478081 5477361 -720 -0.0
RAM 209744 209584 -160 -0.1
lock-app debug unknown 5496 5496 0 0.0
FLASH 4619614 4618858 -756 -0.0
RAM 196952 196760 -192 -0.1
ota-provider-app debug unknown 4856 4856 0 0.0
FLASH 4249684 4248866 -818 -0.0
RAM 185552 185360 -192 -0.1
ota-requestor-app debug unknown 4736 4736 0 0.0
FLASH 4312896 4312110 -786 -0.0
RAM 188376 188184 -192 -0.1
shell debug unknown 4312 4312 0 0.0
FLASH 2932371 2932355 -16 -0.0
RAM 148584 148504 -80 -0.1
thermostat-no-ble arm64 unknown 9976 9976 0 0.0
FLASH 4227567 4226559 -1008 -0.0
RAM 226568 226416 -152 -0.1
tv-app debug unknown 5824 5824 0 0.0
FLASH 5804229 5803477 -752 -0.0
RAM 618312 618104 -208 -0.0
tv-casting-app debug unknown 5352 5352 0 0.0
FLASH 11833349 11832741 -608 -0.0
RAM 772528 772400 -128 -0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 909684 909708 24 0.0
RAM 152824 152824 0 0.0
nxp contact mcxw71+release FLASH 627120 630368 3248 0.5
RAM 64012 64076 64 0.1
lock mcxw71+release FLASH 737312 740552 3240 0.4
RAM 65096 65160 64 0.1
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1657900 1657828 -72 -0.0
RAM 211144 211144 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1579460 1579428 -32 -0.0
RAM 208416 208416 0 0.0
light cy8ckit_062s2_43012 FLASH 1450604 1450532 -72 -0.0
RAM 197144 197144 0 0.0
lock cy8ckit_062s2_43012 FLASH 1482940 1482868 -72 -0.0
RAM 224856 224856 0 0.0
qpg lighting-app qpg6200+debug FLASH 819560 819560 0 0.0
RAM 127600 127600 0 0.0
lock-app qpg6200+debug FLASH 756836 756900 64 0.0
RAM 118552 118552 0 0.0
stm32 light STM32WB5MM-DK FLASH 466532 466564 32 0.0
RAM 141320 141320 0 0.0
telink bridge-app tl7218x FLASH 703720 703840 120 0.0
RAM 93544 93544 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl3218x FLASH 795510 795632 122 0.0
RAM 43960 43960 0 0.0
light-app-ota-shell-factory-data tl7218x FLASH 783916 784038 122 0.0
RAM 100848 100848 0 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 711514 711632 118 0.0
RAM 54180 54180 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 748108 748226 118 0.0
RAM 77336 77336 0 0.0
light-switch-app-ota-factory-data tl3218x_retention FLASH 724834 724952 118 0.0
RAM 36936 36936 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 604776 604898 122 0.0
RAM 112512 112512 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 819520 819646 126 0.0
RAM 99100 99100 0 0.0
tizen all-clusters-app arm unknown 5184 5184 0 0.0
FLASH 1767812 1767372 -440 -0.0
RAM 92212 92100 -112 -0.1
chip-tool-ubsan arm unknown 20772 20772 0 0.0
FLASH 21107706 21107330 -376 -0.0
RAM 9181408 9181228 -180 -0.0

@fabian-imig fabian-imig marked this pull request as draft August 7, 2025 15:29
@fabian-imig fabian-imig marked this pull request as ready for review August 8, 2025 12:51
@Copilot Copilot AI review requested due to automatic review settings August 8, 2025 12:51
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR fixes issues found in Matter 1.5 TE1 for the closure control test cases by improving step skipping logic and correcting test procedure flows. The changes focus on replacing multiple individual step skips with range-based skipping and adding missing test steps for proper latching behavior validation.

Key changes:

  • Replace multiple skip_step() calls with mark_step_range_skipped() for cleaner code
  • Add missing test steps (5m-5u, 9b-9i, 10b-10i) to properly test latching behavior scenarios
  • Fix logic for conditional step execution based on latch control modes and current latch state

Reviewed Changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 8 comments.

File Description
TC_CLCTRL_4_4.py Replaces multiple skip_step calls with mark_step_range_skipped for cleaner step skipping
TC_CLCTRL_4_3.py Major refactoring adding missing test steps and fixing latching behavior test logic
TC_CLCTRL_4_2.py Replaces multiple skip_step calls with mark_step_range_skipped for consistency

Copy link

github-actions bot commented Aug 8, 2025

PR #40465: Size comparison from 9f409ce to cac9eb9

Full report (57 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section 9f409ce cac9eb9 change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1104636 1104636 0 0.0
RAM 179066 179066 0 0.0
bl702 lighting-app bl702+eth FLASH 657270 657270 0 0.0
RAM 134929 134929 0 0.0
bl702+wifi FLASH 835062 835062 0 0.0
RAM 124541 124541 0 0.0
bl706+mfd+rpc+littlefs FLASH 1066976 1066976 0 0.0
RAM 117349 117349 0 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 896158 896158 0 0.0
RAM 105652 105652 0 0.0
lighting-app bl702l+mfd+littlefs FLASH 979872 979872 0 0.0
RAM 109828 109828 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 766632 766632 0 0.0
RAM 103328 103328 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 778228 778228 0 0.0
RAM 108496 108496 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 723832 723832 0 0.0
RAM 96892 96892 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 708188 708188 0 0.0
RAM 97100 97100 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 550586 550586 0 0.0
RAM 205080 205080 0 0.0
lock CC3235SF_LAUNCHXL FLASH 582942 582942 0 0.0
RAM 205296 205296 0 0.0
efr32 lock-app BRD4187C FLASH 957920 957920 0 0.0
RAM 126512 126512 0 0.0
BRD4338a FLASH 752336 752336 0 0.0
RAM 251856 251856 0 0.0
window-app BRD4187C FLASH 1050220 1050220 0 0.0
RAM 122708 122708 0 0.0
esp32 all-clusters-app c3devkit DRAM 102288 102288 0 0.0
FLASH 1750406 1750406 0 0.0
IRAM 83862 83862 0 0.0
m5stack DRAM 121156 121156 0 0.0
FLASH 1698870 1698870 0 0.0
IRAM 117051 117051 0 0.0
linux air-purifier-app debug unknown 4864 4864 0 0.0
FLASH 2588242 2588242 0 0.0
RAM 116664 116664 0 0.0
all-clusters-app debug unknown 5688 5688 0 0.0
FLASH 5977460 5977460 0 0.0
RAM 534696 534696 0 0.0
all-clusters-minimal-app debug unknown 5536 5536 0 0.0
FLASH 5203746 5203746 0 0.0
RAM 227944 227944 0 0.0
bridge-app debug unknown 5568 5568 0 0.0
FLASH 4590144 4590144 0 0.0
RAM 208304 208304 0 0.0
camera-app debug unknown 9008 9008 0 0.0
FLASH 6883307 6883307 0 0.0
RAM 233128 233128 0 0.0
camera-controller debug unknown 9216 9216 0 0.0
FLASH 13644715 13644715 0 0.0
RAM 668960 668960 0 0.0
chip-tool debug unknown 6264 6264 0 0.0
FLASH 13694091 13694091 0 0.0
RAM 655880 655880 0 0.0
chip-tool-ipv6only arm64 unknown 40736 40736 0 0.0
FLASH 12721239 12721239 0 0.0
RAM 690840 690840 0 0.0
closure-app debug unknown 5536 5536 0 0.0
FLASH 4571918 4571918 0 0.0
RAM 200216 200216 0 0.0
fabric-admin debug unknown 5944 5944 0 0.0
FLASH 12038864 12038864 0 0.0
RAM 654888 654888 0 0.0
fabric-bridge-app debug unknown 4816 4816 0 0.0
FLASH 4389056 4389056 0 0.0
RAM 193968 193968 0 0.0
fabric-sync debug unknown 5056 5056 0 0.0
FLASH 5474917 5474917 0 0.0
RAM 493760 493760 0 0.0
lighting-app debug+rpc+ui unknown 6280 6280 0 0.0
FLASH 5476193 5476193 0 0.0
RAM 209616 209616 0 0.0
lock-app debug unknown 5496 5496 0 0.0
FLASH 4618858 4618858 0 0.0
RAM 196760 196760 0 0.0
ota-provider-app debug unknown 4856 4856 0 0.0
FLASH 4247732 4247732 0 0.0
RAM 185424 185424 0 0.0
ota-requestor-app debug unknown 4736 4736 0 0.0
FLASH 4310944 4310944 0 0.0
RAM 188248 188248 0 0.0
shell debug unknown 4312 4312 0 0.0
FLASH 2932179 2932179 0 0.0
RAM 148504 148504 0 0.0
thermostat-no-ble arm64 unknown 9976 9976 0 0.0
FLASH 4226495 4226495 0 0.0
RAM 226464 226464 0 0.0
tv-app debug unknown 5824 5824 0 0.0
FLASH 5803237 5803237 0 0.0
RAM 618104 618104 0 0.0
tv-casting-app debug unknown 5352 5352 0 0.0
FLASH 11831541 11831541 0 0.0
RAM 772432 772432 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 909772 909772 0 0.0
RAM 152832 152832 0 0.0
nxp contact mcxw71+release FLASH 630440 630440 0 0.0
RAM 64084 64084 0 0.0
lock mcxw71+release FLASH 740632 740632 0 0.0
RAM 65168 65168 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1657828 1657828 0 0.0
RAM 211144 211144 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1579428 1579428 0 0.0
RAM 208416 208416 0 0.0
light cy8ckit_062s2_43012 FLASH 1450532 1450532 0 0.0
RAM 197144 197144 0 0.0
lock cy8ckit_062s2_43012 FLASH 1482868 1482868 0 0.0
RAM 224856 224856 0 0.0
qpg lighting-app qpg6200+debug FLASH 819296 819296 0 0.0
RAM 127608 127608 0 0.0
lock-app qpg6200+debug FLASH 756628 756628 0 0.0
RAM 118560 118560 0 0.0
stm32 light STM32WB5MM-DK FLASH 466276 466276 0 0.0
RAM 141336 141336 0 0.0
telink bridge-app tl7218x FLASH 703758 703758 0 0.0
RAM 93552 93552 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl3218x FLASH 795550 795550 0 0.0
RAM 43968 43968 0 0.0
light-app-ota-shell-factory-data tl7218x FLASH 783956 783956 0 0.0
RAM 100856 100856 0 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 711550 711550 0 0.0
RAM 54188 54188 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 748144 748144 0 0.0
RAM 77344 77344 0 0.0
light-switch-app-ota-factory-data tl3218x_retention FLASH 724870 724870 0 0.0
RAM 36944 36944 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 604898 604898 0 0.0
RAM 112512 112512 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 819560 819564 4 0.0
RAM 99108 99108 0 0.0
tizen all-clusters-app arm unknown 5184 5184 0 0.0
FLASH 1767192 1767192 0 0.0
RAM 92108 92108 0 0.0
chip-tool-ubsan arm unknown 20772 20772 0 0.0
FLASH 21106682 21106682 0 0.0
RAM 9181152 9181152 0 0.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[TC-CLCTRL-4.3] Test never receives subscription report in step 8i if DUT is already unlatched
6 participants