Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TC WHM 2.1] - Implement test steps 5-9 #35596

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

PeterC1965
Copy link
Contributor

Fixing issue #35566

Implemented test steps 5 to 9.

Copy link

semanticdiff-com bot commented Sep 16, 2024

Review changes with SemanticDiff.

Analyzed 1 of 1 files.

Overall, the semantic diff is 14% smaller than the GitHub diff.

Filename Status
✔️ src/python_testing/TC_WHM_2_1.py 13.89% smaller

@github-actions github-actions bot added tests matter-1.4-te2-script-change Script changes before end of Matter 1.4 TE2 labels Sep 16, 2024
Copy link

github-actions bot commented Sep 16, 2024

PR #35596: Size comparison from 9de3c6b to 7fcd47c

Full report (82 builds for bl602, bl702, bl702l, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section 9de3c6b 7fcd47c change % change
bl602 lighting-app bl602 FLASH 1278156 1278156 0 0.0
RAM 95832 95832 0 0.0
bl602+mfd FLASH 1292266 1292266 0 0.0
RAM 95968 95968 0 0.0
bl602+rpc FLASH 1317120 1317120 0 0.0
RAM 104256 104256 0 0.0
bl702 lighting-app bl702 FLASH 943866 943866 0 0.0
RAM 15153 15153 0 0.0
bl702+mfd FLASH 946266 946266 0 0.0
RAM 15305 15305 0 0.0
bl702+rpc FLASH 1039186 1039186 0 0.0
RAM 24173 24173 0 0.0
bl706-eth FLASH 646062 646062 0 0.0
RAM 25241 25241 0 0.0
bl706-wifi FLASH 894064 894064 0 0.0
RAM 14477 14477 0 0.0
bl702l lighting-app bl702l FLASH 960526 960526 0 0.0
RAM 16812 16812 0 0.0
bl702l+mfd FLASH 963148 963148 0 0.0
RAM 16964 16964 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 677249 677249 0 0.0
RAM 78492 78492 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 697101 697101 0 0.0
RAM 81132 81132 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 697101 697101 0 0.0
RAM 81132 81132 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 654037 654037 0 0.0
RAM 73560 73560 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 613441 613441 0 0.0
RAM 71460 71460 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 633077 633077 0 0.0
RAM 74004 74004 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 633077 633077 0 0.0
RAM 74004 74004 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 632561 632561 0 0.0
RAM 74508 74508 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 652277 652277 0 0.0
RAM 77052 77052 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 652277 652277 0 0.0
RAM 77052 77052 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 607985 607985 0 0.0
RAM 68588 68588 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 627837 627837 0 0.0
RAM 71228 71228 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 627837 627837 0 0.0
RAM 71228 71228 0 0.0
efr32 lighting-app BRD4187C FLASH 932464 932464 0 0.0
RAM 135060 135060 0 0.0
lock-app BRD2605a FLASH 739956 739948 -8 -0.0
RAM 231212 231212 0 0.0
BRD4338a FLASH 740604 740596 -8 -0.0
RAM 231244 231244 0 0.0
window-app BRD4187C FLASH 1015500 1015492 -8 -0.0
RAM 127000 127000 0 0.0
esp32 all-clusters-app c3devkit DRAM 94160 94160 0 0.0
FLASH 1539514 1539514 0 0.0
IRAM 82538 82538 0 0.0
m5stack DRAM 115096 115096 0 0.0
FLASH 1549838 1549838 0 0.0
IRAM 117039 117039 0 0.0
linux air-purifier-app debug unknown 4688 4688 0 0.0
FLASH 2771107 2771107 0 0.0
RAM 128928 128928 0 0.0
all-clusters-app debug unknown 5456 5456 0 0.0
FLASH 6082602 6082602 0 0.0
RAM 514272 514272 0 0.0
all-clusters-minimal-app debug unknown 5352 5352 0 0.0
FLASH 5406690 5406690 0 0.0
RAM 240624 240624 0 0.0
bridge-app debug unknown 5336 5336 0 0.0
FLASH 4740170 4740170 0 0.0
RAM 217824 217824 0 0.0
chip-tool debug unknown 5888 5888 0 0.0
FLASH 12676228 12676228 0 0.0
RAM 562250 562250 0 0.0
chip-tool-ipv6only arm64 unknown 20384 20384 0 0.0
FLASH 11341508 11341508 0 0.0
RAM 612376 612376 0 0.0
fabric-admin debug unknown 5720 5720 0 0.0
FLASH 10978783 10978783 0 0.0
RAM 561306 561306 0 0.0
fabric-bridge-app debug unknown 4568 4568 0 0.0
FLASH 4562906 4562906 0 0.0
RAM 204440 204440 0 0.0
lighting-app debug+rpc+ui unknown 5984 5984 0 0.0
FLASH 5676481 5676481 0 0.0
RAM 228112 228112 0 0.0
lock-app debug unknown 5272 5272 0 0.0
FLASH 4789448 4789448 0 0.0
RAM 203912 203912 0 0.0
ota-provider-app debug unknown 4648 4648 0 0.0
FLASH 4422638 4422638 0 0.0
RAM 197616 197616 0 0.0
ota-requestor-app debug unknown 4584 4584 0 0.0
FLASH 4561382 4561382 0 0.0
RAM 202184 202184 0 0.0
shell debug unknown 4216 4216 0 0.0
FLASH 3107773 3107773 0 0.0
RAM 159432 159432 0 0.0
thermostat-no-ble arm64 unknown 9336 9336 0 0.0
FLASH 4333164 4333164 0 0.0
RAM 242256 242256 0 0.0
tv-app debug unknown 5552 5552 0 0.0
FLASH 6022133 6022133 0 0.0
RAM 587104 587104 0 0.0
tv-casting-app debug unknown 5208 5208 0 0.0
FLASH 10883805 10883805 0 0.0
RAM 650224 650224 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 915124 915124 0 0.0
RAM 142259 142259 0 0.0
nrf7002dk_nrf5340_cpuapp FLASH 886428 886428 0 0.0
RAM 140398 140398 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 846468 846468 0 0.0
RAM 141077 141077 0 0.0
nxp contact k32w0+release FLASH 580516 580516 0 0.0
RAM 70720 70720 0 0.0
k32w1+release FLASH 593264 593264 0 0.0
RAM 62560 62560 0 0.0
mcxw71+release FLASH 593016 593016 0 0.0
RAM 62560 62560 0 0.0
light k32w0+release FLASH 616312 616312 0 0.0
RAM 70184 70184 0 0.0
k32w1+release FLASH 679512 679512 0 0.0
RAM 48176 48176 0 0.0
mcxw71+release FLASH 679528 679528 0 0.0
RAM 48176 48176 0 0.0
lock k32w1+release FLASH 701824 701824 0 0.0
RAM 66716 66716 0 0.0
mcxw71+release FLASH 701832 701832 0 0.0
RAM 66716 66716 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1646908 1646908 0 0.0
RAM 210960 210960 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1550532 1550532 0 0.0
RAM 207672 207672 0 0.0
light cy8ckit_062s2_43012 FLASH 1466436 1466436 0 0.0
RAM 200672 200672 0 0.0
lock cy8ckit_062s2_43012 FLASH 1462956 1462956 0 0.0
RAM 225024 225024 0 0.0
qpg lighting-app qpg6105+debug FLASH 659084 659084 0 0.0
RAM 105220 105220 0 0.0
lock-app qpg6105+debug FLASH 616976 616976 0 0.0
RAM 99688 99688 0 0.0
stm32 light STM32WB5MM-DK FLASH 480560 480560 0 0.0
RAM 144676 144676 0 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 621704 621704 0 0.0
RAM 50964 50964 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 688206 688206 0 0.0
RAM 148388 148388 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 779888 779888 0 0.0
RAM 110756 110756 0 0.0
bridge-app tlsr9258a FLASH 680724 680724 0 0.0
RAM 91620 91620 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 621468 621468 0 0.0
RAM 50916 50916 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 707400 707400 0 0.0
RAM 74256 74256 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 624622 624622 0 0.0
RAM 144292 144292 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 810030 810030 0 0.0
RAM 99424 99424 0 0.0
lock-app-dfu tlsr9528a FLASH 655220 655220 0 0.0
RAM 66976 66976 0 0.0
ota-requestor-app tlsr9258a FLASH 696700 696700 0 0.0
RAM 91212 91212 0 0.0
pump-app-usb tlsr9518adk80d FLASH 633056 633056 0 0.0
RAM 55792 55792 0 0.0
pump-controller-app tlsr9518adk80d FLASH 610246 610246 0 0.0
RAM 53036 53036 0 0.0
shell tlsr9518adk80d FLASH 467176 467176 0 0.0
RAM 68668 68668 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 628246 628246 0 0.0
RAM 52636 52636 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 652382 652382 0 0.0
RAM 56584 56584 0 0.0
thermostat tlsr9518adk80d FLASH 636976 636976 0 0.0
RAM 53428 53428 0 0.0
window-covering tlsr9118bdk40d FLASH 523152 523152 0 0.0
RAM 97268 97268 0 0.0
tizen all-clusters-app arm unknown 4852 4852 0 0.0
FLASH 1724808 1724808 0 0.0
RAM 89516 89516 0 0.0
chip-tool-ubsan arm unknown 10284 10284 0 0.0
FLASH 17532010 17532010 0 0.0
RAM 7609740 7609740 0 0.0

Copy link

github-actions bot commented Sep 17, 2024

PR #35596: Size comparison from 9de3c6b to 0f52dbf

Full report (82 builds for bl602, bl702, bl702l, cyw30739, efr32, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section 9de3c6b 0f52dbf change % change
bl602 lighting-app bl602 FLASH 1278156 1278168 12 0.0
RAM 95832 95824 -8 -0.0
bl602+mfd FLASH 1292266 1292278 12 0.0
RAM 95968 95968 0 0.0
bl602+rpc FLASH 1317120 1317132 12 0.0
RAM 104256 104248 -8 -0.0
bl702 lighting-app bl702 FLASH 943866 943874 8 0.0
RAM 15153 15145 -8 -0.1
bl702+mfd FLASH 946266 946274 8 0.0
RAM 15305 15305 0 0.0
bl702+rpc FLASH 1039186 1039194 8 0.0
RAM 24173 24173 0 0.0
bl706-eth FLASH 646062 646070 8 0.0
RAM 25241 25233 -8 -0.0
bl706-wifi FLASH 894064 894082 18 0.0
RAM 14477 14477 0 0.0
bl702l lighting-app bl702l FLASH 960526 960534 8 0.0
RAM 16812 16804 -8 -0.0
bl702l+mfd FLASH 963148 963156 8 0.0
RAM 16964 16964 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 677249 677261 12 0.0
RAM 78492 78492 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 697101 697113 12 0.0
RAM 81132 81124 -8 -0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 697101 697113 12 0.0
RAM 81132 81124 -8 -0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 654037 654041 4 0.0
RAM 73560 73560 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 613441 613453 12 0.0
RAM 71460 71452 -8 -0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 633077 633081 4 0.0
RAM 74004 74004 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 633077 633081 4 0.0
RAM 74004 74004 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 632561 632573 12 0.0
RAM 74508 74500 -8 -0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 652277 652289 12 0.0
RAM 77052 77052 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 652277 652289 12 0.0
RAM 77052 77052 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 607985 607989 4 0.0
RAM 68588 68588 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 627837 627841 4 0.0
RAM 71228 71220 -8 -0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 627837 627841 4 0.0
RAM 71228 71220 -8 -0.0
efr32 lighting-app BRD4187C FLASH 932464 932468 4 0.0
RAM 135060 135056 -4 -0.0
lock-app BRD2605a FLASH 739956 739952 -4 -0.0
RAM 231212 231212 0 0.0
BRD4338a FLASH 740604 740600 -4 -0.0
RAM 231244 231244 0 0.0
window-app BRD4187C FLASH 1015500 1015536 36 0.0
RAM 127000 126996 -4 -0.0
esp32 all-clusters-app c3devkit DRAM 94160 94152 -8 -0.0
FLASH 1539514 1539526 12 0.0
IRAM 82538 82538 0 0.0
m5stack DRAM 115096 115096 0 0.0
FLASH 1549838 1549846 8 0.0
IRAM 117039 117039 0 0.0
linux air-purifier-app debug unknown 4688 4688 0 0.0
FLASH 2771107 2771233 126 0.0
RAM 128928 128944 16 0.0
all-clusters-app debug unknown 5456 5456 0 0.0
FLASH 6082602 6082726 124 0.0
RAM 514272 514288 16 0.0
all-clusters-minimal-app debug unknown 5352 5352 0 0.0
FLASH 5406690 5406782 92 0.0
RAM 240624 240640 16 0.0
bridge-app debug unknown 5336 5336 0 0.0
FLASH 4740170 4740294 124 0.0
RAM 217824 217840 16 0.0
chip-tool debug unknown 5888 5888 0 0.0
FLASH 12676228 1267635 126 0.0
RAM 562250 562282 32 0.0
chip-tool-ipv6only arm64 unknown 20384 20384 0 0.0
FLASH 11341508 11341604 96 0.0
RAM 612376 612384 8 0.0
fabric-admin debug unknown 5720 5720 0 0.0
FLASH 10978783 10978909 126 0.0
RAM 561306 561322 16 0.0
fabric-bridge-app debug unknown 4568 4568 0 0.0
FLASH 4562906 4563032 126 0.0
RAM 204440 204456 16 0.0
lighting-app debug+rpc+ui unknown 5984 5984 0 0.0
FLASH 5676481 5676609 128 0.0
RAM 228112 228128 16 0.0
lock-app debug unknown 5272 5272 0 0.0
FLASH 4789448 4789574 126 0.0
RAM 203912 203928 16 0.0
ota-provider-app debug unknown 4648 4648 0 0.0
FLASH 4422638 4422762 124 0.0
RAM 197616 197632 16 0.0
ota-requestor-app debug unknown 4584 4584 0 0.0
FLASH 4561382 4561508 126 0.0
RAM 202184 202200 16 0.0
shell debug unknown 4216 4216 0 0.0
FLASH 3107773 3107901 128 0.0
RAM 159432 159448 16 0.0
thermostat-no-ble arm64 unknown 9336 9336 0 0.0
FLASH 4333164 4333260 96 0.0
RAM 242256 242256 0 0.0
tv-app debug unknown 5552 5552 0 0.0
FLASH 6022133 6022261 128 0.0
RAM 587104 587088 -16 -0.0
tv-casting-app debug unknown 5208 5208 0 0.0
FLASH 10883805 10883805 0 0.0
RAM 650224 650256 32 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 915124 915124 0 0.0
RAM 142259 142259 0 0.0
nrf7002dk_nrf5340_cpuapp FLASH 886428 886440 12 0.0
RAM 140398 140398 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 846468 846468 0 0.0
RAM 141077 141077 0 0.0
nxp contact k32w0+release FLASH 580516 580520 4 0.0
RAM 70720 70720 0 0.0
k32w1+release FLASH 593264 593272 8 0.0
RAM 62560 62552 -8 -0.0
mcxw71+release FLASH 593016 593024 8 0.0
RAM 62560 62552 -8 -0.0
light k32w0+release FLASH 616312 616316 4 0.0
RAM 70184 70184 0 0.0
k32w1+release FLASH 679512 679512 0 0.0
RAM 48176 48176 0 0.0
mcxw71+release FLASH 679528 679528 0 0.0
RAM 48176 48176 0 0.0
lock k32w1+release FLASH 701824 701824 0 0.0
RAM 66716 66708 -8 -0.0
mcxw71+release FLASH 701832 701832 0 0.0
RAM 66716 66708 -8 -0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1646908 1646916 8 0.0
RAM 210960 210952 -8 -0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1550532 1550556 24 0.0
RAM 207672 207664 -8 -0.0
light cy8ckit_062s2_43012 FLASH 1466436 1466468 32 0.0
RAM 200672 200672 0 0.0
lock cy8ckit_062s2_43012 FLASH 1462956 1462988 32 0.0
RAM 225024 225024 0 0.0
qpg lighting-app qpg6105+debug FLASH 659084 659096 12 0.0
RAM 105220 105212 -8 -0.0
lock-app qpg6105+debug FLASH 616976 616988 12 0.0
RAM 99688 99688 0 0.0
stm32 light STM32WB5MM-DK FLASH 480560 480568 8 0.0
RAM 144676 144668 -8 -0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 621704 621708 4 0.0
RAM 50964 50964 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 688206 688210 4 0.0
RAM 148388 148388 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 779888 779892 4 0.0
RAM 110756 110756 0 0.0
bridge-app tlsr9258a FLASH 680724 680728 4 0.0
RAM 91620 91620 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 621468 621472 4 0.0
RAM 50916 50916 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 707400 707404 4 0.0
RAM 74256 74256 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 624622 624626 4 0.0
RAM 144292 144292 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 810030 810034 4 0.0
RAM 99424 99424 0 0.0
lock-app-dfu tlsr9528a FLASH 655220 655224 4 0.0
RAM 66976 66976 0 0.0
ota-requestor-app tlsr9258a FLASH 696700 696704 4 0.0
RAM 91212 91212 0 0.0
pump-app-usb tlsr9518adk80d FLASH 633056 633060 4 0.0
RAM 55792 55792 0 0.0
pump-controller-app tlsr9518adk80d FLASH 610246 610250 4 0.0
RAM 53036 53036 0 0.0
shell tlsr9518adk80d FLASH 467176 467176 0 0.0
RAM 68668 68668 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 628246 628436 190 0.0
RAM 52636 52636 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 652382 652386 4 0.0
RAM 56584 56584 0 0.0
thermostat tlsr9518adk80d FLASH 636976 636980 4 0.0
RAM 53428 53428 0 0.0
window-covering tlsr9118bdk40d FLASH 523152 523156 4 0.0
RAM 97268 97268 0 0.0
tizen all-clusters-app arm unknown 4852 4852 0 0.0
FLASH 1724808 1724840 32 0.0
RAM 89516 89524 8 0.0
chip-tool-ubsan arm unknown 10284 10284 0 0.0
FLASH 17532010 17532050 40 0.0
RAM 7609740 7609748 8 0.0

@@ -76,18 +77,37 @@ def pics_TC_WHM_2_1(self) -> list[str]:
@async_test_body
async def test_TC_WHM_2_1(self):

asserts.assert_true('PIXIT.WHM.MODE_CHANGE_OK' in self.matter_test_config.global_test_params,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we make these optional so that if they aren't specified then we just skip the tests. It will be more user friendly to allow them to be optional.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also I haven't confirmed if this is the correct way to get the PIXIT codes in - so would need to investigate how this works with the test harness

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I used src/python_testing/TC_RVCRUNM_2_1.py as an example implementation. So not quite sure what is good practice and what is not good practice....

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants