[Bug] Test Step Skipped for TC_OVENOPSTATE_2_5 - "Test Step Not Applicable" Repeatedly Skipped During Execution in UI

[Rajashreekalmane]

Describe the bug

While executing the Python test case TC_OVENOPSTATE_2_5 in UI, the test steps related to starting the Python test are repeatedly skipped with the message "Test Step Not Applicable: Start Python test".

Steps to reproduce the behavior

From the Test-Harness user interface loaded the Oven Cavity Operational State Cluster Test Plan.xml PICS file to select the test cases.
Selected the TC_OVENOPSTATE_2_5 Python test case to executed.
Executed the below mentioned command to put DUT into a commissionable state, ././chip-all-clusters-app
Click the Start button on Test-Harness user interface.

Expected behavior

TC should execute successfully without error.

Log files

TC-OVENOPSTATE-2.5.log

PICS file

Oven Cavity Operational State Cluster Test Plan.zip

Screenshots

Environment

Version: v2.11-beta3+fall2024
Sha: f52d40a

Additional Information

No response

[rquidute]

Hi @Rajashreekalmane could you try running this test again? It seems this test was updated in v2.11-beta3.1+fall2024 version.
You can update the branch using this command: ./scripts/ubuntu/auto-update.sh v2.11-beta3.1+fall2024

[Rajashreekalmane]

@rquidute As you suggested, I validated the test case in v2.11-beta3.1+fall2024 but received the same response as before

UI_Test_Run_2024_10_03_13_04_12.log

Project configuration :
{
"config": {
"test_parameters": {
"int-arg": "PIXIT.WAITTIME.REBOOT:100",
"timeout": 1000,
"endpoint": "1"
},
"network": {
"wifi": {
"ssid": "testharness",
"password": "wifi-password"
},
"thread": {
"rcp_serial_path": "/dev/ttyACM0",
"rcp_baudrate": 115200,
"on_mesh_prefix": "fd11:22::/64",
"network_interface": "eth0",
"dataset": {
"channel": "15",
"panid": "0x1234",
"extpanid": "1111111122222222",
"networkkey": "00112233445566778899aabbccddeeff",
"networkname": "DEMO"
},
"otbr_docker_image": null
}
},
"dut_config": {
"discriminator": "3840",
"setup_code": "20202021",
"pairing_mode": "onnetwork",
"chip_timeout": null,
"chip_use_paa_certs": false,
"trace_log": true
}
},
"pics": {
"clusters": {
"Oven Cavity Operational State Cluster Test Plan": {
"name": "Oven Cavity Operational State Cluster Test Plan",
"items": {
"OVENOPSTATE.S": {
"number": "OVENOPSTATE.S",
"enabled": true
},
"OVENOPSTATE.C": {
"number": "OVENOPSTATE.C",
"enabled": true
},
"OVENOPSTATE.S.A0000": {
"number": "OVENOPSTATE.S.A0000",
"enabled": true
},
"OVENOPSTATE.S.A0001": {
"number": "OVENOPSTATE.S.A0001",
"enabled": true
},
"OVENOPSTATE.S.A0002": {
"number": "OVENOPSTATE.S.A0002",
"enabled": true
},
"OVENOPSTATE.S.A0003": {
"number": "OVENOPSTATE.S.A0003",
"enabled": true
},
"OVENOPSTATE.S.A0004": {
"number": "OVENOPSTATE.S.A0004",
"enabled": true
},
"OVENOPSTATE.S.A0005": {
"number": "OVENOPSTATE.S.A0005",
"enabled": true
},
"OVENOPSTATE.S.E00": {
"number": "OVENOPSTATE.S.E00",
"enabled": true
},
"OVENOPSTATE.S.E01": {
"number": "OVENOPSTATE.S.E01",
"enabled": true
},
"OVENOPSTATE.S.C04.Tx": {
"number": "OVENOPSTATE.S.C04.Tx",
"enabled": true
},
"OVENOPSTATE.S.C00.Rsp": {
"number": "OVENOPSTATE.S.C00.Rsp",
"enabled": true
},
"OVENOPSTATE.S.C01.Rsp": {
"number": "OVENOPSTATE.S.C01.Rsp",
"enabled": true
},
"OVENOPSTATE.S.C02.Rsp": {
"number": "OVENOPSTATE.S.C02.Rsp",
"enabled": true
},
"OVENOPSTATE.S.C03.Rsp": {
"number": "OVENOPSTATE.S.C03.Rsp",
"enabled": true
},
"OVENOPSTATE.S.M.ST_STOPPED": {
"number": "OVENOPSTATE.S.M.ST_STOPPED",
"enabled": true
},
"OVENOPSTATE.S.M.ST_RUNNING": {
"number": "OVENOPSTATE.S.M.ST_RUNNING",
"enabled": true
},
"OVENOPSTATE.S.M.ST_PAUSED": {
"number": "OVENOPSTATE.S.M.ST_PAUSED",
"enabled": true
},
"OVENOPSTATE.S.M.ST_ERROR": {
"number": "OVENOPSTATE.S.M.ST_ERROR",
"enabled": true
},
"OVENOPSTATE.S.M.ERR_NO_ERROR": {
"number": "OVENOPSTATE.S.M.ERR_NO_ERROR",
"enabled": true
},
"OVENOPSTATE.S.M.ERR_UNABLE_TO_START_OR_RESUME": {
"number": "OVENOPSTATE.S.M.ERR_UNABLE_TO_START_OR_RESUME",
"enabled": true
},
"OVENOPSTATE.S.M.ERR_UNABLE_TO_COMPLETE_OPERATION": {
"number": "OVENOPSTATE.S.M.ERR_UNABLE_TO_COMPLETE_OPERATION",
"enabled": true
},
"OVENOPSTATE.S.M.ERR_COMMAND_INVALID_IN_STATE": {
"number": "OVENOPSTATE.S.M.ERR_COMMAND_INVALID_IN_STATE",
"enabled": true
}
}
}
}
}
}

Reference app used as DUT: ./chip-all-clusters-app

[fabiowmm]

@rquidute what's the status here?

[rquidute]

There already a PR with pending review: project-chip/certification-tool-backend#154