-
Notifications
You must be signed in to change notification settings - Fork 8.3k
Labels
area: SanitycheckSanitycheck has been renamed to TwisterSanitycheck has been renamed to TwisterbugThe issue is a bug, or the PR is fixing a bugThe issue is a bug, or the PR is fixing a bugpriority: highHigh impact/importance bugHigh impact/importance bug
Description
There are some tests that are required to be built for a certain set of platforms in order to verify that a set of changes of changes in a PR has not broken the code.
As an example, we can use tests/bluetooth/init. In those tests, there is a subset with a platform_allow set to a few Nordic platforms. For every PR (or at the very least whenever code in subsys/bluetooth is modified), those tests should be built for those nRF platforms. This is not the case today:
$ scripts/sanitycheck --integration -T tests/bluetooth/init/
INFO - Zephyr version: zephyr-v2.4.0-1254-gfbc487cce3
INFO - JOBS: 8
INFO - Selecting default platforms per test case
INFO - Building initial testcase list...
INFO - 40 test configurations selected, 11920 configurations discarded due to filters.
INFO - Adding tasks to the queue...
INFO - 0 of 0 tests passed (0.00%), 0 failed, 40 skipped with 0 warnings in 0.61 seconds
INFO - In total 0 test cases were executed on 1 out of total 299 platforms (0.33%)
INFO - 0 tests executed on platforms, 0 tests were only built.
Another example is building the MCUBoot tests for nRF platforms to avoid regressions, this is documented in #29397
nvlsianpu
Metadata
Metadata
Assignees
Labels
area: SanitycheckSanitycheck has been renamed to TwisterSanitycheck has been renamed to TwisterbugThe issue is a bug, or the PR is fixing a bugThe issue is a bug, or the PR is fixing a bugpriority: highHigh impact/importance bugHigh impact/importance bug