ARM_BEETLE_SOC tests fail - GCC OoB RC#1

[MarceloSalazar]

Version: https://github.com/mbedmicro/mbed/releases/tag/mbed-os-5.1.0-rc1
GCC toolchain
Target: ARM_BEETLE_SOC
Host OS: Windows 7

+------------------------+----------------+--------------------------------------------------------------------------------------+---------+--------------------+-------------+
| target                 | platform_name  | test suite                                                                           | result  | elapsed_time (sec) | copy_method |
+------------------------+----------------+--------------------------------------------------------------------------------------+---------+--------------------+-------------+
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-basic_test                        | TIMEOUT | 72.15              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-basic_test_default                | TIMEOUT | 72.15              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_async_validate               | TIMEOUT | 72.12              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_control_async                | TIMEOUT | 72.13              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_control_repeat               | TIMEOUT | 72.1               | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_selection                    | TIMEOUT | 85.97              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_setup_failure                | TIMEOUT | 72.14              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_teardown_failure             | TIMEOUT | 72.1               | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-control_type                      | TIMEOUT | 72.08              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_async_scheduler           | TIMEOUT | 72.13              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | OK      | 29.58              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-test_assertion_failure_test_setup | TIMEOUT | 72.14              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-test_setup_case_selection_failure | TIMEOUT | 72.11              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-test_setup_failure                | TIMEOUT | 72.14              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-integration-basic                                                      | TIMEOUT | 72.12              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-integration-threaded_blinky                                            | TIMEOUT | 72.16              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-c_strings                                                 | TIMEOUT | 72.11              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-callback                                                  | TIMEOUT | 72.17              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-dev_null                                                  | TIMEOUT | 72.14              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-echo                                                      | TIMEOUT | 72.16              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-generic_tests                                             | TIMEOUT | 72.12              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-rtc                                                       | TIMEOUT | 72.09              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-stl_features                                              | TIMEOUT | 72.09              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-ticker                                                    | TIMEOUT | 72.1               | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-timeout                                                   | TIMEOUT | 72.16              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-wait_us                                                   | TIMEOUT | 72.12              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-mbed-attributes                                              | TIMEOUT | 72.13              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-mbed-call_before_main                                        | TIMEOUT | 72.16              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-mbed-cpp                                                     | TIMEOUT | 72.14              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-mbed-div                                                     | TIMEOUT | 72.12              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-basic                                              | TIMEOUT | 72.09              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-isr                                                | TIMEOUT | 72.07              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-mail                                               | TIMEOUT | 72.16              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-mutex                                              | TIMEOUT | 72.14              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-queue                                              | TIMEOUT | 72.14              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-semaphore                                          | TIMEOUT | 72.14              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-signals                                            | TIMEOUT | 72.14              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-threads                                            | TIMEOUT | 72.13              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-timer                                              | TIMEOUT | 72.15              | shell       |
+------------------------+----------------+--------------------------------------------------------------------------------------+---------+--------------------+-------------+
mbedgt: test suite results: 1 OK / 38 TIMEOUT
mbedgt: test case report:
+------------------------+----------------+--------------------------------------------------------------------------------------+----------------------------------------------------------------------
----------------+--------+--------+--------+--------------------+
| target                 | platform_name  | test suite                                                                           | test case
                | passed | failed | result | elapsed_time (sec) |
+------------------------+----------------+--------------------------------------------------------------------------------------+----------------------------------------------------------------------
----------------+--------+--------+--------+--------------------+
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-basic_test                        | mbed-os-features-frameworks-utest-tests-unit_tests-basic_test
                | 0      | 1      | ERROR  | 72.15              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-basic_test_default                | mbed-os-features-frameworks-utest-tests-unit_tests-basic_test_default
                | 0      | 1      | ERROR  | 72.15              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_async_validate               | mbed-os-features-frameworks-utest-tests-unit_tests-case_async_validat
e               | 0      | 1      | ERROR  | 72.12              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_control_async                | mbed-os-features-frameworks-utest-tests-unit_tests-case_control_async
                | 0      | 1      | ERROR  | 72.13              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_control_repeat               | mbed-os-features-frameworks-utest-tests-unit_tests-case_control_repea
t               | 0      | 1      | ERROR  | 72.1               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_selection                    | mbed-os-features-frameworks-utest-tests-unit_tests-case_selection
                | 0      | 1      | ERROR  | 85.97              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_setup_failure                | mbed-os-features-frameworks-utest-tests-unit_tests-case_setup_failure
                | 0      | 1      | ERROR  | 72.14              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-case_teardown_failure             | mbed-os-features-frameworks-utest-tests-unit_tests-case_teardown_fail
ure             | 0      | 1      | ERROR  | 72.1               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-control_type                      | mbed-os-features-frameworks-utest-tests-unit_tests-control_type
                | 0      | 1      | ERROR  | 72.08              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_async_scheduler           | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_async_sche
duler           | 0      | 1      | ERROR  | 72.13              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 1
                | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 2
                | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 3
                | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 4
                | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 5
                | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 6
                | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 7
                | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 8
                | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-test_assertion_failure_test_setup | mbed-os-features-frameworks-utest-tests-unit_tests-test_assertion_fai
lure_test_setup | 0      | 1      | ERROR  | 72.14              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-test_setup_case_selection_failure | mbed-os-features-frameworks-utest-tests-unit_tests-test_setup_case_se
lection_failure | 0      | 1      | ERROR  | 72.11              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-features-frameworks-utest-tests-unit_tests-test_setup_failure                | mbed-os-features-frameworks-utest-tests-unit_tests-test_setup_failure
                | 0      | 1      | ERROR  | 72.14              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-integration-basic                                                      | mbed-os-tests-integration-basic
                | 0      | 1      | ERROR  | 72.12              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-integration-threaded_blinky                                            | mbed-os-tests-integration-threaded_blinky
                | 0      | 1      | ERROR  | 72.16              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-c_strings                                                 | mbed-os-tests-mbed_drivers-c_strings
                | 0      | 1      | ERROR  | 72.11              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-callback                                                  | mbed-os-tests-mbed_drivers-callback
                | 0      | 1      | ERROR  | 72.17              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-dev_null                                                  | mbed-os-tests-mbed_drivers-dev_null
                | 0      | 1      | ERROR  | 72.14              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-echo                                                      | mbed-os-tests-mbed_drivers-echo
                | 0      | 1      | ERROR  | 72.16              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-generic_tests                                             | mbed-os-tests-mbed_drivers-generic_tests
                | 0      | 1      | ERROR  | 72.12              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-rtc                                                       | mbed-os-tests-mbed_drivers-rtc
                | 0      | 1      | ERROR  | 72.09              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-stl_features                                              | mbed-os-tests-mbed_drivers-stl_features
                | 0      | 1      | ERROR  | 72.09              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-ticker                                                    | mbed-os-tests-mbed_drivers-ticker
                | 0      | 1      | ERROR  | 72.1               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-timeout                                                   | mbed-os-tests-mbed_drivers-timeout
                | 0      | 1      | ERROR  | 72.16              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-wait_us                                                   | mbed-os-tests-mbed_drivers-wait_us
                | 0      | 1      | ERROR  | 72.12              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-mbed-attributes                                              | mbed-os-tests-mbedmicro-mbed-attributes
                | 0      | 1      | ERROR  | 72.13              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-mbed-call_before_main                                        | mbed-os-tests-mbedmicro-mbed-call_before_main
                | 0      | 1      | ERROR  | 72.16              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-mbed-cpp                                                     | mbed-os-tests-mbedmicro-mbed-cpp
                | 0      | 1      | ERROR  | 72.14              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-mbed-div                                                     | mbed-os-tests-mbedmicro-mbed-div
                | 0      | 1      | ERROR  | 72.12              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-basic                                              | mbed-os-tests-mbedmicro-rtos-mbed-basic
                | 0      | 1      | ERROR  | 72.09              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-isr                                                | mbed-os-tests-mbedmicro-rtos-mbed-isr
                | 0      | 1      | ERROR  | 72.07              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-mail                                               | mbed-os-tests-mbedmicro-rtos-mbed-mail
                | 0      | 1      | ERROR  | 72.16              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-mutex                                              | mbed-os-tests-mbedmicro-rtos-mbed-mutex
                | 0      | 1      | ERROR  | 72.14              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-queue                                              | mbed-os-tests-mbedmicro-rtos-mbed-queue
                | 0      | 1      | ERROR  | 72.14              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-semaphore                                          | mbed-os-tests-mbedmicro-rtos-mbed-semaphore
                | 0      | 1      | ERROR  | 72.14              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-signals                                            | mbed-os-tests-mbedmicro-rtos-mbed-signals
                | 0      | 1      | ERROR  | 72.14              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-threads                                            | mbed-os-tests-mbedmicro-rtos-mbed-threads
                | 0      | 1      | ERROR  | 72.13              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbedmicro-rtos-mbed-timer                                              | mbed-os-tests-mbedmicro-rtos-mbed-timer
                | 0      | 1      | ERROR  | 72.15              |
+------------------------+----------------+--------------------------------------------------------------------------------------+----------------------------------------------------------------------
----------------+--------+--------+--------+--------------------+
mbedgt: test case results: 8 OK / 38 ERROR
mbedgt: completed in 2784.56 sec

[0xc0170]

cc @fvincenzo

[fvincenzo]

@MarceloSalazar @abhishek-pandit

To me looks like that the board in your case was not recognized properly.

My configuration:
Version: https://github.com/mbedmicro/mbed/releases/tag/mbed-os-5.1.0-rc1
GCC toolchain
Target: ARM_BEETLE_SOC
Host OS: Windows 7

mbedgt: test suite report:
+------------------------+----------------+-------------------------------------------------------------------------------------------+---------+--------------------+-------------+
| target                 | platform_name  | test suite                                                                                | result  | elapsed_time (sec) | copy_method |
+------------------------+----------------+-------------------------------------------------------------------------------------------+---------+--------------------+-------------+
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-basic_test                        | OK      | 20.93              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-basic_test_default                | OK      | 21.08              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_async_validate               | OK      | 22.71              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_async                | OK      | 29.01              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_repeat               | OK      | 22.96              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_selection                    | OK      | 20.85              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_setup_failure                | OK      | 21.47              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_teardown_failure             | OK      | 21.51              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-control_type                      | OK      | 21.99              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_async_scheduler           | OK      | 21.83              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | OK      | 22.52              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-test_assertion_failure_test_setup | OK      | 20.74              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-test_setup_case_selection_failure | OK      | 20.69              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-test_setup_failure                | OK      | 20.72              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-integration-basic                                                      | OK      | 19.93              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-integration-threaded_blinky                                            | OK      | 39.91              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-c_strings                                                 | OK      | 22.79              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | OK      | 27.58              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-dev_null                                                  | OK      | 23.89              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-echo                                                      | OK      | 31.88              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-generic_tests                                             | OK      | 21.78              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-rtc                                                       | OK      | 32.15              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-stl_features                                              | OK      | 22.39              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-ticker                                                    | FAIL    | 80.21              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-timeout                                                   | TIMEOUT | 78.64              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-wait_us                                                   | OK      | 30.62              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-attributes                                              | OK      | 22.65              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-call_before_main                                        | OK      | 20.61              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-cpp                                                     | OK      | 20.77              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-div                                                     | OK      | 20.74              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-basic                                              | OK      | 34.98              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-isr                                                | OK      | 25.68              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-mail                                               | OK      | 22.32              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-mutex                                              | OK      | 30.93              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-queue                                              | OK      | 22.18              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-semaphore                                          | OK      | 28.07              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-signals                                            | OK      | 25.78              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | OK      | 26.09              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-timer                                              | OK      | 34.97              | shell       |
+------------------------+----------------+-------------------------------------------------------------------------------------------+---------+--------------------+-------------+
mbedgt: test suite results: 1 FAIL / 37 OK / 1 TIMEOUT
mbedgt: test case report:
+------------------------+----------------+-------------------------------------------------------------------------------------------+--------------------------------------------------------+--------+--------+--------+--------------------+
| target                 | platform_name  | test suite                                                                                | test case                                              | passed | failed | result | elapsed_time (sec) |
+------------------------+----------------+-------------------------------------------------------------------------------------------+--------------------------------------------------------+--------+--------+--------+--------------------+
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-basic_test                        | Repeating Test                                         | 2      | 0      | OK     | 0.08               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-basic_test                        | Simple Test                                            | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-basic_test_default                | Repeating Test                                         | 2      | 0      | OK     | 0.09               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-basic_test_default                | Simple Test                                            | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_async_validate               | Validate: Attributed Validation: Cancel Repeat         | 1      | 0      | OK     | 0.18               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_async_validate               | Validate: Attributed Validation: Enable Repeat Handler | 2      | 0      | OK     | 0.18               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_async_validate               | Validate: Multiple Premature Validation                | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_async_validate               | Validate: Multiple Validation                          | 1      | 0      | OK     | 0.16               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_async_validate               | Validate: Premature Validation                         | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_async_validate               | Validate: Simple Validation                            | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_async                | Control: Await                                         | 1      | 0      | OK     | 1.41               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_async                | Control: CaseNext                                      | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_async                | Control: NoTimeout                                     | 1      | 0      | OK     | 0.03               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_async                | Control: RepeatAllOnTimeout                            | 1      | 0      | OK     | 0.11               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_async                | Control: RepeatHandlerOnTimeout                        | 1      | 0      | OK     | 1.62               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_async                | Control: Timeout (Failure)                             | 1      | 0      | OK     | 0.22               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_async                | Control: Timeout (Success)                             | 1      | 0      | OK     | 0.17               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_repeat               | Control: CaseNext                                      | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_repeat               | Control: NoRepeat                                      | 1      | 0      | OK     | 0.03               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_repeat               | Control: RepeatAll                                     | 10     | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_control_repeat               | Control: RepeatHandler                                 | 10     | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_selection                    | Case 1                                                 | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_selection                    | Case 2                                                 | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_selection                    | Case 3                                                 | 1      | 0      | OK     | 0.02               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_setup_failure                | Setup handler returns ABORT                            | 1      | 0      | OK     | 0.13               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_setup_failure                | Setup handler returns CONTINUE                         | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_setup_failure                | Setup handler returns IGNORE                           | 1      | 0      | OK     | 0.14               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_teardown_failure             | Teardown handler returns ABORT                         | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_teardown_failure             | Teardown handler returns ABORT but is IGNORED          | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-case_teardown_failure             | Teardown handler returns CONTINUE                      | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-control_type                      | Testing combinations of different group                | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-control_type                      | Testing combinations of same group                     | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-control_type                      | Testing constants                                      | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-control_type                      | Testing constructors                                   | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_async_scheduler           | Minimal Scheduler: Async Case 4 (Failure)              | 0      | 0      | OK     | 0.34               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_async_scheduler           | Minimal Scheduler: Case 1                              | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_async_scheduler           | Minimal Scheduler: Case 2                              | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_async_scheduler           | Minimal Scheduler: Case 3                              | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 1                              | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 2                              | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 3                              | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 4                              | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 5                              | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 6                              | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 7                              | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-minimal_scheduler                 | Minimal Scheduler: Case 8                              | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-test_assertion_failure_test_setup | dummy test                                             | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-test_setup_case_selection_failure | dummy test                                             | 1      | 0      | OK     | 0.03               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-test_setup_case_selection_failure | dummy test 2                                           | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-test_setup_failure                | dummy test                                             | 1      | 0      | OK     | 0.03               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-features-frameworks-utest-tests-unit_tests-test_setup_failure                | dummy test 2                                           | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-integration-basic                                                      | mbed-os-core-tests-integration-basic                   | 1      | 0      | OK     | 19.93              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-integration-threaded_blinky                                            | mbed-os-core-tests-integration-threaded_blinky         | 1      | 0      | OK     | 39.91              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-c_strings                                                 | C strings: %e %E float formatting                      | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-c_strings                                                 | C strings: %f %f float formatting                      | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-c_strings                                                 | C strings: %g %g float formatting                      | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-c_strings                                                 | C strings: %i %d integer formatting                    | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-c_strings                                                 | C strings: %u %d integer formatting                    | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-c_strings                                                 | C strings: %x %E integer formatting                    | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-c_strings                                                 | C strings: strpbrk                                     | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-c_strings                                                 | C strings: strtok                                      | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing FunctionPointer compatibility                  | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing FunctionPointerArg1 compatibility              | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 0 ints                          | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 0 uchars                        | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 0 uint64s                       | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 1 ints                          | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 1 uchars                        | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 1 uint64s                       | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 2 ints                          | 1      | 0      | OK     | 0.08               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 2 uchars                        | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 2 uint64s                       | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 3 ints                          | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 3 uchars                        | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 3 uint64s                       | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 4 ints                          | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 4 uchars                        | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 4 uint64s                       | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 5 ints                          | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 5 uchars                        | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-callback                                                  | Testing callbacks with 5 uint64s                       | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-dev_null                                                  | mbed-os-core-tests-mbed_drivers-dev_null               | 1      | 0      | OK     | 23.89              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-echo                                                      | Echo server: x16                                       | 1      | 0      | OK     | 1.62               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-echo                                                      | Echo server: x32                                       | 1      | 0      | OK     | 3.16               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-echo                                                      | Echo server: x64                                       | 1      | 0      | OK     | 6.22               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-generic_tests                                             | Basic                                                  | 1      | 0      | OK     | 0.01               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-generic_tests                                             | Blinky                                                 | 1      | 0      | OK     | 0.02               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-generic_tests                                             | C++ heap                                               | 1      | 0      | OK     | 0.1                |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-generic_tests                                             | C++ stack                                              | 1      | 0      | OK     | 0.15               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-rtc                                                       | RTC strftime                                           | 1      | 0      | OK     | 10.4               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-stl_features                                              | STL std::equal                                         | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-stl_features                                              | STL std::sort abs                                      | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-stl_features                                              | STL std::sort greater                                  | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-stl_features                                              | STL std::transform                                     | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-ticker                                                    | Timers: 1x ticker                                      | 1      | 0      | OK     | 11.04              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-ticker                                                    | Timers: 2x tickers                                     | 0      | 0      | ERROR  | 0.0                |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-timeout                                                   | mbed-os-core-tests-mbed_drivers-timeout                | 0      | 1      | ERROR  | 78.64              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-wait_us                                                   | Timers: wait_us                                        | 1      | 0      | OK     | 10.19              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-attributes                                              | Testing ALIGN attribute                                | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-attributes                                              | Testing DEPRECATED attribute                           | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-attributes                                              | Testing FORCEINLINE attribute                          | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-attributes                                              | Testing NORETURN attribute                             | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-attributes                                              | Testing PACKED attribute                               | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-attributes                                              | Testing PURE attribute                                 | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-attributes                                              | Testing UNREACHABLE attribute                          | 1      | 0      | OK     | 0.08               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-attributes                                              | Testing UNUSED attribute                               | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-attributes                                              | Testing WEAK attribute                                 | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-call_before_main                                        | mbed-os-core-tests-mbedmicro-mbed-call_before_main     | 1      | 0      | OK     | 20.61              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-cpp                                                     | mbed-os-core-tests-mbedmicro-mbed-cpp                  | 1      | 0      | OK     | 20.77              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-mbed-div                                                     | mbed-os-core-tests-mbedmicro-mbed-div                  | 1      | 0      | OK     | 20.74              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-basic                                              | mbed-os-core-tests-mbedmicro-rtos-mbed-basic           | 1      | 0      | OK     | 34.98              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-isr                                                | mbed-os-core-tests-mbedmicro-rtos-mbed-isr             | 1      | 0      | OK     | 25.68              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-mail                                               | mbed-os-core-tests-mbedmicro-rtos-mbed-mail            | 1      | 0      | OK     | 22.32              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-mutex                                              | mbed-os-core-tests-mbedmicro-rtos-mbed-mutex           | 1      | 0      | OK     | 30.93              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-queue                                              | mbed-os-core-tests-mbedmicro-rtos-mbed-queue           | 1      | 0      | OK     | 22.18              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-semaphore                                          | mbed-os-core-tests-mbedmicro-rtos-mbed-semaphore       | 1      | 0      | OK     | 28.07              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-signals                                            | mbed-os-core-tests-mbedmicro-rtos-mbed-signals         | 1      | 0      | OK     | 25.78              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing parallel threads                               | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing parallel threads with child                    | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing parallel threads with murder                   | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing parallel threads with wait                     | 1      | 0      | OK     | 0.16               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing parallel threads with yield                    | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing serial threads                                 | 1      | 0      | OK     | 0.04               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing serial threads with child                      | 1      | 0      | OK     | 0.09               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing serial threads with murder                     | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing serial threads with wait                       | 1      | 0      | OK     | 1.08               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing serial threads with yield                      | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing single thread                                  | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing single thread with child                       | 1      | 0      | OK     | 0.05               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing single thread with murder                      | 1      | 0      | OK     | 0.07               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing single thread with wait                        | 1      | 0      | OK     | 0.17               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-threads                                            | Testing single thread with yield                       | 1      | 0      | OK     | 0.06               |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbedmicro-rtos-mbed-timer                                              | mbed-os-core-tests-mbedmicro-rtos-mbed-timer           | 1      | 0      | OK     | 34.97              |
+------------------------+----------------+-------------------------------------------------------------------------------------------+--------------------------------------------------------+--------+--------+--------+--------------------+
mbedgt: test case results: 131 OK / 2 ERROR

[fvincenzo]

@0xc0170

I noticed that with the latest rc I have two errors:

• ticker
• timeout

They were working before the latest changes in mbed-os. What did it change?

| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-ticker                                           | OK      | 32.03              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-timeout                                          | OK      | 31.93              | shell       |

[PrzemekWirkus]

@fvincenzo Vincenzo, can you try runnig just these two tests?

$ mbedgt -V -n mbed-os-core-tests-mbed_drivers-ticker,mbed-os-core-tests-mbed_drivers-timeout

Maybe there is something with the serial, test tools.

[fvincenzo]

@PrzemekWirkus

I obtain this:

$ mbedgt -V -n mbed-os-core-tests-mbed_drivers-ticker,mbed-os-core-tests-mbed_drivers-timeout
mbedgt: greentea should be run inside a Yotta module or --test-spec switch should be used.
mbedgt: completed in 0.00 sec
mbedgt: exited with code -1

[PrzemekWirkus]

@fvincenzo Maybe you need a newer Greentea, something like v1.0.2 onwards.

This is what I did on mbedmicro:

C:\Work\mbed>$ git remote --verbose
origin  https://github.com/mbedmicro/mbed.git (fetch)
origin  https://github.com/mbedmicro/mbed.git (push)

C:\Work\mbed>$ mbed test --compile -t GCC_ARM -m K64F

C:\Work\mbed>$mbedgt -V -n tests-mbed_drivers-timeout
mbedgt: greentea test automation tool ver. 1.2.0
mbedgt: using multiple test specifications from current directory!
        using '.build\tests\K64F\GCC_ARM\test_spec.json'
mbedgt: detecting connected mbed-enabled devices...

[PrzemekWirkus]

Oh, I think the test names changed...

[fvincenzo]

This is what I see (the mbedgt now works now :) ):

$ mbedgt -V -n mbed-os-core-tests-mbed_drivers-ticker
mbedgt: greentea test automation tool ver. 1.2.0
mbedgt: using multiple test specifications from current directory!
        using '.build\tests\ARM_BEETLE_SOC\GCC_ARM\test_spec.json'
mbedgt: detecting connected mbed-enabled devices...
mbedgt: detected 1 device
        +----------------+----------------------+-------------+-------------+--------------------------+
        | platform_name  | platform_name_unique | serial_port | mount_point | target_id                |
        +----------------+----------------------+-------------+-------------+--------------------------+
        | ARM_BEETLE_SOC | ARM_BEETLE_SOC[0]    | COM27       | F:          | 500302030C48FD3AF1B452C1 |
        +----------------+----------------------+-------------+-------------+--------------------------+
mbedgt: processing target 'ARM_BEETLE_SOC' toolchain 'GCC_ARM' compatible platforms... (note: switch set to --parallel 1)
        +----------------+----------------------+-------------+-------------+--------------------------+
        | platform_name  | platform_name_unique | serial_port | mount_point | target_id                |
        +----------------+----------------------+-------------+-------------+--------------------------+
        | ARM_BEETLE_SOC | ARM_BEETLE_SOC[0]    | COM27:9600  | F:          | 500302030C48FD3AF1B452C1 |
        +----------------+----------------------+-------------+-------------+--------------------------+
mbedgt: test case filter (specified with -n option)
        test filtered in 'mbed-os-core-tests-mbed_drivers-ticker'
mbedgt: running 1 test for platform 'ARM_BEETLE_SOC' and toolchain 'GCC_ARM'
        use 1 instance of execution threads for testing
mbedgt: checking for 'host_tests' directory above image directory structure
        'host_tests' directory not found: two directory levels above image path checked
mbedgt: selecting test case observer...
        calling mbedhtrun: mbedhtrun -m ARM_BEETLE_SOC -p COM27:9600 -f ".build/tests/ARM_BEETLE_SOC/GCC_ARM/mbed-os/core/TESTS/mbed_drivers/ticker/ticker.bin" -d F: -C 4 -c shell -t 500302030C48FD3AF1B452C1
mbedgt: mbed-host-test-runner: started
[1469714254.65][HTST][INF] host test executor ver. 1.1.0
[1469714254.65][HTST][INF] copy image onto target...
[1469714254.65][COPY][INF] Waiting up to 60 sec for '500302030C48FD3AF1B452C1' mount point (current is 'F:')...
        1 file(s) copied.
[1469714272.81][HTST][INF] starting host test process...
[1469714273.14][CONN][INF] starting connection process...
[1469714273.14][CONN][INF] notify event queue about extra 60 sec timeout for serial port pooling
[1469714273.14][CONN][INF] initializing serial port listener...
[1469714273.15][HTST][INF] setting timeout to: 60 sec
[1469714273.15][SERI][INF] serial(port=COM27, baudrate=9600, timeout=0)
[1469714273.15][PLGN][INF] Waiting up to 60 sec for '500302030C48FD3AF1B452C1' serial port (current is 'COM27')...
[1469714273.19][SERI][INF] reset device using 'default' plugin...
[1469714273.44][SERI][INF] waiting 1.00 sec after reset
[1469714274.44][SERI][INF] wait for it...
[1469714274.44][SERI][TXD] mbedmbedmbedmbedmbedmbedmbedmbedmbedmbed
[1469714274.44][CONN][INF] sending up to 2 __sync packets (specified with --sync=2)
[1469714274.44][CONN][INF] sending preamble '846a47d7-3553-40e5-affe-82c1a9e899c6'
[1469714274.44][SERI][TXD] {{__sync;846a47d7-3553-40e5-affe-82c1a9e899c6}}
[1469714274.58][CONN][RXD] {{__sync;846a47d7-3553-40e5-affe-82c1a9e899c6}}
[1469714274.58][CONN][INF] found SYNC in stream: {{__sync;846a47d7-3553-40e5-affe-82c1a9e899c6}} it is #0 sent, queued...
[1469714274.58][HTST][INF] sync KV found, uuid=846a47d7-3553-40e5-affe-82c1a9e899c6, timestamp=1469714274.584000
[1469714274.60][CONN][RXD] {{__version;1.3.0}}
[1469714274.61][HTST][INF] DUT greentea-client version: 1.3.0
[1469714274.61][CONN][INF] found KV pair in stream: {{__version;1.3.0}}, queued...
[1469714274.62][CONN][RXD] {{__timeout;60}}
[1469714274.62][HTST][INF] setting timeout to: 60 sec
[1469714274.62][CONN][INF] found KV pair in stream: {{__timeout;60}}, queued...
[1469714274.66][CONN][RXD] {{__host_test_name;wait_us_auto}}
[1469714274.66][CONN][INF] found KV pair in stream: {{__host_test_name;wait_us_auto}}, queued...
[1469714274.66][HTST][INF] host test class: '<class 'mbed_host_tests.host_tests.wait_us_auto.WaitusTest'>'
[1469714274.66][HTST][INF] host test setup() call...
[1469714274.66][HTST][INF] CALLBACKs updated
[1469714274.66][HTST][INF] host test detected: wait_us_auto
[1469714274.68][CONN][RXD] {{__testcase_count;3}}
[1469714274.68][CONN][INF] found KV pair in stream: {{__testcase_count;3}}, queued...
[1469714274.71][CONN][RXD] >>> Running 3 test cases...
[1469714274.77][CONN][RXD] {{__testcase_name;Timers: 1x ticker}}
[1469714274.77][CONN][INF] found KV pair in stream: {{__testcase_name;Timers: 1x ticker}}, queued...
[1469714274.79][CONN][RXD] {{__testcase_name;Timers: 2x tickers}}
[1469714274.79][CONN][INF] found KV pair in stream: {{__testcase_name;Timers: 2x tickers}}, queued...
[1469714274.83][CONN][RXD] {{__testcase_name;Timers: 2x callbacks}}
[1469714274.83][CONN][INF] found KV pair in stream: {{__testcase_name;Timers: 2x callbacks}}, queued...
[1469714274.88][CONN][RXD] >>> Running case #1: 'Timers: 1x ticker'...
[1469714274.92][CONN][RXD] {{__testcase_start;Timers: 1x ticker}}
[1469714274.92][CONN][INF] found KV pair in stream: {{__testcase_start;Timers: 1x ticker}}, queued...
[1469714275.93][CONN][RXD] {{tick;0}}
[1469714275.93][CONN][INF] found KV pair in stream: {{tick;0}}, queued...
[1469714275.93][HTST][INF] tick! 1469714275.93
[1469714276.93][CONN][RXD] {{tick;1}}
[1469714276.93][CONN][INF] found KV pair in stream: {{tick;1}}, queued...
[1469714276.93][HTST][INF] tick! 1469714276.93
[1469714277.95][CONN][RXD] {{tick;2}}
[1469714277.95][CONN][INF] found KV pair in stream: {{tick;2}}, queued...
[1469714277.95][HTST][INF] tick! 1469714277.95
[1469714278.95][CONN][RXD] {{tick;3}}
[1469714278.95][CONN][INF] found KV pair in stream: {{tick;3}}, queued...
[1469714278.95][HTST][INF] tick! 1469714278.95
[1469714279.94][CONN][RXD] {{tick;4}}
[1469714279.94][CONN][INF] found KV pair in stream: {{tick;4}}, queued...
[1469714279.94][HTST][INF] tick! 1469714279.94
[1469714280.94][CONN][RXD] {{tick;5}}
[1469714280.94][CONN][INF] found KV pair in stream: {{tick;5}}, queued...
[1469714280.95][HTST][INF] tick! 1469714280.94
[1469714281.94][CONN][RXD] {{tick;6}}
[1469714281.94][CONN][INF] found KV pair in stream: {{tick;6}}, queued...
[1469714281.94][HTST][INF] tick! 1469714281.94
[1469714282.93][CONN][RXD] {{tick;7}}
[1469714282.93][CONN][INF] found KV pair in stream: {{tick;7}}, queued...
[1469714282.93][HTST][INF] tick! 1469714282.93
[1469714283.93][CONN][RXD] {{tick;8}}
[1469714283.93][CONN][INF] found KV pair in stream: {{tick;8}}, queued...
[1469714283.93][HTST][INF] tick! 1469714283.93
[1469714284.94][CONN][RXD] {{tick;9}}
[1469714284.94][CONN][INF] found KV pair in stream: {{tick;9}}, queued...
[1469714284.94][HTST][INF] tick! 1469714284.94
[1469714285.97][CONN][RXD] {{__testcase_finish;Timers: 1x ticker;1;0}}
[1469714285.97][CONN][INF] found KV pair in stream: {{__testcase_finish;Timers: 1x ticker;1;0}}, queued...
[1469714286.01][CONN][RXD] >>> 'Timers: 1x ticker': 1 passed, 0 failed
[1469714286.06][CONN][RXD] >>> Running case #2: 'Timers: 2x tickers'...
[1469714286.11][CONN][RXD] {{__testcase_start;Timers: 2x tickers}}
[1469714286.11][CONN][INF] found KV pair in stream: {{__testcase_start;Timers: 2x tickers}}, queued...
[1469714287.11][CONN][RXD] {{tick;1}}
[1469714287.11][CONN][INF] found KV pair in stream: {{tick;1}}, queued...
[1469714287.11][HTST][INF] tick! 1469714287.11
[1469714288.11][CONN][RXD] {{tick;2}}
[1469714288.11][CONN][INF] found KV pair in stream: {{tick;2}}, queued...
[1469714288.11][HTST][INF] tick! 1469714288.11
[1469714289.11][CONN][RXD] {{tick;3}}
[1469714289.11][CONN][INF] found KV pair in stream: {{tick;3}}, queued...
[1469714289.11][HTST][INF] tick! 1469714289.11
[1469714290.12][CONN][RXD] {{tick;4}}
[1469714290.12][CONN][INF] found KV pair in stream: {{tick;4}}, queued...
[1469714290.12][HTST][INF] tick! 1469714290.12
[1469714291.11][CONN][RXD] {{tick;5}}
[1469714291.11][CONN][INF] found KV pair in stream: {{tick;5}}, queued...
[1469714291.11][HTST][INF] tick! 1469714291.11
[1469714334.62][HTST][INF] test suite run finished after 60.00 sec...
[1469714334.62][CONN][INF] received special even '__host_test_finished' value='True', finishing
[1469714334.64][HTST][INF] CONN exited with code: 0
[1469714334.65][HTST][INF] No events in queue
[1469714334.65][HTST][INF] stopped consuming events
[1469714334.65][HTST][INF] host test result(): False
[1469714334.65][HTST][WRN] missing __exit event from DUT
[1469714334.65][HTST][INF] calling blocking teardown()
[1469714334.65][HTST][INF] teardown() finished
[1469714334.65][HTST][INF] {{result;failure}}
mbedgt: checking for GCOV data...
mbedgt: mbed-host-test-runner: stopped and returned 'FAIL'
mbedgt: test on hardware with target id: 500302030C48FD3AF1B452C1
mbedgt: test suite 'mbed-os-core-tests-mbed_drivers-ticker' .......................................... FAIL in 80.31 sec
        test case: 'Timers: 1x ticker' ............................................................... OK in 11.05 sec
        test case: 'Timers: 2x callbacks' ............................................................ SKIPPED in 0.00 sec
        test case: 'Timers: 2x tickers' .............................................................. ERROR in 0.00 sec
mbedgt: all tests finished!
mbedgt: shuffle seed: 0.8504098639
mbedgt: test suite report:
+------------------------+----------------+----------------------------------------+--------+--------------------+-------------+
| target                 | platform_name  | test suite                             | result | elapsed_time (sec) | copy_method |
+------------------------+----------------+----------------------------------------+--------+--------------------+-------------+
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-ticker | FAIL   | 80.31              | shell       |
+------------------------+----------------+----------------------------------------+--------+--------------------+-------------+
mbedgt: test suite results: 1 FAIL
mbedgt: test case report:
+------------------------+----------------+----------------------------------------+----------------------+--------+--------+---------+--------------------+
| target                 | platform_name  | test suite                             | test case            | passed | failed | result  | elapsed_time (sec) |
+------------------------+----------------+----------------------------------------+----------------------+--------+--------+---------+--------------------+
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-ticker | Timers: 1x ticker    | 1      | 0      | OK      | 11.05              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-ticker | Timers: 2x callbacks | 0      | 0      | SKIPPED | 0.0                |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-core-tests-mbed_drivers-ticker | Timers: 2x tickers   | 0      | 0      | ERROR   | 0.0                |
+------------------------+----------------+----------------------------------------+----------------------+--------+--------+---------+--------------------+
mbedgt: test case results: 1 SKIPPED / 1 OK / 1 ERROR
mbedgt: completed in 80.38 sec
mbedgt: exited with code 1

[PrzemekWirkus]

@fvincenzo I think someone refactored timer test to contain few timer/ticker tests. You fail on second one (Timers: 2x tickers).

[fvincenzo]

@PrzemekWirkus I will re-test when the test strategy on timers will be reported to the old one. Thanks for you help 👍

[bridadan]

@fvincenzo Thanks for reporting this. Like @PrzemekWirkus said, someone (me actually!) consolidated some the ticker tests to speed up testing a bit and to reduce the amount of duplicated code between the tests. This is the consolidated test case now: https://github.com/mbedmicro/mbed/blob/master/TESTS/mbed_drivers/ticker/main.cpp

The interesting thing from your test output is that the second test case inside the consolidate test stops halfway through, which seems like a legitimate issue. If you want, we can try and look at this offline on Skype or something.

[fvincenzo]

@bridadan it is ok for me, we can look at it if you think that it is a legitimate issue.

[ciarmcom]

ARM Internal Ref: IOTMORF-106

[fvincenzo]

@MarceloSalazar @bridadan @screamerbg I verified the tests with the latest mbed-os master code changes (PR: #2402) and everything works correctly. I think this ticket can be closed:

mbedgt: test suite report:
+------------------------+----------------+------------------------------------+--------+--------------------+-------------+
| target                 | platform_name  | test suite                         | result | elapsed_time (sec) | copy_method |
+------------------------+----------------+------------------------------------+--------+--------------------+-------------+
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-ticker  | OK     | 52.07              | shell       |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-timeout | OK     | 32.27              | shell       |
+------------------------+----------------+------------------------------------+--------+--------------------+-------------+
mbedgt: test suite results: 2 OK
mbedgt: test case report:
+------------------------+----------------+------------------------------------+-----------------------+--------+--------+--------+--------------------+
| target                 | platform_name  | test suite                         | test case             | passed | failed | result | elapsed_time (sec) |
+------------------------+----------------+------------------------------------+-----------------------+--------+--------+--------+--------------------+
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-ticker  | Timers: 1x ticker     | 1      | 0      | OK     | 11.04              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-ticker  | Timers: 2x callbacks  | 1      | 0      | OK     | 10.04              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-ticker  | Timers: 2x tickers    | 1      | 0      | OK     | 10.04              |
| ARM_BEETLE_SOC-GCC_ARM | ARM_BEETLE_SOC | mbed-os-tests-mbed_drivers-timeout | Timers: toggle on/off | 1      | 0      | OK     | 11.83              |
+------------------------+----------------+------------------------------------+-----------------------+--------+--------+--------+--------------------+
mbedgt: test case results: 4 OK
mbedgt: completed in 84.41 sec