Description
Description
UBLOX_EVK_ODIN_W2 target crashes in our nightly CI when running network-wifi test. We have not seen this earlier as the test was running inside of a rf shielded box. Now the tests are running in a very noisy environment which most probably causes these crashes when the Odin tries to connect to the network. I can reproduce the crash from line 1826 when I re-run the test inside the test farm. Does not reproduce on my desk (not enough noise I guess).
More common crash:
[1560302096.85][CONN][RXD] >>> Running case #9: 'WIFI-CONNECT-PARAMS-VALID-UNSECURE'...
[1560302096.98][CONN][INF] found KV pair in stream: {{__testcase_start;WIFI-CONNECT-PARAMS-VALID-UNSECURE}}, queued...
[1560302134.33][CONN][RXD]
[1560302134.33][CONN][RXD]
[1560302134.33][CONN][RXD] ++ MbedOS Error Info ++
[1560302134.43][CONN][RXD] Error Status: 0x80FF0144 Code: 324 Module: 255
[1560302134.43][CONN][RXD] Error Message: Assertion failed: msg != NULL
[1560302134.53][CONN][RXD] Location: 0x0
[1560302134.63][CONN][RXD] File: ./targets/TARGET_STM/TARGET_STM32F4/TARGET_STM32F439xI/TARGET_MODULE_UBLOX_ODIN_W2/sdk/ublox-odin-w2-drivers/OdinWiFiInterface.cpp+1826
[1560302134.63][CONN][RXD] Error Value: 0x0
[1560302134.83][CONN][RXD] Current Thread: application_unnamed_thread Id: 0x20010E08 Entry: 0x80E44C1 StackSize: 0x1000 StackMem: 0x20010E60 SP: 0x20011D08
[1560302134.94][CONN][RXD] For more info, visit: https://mbed.com/s/error?error=0x80FF0144&osver=999999&core=0x410FC241&comp=3&ver=8032001&tgt=UBLOX_EVK_...
[1560302134.94][CONN][RXD]
[1560302134.94][CONN][RXD] -- MbedOS Error Info --
[1560302134.94][CONN][RXD]
[1560302135.03][CONN][RXD] = System will be rebooted due to a fatal error =
This crash has happened only in CI runs:
[1560301680.70][CONN][RXD] >>> Running case #9: 'WIFI-CONNECT-PARAMS-VALID-UNSECURE'...
[1560301680.70][CONN][INF] found KV pair in stream: {{__testcase_start;WIFI-CONNECT-PARAMS-VALID-UNSECURE}}, queued...
[1560301708.56][CONN][RXD]
[1560301708.56][CONN][RXD]
[1560301708.56][CONN][RXD] ++ MbedOS Error Info ++
[1560301708.66][CONN][RXD] Error Status: 0x80FF0144 Code: 324 Module: 255
[1560301708.66][CONN][RXD] Error Message: Assertion failed: msg != NULL
[1560301708.66][CONN][RXD] Location: 0x801A1A3
[1560301708.86][CONN][RXD] File: ./targets/TARGET_STM/TARGET_STM32F4/TARGET_STM32F439xI/TARGET_MODULE_UBLOX_ODIN_W2/sdk/ublox-odin-w2-drivers/OdinWiFiInterface.cpp+1596
[1560301708.86][CONN][RXD] Error Value: 0x0
[1560301708.96][CONN][RXD] Current Thread: application_unnamed_thread Id: 0x20010890 Entry: 0x8010799 StackSize: 0x1000 StackMem: 0x200108E8 SP: 0x20011490
[1560301709.16][CONN][RXD] For more info, visit: https://mbed.com/s/error?error=0x8003010F&osver=999999&core=0x410FC241&comp=1&ver=6110004&tgt=UBLOX_EVK_...
[1560301709.16][CONN][RXD]
[1560301709.16][CONN][RXD] -- MbedOS Error Info --
[1560301709.16][CONN][RXD]
[1560301709.16][CONN][RXD] = System will be rebooted due to a fatal error =
Edit - found one more crash:
[1560935800.92][CONN][RXD] >>> Running case #8: 'WIFI-GET-RSSI'...
[1560935801.02][CONN][INF] found KV pair in stream: {{__testcase_start;WIFI-GET-RSSI}}, queued...
[1560935823.68][CONN][RXD]
[1560935823.68][CONN][RXD]
[1560935823.76][CONN][RXD] ++ MbedOS Error Info ++
[1560935823.76][CONN][RXD] Error Status: 0x80FF0144 Code: 324 Module: 255
[1560935823.86][CONN][RXD] Error Message: Assertion failed: msg->type == ODIN_WIFI_MSG_USER_DISCONNECT
[1560935823.86][CONN][RXD] Location: 0x801A1A3
[1560935824.06][CONN][RXD] File: ./targets/TARGET_STM/TARGET_STM32F4/TARGET_STM32F439xI/TARGET_MODULE_UBLOX_ODIN_W2/sdk/ublox-odin-w2-drivers/OdinWiFiInterface.cpp+463
[1560935824.06][CONN][RXD] Error Value: 0x0
[1560935824.16][CONN][RXD] Current Thread: main Id: 0x2000BA60 Entry: 0x801A791 StackSize: 0x1000 StackMem: 0x200071D8 SP: 0x20008088
[1560935824.26][CONN][RXD] For more info, visit: https://mbed.com/s/error?error=0x80FF0144&osver=999999&core=0x410FC241&comp=1&ver=6110004&tgt=UBLOX_EVK_...
[1560935824.26][CONN][RXD]
[1560935824.36][CONN][RXD] -- MbedOS Error Info --
[1560935824.36][CONN][RXD]
[1560935824.36][CONN][RXD] = System will be rebooted due to a fatal error =
mbed-os version (master):
commit fc645bc3ed357743d4acf6714564b7f6291c6016 (HEAD -> master, origin/master, origin/HEAD)
Merge: ed69fc1 6df6dec
Author: Anna Bridge <Anna.Bridge@arm.com>
Date: Tue Jun 11 15:07:43 2019 +0100
Merge pull request #10805 from kjbracey-arm/armc5_blinky
Fix ARMC5 compilation
The crashes don't seem to be compiler or test case specific. I have seen these crashes with several different wifi tests cases from this same test suite.
How to reproduce:
Use a VERY noisy test environment for Wifi
Edit tools/test_configs/WiFiInterface.json and give proper values for:
wifi-secure-ssid
wifi-unsecure-ssid
wifi-password
wifi-ch-secure
wifi-ch-unsecure
mbed test --compile -t GCC_ARM -m UBLOX_EVK_ODIN_W2 -n tests-network-wifi --app-config=tools/test_configs/WiFiInterface.json -DMBED_HEAP_STATS_ENABLED=1 -DMBED_STACK_STATS_ENABLED=1 -DMBED_TRAP_ERRORS_ENABLED=1 -DMBED_ALL_STATS_ENABLED -DSKIP_TIME_DRIFT_TESTS=1
mbedgt -m UBLOX_EVK_ODIN_W2 -n tests-network-wifi -V
(crashes 2/3 times in our environment)
Issue request type
[ ] Question
[ ] Enhancement
[X] Bug