xtensa-esp32-elf-gdb crash (IDFGH-353)

[v1993]

Environment

• Development Kit: noname
• Core (if using chip or module): ESP-WROOM-32
• IDF version (git rev-parse --short HEAD to get the commit id.): 30545f4
• Development Env: Eclipse
• Operating System: Ubuntu
• Power Supply: USB (5v via JTAG)

Problem Description

Debugger crashes when I try to debug my problem.

Expected Behavior

Debug my program.

Actual Behavior

Crash with error message.

Steps to repropduce

It is pretty complicated in my case…

Debug Logs

GNU gdb (crosstool-NG crosstool-ng-1.22.0-80-g6c4433a) 7.10
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "--host=x86_64-build_pc-linux-gnu --target=xtensa-esp32-elf".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word".


[New Remote target]

[New Thread 1073451264]
[New Thread 1073449364]
[New Thread 1073453920]
[New Thread 1073437004]
[New Thread 1073412744]
[New Thread 1073435616]
[New Thread 1073438136]
[Switching to Thread 1073447248]

Temporary breakpoint 5, app_main () at /home/v/compile/esp32-sound-vorbis-test/main/main.cpp:73
73	extern "C" void app_main(void) {

[New Thread 1073555376]
[Switching to Thread 1073555376]

Breakpoint 1, SoundVorbis::SoundProviderVorbis::task_code (this=0x3ffbdf80) at /home/v/compile/esp32-sound-vorbis-test/components/esp32-sound-vorbis/soundProviderVorbis.cpp:133
133			std::unique_lock<std::mutex> heapLock(heapUsed);
[Switching to Thread 1073412744]

Breakpoint 2, Sound::SoundMixer::soundCallback (this=0x3ffba148) at /home/v/compile/esp32-sound-vorbis-test/components/esp32-sound/soundMixer.cpp:170
170								if (sound->repeat) {
[Switching to Thread 1073555376]

Breakpoint 1, SoundVorbis::SoundProviderVorbis::task_code (this=0x3ffbdf80) at /home/v/compile/esp32-sound-vorbis-test/components/esp32-sound-vorbis/soundProviderVorbis.cpp:133
133			std::unique_lock<std::mutex> heapLock(heapUsed);
[Switching to Thread 1073412744]

Breakpoint 2, Sound::SoundMixer::soundCallback (this=0x3ffba148) at /home/v/compile/esp32-sound-vorbis-test/components/esp32-sound/soundMixer.cpp:170
170								if (sound->repeat) {
[Switching to Thread 1073555376]

Breakpoint 1, SoundVorbis::SoundProviderVorbis::task_code (this=0x3ffbdf80) at /home/v/compile/esp32-sound-vorbis-test/components/esp32-sound-vorbis/soundProviderVorbis.cpp:133
133			std::unique_lock<std::mutex> heapLock(heapUsed);
[Switching to Thread 1073412744]

Breakpoint 2, Sound::SoundMixer::soundCallback (this=0x3ffba148) at /home/v/compile/esp32-sound-vorbis-test/components/esp32-sound/soundMixer.cpp:170
170								if (sound->repeat) {
[Switching to Thread 1073555376]

Breakpoint 1, SoundVorbis::SoundProviderVorbis::task_code (this=0x3ffbdf80) at /home/v/compile/esp32-sound-vorbis-test/components/esp32-sound-vorbis/soundProviderVorbis.cpp:133
133			std::unique_lock<std::mutex> heapLock(heapUsed);
[Switching to Thread 1073412744]

Breakpoint 2, Sound::SoundMixer::soundCallback (this=0x3ffba148) at /home/v/compile/esp32-sound-vorbis-test/components/esp32-sound/soundMixer.cpp:170
170								if (sound->repeat) {
/builds/idf/crosstool-NG/.build/src/gdb-7.10/gdb/inline-frame.c:171: internal-error: inline_frame_this_id: Assertion `!frame_id_eq (*this_id, outer_frame_id)' failed.
A problem internal to GDB has been detected,
further debugging may prove unreliable.
Quit this debugging session? (y or n) [answered Y; input not from terminal]

This is a bug, please report it.  For instructions, see:
<http://www.gnu.org/software/gdb/bugs/>.

/builds/idf/crosstool-NG/.build/src/gdb-7.10/gdb/inline-frame.c:171: internal-error: inline_frame_this_id: Assertion `!frame_id_eq (*this_id, outer_frame_id)' failed.
A problem internal to GDB has been detected,
further debugging may prove unreliable.
Create a core file of GDB? (y or n) [answered Y; input not from terminal]

Other items if possible

None.

[igrr]

Linking #645 which is the same issue

[v1993]

Glad to see progress on it! How soon (about) it will be fixed?

[igrr]

There will be two steps: first, we will add an option (enabled by default) to ESP-IDF to wrap user provided task function into another function. This will mean that situation when inline function is called from outer stack frame (which is what makes gdb crash) will not occur. It will cost 16 bytes of stack and may be disabled in production builds. Timeline is likely next week.

The second step will be to update the tool chain, adding a patch for GDB to handle this case correctly. Since we are also updating GCC to 8.2, this will be a pretty big change, and we are holding it off until IDF 4.0 to reduce the chance of breaking user applications. Timeline for this is TBD, current plan is to have IDF 4.0 released late this year or early 2019.

[v1993]

I know about gcc's __attribute__((noinline)). Which functions should be marked with it to do debugging just fine before fix?

[igrr]

Well, hard to say without looking at your task code. You can add -fno-inline-functions to CFLAGS or CXXFLAGS of the file where your task is defined. E.g. in your component.mk:

myfile.o: CFLAGS += -fno-inline-functions

[v1993]

Ok, thank you. Should I noinline only functions which are passed to xCreateTask or some other too? BTW, my project is opensource and can be found here: https://github.com/v1993/esp32-sound/tree/dev

[v1993]

@igrr I'm trying to continue debugging now. Now there is new error message:

/builds/idf/crosstool-NG/.build/src/gdb-7.10/gdb/inline-frame.c:343: internal-error: skip_inline_frames: Assertion `find_inline_frame_state (ptid) == NULL' failed.

How can I overpass this one? I think that it is same issue.

[v1993]

@igrr Even after adding -fno-inline-functions to all files (via Makefile.projbuild) I still can't view stack of one my task. Same error as before:

/builds/idf/crosstool-NG/.build/src/gdb-7.10/gdb/inline-frame.c:171: internal-error: inline_frame_this_id: Assertion `!frame_id_eq (*this_id, outer_frame_id)' failed.
A problem internal to GDB has been detected,
further debugging may prove unreliable.
Quit this debugging session? (y or n) [answered Y; input not from terminal]

This is a bug, please report it.  For instructions, see:
<http://www.gnu.org/software/gdb/bugs/>.

/builds/idf/crosstool-NG/.build/src/gdb-7.10/gdb/inline-frame.c:171: internal-error: inline_frame_this_id: Assertion `!frame_id_eq (*this_id, outer_frame_id)' failed.
A problem internal to GDB has been detected,
further debugging may prove unreliable.
Create a core file of GDB? (y or n) [answered Y; input not from terminal]

[igrr]

@v1993 is that task also part of the code repository you have linked above? Can you please point which task is that?

[v1993]

@iggr task code can be found here: https://github.com/v1993/esp32-sound-vorbis/blob/master/soundProviderVorbis.cpp

And xTaskCreate can be found here: https://github.com/v1993/esp32-sound/blob/dev/soundProviderTask.cpp

[igrr]

Thanks @v1993. Can you please point to the top level project used to compile this component, and sdkconfig file used? I see https://github.com/v1993/esp32-sound-pcm-test repository on your Github page which looks like it uses same components, do you see the issue with this project as well?