[CRASH] Occasional OpenSIPS crash #3596
Description
Hello Opensips team,
I'm seeing occasional crash of OpenSIPS which I can't relate to anything so far. We have traffic between TCP-TCP and TCP-UDP. We use topologhy hiding with Dialog module and RTPEngine.
opensips -V
version: opensips 3.5.2 (x86_64/linux)
flags: STATS: On, DISABLE_NAGLE, USE_MCAST, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC, HP_MALLOC, DBG_MALLOC, FAST_LOCK-ADAPTIVE_WAIT
ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535
poll method support: poll, epoll, sigio_rt, select.
git revision: b16e49c
main.c compiled on 10:04:43 Jan 21 2025 with cc 11
Output from messages.log
general protection fault ip:5ad9e5 sp:7ffcef193588 error:0 in opensips[419000+2bf000]
Started Process Core Dump (PID 2942072/UID 0).
Process 2723192 (opensips) of user 0 dumped core.#12#012Stack trace of thread 2723192:#12#0 0x00000000005ad9e5 fm_frag_size (opensips + 0x1ad9e5)#12#1 0x00007f2ec7372c11 _shm_free (dialog.so + 0x57c11)#12#2 0x00007f2ec73871f9 _unref_dlg (dialog.so + 0x6c1f9)#12#3 0x00007f2ec735d854 dlg_onreply (dialog.so + 0x42854)#12#4 0x00007f2ec73610a2 unreference_dialog_create (dialog.so + 0x460a2)#12#5 0x00007f2ec7d8e709 empty_tmcb_list (tm.so + 0x52709)#12#6 0x00007f2ec7d6017a free_cell (tm.so + 0x2417a)#12#7 0x00007f2ec7d92bf8 wait_handler (tm.so + 0x56bf8)#12#8 0x000000000053f01c handle_timer_job (opensips + 0x13f01c)#12#9 0x00000000006a44fb handle_io (opensips + 0x2a44fb)#12#10 0x00000000006a577e io_wait_loop_epoll (opensips + 0x2a577e)#12#11 0x000000000069d780 tcp_start_processes (opensips + 0x29d780)#12#12 0x000000000041d825 main_loop (opensips + 0x1d825)#12#13 0x00007f2ed7e295d0 __libc_start_call_main (libc.so.6 + 0x295d0)#12#14 0x00007f2ed7e29680 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x29680)#12#15 0x000000000041dfb5 _start (opensips + 0x1dfb5)#012ELF object binary architecture: AMD x86-64
Coredump file( reachable for 3 days, starting from 07.03.2025)
https://sendgb.com/bZSps94Mhv3
Operating System: CentOS Stream 9 5.14.0-539.el9.x86_64
OpenSIPS installation: As far as I remember From Git
Additional info;
I start opensips as follows.
/usr/local/sbin/opensips -m 1024 -M 128 -f /usr/local/etc/opensips/opensips.cfg
Output from top during high traffic times.
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
568678 root 20 0 1206660 17820 12032 S 0.0 0.2 0:05.07 opensips
3568679 root 20 0 1206660 17820 12032 S 0.0 0.2 0:05.17 opensips
3568680 root 20 0 1206660 17820 12032 S 0.0 0.2 0:05.51 opensips
3568686 root 20 0 1206660 17692 11904 S 0.0 0.2 0:06.68 opensips
3568685 root 20 0 1206660 17564 11776 S 0.0 0.2 0:06.13 opensips
3568689 root 20 0 1206660 17564 11776 S 0.0 0.2 0:09.49 opensips
3568687 root 20 0 1206660 17436 11648 S 0.0 0.2 0:07.46 opensips
3568690 root 20 0 1206660 17436 11648 S 0.0 0.2 0:11.36 opensips
3568688 root 20 0 1206660 17308 11520 S 0.0 0.2 0:08.52 opensips
3568684 root 20 0 1206660 16412 10624 S 0.0 0.2 0:05.70 opensips
3568683 root 20 0 1206660 16284 10496 S 0.0 0.2 0:05.35 opensips