Opensips is crashing

[AnjanIpc]

sometimes opensips is crashing.

OpenSIPS version you are running

opensips -V
**version: opensips 2.4.4 (x86_64/linux)**
flags: STATS: On, DISABLE_NAGLE, USE_MCAST, SHM_MMAP, PKG_MALLOC, F_MALLOC, FAST_LOCK-ADAPTIVE_WAIT
ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535
poll method support: poll, epoll, sigio_rt, select.
git revision: a42226ccb
main.c compiled on 21:56:57 May  1 2020 with gcc 4.4.7

Crash Core Dump

Describe the traffic that generated the bug

To Reproduce

Relevant System Logs

OS/environment information

• Operating System: Red Hat Enterprise Linux Server release 6.9 (Santiago)
• other relevant information:

Additional context
when i look at the log, I can see the below logs.

2020-09-15T16:19:34.000-04:00 [local2] [debug] ny5-cp-ipcac-01.corp.schonfeld.com /usr/sbin/opensipsExternal[159653]: DBG:core:build_res_buf_from_sip_res: copied size: orig:159, new: 387, rest: 329 msg=
SIP/2.0 200 OK
To: sip:10.203.250.2:5061;tag=0d69e290
Via: SIP/2.0/TCP 127.0.0.1:5061;received=10.203.87.41;rport=33404
Record-Route: sip:10.203.250.2:5066;r2=on;lr
Record-Route: sip:10.203.250.2:5061;transport=tls;r2=on;lr
CSeq: 1 OPTIONS
Content-Length: 0
Accept: application/sdp
Supported: 100rel
Call-ID: 1234
Accept-Encoding: identity
From: sip:127.0.0.1:5061

2020-09-15T16:19:34.000-04:00 [local2] [debug] ny5-cp-ipcac-01.corp.schonfeld.com /usr/sbin/opensipsExternal[159653]: DBG:core:tcp_conn_get: con found in state 0
2020-09-15T16:19:34.000-04:00 [local2] [debug] ny5-cp-ipcac-01.corp.schonfeld.com /usr/sbin/opensipsExternal[159653]: DBG:core:tcp_conn_get: tcp connection found (0x7f0f79bf71e0), acquiring fd
2020-09-15T16:19:34.000-04:00 [local2] [debug] ny5-cp-ipcac-01.corp.schonfeld.com /usr/sbin/opensipsExternal[159653]: DBG:core:tcp_conn_get: c= 0x7f0f79bf71e0, n=16, Usock=39
2020-09-15T16:19:34.000-04:00 [local2] [debug] ny5-cp-ipcac-01.corp.schonfeld.com /usr/sbin/opensipsExternal[159659]: DBG:core:handle_worker: read response= 7f0f79bf71e0, 1, fd -1 from 5 (159653)
2020-09-15T16:19:34.000-04:00 [local2] [debug] ny5-cp-ipcac-01.corp.schonfeld.com /usr/sbin/opensipsExternal[159653]: DBG:core:tcp_conn_get: after receive_fd: c= 0x7f0f79bf71e0 n=8 fd=5
2020-09-15T16:19:34.000-04:00 [local2] [debug] ny5-cp-ipcac-01.corp.schonfeld.com /usr/sbin/opensipsExternal[159653]: DBG:core:proto_tcp_send: sending via fd 5...
2020-09-15T16:19:34.000-04:00 [local2] [crit] ny5-cp-ipcac-01.corp.schonfeld.com /usr/sbin/opensipsExternal[159653]: CRITICAL:core:sig_usr: segfault in process pid: 159653, id: 5
2020-09-15T16:19:34.000-04:00 [local2] [debug] ny5-cp-ipcac-01.corp.schonfeld.com /usr/sbin/opensipsExternal[159653]: DBG:core:restore_segv_handler: restoring SIGSEGV handler...
2020-09-15T16:19:34.000-04:00 [local2] [debug] ny5-cp-ipcac-01.corp.schonfeld.com /usr/sbin/opensipsExternal[159653]: DBG:core:restore_segv_handler: successfully restored system SIGSEGV handler

I had attached the log for your reference.

Thanks,
Anjan

[AnjanIpc]

opensipsbkup.zip
Attaching the log file for your reference

[AnjanIpc]

Any Update on this please ?

[AnjanIpc]

can someone update on this me please ?
Its already 9 days over...

[AnjanIpc]

Anyone , please help on this ?

[liviuchircu]

hey, @AnjanIpc! Your 2.4.4 version is from almost 2 years ago. There were many fixes during this time, so I suggest upgrading to the nightly 2.4.8 version, using the nightly APT or YUM packages.

If you still get the crash, please provide a crash backtrace.

[AnjanIpc]

Thanks liviuchircu for the info.
Can you please confirm if the issue i ma mentioning is fixed in the latest version ?
The reason I am asking is , our Product is deployed in several locations and it is quite difficult to upgrade at every location and i have take permission from each customer on the upgrade but they might need a confirmation that the issue is fixed in the latest version for sure.
So if you can confirm that the issue is fixed for sure in the latest version, it will be really great and highly appreciate.

Thanks,
Anjan

[liviuchircu]

2.4.8 nightly is a good product, and is powering many platforms, in production, as we speak.

It is hard for me to remember a specific fix within the last 2 years which could cause this log. If you really want more info for your customers, please provide a backtrace, as instructed.

[liviuchircu]

By the way, the 2.4.x minor releases only contain fixes. There is nothing experimental, no new features, no backward-incompatibilities. In my opinion, you have a smaller risk of pulling latest fixes and getting a bug than not updating and risking running into an already solved crash.

[AnjanIpc]

Thanks a ton once again.
Let me try to get the stacktrace and come back to you

Thanks,

[AnjanIpc]

we ran "ulimit -c unlimited" but somehow core dump is not created..
Can u please let me know, how to get the core dump created ?

Thanks

[liviuchircu]

Please find the relevant section in the wiki page I linked earlier.