[GOWS] - WHEN I TRY TO DELETE FAILED SESSION ITS GETS RESTART AND RECONNECT MODE

[ChangBangKok]

When I try to delete a failed session, the service restarts and the session reconnects again, as shown in the screenshot. I’ve observed this issue happening about three times a day. If I don’t delete the failed session, the system runs smoothly throughout the day without any problems. However, deleting even a single failed session triggers a restart. Earlier, this functionality was working perfectly.

[gkp1]

Sending waha container logs would help debug also enable debug mode for the session in session config

[ChangBangKok]

"]}},"res":{"statusCode":500},"responseTime":13}
err: {
"type": "DatabaseError",
"message": "the database system is in recovery mode",
"stack":
error: the database system is in recovery mode
at Parser.parseErrorMessage (/app/node_modules/pg-protocol/dist/parser.js:285:98)
at Parser.handlePacket (/app/node_modules/pg-protocol/dist/parser.js:122:29)
at Parser.parse (/app/node_modules/pg-protocol/dist/parser.js:35:38)
at Socket. (/app/node_modules/pg-protocol/dist/index.js:11:42)
at Socket.emit (node:events:508:28)
at addChunk (node:internal/streams/readable:559:12)
at readableAddChunkPushByteMode (node:internal/streams/readable:510:3)
at Readable.push (node:internal/streams/readable:390:5)
at TCP.onStreamRead (node:internal/stream_base_commons:189:23)
"length": 110,
"name": "error",
"severity": "FATAL",
"code": "57P03",
"file": "backend_startup.c",
"line": "297",
"routine": "BackendInitialize"
}
[04:55:25.947] INFO (7): request completed {"reqId":9181994,"req":{"id":9181994,"method":"GET","url":"/api/sessions/68f1eb8f11b8a","query":{},"params":{"path":["api","sessions","68f1eb8f11b8a"]}},"res":{"statusCode":401},"responseTime":1}
[04:55:25.948] INFO (7): request completed {"reqId":9181996,"req":{"id":9181996,"method":"GET","url":"/api/sessions/68ce44f2b26f4","query":{},"params":{"path":["api","sessions","68ce44f2b26f4"]}},"res":{"statusCode":401},"responseTime":0}
[04:55:25.944] ERROR (7): [Session/68fb46d5956e9/Client] Failed to store LID-PN mapping for 154683347841246@lid -> 919634525268@s.whatsapp.net: transaction: begin: pq: the database system is in recovery mode {"engine":"gows"}
[04:55:25.944] ERROR (7): [Session/68fb46d5956e9/Client] Failed to save push name of 919634525268@s.whatsapp.net in device store: pq: the database system is in recovery mode {"engine":"gows"}
[04:55:25.950] INFO (7): request completed {"reqId":9181995,"req":{"id":9181995,"method":"GET","url":"/api/sessions/6948fce209fdf","query":{},"params":{"path":["api","sessions","6948fce209fdf"]}},"res":{"statusCode":200},"responseTime":3}
[04:55:25.949] WARN (7): [Session/68fb46d5956e9/Client] Error decrypting message 3A7020C4B5ED31517A7B from 919634525268@s.whatsapp.net in status@broadcast: failed to decrypt prekey message: failed to load session with 154683347841246_1:0: pq: the database system is in recovery mode {"engine":"gows"}
[04:55:25.949] WARN (7): [Session/68fb46d5956e9/Client] Not sending any more retry receipts for 3A7020C4B5ED31517A7B {"engine":"gows"}
[04:55:25.951] INFO (7): request completed {"reqId":9181997,"req":{"id":9181997,"method":"GET","url":"/api/sessions/68ea530682541","query":{},"params":{"path":["api","sessions","68ea530682541"]}},"res":{"statusCode":401},"responseTime":1}
[04:55:25.951] INFO (7): request completed {"reqId":9181998,"req":{"id":9181998,"method":"GET","url":"/api/sessions/68edd4d430ed3","query":{},"params":{"path":["api","sessions","68edd4d430ed3"]}},"res":{"statusCode":401},"responseTime":0}
[04:55:25.952] INFO (7): request completed {"reqId":9181999,"req":{"id":9181999,"method":"GET","url":"/api/sessions/68e3b813341cf","query":{},"params":{"path":["api","sessions","68e3b813341cf"]}},"res":{"statusCode":401},"responseTime":0}
[04:55:25.953] INFO (7): request completed {"reqId":9182000,"req":{"id":9182000,"method":"GET","url":"/api/sessions/68d661073996e","query":{},"params":{"path":["api","sessions","68d661073996e"]}},"res":{"statusCode":401},"responseTime":0}
[04:55:25.955] INFO (7): request completed {"reqId":9182002,"req":{"id":9182002,"method":"GET","url":"/api/sessions/68dbcbfc666bb","query":{},"params":{"path":["api","sessions","68dbcbfc666bb"]}},"res":{"statusCode":401},"responseTime":0}
[04:55:25.961] INFO (7): request completed {"reqId":9182005,"req":{"id":9182005,"method":"GET","url":"/api/sessions/68beb44411d2c","query":{},"params":{"path":["api","sessions","68beb44411d2c"]}},"res":{"statusCode":401},"responseTime":0}
[04:55:25.961] INFO (7): request completed {"reqId":9182006,"req":{"id":9182006,"method":"GET","url":"/api/sessions/690a0033b1b2c","query":{},"params":{"path":["api","sessions","690a0033b1b2c"]}},"res":{"statusCode":401},"responseTime":0}
[04:55:25.962] INFO (7): request errored {"reqId":9182001,"req":
"type": "DatabaseError",
"message": "the database system is in recovery mode",
"stack":
error: the database system is in recovery mode
at Parser.parseErrorMessage (/app/node_modules/pg-protocol/dist/parser.js:285:98)
at Parser.handlePacket (/app/node_modules/pg-protocol/dist/parser.js:122:29)
at Parser.parse (/app/node_modules/pg-protocol/dist/parser.js:35:38)
at Socket. (/app/node_modules/pg-protocol/dist/index.js:11:42)
at Socket.emit (node:events:508:28)
at addChunk (node:internal/streams/readable:559:12)
at readableAddChunkPushByteMode (node:internal/streams/readable:510:3)
at Readable.push (node:internal/streams/readable:390:5)
at TCP.onStreamRead (node:internal/stream_base_commons:189:23)
"length": 110,
"name": "error",
"severity": "FATAL",
"code": "57P03",
"file": "backend_startup.c",
"line": "297",
"routine": "BackendInitialize"
}
[04:55:26.226] INFO (7): request errored {"reqId":9182109,"req":{"id":9182109,"method":"GET","url":"/api/sessions/693a7817dd88b","query":{},"params":{"path":["api","sessions","693a7817dd88b"]}},"res":{"statusCode":500},"responseTime":10}
err: {
"type": "DatabaseError",
"message": "the database system is in recovery mode",
"stack":
error: the database system is in recovery mode
at Parser.parseErrorMessage (/app/node_modules/pg-protocol/dist/parser.js:285:98)
at Parser.handlePacket (/app/node_modules/pg-protocol/dist/parser.js:122:29)
at Parser.parse (/app/node_modules/pg-protocol/dist/parser.js:35:38)
at Socket. (/app/node_modules/pg-protocol/dist/index.js:11:42)
at Socket.emit (node:events:508:28)
at addChunk (node:internal/streams/readable:559:12)
at readableAddChunkPushByteMode (node:internal/streams/readable:510:3)
at Readable.push (node:internal/streams/readable:390:5)
at TCP.onStreamRead (node:internal/stream_base_commons:189:23)
"length": 110,
"name": "error",
"severity": "FATAL",
"code": "57P03",
"file": "backend_startup.c",
"line": "297",
"routine": "BackendInitialize"
}
[04:55:26.230] INFO (7): request completed {"reqId":9182113,"req":{"id":9182113,"method":"GET","url":"/api/sessions/68de152cc2316","query":{},"params":{"path":["api","sessions","68de152cc2316"]}},"res":{"statusCode":401},"responseTime":1}
[04:55:26.236] INFO (7): request errored {"reqId":9182110,"req":{"id":9182110,"method":"GET","url":"/api/sessions/693e46b8e8112","query":{},"params":{"path":["api","sessions","693e46b8e8112"]}},"res":{"statusCode":500},"responseTime":18}
err: {
"type": "DatabaseError",
"message": "the database system is in recovery mode",
"stack":
error: the database system is in recovery mode
at Parser.parseErrorMessage (/app/node_modules/pg-protocol/dist/parser.js:285:98)
at Parser.handlePacket (/app/node_modules/pg-protocol/dist/parser.js:122:29)
at Parser.parse (/app/node_modules/pg-protocol/dist/parser.js:35:38)
at Socket. (/app/node_modules/pg-protocol/dist/index.js:11:42)
at Socket.emit (node:events:508:28)
at addChunk (node:internal/streams/readable:559:12)
at readableAddChunkPushByteMode (node:internal/streams/readable:510:3)
at Readable.push (node:internal/streams/readable:390:5)
at TCP.onStreamRead (node:internal/stream_base_commons:189:23)
"length": 110,
"name": "error",
"severity": "FATAL",
"code": "57P03",
"file": "backend_startup.c",
"line": "297",
"routine": "BackendInitialize"
}
[04:55:26.237] INFO (7): request errored {"reqId":9182111,"req":{"id":9182111,"method":"GET","url":"/api/sessions/69354976242e7","query":{},"params":{"path":["api","sessions","69354976242e7"]}},"res":{"statusCode":500},"responseTime":16}
err: {
"type": "DatabaseError",
"message": "the database system is in recovery mode",
"stack":
error: the database system is in recovery mode
at Parser.parseErrorMessage (/app/node_modules/pg-protocol/dist/parser.js:285:98)
at Parser.handlePacket (/app/node_modules/pg-protocol/dist/parser.js:122:29)
at Parser.parse (/app/node_modules/pg-protocol/dist/parser.js:35:38)
at Socket. (/app/node_modules/pg-protocol/dist/index.js:11:42)
at Socket.emit (node:events:508:28)
at addChunk (node:internal/streams/readable:559:12)
at readableAddChunkPushByteMode (node:internal/streams/readable:510:3)
at Readable.push (node:internal/streams/readable:390:5)
at TCP.onStreamRead (node:internal/stream_base_commons:189:23)
"length": 110,
"name": "error",
"severity": "FATAL",
"code": "57P03",
"file": "backend_startup.c",
"line": "297",
"routine": "BackendInitialize"
}
[04:55:26.240] INFO (7): request completed {"reqId":9182115,"req":{"id":9182115,"method":"GET","url":"/api/sessions/68d24876c724c","query":{},"params":{"path":["api","sessions","68d24876c724c"]}},"res":{"statusCode":401},"responseTime":0}
[04:55:26.215] WARN (7): [Session/69455aeee6d80/Client] Error decrypting message ACE41571865CA4CAB317FD6CCF1567C7 from 919730541283@s.whatsapp.net in status@broadcast: failed to decrypt prekey message: failed to load session with 70592149618926_1:0: pq: the database system is in recovery mode {"engine":"gows"}
[04:55:26.215] WARN (7): [Session/69455aeee6d80/Client] Not sending any more retry receipts for ACE41571865CA4CAB317FD6CCF1567C7 {"engine":"gows"}
[04:55:26.233] ERROR (7): [Session/69304755b0e37/Client] Failed to store LID-PN mapping for 243215575814306@lid -> 919717168005@s.whatsapp.net: transaction: begin: pq: the database system is in recovery mode {"engine":"gows"}
[04:55:26.233] WARN (7): [Session/694395786fa18/Client] Error decrypting message 4A912E567D4EA630B65F from 917893800836@s.whatsapp.net in status@broadcast: failed to decrypt prekey message: failed to load session with 106889002107049_1:0: pq: the database system is in recovery mode {"engine":"gows"}
[04:55:26.233] ERROR (7): [Session/69304755b0e37/Client] Failed to save push name of 919717168005@s.whatsapp.net in device store: pq: the database system is in recovery mode {"engine":"gows"}
[04:55:26.233] ERROR (7): [Session/694395786fa18/Client] Failed to get prekey for retry receipt: failed to query next prekey ID: pq: the database system is in recovery mode {"engine":"gows"}
[04:55:26.233] WARN (7): [Session/69304755b0e37/Client] Error decrypting message AC38B4BCDEE09CC2207A33E74B2116A3 from 919717168005@s.whatsapp.net in status@broadcast: failed to decrypt prekey message: failed to load session with 243215575814306_1:0: pq: the database system is in recovery mode {"engine":"gows"}
[04:55:26.241] INFO (7): request completed {"reqId":9182116,"req":{"id":9182116,"method":"GET","url":"/api/sessions/68a5825f75e97","query":{},"params":{"path":["api","sessions","68a5825f75e97"]}},"res":{"statusCode":401},"responseTime":0}
[04:55:26.242] INFO (7): request completed {"reqId":9182117,"req":{"id":9182117,"method":"GET","url":"/api/sessions/68ca641a9016a","query":{},"params":{"path":["api","sessions","68ca641a9016a"]}},"res":{"statusCode":401},"responseTime":0}
[04:55:26.243] INFO (7): request errored {"reqId":9182112,"req":{"id":9182112,"method":"GET","url":"/api/sessions/6937c2a1e54b5","query":{},"params":{"path":["api","sessions","6937c2a1e54b5"]}},"res":{"statusCode":500},"responseTime":19}
err: {
"type": "DatabaseError",
"message": "the database system is in recovery mode",
"stack":
error: the database system is in recovery mode
at Parser.parseErrorMessage (/app/node_modules/pg-protocol/dist/parser.js:285:98)
at Parser.handlePacket (/app/node_modules/pg-protocol/dist/parser.js:122:29)
at Parser.parse (/app/node_modules/pg-protocol/dist/parser.js:35:38)
at Socket. (/app/node_modules/pg-protocol/dist/index.js:11:42)
at Socket.emit (node:events:508:28)
at addChunk (node:internal/streams/readable:559:12)
at readableAddChunkPushByteMode (node:internal/streams/readable:510:3)
at Readable.push (node:internal/streams/readable:390:5)
at TCP.onStreamRead (node:internal/stream_base_commons:189:23)
"length": 110,
"name": "error",
"severity": "FATAL",
"code": "57P03",
"file": "backend_startup.c",
"line": "297",
"routine": "BackendInitialize"
}
[04:55:26.244] ERROR (7): [Session/69304755b0e37/Client] Failed to get prekey for retry receipt: failed to query next prekey ID: pq: the database system is in recovery mode {"engine":"gows"}
[04:55:26.246] INFO (7): request errored {"reqId":9182114,"req":{"id":9182114,"method":"GET","url":"/api/sessions/6943edc0a26eb","query":{},"params":{"path":["api","sessions","6943edc0a26eb"]}},"res":{"statusCode":500},"responseTime":11}
err: {
"type": "DatabaseError",
"message": "the database system is in recovery mode",
"stack":
error: the database system is in recovery mode
at Parser.parseErrorMessage (/app/node_modules/pg-protocol/dist/parser.js:285:98)
at Parser.handlePacket (/app/node_modules/pg-protocol/dist/parser.js:122:29)
at Parser.parse (/app/node_modules/pg-protocol/dist/parser.js:35:38)
at Socket. (/app/node_modules/pg-protocol/dist/index.js:11:42)
at Socket.emit (node:events:508:28)
at addChunk (node:internal/streams/readable:559:12)
at readableAddChunkPushByteMode (node:internal/streams/readable:510:3)
at Readable.push (node:internal/streams/readable:390:5)
at TCP.onStreamRead (node:internal/stream_base_commons:189:23)
"length": 110,
"name": "error",
"severity": "FATAL",
"code": "57P03",
"file": "backend_startup.c",
"line": "297",
"routine": "BackendInitialize"
}
[04:55:26.255] INFO (7): request errored {"reqId":9182118,"req":{"id":9182118,"method":"GET","url":"/api/sessions/693d73b193c72","query":{},"params":{"path":["api","sessions","693d73b193c72"]}},"res":{"statusCode":500},"responseTime":10}
err: {
"type": "DatabaseError",
"message": "the database system is in recovery mode",
"stack":
error: the database system is in recovery mode
at Parser.parseErrorMessage (/app/node_modules/pg-protocol/dist/parser.js:285:98)
at Parser.handlePacket (/app/node_modules/pg-protocol/dist/parser.js:122:29)
at Parser.parse (/app/node_modules/pg-protocol/dist/parser.js:35:38)
at Socket. (/app/node_modules/pg-protocol/dist/index.js:11:42)
at Socket.emit (node:events:508:28)
at addChunk (node:internal/streams/readable:559:12)
at readableAddChunkPushByteMode (node:internal/streams/readable:510:3)
at Readable.push (node:internal/streams/readable:390:5)
at TCP.onStreamRead (node:internal/stream_base_commons:189:23)
"length": 110,
"name": "error",
"severity": "FATAL",
"code": "57P03",
"file": "backend_startup.c",
"line": "297",
"routine": "BackendInitialize"
}

[ChangBangKok]

ERROR: could not resize shared memory segment "/PostgreSQL.957106894" to 33554432 bytes: No space left on device

root@vmi2627094:~# df -h
Filesystem Size Used Avail Use% Mounted on
tmpfs 1.2G 121M 1.1G 11% /run
/dev/sda3 394G 305G 72G 82% /
tmpfs 5.9G 0 5.9G 0% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
/dev/sda2 2.0G 144M 1.7G 8% /boot
overlay 394G 305G 72G 82% /var/lib/docker/overlay2/0791ff74b06fe086e87bbc01b621a1fa1c0128147a246fc1ed052c172494e86c/merged
overlay 394G 305G 72G 82% /var/lib/docker/overlay2/794b9ac4fabbf27f840c9d67f11ebd432b2592cddd42d701454fea043d628c2f/merged
tmpfs 1.2G 0 1.2G 0% /run/user/0