Intermittent problems with cache

[jradikk]

Attempted Debugging

• I have read the debugging page

Searched GitHub Issues

• I have searched GitHub for the issue.

Describe the Scenario

The /status page returns 500 with {"database":true,"cache":false,"session":true} every once in a while. No errors in bookstack log
Switching the cache driver value between file/redis doesn't solve the problem. Number of bookstack application replicas don't affect the problem either (both 1 replica and 2 replicas setups experience the same problem)

With cache and session drivers set to redis, only cache is the one getting errors

Exact BookStack Version

v22.04.02

Log Content

bookstack:80 127.0.0.6 - - [24/Jul/2023:11:55:55 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:55:55 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:05 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:05 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:15 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:15 +0000] "GET /status HTTP/1.1" 500 1496 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:25 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:25 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:35 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:35 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:45 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:45 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:55 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:56:55 +0000] "GET /status HTTP/1.1" 500 1496 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:05 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:05 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:15 +0000] "GET /status HTTP/1.1" 500 1496 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:15 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:25 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"
bookstack:80 127.0.0.6 - - [24/Jul/2023:11:57:25 +0000] "GET /status HTTP/1.1" 200 1476 "-" "kube-probe/1.24"

PHP Version

8.1.6

Hosting Environment

Kubernetes cluster (1.24), Ubuntu 20.04 OS, solidnerd/bookstack:22.04.02 docker image

[ssddanbrown]

Hi @jradikk,

Are you able to replicate this in an easily reproducible manner at all? Like via quick refreshing the status endpoint in the browser, or via hitting the status endpoint via something like watch -n 0.2 curl https://instance.example.com/status?

Have you tried a more up-to-date version of BookStack?

Have you tried the database caching driver option?

[jradikk]

Hi @ssddanbrown. Thanks for the quick reply

I am able to reproduce it with a simple bash script. I tested the database caching driver and it didn't help either
I'll try upgrading to the latest bookstack version today and will let you know if that helped

[jradikk]

I'm still seeing the same 500 errors after the upgrade to 23.06.2

[ssddanbrown]

I am able to reproduce it with a simple bash script.

Are you able to share that script? Or do you mean my watch command?
Also confirm any frequency/pattern you see in the results of the script.

Just want to get in a position where I can run the same test in my environments.

[jradikk]

I used the following script, but essentially it's the same thing as your watch command
while true; do curl -vkis 127.0.0.1:8080/status ; sleep 5; done

Around 20% of requests fail. below is the log of healthchecks from the Kubernetes pod in case it helps with understanding the pattern better:

Healthcheck log

bookstack:80 127.0.0.6 - - [26/Jul/2023:11:22:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:22:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:23:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:24:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:25:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:26:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:27:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:28:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:29:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:30:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:31:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:32:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:33:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:34:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:35:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:36:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:37:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:38:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:39:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:40:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:41:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:42:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:43:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:44:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:45:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:46:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:47:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:42 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:48:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:49:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:50:52 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:12 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:51:52 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:02 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:02 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:12 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:22 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:22 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:32 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:32 +0000] "GET /status HTTP/1.1" 500 1515 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24" bookstack:80 127.0.0.6 - - [26/Jul/2023:11:52:42 +0000] "GET /status HTTP/1.1" 200 1495 "-" "kube-probe/1.24"

[jradikk]

@ssddanbrown Do you have any idea what might be the problem with the cache or healthcheck? Thanks

[ssddanbrown]

Just had another play with this. I'm able to reproduce when running multiple watch -n 0.1 curl <url>/status instances simultaneously, instead of just one.

The cache check at this endpoint is quite simple, it puts a random string into the cache under a specific key, then pulls it back out then compares the result, failing if the new value does not match.
I think this is simply a case of multiple simultaneous requests caching that cache value within the process of another, so the result fails.

There's a couple of things we could do to adjust for this. We could use cache locks, although this does introduce some additional database requirements for us. Alternatively, we could just add a unique/random element to the cache key used to check status to likely limit the chance of conflict.

I'll mark this as something for the next feature release.
If you could add some level of random delay to your checks, or avoid whatever causes simultaneous requests, that may help work around this until cache checks are made unique.

[ssddanbrown]

I've now patched this in e44ef57, to be part of the next feature release.
Could not reproduce via previous means with this patch.

Thanks @jradikk for reporting and providing info!