Watchdog task keyError

[komuw]

{"log":"{'timestamp': '2019-05-18 16:34:02,325', 'event': 'wiji.SimpleRateLimiter.limit', 'stage': 'start', 'task_name': 'task_name-AdderTask', 'queue_name': 'AdderTask', 'worker_id': 'K3F4LRLL72ZFXTKU9', 'process_id': 1}\n","stream":"stderr","time":"2019-05-18T16:34:02.325566008Z"}
{"log":"{'timestamp': '2019-05-18 16:34:02,325', 'event': 'wiji.SimpleRateLimiter.limit', 'stage': 'end', 'task_processing_rate': 100000000.0, 'task_name': 'task_name-AdderTask', 'queue_name': 'AdderTask', 'worker_id': 'K3F4LRLL72ZFXTKU9', 'process_id': 1}\n","stream":"stderr","time":"2019-05-18T16:34:02.32614814Z"}
{"log":"Exception in thread Thread-\u003cwiji_watchdog\u003e:\n","stream":"stderr","time":"2019-05-18T16:34:02.341169847Z"}
{"log":"Traceback (most recent call last):\n","stream":"stderr","time":"2019-05-18T16:34:02.341189601Z"}
{"log":"  File \"/usr/local/lib/python3.7/site-packages/wiji/watchdog.py\", line 167, in _main_loop\n","stream":"stderr","time":"2019-05-18T16:34:02.341194799Z"}
{"log":"    raise BlockingTaskError(error_msg)\n","stream":"stderr","time":"2019-05-18T16:34:02.341199641Z"}
{"log":"wiji.watchdog.BlockingTaskError: Blocked tasks Watchdog has not received any notifications in 0.1 seconds. This means the Main thread is blocked! \n","stream":"stderr","time":"2019-05-18T16:34:02.341204187Z"}
{"log":"Hint: are you running any tasks with blocking calls? eg; using python-requests, etc? \n","stream":"stderr","time":"2019-05-18T16:34:02.341208844Z"}
{"log":"Hint: look at the `stack_trace` attached to this log event to discover which calls are potentially blocking.\n","stream":"stderr","time":"2019-05-18T16:34:02.341213334Z"}
{"log":"\n","stream":"stderr","time":"2019-05-18T16:34:02.341217636Z"}
{"log":"During handling of the above exception, another exception occurred:\n","stream":"stderr","time":"2019-05-18T16:34:02.341221706Z"}
{"log":"\n","stream":"stderr","time":"2019-05-18T16:34:02.341246886Z"}
{"log":"Traceback (most recent call last):\n","stream":"stderr","time":"2019-05-18T16:34:02.341250997Z"}
{"log":"  File \"/usr/local/lib/python3.7/threading.py\", line 917, in _bootstrap_inner\n","stream":"stderr","time":"2019-05-18T16:34:02.341255132Z"}
{"log":"    self.run()\n","stream":"stderr","time":"2019-05-18T16:34:02.341259784Z"}
{"log":"  File \"/usr/local/lib/python3.7/threading.py\", line 865, in run\n","stream":"stderr","time":"2019-05-18T16:34:02.341263892Z"}
{"log":"    self._target(*self._args, **self._kwargs)\n","stream":"stderr","time":"2019-05-18T16:34:02.341268402Z"}
{"log":"  File \"/usr/local/lib/python3.7/site-packages/wiji/watchdog.py\", line 169, in _main_loop\n","stream":"stderr","time":"2019-05-18T16:34:02.341272696Z"}
{"log":"    all_threads_stack_trace = self._save_stack_trace()\n","stream":"stderr","time":"2019-05-18T16:34:02.341290449Z"}
{"log":"  File \"/usr/local/lib/python3.7/site-packages/wiji/watchdog.py\", line 214, in _save_stack_trace\n","stream":"stderr","time":"2019-05-18T16:34:02.341295189Z"}
{"log":"    f=sys._current_frames()[thread.ident]  # type: ignore\n","stream":"stderr","time":"2019-05-18T16:34:02.341299561Z"}
{"log":"KeyError: 140032828143360\n","stream":"stderr","time":"2019-07/threading.py\", line 917, in _bootstrap_inner\n","stream":"stderr","time":"2019-05-18T16:34:02.341255132Z"}
{"log":"    self.run()\n","stream":"stderr","time":"2019-05-18T16:34:02.341259784Z"}
{"log":"  File \"/usr/local/lib/python3.7/threading.py\", line 865, in run\n","stream":"stderr","time":"2019-05-18T16:34:02.341263892Z"}
{"log":"    self._target(*self._args, **self._kwargs)\n","stream":"stderr","time":"2019-05-18T16:34:02.341268402Z"}
{"log":"  File \"/usr/local/lib/python3.7/site-packages/wiji/watchdog.py\", line 169, in _main_loop\n","stream":"stderr","time":"2019-05-18T16:34:02.341272696Z"}
{"log":"    all_threads_stack_trace = self._save_stack_trace()\n","stream":"stderr","time":"2019-05-18T16:34:02.341290449Z"}
{"log":"  File \"/usr/local/lib/python3.7/site-packages/wiji/watchdog.py\", line 214, in _save_stack_trace\n","stream":"stderr","time":"2019-05-18T16:34:02.341295189Z"}
{"log":"    f=sys._current_frames()[thread.ident]  # type: ignore\n","stream":"stderr","time":"2019-05-18T16:34:02.341299561Z"}
{"log":"KeyError: 140032828143360\n","stream":"stderr","time":"2019-05-18T16:34:02.341303709Z"}
{"log":"\n","stream":"stderr","time":"2019-05-18T16:34:02.341324569Z"}

[komuw]

maybe we are trying to get a thread_id when the thread has already died/exited

[komuw]

this doesn't affect the normal running of wiji; its a low priority