v2.1.2 default installation after instruction lacks dependencies for parsers/html_table

[bernhardreiter]

Following v2.1.2 Install and Development instructions, then starting the example default bot net,
the feodo-tracker-browse-parser stopped with

  File "/opt/dev_intelmq/intelmq/bots/parsers/html_table/parser.py", line 37, in init
    raise MissingDependencyError("beautifulsoup4")
intelmq.lib.exceptions.MissingDependencyError: Could not load dependency 'beautifulsoup4', please install it with apt/yum/dnf/zypper (possibly named python3-beautifulsoup4) or pip3.

Expectation: the instructions or the setup process should make sure that the dependencies for the standard bots are there.

Workaround on Ubuntu 18.04 LTS:

apt-install python-bs4 python3-lxml

Idea: the intelmqctl check command should also check if dependencies can be loaded. Probably needs changes in the bots implementation.

Sorry for the accidental close, I mixed up the issue numbers -.-

See also #552

Requires some changes in the core. The requirements of bots need to be defined somewhere

[motok]

intelmq 3.0.1 seems still have this issue.

$ intelmqctl -v
3.0.1

2022-01-18 16:30:35,475 - feodo-tracker-browse-parser - INFO - HTMLTableParserBot initialized with id feodo-tracker-browse-parser and intelmq 3.0.1 and python 3.8.12 (default, Nov  4 2021, 01:12:24) as process 769.
2022-01-18 16:30:35,475 - feodo-tracker-browse-parser - INFO - Bot is starting.
2022-01-18 16:30:35,650 - feodo-tracker-browse-parser - ERROR - Bot initialization failed.
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/intelmq/lib/bot.py", line 209, in __init__
    self.init()
  File "/usr/local/lib/python3.8/site-packages/intelmq/bots/parsers/html_table/parser.py", line 55, in init
    raise MissingDependencyError("beautifulsoup4")
intelmq.lib.exceptions.MissingDependencyError: Could not load dependency 'beautifulsoup4', please install it with apt/yum/dnf/zypper (possibly named python3-beautifulsoup4) or pip3.
2022-01-18 16:30:35,653 - feodo-tracker-browse-parser - INFO - Bot stopped.