[Bug]: command line LPAD init -u will not create correctly user DB

[catchthemonster]

Code snippet

LPAD init -u worked just fine with 2.0.3 fireworks.
We ungraded fireworks to 2.0.5 and now:
./create-MongoUser-DB.sh 
Note 1: You are in URI format mode. This means that all database parameters (username, password, host, port, database name, etc.) must be present in the URI. See: https://docs.mongodb.com/manual/reference/connection-string/ for details.
(Enter your connection URI through the 'host' parameter)
Please supply the following configuration values
(press Enter if you want to accept the defaults)

Enter host parameter. (default=None). Example: mongodb+srv://USER:PASSWORD@CLUSTERNAME.mongodb.net/fireworks: 
mongodb+srv:://XXXX:XXXXX@mongo.XXXX.XXXXX.XX.XXX/fireworks-test

Enter ssl_ca_file parameter. (default=None). Path to any client certificate to be used for mongodb connection: 
Enter authsource parameter. (default=None). Database used for authentication, if not connection db. e.g., for MongoDB Atlas this is sometimes 'admin'.: 
Traceback (most recent call last):
  File "/cube/api/py-3.10.8/bin/lpad", line 7, in <module>
    sys.exit(lpad())
  File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/scripts/lpad_run.py", line 1567, in lpad
    args.func(args)
  File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/scripts/lpad_run.py", line 185, in init_yaml
    lp = LaunchPad.from_dict(doc)
  File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/core/launchpad.py", line 285, in from_dict
    return LaunchPad(
  File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/core/launchpad.py", line 204, in __init__
    raise ValueError("Must specify a database name when using a MongoDB URI string.")
ValueError: Must specify a database name when using a MongoDB URI string.

./lpad --version
lpad v2.0.5 located in /XXX/XXX/py-3.10.8/lib/python3.10/site-packages

Could someone confirm this and let us know if this is python DNS lookup issue, query changed or some mongo or pymongo issue...

Mongo is mongodb-8.0.10


Regards,

What happened?

LPAD init -u worked just fine with 2.0.3 fireworks.
We ungraded fireworks to 2.0.5 and now:
./create-MongoUser-DB.sh
Note 1: You are in URI format mode. This means that all database parameters (username, password, host, port, database name, etc.) must be present in the URI. See: https://docs.mongodb.com/manual/reference/connection-string/ for details.
(Enter your connection URI through the 'host' parameter)
Please supply the following configuration values
(press Enter if you want to accept the defaults)

Enter host parameter. (default=None). Example: mongodb+srv://USER:PASSWORD@CLUSTERNAME.mongodb.net/fireworks:
mongodb+srv:://XXXX:XXXXX@mongo.XXXX.XXXXX.XX.XXX/fireworks-test

Enter ssl_ca_file parameter. (default=None). Path to any client certificate to be used for mongodb connection:
Enter authsource parameter. (default=None). Database used for authentication, if not connection db. e.g., for MongoDB Atlas this is sometimes 'admin'.:
Traceback (most recent call last):
File "/cube/api/py-3.10.8/bin/lpad", line 7, in
sys.exit(lpad())
File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/scripts/lpad_run.py", line 1567, in lpad
args.func(args)
File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/scripts/lpad_run.py", line 185, in init_yaml
lp = LaunchPad.from_dict(doc)
File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/core/launchpad.py", line 285, in from_dict
return LaunchPad(
File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/core/launchpad.py", line 204, in init
raise ValueError("Must specify a database name when using a MongoDB URI string.")
ValueError: Must specify a database name when using a MongoDB URI string.

./lpad --version
lpad v2.0.5 located in /XXX/XXX/py-3.10.8/lib/python3.10/site-packages

Could someone confirm this and let us know if this is python DNS lookup issue, query changed or some mongo or pymongo issue...

Mongo is mongodb-8.0.10

Regards,

Version

2.0.5

Which OS?

• MacOS
• Windows
• Linux

Log output

Traceback (most recent call last):
  File "/cube/api/py-3.10.8/bin/lpad", line 7, in <module>
    sys.exit(lpad())
  File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/scripts/lpad_run.py", line 1567, in lpad
    args.func(args)
  File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/scripts/lpad_run.py", line 185, in init_yaml
    lp = LaunchPad.from_dict(doc)
  File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/core/launchpad.py", line 285, in from_dict
    return LaunchPad(
  File "/cube/api/py-3.10.8/lib/python3.10/site-packages/fireworks/core/launchpad.py", line 204, in __init__
    raise ValueError("Must specify a database name when using a MongoDB URI string.")
ValueError: Must specify a database name when using a MongoDB URI string.
[root@azcldatte-twev1.englab (eastus2) LPAD]#

[ikondov]

@catchthemonster Would you please provide the script ./create-MongoUser-DB.sh or better the essential lines in it that are necessary to reproduce the issue?

[ikondov]

@catchthemonster Apart from this issue, that may need to be soved, as an alternative you can have a look at the admongo tool [1-2] that facilitates interactive management of databases, users, roles etc.

[1] https://gitlab.kit.edu/ivan.kondov/mongo-admin
[2] https://pypi.org/project/admongo

[ikondov]

I tried these commands and entered the properly formatted URI (cannot put here because for security reasons):

$ lpad --version
lpad v2.0.5 located in /mnt/data/ubuntu/work/python-3.10.12/lib/python3.10/site-packages

$ lpad init -u --config-file new_config.yaml

But I received this error:

Traceback (most recent call last):
  File "/mnt/data/ubuntu/work/python-3.10.12/bin/lpad", line 7, in <module>
    sys.exit(lpad())
  File "/mnt/data/ubuntu/work/python-3.10.12/lib/python3.10/site-packages/fireworks/scripts/lpad_run.py", line 1567, in lpad
    args.func(args)
  File "/mnt/data/ubuntu/work/python-3.10.12/lib/python3.10/site-packages/fireworks/scripts/lpad_run.py", line 185, in init_yaml
    lp = LaunchPad.from_dict(doc)
  File "/mnt/data/ubuntu/work/python-3.10.12/lib/python3.10/site-packages/fireworks/core/launchpad.py", line 285, in from_dict
    return LaunchPad(
  File "/mnt/data/ubuntu/work/python-3.10.12/lib/python3.10/site-packages/fireworks/core/launchpad.py", line 202, in __init__
    self.connection = MongoClient(host, **self.mongoclient_kwargs)
  File "/mnt/data/ubuntu/work/python-3.10.12/lib/python3.10/site-packages/pymongo/mongo_client.py", line 774, in __init__
    res = uri_parser.parse_uri(
  File "/mnt/data/ubuntu/work/python-3.10.12/lib/python3.10/site-packages/pymongo/uri_parser.py", line 547, in parse_uri
    nodes = dns_resolver.get_hosts()
  File "/mnt/data/ubuntu/work/python-3.10.12/lib/python3.10/site-packages/pymongo/srv_resolver.py", line 140, in get_hosts
    _, nodes = self._get_srv_response_and_hosts(True)
  File "/mnt/data/ubuntu/work/python-3.10.12/lib/python3.10/site-packages/pymongo/srv_resolver.py", line 120, in _get_srv_response_and_hosts
    results = self._resolve_uri(encapsulate_errors)
  File "/mnt/data/ubuntu/work/python-3.10.12/lib/python3.10/site-packages/pymongo/srv_resolver.py", line 114, in _resolve_uri
    raise ConfigurationError(str(exc)) from None
pymongo.errors.ConfigurationError: The DNS query name does not exist: _mongodb._tcp.<MY_MONGODB_HOSTNAME>.

Other issues (maybe they should be opened separately):

1. The normal (non-URI) mode works with the same connection settings

   $ lpad init --config-file new_config.yaml
   

   "Works" means that there is no error and the launchpad file is created. But all SSL/TLS settings are not written to the file! In addition, it did not ask about my client certificate. My mongodb server accepts connections only with a client certificate.

2. Another issue is that the database password is displayed on the screen when using lpad init. I would not recommend such methods.

[catchthemonster]

Hi Ivan, the problem is that scripts/lpad_run.py module and _helpers.py module are not working correctly when you try to create a fireworks collection under a new user database. I am assuming here, that ./lpad -u with default fireworks DB and fireworks collection works fine. But in our case we have development environments for fireworks that work per developer, meaning I want to try to setup let's say: fireworks-test db and inject fireworks collection within. Parsing arguments with -u or without -u option fails. Now, we developed an accidental fix by creating my_lunchlpad.yaml and utilizing lpad -l my_lunchpad.yaml rest which actually creates a fireworks collection and database for firework-test user. I am not sure if this is the issue with mongoDb not creating a database and collection without any data being injected but ether way this is a problem for less experienced devs and fireworks. Another problem is that the lpad_run.py module should be in my opinion easy to debug, and import of modules like _helpers.py should be absolute, not a relative path. I debuged the script and like I said it does not fail per say but even in debug mode mongo db is not created and fireworks collection is not injected. The tools you are mentioning are not helping here, as schema is the key and replication is not easy or I do not know where that json file is? I hope this helps, Regards,

…

On Wed, Oct 22, 2025 at 3:35 AM Ivan Kondov ***@***.***> wrote: *ikondov* left a comment (materialsproject/fireworks#553) <#553 (comment)> @catchthemonster <https://github.com/catchthemonster> Apart from this issue, that may need to be soved, as an alternative you can have a look at the admongo tool [1-2] that facilitates interactive management of databases, users, roles etc. [1] https://gitlab.kit.edu/ivan.kondov/mongo-admin [2] https://pypi.org/project/admongo — Reply to this email directly, view it on GitHub <#553 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAEC5FXSPLIVIGWWSC7FRW33Y4XUHAVCNFSM6AAAAACJWI5XYWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTIMZQHA2DMMBWGE> . You are receiving this because you were mentioned.Message ID: ***@***.***>

-- Aleksandar Kacanski - Sasha ---------------------------------------- *Python Rocks, natural or digital, regardless ...*

[catchthemonster]

Ivan script is very simple bash script, nothing there: #!/usr/bin/bash LPAD=/cube/api/py-3.10.8/bin/lpad ## we use custom python interpreter ${LPAD} init ## or alternatively init -u Again, please read my earlier reply ...

…

On Wed, Oct 22, 2025 at 3:15 AM Ivan Kondov ***@***.***> wrote: *ikondov* left a comment (materialsproject/fireworks#553) <#553 (comment)> @catchthemonster <https://github.com/catchthemonster> Would you please provide the script ./create-MongoUser-DB.sh or better the essential lines in it that are necessary to reproduce the issue? — Reply to this email directly, view it on GitHub <#553 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAEC5FV53M3P3N6YWM7LXQD3Y4VJHAVCNFSM6AAAAACJWI5XYWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTIMZQG44TANRZGQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>

-- Aleksandar Kacanski - Sasha ---------------------------------------- *Python Rocks, natural or digital, regardless ...*