Site installation ends with "ModuleNotFoundError: No module named 'sqlglot.parsers'"

[peerDE]

In pilot's nice admin interface, after starting a site installation, choosing a site name and some apps to be installed, the admin interface went away after some minutes. Restarting was not possible and re-aborts right away, signaling the same error. The terminal shows this error log:

[admin] ::ffff:127.0.0.1 - - [26/Aug/2026 10:41:34] "GET /api/v1/health HTTP/1.1" 200 -
[admin] ::ffff:127.0.0.1 - - [26/Aug/2026 10:41:37] "GET /api/v1/health HTTP/1.1" 200 -
[admin] ::ffff:127.0.0.1 - - [26/Aug/2026 10:41:40] "GET /api/v1/health HTTP/1.1" 200 -
[admin] ::ffff:127.0.0.1 - - [26/Aug/2026 10:41:43] "GET /api/v1/health HTTP/1.1" 200 -
[admin] ::ffff:127.0.0.1 - - [26/Aug/2026 10:41:46] "GET /api/v1/health HTTP/1.1" 200 -
[web] * Detected change in '/home/peer/pilot/benches/dev-bench/env/lib/python3.14/site-packages/sqlglot/transforms.py', reloading
[admin] ::ffff:127.0.0.1 - - [26/Aug/2026 10:41:49] "GET /api/v1/health HTTP/1.1" 200 -
[web] * Restarting with stat
[web] Traceback (most recent call last):
[web] File "/home/peer/pilot/benches/dev-bench/apps/frappe/frappe/utils/bench_helper.py", line 48, in invoke
[web] return super().invoke(ctx)
[web] ~~~~~~~~~~~~~~^^^^^
[web] File "/home/peer/pilot/benches/dev-bench/env/lib/python3.14/site-packages/click/core.py", line 1970, in invoke
[web] return _process_result(sub_ctx.command.invoke(sub_ctx))
[web] ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
[web] File "/home/peer/pilot/benches/dev-bench/env/lib/python3.14/site-packages/click/core.py", line 1353, in invoke
[web] return ctx.invoke(self.callback, **ctx.params)
[web] ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[web] File "/home/peer/pilot/benches/dev-bench/env/lib/python3.14/site-packages/click/core.py", line 907, in invoke
[web] return callback(*args, **kwargs)
[web] File "/home/peer/pilot/benches/dev-bench/env/lib/python3.14/site-packages/click/decorators.py", line 34, in new_func
[web] return f(get_current_context(), *args, **kwargs)
[web] File "/home/peer/pilot/benches/dev-bench/apps/frappe/frappe/commands/init.py", line 28, in _func
[web] ret = f(ctx.obj, *args, **kwargs)
[web] File "/home/peer/pilot/benches/dev-bench/apps/frappe/frappe/commands/utils.py", line 808, in serve
[web] import frappe.app
[web] File "/home/peer/pilot/benches/dev-bench/apps/frappe/frappe/app.py", line 17, in
[web] import frappe.api
[web] File "/home/peer/pilot/benches/dev-bench/apps/frappe/frappe/api/init.py", line 89, in
[web] from frappe.api.v2 import url_rules as v2_rules
[web] File "/home/peer/pilot/benches/dev-bench/apps/frappe/frappe/api/v2.py", line 17, in
[web] import frappe.client
[web] File "/home/peer/pilot/benches/dev-bench/apps/frappe/frappe/client.py", line 11, in
[web] from frappe.desk.reportview import validate_args
[web] File "/home/peer/pilot/benches/dev-bench/apps/frappe/frappe/desk/reportview.py", line 10, in
[web] from sql_metadata import Parser
[web] File "/home/peer/pilot/benches/dev-bench/env/lib/python3.14/site-packages/sql_metadata/init.py", line 20, in
[web] from sql_metadata.parser import Parser
[web] File "/home/peer/pilot/benches/dev-bench/env/lib/python3.14/site-packages/sql_metadata/parser.py", line 20, in
[web] from sql_metadata.ast_parser import ASTParser
[web] File "/home/peer/pilot/benches/dev-bench/env/lib/python3.14/site-packages/sql_metadata/ast_parser.py", line 13, in
[web] from sql_metadata.dialect_parser import DialectParser
[web] File "/home/peer/pilot/benches/dev-bench/env/lib/python3.14/site-packages/sql_metadata/dialect_parser.py", line 17, in
[web] from sqlglot.parsers.redshift import RedshiftParser
[web] ModuleNotFoundError: No module named 'sqlglot.parsers'
[web]
[web] No module named 'sqlglot.parsers'
[web] exited with code 1
[redis_queue] 1354740:signal-handler (1787733711) Received SIGTERM scheduling shutdown...
[redis_cache] 1354738:signal-handler (1787733711) Received SIGTERM scheduling shutdown...
[worker_default_short_long_1] 2026-08-26 10:41:51,048 Worker d6a0440e2ff84c2a9d31bbdd1479efe6 [PID 1354736]: warm shut down requested
[worker_default_short_long_1] 2026-08-26 10:41:51,049 Worker d6a0440e2ff84c2a9d31bbdd1479efe6: unsubscribing from channel rq:pubsub:d6a0440e2ff84c2a9d31bbdd1479efe6
[redis_cache] 1354738:M 26 Aug 2026 10:41:51.049 # User requested shutdown...
[redis_cache] 1354738:M 26 Aug 2026 10:41:51.049 # Redis is now ready to exit, bye bye...
[redis_queue] 1354740:M 26 Aug 2026 10:41:51.139 # User requested shutdown...
[redis_queue] 1354740:M 26 Aug 2026 10:41:51.139 # Redis is now ready to exit, bye bye...
[admin] ::ffff:127.0.0.1 - - [26/Aug/2026 10:41:52] "GET /api/v1/health HTTP/1.1" 200 -
[admin] ::ffff:127.0.0.1 - - [26/Aug/2026 10:41:55] "GET /api/v1/health HTTP/1.1" 200 -

Done in 21m 59s

[tanmoysrt]

It doesn't looks like an issue with pilot.
Some conflict with app dependencies probably.

Can you please share the apps, that you have installed and their version.

[tanmoysrt]

If you are installing insights also, try pip install "sqlglot==30.12.0" inside the bench's environment.
This should have fixed the issue for insights also though : frappe/insights#1299

[peerDE]

$ cat sites/apps.txt
frappe
erpnext
wiki
insights
builder
blog
offsite_backups
raven
raven_integration
erpnext_shipping
email_delivery_service
gameplan

Here's the output log of the new-site command.
Interestingly, the directory of the new site is not to be found in the sites directory, but in "archived". Not sure why this is, maybe it's used as a staging area before mv-ing it in place?

output.log

[peerDE]

The
pip install "sqlglot==30.12.0"
strangely yields this:

peer@risen:~/pilot/benches/dev-bench$ . env/bin/activate
(env) peer@risen:~/pilot/benches/dev-bench$ pip install "sqlglot==30.12.0"
error: externally-managed-environment

× This environment is externally managed
╰─> To install Python packages system-wide, try apt install
    python3-xyz, where xyz is the package you are trying to
    install.

    If you wish to install a non-Debian-packaged Python package,
    create a virtual environment using python3 -m venv path/to/venv.
    Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
    sure you have python3-full installed.

    If you wish to install a non-Debian packaged Python application,
    it may be easiest to use pipx install xyz, which will manage a
    virtual environment for you. Make sure you have pipx installed.

    See /usr/share/doc/python3.12/README.venv for more information.

note: If you believe this is a mistake, please contact your Python
installation or OS distribution provider. You can override this, at the
risk of breaking your Python installation or OS, by passing
--break-system-packages.
hint: See PEP 668 for the detailed specification.

Why does it count as "externally managed" when I'm in the pilot's
bench's environment, as shown by the prompt-preceding "(env)"?

I could try out the suggested apt command, but then, why would it be
necessare? Is there something wrong with that env?

[tanmoysrt]

Interestingly, the directory of the new site is not to be found in the sites directory, but in "archived". Not sure why this is, maybe it's used as a staging area before mv-ing it in place?

If site creation failed, it gets reverted.

Why does it count as "externally managed" when I'm in the pilot's
That seems weird.

I will try to replicate the behaviours.

[peerDE]

If you are installing insights also, try pip install "sqlglot==30.12.0" inside the bench's environment. This should have fixed the issue for insights also though : frappe/insights#1299

The output.log included in another reply (above) shows that the new-bench errored out while installing frappe/frappe.
Insights installer went through as it should.

These two apps' commits that were installed are:

(env) peer@risen:~/pilot/benches/dev-bench/apps/frappe$ git log
commit 5cba016e86b54b57f34a3864282b92300ef20fb0 (grafted, HEAD -> version-16, tag: v16.32.0, origin/version-16)
Author: Frappe PR Bot <developers@frappe.io>
Date:   Wed Aug 26 05:43:40 2026 +0000

and

(env) peer@risen:~/pilot/benches/dev-bench/apps/insights$ git log
commit 1a78fa6631d158f115c507d1224cc50a3d0de36a (grafted, HEAD -> develop)
Author: Saqib Ansari <nextchamp.saqib@gmail.com>
Date:   Thu Jul 30 14:31:48 2026 +0530

Maybe something is out of sync.

Regarding the weird (env), the paths are like this:
In the (env):

(env) peer@risen:~/pilot/benches/dev-bench/apps/insights$ echo $PATH
/home/peer/pilot/benches/dev-bench/env/bin:/home/peer/pilot/bin:/home/peer/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/snap/bin

outside of it:

(env) peer@risen:~/pilot/benches/dev-bench/apps/insights$ deactivate
peer@risen:~/pilot/benches/dev-bench/apps/insights$ echo $PATH
/home/peer/pilot/bin:/home/peer/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/snap/bin