poetry 1.7 ignores extra dependencies of extra dependencies

[pmav99]

Poetry
Version: 1.7.0
Python:  3.11.5

Virtualenv
Python:         3.10.12
Implementation: CPython
Path:           /tmp/asdf/.venv
Executable:     /tmp/asdf/.venv/bin/python
Valid:          True

System
Platform:   linux
OS:         posix
Python:     3.10.12
Path:       /usr
Executable: /usr/bin/python3.10

[tool.poetry]
name = "asdf"
version = "0.1.0"
description = ""
authors = ["pmav99"]
readme = "README.md"
 
[tool.poetry.dependencies]
python = "^3.11"
xarray = {version = "^2023.10.1", extras = ["parallel"]}
 
[build-system]
requires = ["poetry-core"]
build-backend = "poetry.core.masonry.api"

• I am on the latest stable Poetry version, installed using a recommended method.
• I have searched the issues of this repo and believe that this is not a duplicate.
• I have consulted the FAQ and blog for any relevant entries or release notes.
• If an exception occurs when executing a command, I executed it again in debug mode (-vvv option) and have included the output below.

Issue

This is similar to #5862 but that one was affecting an older version of poetry and according to the report it had been resolved. So this is probably a regression. For the record, I tested the following with poetry 1.6.1 and it is an issue there, too.

xarray[parallel] is pulling dask[complete]. Nevertheless poetry only install the basic dependencies of dask and ignores dask's extras.
For example dask[complete] should install e.g. bokeh. Nevertheless, poetry does not install it:

poetry init -n
poetry add xarray -E parallel
python -c 'import bokeh'  # fails

• https://pypi.org/pypi/xarray/json
• https://pypi.org/pypi/dask/json

[dimbleby]

bokeh is not part of dask[complete]:

$ curl --silent https://pypi.org/pypi/dask/2023.10.1/json | jq ".info.requires_dist" | grep bokeh
  "bokeh >=2.4.2 ; extra == 'diagnostics'",

please close

edit: and also poetry does not support recursive extras #3369, #7646 so if dask[complete] requires dask[diagnostics] - then this issue is a duplicate of those and still wants closing

[pmav99]

For the record, poetry add xarray="*" -E complete also is not working as expected. It just installs the basic package:

$ poetry add xarray="*" -E complete

Updating dependencies
Resolving dependencies... (6.9s)

Package operations: 8 installs, 0 updates, 0 removals

  • Installing six (1.16.0)
  • Installing numpy (1.26.3)
  • Installing python-dateutil (2.8.2)
  • Installing pytz (2023.3.post1)
  • Installing tzdata (2023.4)
  • Installing packaging (23.2)
  • Installing pandas (2.1.4)
  • Installing xarray (2023.12.0)

If you follow up with python -mpip install 'xarray[complete]' you get:

$  python -m pip install 'xarray[complete]'
Requirement already satisfied: xarray[complete] in ./.venv/lib/python3.11/site-packages (2023.12.0)
Requirement already satisfied: numpy>=1.22 in ./.venv/lib/python3.11/site-packages (from xarray[complete]) (1.26.3)
Requirement already satisfied: packaging>=21.3 in ./.venv/lib/python3.11/site-packages (from xarray[complete]) (23.2)
Requirement already satisfied: pandas>=1.4 in ./.venv/lib/python3.11/site-packages (from xarray[complete]) (2.1.4)
Requirement already satisfied: python-dateutil>=2.8.2 in ./.venv/lib/python3.11/site-packages (from pandas>=1.4->xarray[complete]) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in ./.venv/lib/python3.11/site-packages (from pandas>=1.4->xarray[complete]) (2023.3.post1)
Requirement already satisfied: tzdata>=2022.1 in ./.venv/lib/python3.11/site-packages (from pandas>=1.4->xarray[complete]) (2023.4)
Collecting scipy (from xarray[complete])
Obtaining dependency information for scipy from https://files.pythonhosted.org/packages/6b/d4/d62ce38ba00dc67d7ec4ec5cc19d36958d8ed70e63778715ad626bcbc796/scipy-1.11.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
[....]
Installing collected packages: sortedcontainers, asciitree, zipp, zict, xyzservices, urllib3, tornado, toolz, tblib, scipy, pyyaml, pyparsing, pyarrow-hotfix, pyarrow, psutil, platformdirs, pillow, opt-einsum, numpy-groupies, numcodecs, msgpack, MarkupSafe, lz4, locket, llvmlite, kiwisolver, idna, h5py, fsspec, fonttools, fasteners, cycler, contourpy, cloudpickle, click, charset-normalizer, cftime, certifi, bottleneck, zarr, requests, partd, numba, netCDF4, matplotlib, jinja2, importlib-metadata, h5netcdf, seaborn, pooch, numbagg, nc-time-axis, flox, dask, bokeh, distributed
Successfully installed MarkupSafe-2.1.3 asciitree-0.3.3 bokeh-3.3.3 bottleneck-1.3.7 certifi-2023.11.17 cftime-1.6.3 charset-normalizer-3.3.2 click-8.1.7 cloudpickle-3.0.0 contourpy-1.2.0 cycler-0.12.1 dask-2023.12.1 distributed-2023.12.1 fasteners-0.19 flox-0.8.6 fonttools-4.47.0 fsspec-2023.12.2 h5netcdf-1.3.0 h5py-3.10.0 idna-3.6 importlib-metadata-7.0.1 jinja2-3.1.2 kiwisolver-1.4.5 llvmlite-0.41.1 locket-1.0.0 lz4-4.3.3 matplotlib-3.8.2 msgpack-1.0.7 nc-time-axis-1.4.1 netCDF4-1.6.5 numba-0.58.1 numbagg-0.6.8 numcodecs-0.12.1 numpy-groupies-0.10.2 opt-einsum-3.3.0 partd-1.4.1 pillow-10.2.0 platformdirs-4.1.0 pooch-1.8.0 psutil-5.9.7 pyarrow-14.0.2 pyarrow-hotfix-0.6 pyparsing-3.1.1 pyyaml-6.0.1 requests-2.31.0 scipy-1.11.4 seaborn-0.13.1 sortedcontainers-2.4.0 tblib-3.0.0 toolz-0.12.0 tornado-6.4 urllib3-2.1.0 xyzservices-2023.10.1 zarr-2.16.1 zict-3.0.0 zipp-3.17.0

[github-actions]

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.