micropkg cannot package modules that are not directly under the src/<project_name>/ directory

[lamhm]

Description

micropkg cannot package sub-folders that are more than 1 level below the src/<project_name>/ folder. This has rendered micropkg unusable for pipelines (if you follow the standard folder structure of Kedro).

Steps to Reproduce

Here was my src folder structure:

src
|-- <project_name>
|   |-- io
|   |   |-- __init__.py
|   |   |-- ...
|   |-- pipelines
|       |-- ...
|       |-- clean_data
|           |-- __init__.py
|           |-- ...
|-- tests
|   |-- ...
|-- ...

Under the [tool.kedro.micropkg.package] spec of pyproject.toml, I had:

[tool.kedro.micropkg.package]
io = {}
pipelines.clean_data = {}

Then, I executed kedro micropkg package --all.

Expected Result

Both the io and the pipelines.clean_data modules should be packaged without problems.

Actual Result

Only the io module was packaged successfully.

Packaging the pipelines.clean_data module raised the following error:

TypeError: _package_micropkg() got an unexpected keyword argument 'clean_data'

My Environment

• Kedro version used: 0.18.4
• Python version used: 3.10.8
• Operating system and version: Ubuntu 20.04

Important Note

To make micropkg works on Kedro 0.18.4, I have manually fixed the bug #2119 on my local environment (by following what @merelcht has described in the bug report). Without this step, micropkg would not work at all.

[noklam]

@lamhm Is this still failing or fixed by #2119 already?

[noklam]

Closing this as I believe this is already fixed in previous releases, feel free to re-open if it isn't the case.

[lamhm]

@noklam: Apologies for my late response.

While testing Kedro 0.18.6, I have just noticed that I forgot to quote the key pipelines.clean_data in the [tool.kedro.micropkg.package] section of project.toml. As soon as I surrounded pipelines.clean_data with quotation marks, micropkg worked perfectly.

So, this may be an invalid bug report. Sorry for having bothered you. And thank you very much for your support.

[noklam]

@lamhm Don't worry at all! Thanks for reporting back😀