Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add installed_extensions information #2018

Merged
merged 4 commits into from
Sep 16, 2024

Conversation

romain-intel
Copy link
Contributor

This adds information to the system tags about the metaflow extensions that are installed. This makes it easier to reproduce the exact same environment. Information about whether the package information is complete or not is also included.

This PR also fixes some issues with extension loading and allows extension information to be gathered in a programatic fashion thereby enabling the discovery of extensions.

@romain-intel
Copy link
Contributor Author

Fixes #1974

This adds information to the system tags about the metaflow extensions that
are installed. This makes it easier to reproduce the exact same
environment. Information about whether the package information is complete or
not is also included.

This PR also fixes some issues with extension loading and allows extension
information to be gathered in a programatic fashion thereby enabling the
discovery of extensions.
@romain-intel romain-intel merged commit 5bb6cf3 into fix/version-info Sep 16, 2024
1 check passed
@romain-intel romain-intel deleted the fix/add-ext-info-to-env branch September 16, 2024 06:23
romain-intel added a commit that referenced this pull request Sep 16, 2024
* Modify getting Metaflow version

Favors reading the INFO file if present to be able to have the
most accurate version of Metaflow when executing remotely (especially in
the presence of extensions).

Also limit reading the INFO file to once per process (as opposed to possibly
twice).

Finally, gets the version of the source of Metaflow (and not the current
directory)

* Addressed comments

* Add support for overriding version string

* Fix issue with brew (hopefully)

* Revert "Add support for overriding version string"

This reverts commit 0434e97.

* Add installed_extensions information (#2018)

* Add installed_extensions information

This adds information to the system tags about the metaflow extensions that
are installed. This makes it easier to reproduce the exact same
environment. Information about whether the package information is complete or
not is also included.

This PR also fixes some issues with extension loading and allows extension
information to be gathered in a programatic fashion thereby enabling the
discovery of extensions.

* Allow users to configure where extensions are searched

* Move EXTENSIONS_SEARCH_DIRS out of config

* Move the extension installation information to _graph_info

* Use .metadata[X] for name and version since not all importlibs have the aliases
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant