Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Show loaded model version in logs #552

Open
mck-star-yar opened this issue May 13, 2024 · 2 comments · May be fixed by #588
Open

Show loaded model version in logs #552

mck-star-yar opened this issue May 13, 2024 · 2 comments · May be fixed by #588
Labels
enhancement New feature or request need-design-decision Several ways of implementation are possible and one must be chosen

Comments

@mck-star-yar
Copy link

Description

When I'm using MlflowModelRegistryDataset with the load parameter set to latest logs don't capture the exact version loaded from mlflow. It'd be good to propagate them.

Context

As a DS, looking at the logs I'd like to know what version of model was loaded

Possible Implementation

Ideally, that should live on the mlflow side. But as long as that's not the case we can manually check if user passed the latest arg and log latest version available for the model.

@Galileo-Galilei Galileo-Galilei added enhancement New feature or request need-design-decision Several ways of implementation are possible and one must be chosen labels May 15, 2024
@Galileo-Galilei
Copy link
Owner

Hi, eventually I could store a bunch of metadata but I also think this should live on mlflow's side. I am a bit reluctant to log too many custom things. I think I can log some metadata of the loaded, but I don't know if I should only log it in hte logs, or in mlflow itself (because one may want to load a model without logging the inference run in mlflow, especially in production). Could yu elaborate more on your ideal result?

@mck-star-yar
Copy link
Author

Could yu elaborate more on your ideal result?

Ideal result would be just to show loaded model version, something like: Loaded model version v10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request need-design-decision Several ways of implementation are possible and one must be chosen
Projects
None yet
2 participants