Skip to content

Conversation

@tjhunter
Copy link
Collaborator

Description

Adds a cleanup script for mlflow runs. This script keeps tags, last metrics values, configuration, but it discards metric history and attachments (artifacts). This is still present on S3 or the HPCs.

Issue Number

Closes #1482

Checklist before asking for review

  • I have performed a self-review of my code
  • My changes comply with basic sanity checks:
    • I have fixed formatting issues with ./scripts/actions.sh lint
    • I have run unit tests with ./scripts/actions.sh unit-test
    • I have documented my code and I have updated the docstrings.
    • I have added unit tests, if relevant
  • I have tried my changes with data and code:
    • I have run the integration tests with ./scripts/actions.sh integration-test
    • (bigger changes) I have run a full training and I have written in the comment the run_id(s): launch-slurm.py --time 60
    • (bigger changes and experiments) I have shared a hegdedoc in the github issue with all the configurations and runs for this experiments
  • I have informed and aligned with people impacted by my change:
    • for config changes: the MatterMost channels and/or a design doc
    • for changes of dependencies: the MatterMost software development channel

@github-actions github-actions bot added the infra Issues related to infrastructure label Dec 18, 2025
@tjhunter tjhunter requested a review from grassesi December 30, 2025 10:36
@grassesi grassesi merged commit 5ec2888 into develop Jan 7, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

infra Issues related to infrastructure

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Quota issues on databricks

3 participants