Skip to content

[FEA] Improve What Is Stored In CI Artifacts to Reduce Size and Allow for In-Place Builds #112

Closed

Description

Is your feature request related to a problem? Please describe.
The original implementation of the CI system in PR #80, saves the entire conda environment and workspace as artifacts to allow for the built morpheus packages to be used in docs and testing. It seems that this is necessary because the cudf packages are installed into the conda environment and the morpheus packages are installed as in-place developer builds. This requires both the workspace and conda environment to be zipped up and moved to the next build stage.

Describe the solution you'd like
Taring up the entire conda environment is a bit unnecessary and will require 4+ GB of storage per build when the majority of the files are the same. Instead, we only need a few packages to be transferred between the build and test/docs phase:

  1. The built cudf conda package
  2. The built morpheus conda package
  3. The built morpheus wheel package
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

Labels

Type

No type

Projects

  • Status

    Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions