Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Removing support for MultiMessage from stages #1803

Merged

Conversation

yczhang-nv
Copy link
Contributor

@yczhang-nv yczhang-nv commented Jul 8, 2024

Description

Part of finalizing MultiMessage deprecation. Previously the stages support processing both ControlMessage and MultiMessage - this PR removes the code paths for MultiMessage from the following stages (from both C++ & Python implementation):

  • Pre-process stages:

    • deserialize_stage
    • preprocess_base_stage
    • preprocess_ae_stage
    • preprocess_fil_stage
    • preprocess_nlp_stage
    • train_ae_stage
  • Post-process stages:

    • serialize_stage
    • add_scores_stage_base_stage
    • add_scores_stage
    • add_classification_stage
    • filter_detections_stage
    • generate_viz_frames_stage
    • ml_flow_drift_stage
    • time_series_stage
    • validation_stage
  • Inference stages:

    • auto_encoder_inference_stage
    • identity_inference_stage
    • inference_stage
    • pytorch_inference_stage
    • triton_inference_stage
  • Output stages:

    • write_to_vector_db_stage

The related unit tests are also updated to use only ControlMessage.

Morpheus examples that imports stages/messages directly (rather than creating their own version) are also updated to get CI passed for this PR.

Closes #1887

By Submitting this PR I confirm:

  • I am familiar with the Contributing Guidelines.
  • When the PR is ready for review, new or existing tests cover these changes.
  • When the PR is ready for review, the documentation is up to date with these changes.

@yczhang-nv yczhang-nv added breaking Breaking change improvement Improvement to existing functionality labels Jul 8, 2024
@yczhang-nv yczhang-nv self-assigned this Jul 8, 2024
@yczhang-nv yczhang-nv requested a review from a team as a code owner July 8, 2024 19:05
@yczhang-nv yczhang-nv marked this pull request as draft July 8, 2024 19:05
…y-to-cpp-for-control-message' into complete-remove-multi-message"

This reverts commit 38e8f9c, reversing
changes made to c4a7095.
This reverts commit 41e9e2f.
@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv
Copy link
Contributor Author

/ok to test

@mdemoret-nv
Copy link
Contributor

/ok to test

Copy link
Contributor

@mdemoret-nv mdemoret-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed. Will check for completness in #1886

@mdemoret-nv
Copy link
Contributor

/ok to test

Copy link
Contributor

@dagardner-nv dagardner-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, just one small docstring fix needed

@yczhang-nv yczhang-nv requested a review from a team as a code owner September 10, 2024 23:32
@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv
Copy link
Contributor Author

/merge

@rapids-bot rapids-bot bot merged commit 1d02332 into nv-morpheus:branch-24.10 Sep 11, 2024
13 checks passed
rapids-bot bot pushed a commit that referenced this pull request Sep 12, 2024
Should be merged after merging #1803.

The Final step of completely remove `MultiMessage` from the whole Morpheus repo.

This PR removes `MultiMessage` and its sub-classes. All occurrences of `MultiMessage` and its sub-classes in examples and docs are updated to `ControlMessage`.

Closes #1802 

## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/nv-morpheus/Morpheus/blob/main/docs/source/developer_guide/contributing.md).
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.

Authors:
  - Yuchen Zhang (https://github.com/yczhang-nv)
  - Michael Demoret (https://github.com/mdemoret-nv)

Approvers:
  - David Gardner (https://github.com/dagardner-nv)
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #1886
@yczhang-nv yczhang-nv deleted the complete-remove-multi-message branch September 16, 2024 21:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
breaking Breaking change improvement Improvement to existing functionality
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

Removes the code path of MultiMessage from pre-process stages, post-process stages, inference stages, etc.
3 participants