Skip to content

[BUG]: Not all models in models/triton-model-repo are compatible with Triton 24.09 #2025

Closed

Description

Version

24.10

Which installation method(s) does this occur on?

No response

Describe the bug.

Incompatible models are:

  • phishing-bert-trt (we're using phishing-bert-onnx)
  • ransomw-model-long-rf (we're using ransomw-model-short-rf)
  • ransomw-model-medium-rf (we're using ransomw-model-short-rf)
  • sid-minibert-trt (we're using sid-minibert-onnx)

None of these are used by any of the documented workflows

Minimum reproducible example

docker run --rm -ti --gpus=all -p8000:8000 -p8001:8001 -p8002:8002 \
  nvcr.io/nvidia/morpheus/morpheus-tritonserver-models:24.10 \
  tritonserver --model-repository=/models/triton-model-repo \
    --exit-on-error=false \
    --log-info=true \
    --strict-readiness=false \
    --disable-auto-complete-config

Relevant log output

Click here to see error details

[Paste the error here, it will be hidden by default]

Full env printout

Click here to see environment details

[Paste the results of print_env.sh here, it will be hidden by default]

Other/Misc.

No response

Code of Conduct

  • I agree to follow Morpheus' Code of Conduct
  • I have searched the open bugs and have found no duplicates for this bug report
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Labels

bugSomething isn't working

Type

No type

Projects

  • Status

    Done

Relationships

None yet

Development

No branches or pull requests

Issue actions