Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix sagemaker test suite #1944

Merged
merged 1 commit into from
May 21, 2024
Merged

fix sagemaker test suite #1944

merged 1 commit into from
May 21, 2024

Conversation

siddvenk
Copy link
Contributor

@siddvenk siddvenk commented May 21, 2024

Description

Updating the SM PySDK tests that have been failing for a while. I've removed usage of our custom DJLModel implementation for now, since we need to either update those classes or decide what we do with them moving forward.

For now, these tests validate key functionality on SM endpoints, including:

  • Uncompressed model artifacts with SM native solution (network isolation use-case)
  • LMI and TRT LLM containers with S5cmd and hf hub test-cases
  • MME test

I also removed the partitioning test cases. Test run with these changes https://github.com/deepjavalibrary/djl-serving/actions/runs/9179268954.

We have discussed removing this suite entirely, but I think this is needed/useful to validate key SM functionality works with our containers

@siddvenk siddvenk requested review from zachgk, frankfliu and a team as code owners May 21, 2024 18:51
@siddvenk siddvenk force-pushed the sm-tests branch 2 times, most recently from 73c967a to 67c9154 Compare May 21, 2024 18:53
@siddvenk siddvenk merged commit 83d52bf into master May 21, 2024
8 checks passed
@siddvenk siddvenk deleted the sm-tests branch May 21, 2024 22:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants