Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Modify L0_backend_python bls test for BLS decoupled support #5455

Merged
merged 8 commits into from
Mar 8, 2023

Conversation

krishung5
Copy link
Contributor

The tensor byte size is still at least 1GB in order to trigger the out of memory error.

@krishung5 krishung5 requested a review from Tabrizian March 6, 2023 17:16
Tabrizian
Tabrizian previously approved these changes Mar 6, 2023
@krishung5 krishung5 changed the title Lower the tensor size to avoid intermittent issue Lower the tensor size to avoid intermittent issue and disable multiprocessing for decoupled case for L0_backend_python bls test Mar 6, 2023
@krishung5 krishung5 requested a review from Tabrizian March 6, 2023 17:41
@krishung5 krishung5 changed the title Lower the tensor size to avoid intermittent issue and disable multiprocessing for decoupled case for L0_backend_python bls test Modify L0_backend_python bls test for BLS decoupled support Mar 7, 2023
@krishung5
Copy link
Contributor Author

@Tabrizian I went ahead and added some unittest cases for the response iterator. Please let me know if there is other corner cases that I missed. Thanks!

Tabrizian
Tabrizian previously approved these changes Mar 7, 2023
@krishung5 krishung5 merged commit 6629deb into main Mar 8, 2023
@krishung5 krishung5 deleted the krish-decoupled-bls branch March 8, 2023 16:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants