Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix long-running stress test #3346

Merged
merged 7 commits into from
Sep 13, 2021
Merged

Fix long-running stress test #3346

merged 7 commits into from
Sep 13, 2021

Conversation

krishung5
Copy link
Contributor

No description provided.

@@ -51,7 +51,7 @@

FLAGS = None
CORRELATION_ID_BLOCK_SIZE = 100
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make CORRELATION_ID_BLOCK_SIZE much larger... 1024 * 1024

# instead of being a sequence missing start flag, which gives results
# not expected.
if test_case_name == "sequence_no_start":
sequence_id *= 10
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just multiplying by 10 seems a little magical... I think there is a better way described below

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will remove this part and use the original approach mentioned below.

qa/L0_long_running_stress/stress.py Show resolved Hide resolved
deadeyegoodwin
deadeyegoodwin previously approved these changes Sep 9, 2021
CoderHam
CoderHam previously approved these changes Sep 10, 2021
@krishung5
Copy link
Contributor Author

@deadeyegoodwin I think the original logic doesn't work well is because in the original sequence stress test, we only serve one model, so we can just use the last_seq_choice to see if the last sequence case is some no-end cases. But we are serving multiple models in this stress test, so we need to remember which model is used for the no-end cases.

@deadeyegoodwin deadeyegoodwin merged commit 4301e4b into main Sep 13, 2021
@deadeyegoodwin deadeyegoodwin deleted the krish-fix-stress-test branch September 13, 2021 16:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

3 participants