Skip to content

Kubernetes performance test#84

Merged
AlexanderWells-diamond merged 19 commits intomainfrom
kubernetes_performance_test
Jul 11, 2023
Merged

Kubernetes performance test#84
AlexanderWells-diamond merged 19 commits intomainfrom
kubernetes_performance_test

Conversation

@AlexanderWells-diamond
Copy link
Contributor

@AlexanderWells-diamond AlexanderWells-diamond commented Jul 4, 2023

This PR contains changes necessary to build the Performance Test script into a pair of Containers, one for the IOC and one for the Python test client. There are also many tweaks to the scripts to make them work in Kubernetes.

See the PR the deployment repo for further details.

Sets up a Coniql server, IOC, and a variable number of Python client
programs.

Collects various data about the system and prints it to terminal.
This is very convenient for various Kubernetes deployment files
This one was recommended to us by the Cloud team as being little used
and so therefore the most likely to be most stable
This allows easy usage of parameters to configure the tests
This helps ensure we retrieve the right data from Prometheus
@AlexanderWells-diamond AlexanderWells-diamond self-assigned this Jul 4, 2023
When we run the test repeatedly, its possible for the previous Coniql
server to not have finished terminating when the new one is starting
This means we won't accidentally start running the Jobs before Coniql
is ready to receive data.

Previously we would occasionally see TimeoutError() coming from
websockets.connect().

Also reduced CPU usage as the clients really don't need much.
This allows us to see progress messages in Kubernetes pods
Most stdout output is now dumped into /dev/null as we just don't need it
@codecov
Copy link

codecov bot commented Jul 5, 2023

Codecov Report

Merging #84 (86054d9) into main (df500bd) will not change coverage.
The diff coverage is n/a.

❗ Current head 86054d9 differs from pull request most recent head db87a2f. Consider uploading reports for the commit db87a2f to get more accurate results

@@           Coverage Diff           @@
##             main      #84   +/-   ##
=======================================
  Coverage   93.30%   93.30%           
=======================================
  Files          10       10           
  Lines         807      807           
=======================================
  Hits          753      753           
  Misses         54       54           

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

They don't belong in this repository
This appeared a few times while running the Kubernetes tests.
Some of this was remnants from when the kubernetes test was in this repo
@AlexanderWells-diamond AlexanderWells-diamond force-pushed the kubernetes_performance_test branch from 4dfdf64 to 86054d9 Compare July 10, 2023 12:02
@AlexanderWells-diamond AlexanderWells-diamond marked this pull request as ready for review July 10, 2023 12:04
Copy link
Collaborator

@rjwills28 rjwills28 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@AlexanderWells-diamond AlexanderWells-diamond merged commit 1d8c7ff into main Jul 11, 2023
@AlexanderWells-diamond AlexanderWells-diamond deleted the kubernetes_performance_test branch July 11, 2023 14:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants