Add GitLab CI to stress test upper bound of the endpoint measurement

[nvzhihanj]

Develop the proper e2e CI test to make sure:

1. the inference endpoint measurement matches the server capality (the server is not bottlenecked by the client)
2. Inference endpoint client is not bottlenecked by any of the components (the client is not bottlenecked by the components)