Skip to content

Implement sending mixed traffic (json,proto) #3478

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Implement sending mixed traffic (json,proto) #3478

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
b0a394d
Implement sending mixed traffic (json,proto)
arshadd-b Jul 25, 2025
12d583c
add pods cleanup
arshadd-b Sep 5, 2025
57bc108
update delete pods logic
arshadd-b Sep 5, 2025
4e77faf
update list benchmark config.yaml
arshadd-b Sep 9, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 28 additions & 5 deletions clusterloader2/testing/list/config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
{{$configMapGroup := DefaultParam .CL2_LIST_CONFIG_MAP_GROUP "list-configmap"}}

{{$listReplicas := DefaultParam .CL2_LIST_BENCHMARK_PODS 1}}
{{$contentType := DefaultParam .CL2_LIST_BENCHMARK_CONTENT_TYPE "json"}}
{{$contentTypes := (DefaultParam .CL2_LIST_BENCHMARK_CONTENT_TYPE "json") | StringSplit}}

name: list-benchmark
namespace:
Expand Down Expand Up @@ -56,19 +56,20 @@ steps:
bytes: {{$configMapBytes}}
group: {{$configMapGroup}}

{{- range $i, $ct := $contentTypes }}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you tested if this for loop works?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, have tested it, I passed the env variable export CL2_LIST_BENCHMARK_CONTENT_TYPE=json,proto
and it was working fine. I have highlighted json and proto log.

`I0904 12:17:41.288482 96635 exec_service.go:122] Exec service: service set up successfully!
W0904 12:17:41.288517 96635 imagepreload.go:92] No images specified. Skipping image preloading
I0904 12:17:41.291307 96635 clusterloader.go:454] Test config successfully dumped to: generatedConfig_list-benchmark.yaml
I0904 12:17:41.291315 96635 clusterloader.go:243] --------------------------------------------------------------------------------
I0904 12:17:41.291317 96635 clusterloader.go:244] Running ../testing/list/config.yaml
I0904 12:17:41.291319 96635 clusterloader.go:245] --------------------------------------------------------------------------------
I0904 12:17:41.291355 96635 simple_test_executor.go:58] AutomanagedNamespacePrefix: test-2guakh
I0904 12:17:41.324983 96635 simple_test_executor.go:162] Step "[step: 01] Setup namespace for list benchmark pods" started
I0904 12:17:41.440693 96635 simple_test_executor.go:183] Step "[step: 01] Setup namespace for list benchmark pods" ended
I0904 12:17:41.440713 96635 simple_test_executor.go:162] Step "[step: 02] Setup permissions" started
I0904 12:17:41.449398 96635 simple_test_executor.go:183] Step "[step: 02] Setup permissions" ended
I0904 12:17:41.449415 96635 simple_test_executor.go:162] Step "[step: 03] starting measurements" started
I0904 12:17:41.460559 96635 container_memory_usage.go:129] ContainerMemoryUsage: measurement already running
I0904 12:17:41.460576 96635 simple_test_executor.go:183] Step "[step: 03] starting measurements" ended

I0904 12:17:41.460583 96635 simple_test_executor.go:162] Step "[step: 04] Wait 5 minutes for json" started

[{kube-apiserver map[cpu:{{891606624 -9} {} 891606624n DecimalSI} memory:{{228081664 0} {} BinarySI}]}]
names kube-apiserver
I0904 12:18:11.461067 96635 simple_test_executor.go:183] Step "[step: 04] Wait 5 minutes for json" ended
I0904 12:18:11.461088 96635 simple_test_executor.go:162] Step "[step: 05] gathering measurements" started
I0904 12:18:11.464702 96635 container_memory_usage.go:166] ContainerMemoryUsage: measurement already running
I0904 12:18:11.464713 96635 container_memory_usage.go:177] ContainerMemoryUsage: gathering summaries
I0904 12:18:11.464719 96635 container_memory_usage.go:184] %!d(float64=0.2124176025390625): peak
I0904 12:18:11.464721 96635 container_memory_usage.go:185] %!d(float64=1): threshold
I0904 12:18:11.464727 96635 simple_test_executor.go:183] Step "[step: 05] gathering measurements" ended
I0904 12:18:11.464734 96635 simple_test_executor.go:162] Step "[step: 06] starting measurements" started
I0904 12:18:11.465408 96635 container_memory_usage.go:129] ContainerMemoryUsage: measurement already running
I0904 12:18:11.465415 96635 simple_test_executor.go:183] Step "[step: 06] starting measurements" ended

I0904 12:18:11.465419 96635 simple_test_executor.go:162] Step "[step: 07] Wait 5 minutes for proto" started

[{kube-apiserver map[cpu:{{899564744 -9} {} 899564744n DecimalSI} memory:{{226471936 0} {} 221164Ki BinarySI}]}]
names kube-apiserver
I0904 12:18:41.465856 96635 simple_test_executor.go:183] Step "[step: 07] Wait 5 minutes for proto" ended
I0904 12:18:41.465879 96635 simple_test_executor.go:162] Step "[step: 08] gathering measurements" started
I0904 12:18:41.468584 96635 container_memory_usage.go:166] ContainerMemoryUsage: measurement already running
I0904 12:18:41.468592 96635 container_memory_usage.go:177] ContainerMemoryUsage: gathering summaries
I0904 12:18:41.468600 96635 container_memory_usage.go:184] %!d(float64=0.2124176025390625): peak
I0904 12:18:41.468602 96635 container_memory_usage.go:185] %!d(float64=1): threshold
I0904 12:18:41.468606 96635 simple_test_executor.go:183] Step "[step: 08] gathering measurements" ended
I0904 12:18:41.468613 96635 simple_test_executor.go:97] ContainerMemoryUsage: {"peakMemory": %!d(float64=0.2124176025390625), "threshold": %!d(float64=1)}
I0904 12:18:41.468615 96635 simple_test_executor.go:97] ContainerMemoryUsage: {"peakMemory": %!d(float64=0.2124176025390625), "threshold": %!d(float64=1)}
I0904 12:18:51.501218 96635 simple_test_executor.go:411] Resources cleanup time: 10.032641458s
I0904 12:18:51.501232 96635 simple_test_executor.go:414] Tearing down dependencies
I0904 12:18:51.501236 96635 simple_test_executor.go:418] All dependencies torn down successfully, cleanup time: 3.667µs`

- module:
path: modules/list-benchmark.yaml
params:
namePrefix: "list-configmaps-"
namePrefix: "list-configmaps-{{$ct}}-"
replicas: {{$listReplicas}}
uri: /api/v1/configmaps?resourceVersion=0
namespaced: false
contentType: {{$contentType}}
contentType: {{$ct}}
- module:
path: /modules/measurements.yaml
params:
action: start
- name: Wait 5 minutes
- name: Wait 5 minutes for {{$ct}}
measurements:
- Identifier: Wait
Method: Sleep
Expand All @@ -81,5 +82,27 @@ steps:
- module:
path: modules/list-benchmark.yaml
params:
namePrefix: "list-configmaps-"
namePrefix: "list-configmaps-{{$ct}}-"
replicas: 0
- name: Deleting list-configmaps-{{$ct}}-deployment
phases:
- tuningSet: Sequence
replicasPerNamespace: 0
namespaceRange:
min: 0
max: 0
basename: list-benchmark
objectBundle:
- basename: "list-configmaps-{{$ct}}-deploy"
objectTemplatePath: deployment.yaml
templateFillMap:
Replicas: {{$listReplicas}}
Uri: /api/v1/configmaps?resourceVersion=0
ContentType: {{$ct}}
- name: Wait 5 minutes for apiserver garbage collection
measurements:
- Identifier: Wait
Method: Sleep
Params:
duration: 5m
{{- end }}