Add antrea scale test tool #5772

wenqiq · 2023-12-05T11:01:55Z

Add antrea scale test tool.
antrea-scale provides an automated testing tool for Container Network Interface (CNI), enabling
the scalable testing of Antrea CNI plugins' fundamental functionalities in Kubernetes clusters.
This includes testing features such as Service network support and NetworkPolicy network isolation
in a Kubernetes Cluster.

Signed-off-by: Wenqi Qiu wenqiq@vmware.com
Co-authored-by: Shuyang Xin gavinx@vmware.com
Co-authored-by: Weiqiang Tang weiqiangt@vmware.com

wenqiq · 2024-01-12T03:31:09Z

/test-scale

build/images/Dockerfile.scale

Makefile

cmd/antrea-agent-simulator/README

test/performance/assets/np-1-ingress.yaml

test/performance/assets/np-ingress.yml

test/performance/assets/tmp.json

ci/test-scale.sh

luolanzone · 2024-01-16T09:05:25Z

test/performance/README.md

Please add the details of this scale test tool to help reviewers and users to understand the framework and how to use it.

build/images/Dockerfile.scale

luolanzone

not finished

build/images/Dockerfile.scale

build/yamls/antrea-scale-exec.yml

ci/jenkins/test-scale.sh

test/performance/framework/agent.go

luolanzone · 2024-03-28T03:58:26Z

test/performance/framework/agent.go

+	var clientPod *corev1.Pod
+	clientPod, err = client_pod.CreatePod(ctx, data.kubernetesClientSet, []string{prober}, client_pod.ScaleClientPodControllerProbeContainer, client_pod.ClientPodsNamespace)
+	if err != nil {
+		klog.ErrorS(err, "Create client test Pod failed")


Suggested change

klog.ErrorS(err, "Create client test Pod failed")

klog.ErrorS(err, "Failed to create client test Pod")

or client test Pod creation failed
Please check your logs and comments, there are lots of syntax error.

luolanzone · 2024-04-12T03:57:20Z

@wenqiq you can run make golangci locally to avoid golint error before you push the code to github.

ci/jenkins/test-scale.sh

test/performance/monitoring/node_exporter/node-exporter.yml

test/performance/monitoring/grafana/grafana.yml

test/performance/utils/util_test.go

XinShuYang · 2024-06-03T03:04:48Z

ci/jenkins/test-scale.sh

@@ -0,0 +1,302 @@
+#!/usr/bin/env bash


I suppose this script should be integrated with Jenkins, right? If so, ci/jenkins/jobs/macros.yaml and ci/jenkins/jobs/projects-lab.yaml should also be updated.

Will update ci/jenkins/test-scale.sh ci/jenkins/jobs/macros.yaml ci/jenkins/jobs/projects-lab.yaml together.

Will update ci/jenkins/test-scale.sh ci/jenkins/jobs/macros.yaml ci/jenkins/jobs/projects-lab.yaml together.

Got it @wenqiq , I will review it again once the updates have been made.

test/performance/framework/case.go

test/performance/config/config.go

test/performance/framework/agent.go

luolanzone · 2024-03-29T02:43:04Z

test/performance/framework/agent.go

+		return
+	}
+	startTime := time.Now().UnixNano()
+	klog.InfoS("Deleting operate time", "Duration(ms)", (startTime-startTime0)/1000000)


Suggested change

klog.InfoS("Deleting operate time", "Duration(ms)", (startTime-startTime0)/1000000)

klog.InfoS("Deleting operation time", "Duration(ms)", (startTime-startTime0)/1000000)

One question, do we need to check this operation time?

Just for reference in case we would check the operation time. I changed the log level.

test/performance/README.md

luolanzone · 2024-06-03T03:49:41Z

test/performance/README.md

+    repeat_times: 1
+```
+
+## 3. Flexibility & Assemblability


The following two parts are for configuration details, you can remove this title.

test/performance/README.md

luolanzone · 2024-06-03T03:54:19Z

test/performance/README.md

+## 5. Multiple platforms(Different CNIs)
+
+Additionally, for some common functional features, it's essential to compare the performance
+differences between different CNIs to understand our shortcomings or advantages.
+The scale test tool can run tests on different Kubernetes platforms and compare the performance
+metrics of different CNIs.


Have you tried with different CNIs? If yes, please highlight the configuration yaml differences and requirements, I don't think the case like ScaleRestartAgent will work for other CNIs. If not, please remove this section.

Of course. I think we can use ScaleService and ScaleNetworkPolicy to test any other CNIs.

scales: - name: "ScaleUpWorkloadPods" package: "test/performance/framework" repeat_times: 1 - name: "ScaleService" package: "test/performance/framework" repeat_times: 1 - name: "ScaleNetworkPolicy" package: "test/performance/framework" repeat_times: 1

luolanzone · 2024-06-03T03:56:36Z

test/performance/README.md

+
+## 6. Measure and monitoring
+
+The Antrea scale test tool also integrates monitoring tools, with Prometheus and Grafana,


Please provide the details about how to install monitoring tools, or at least point out the deploy.sh script and the path of dashboards, Otherwise, user might not be aware of these tools and pre-defined dashboards.

Signed-off-by: Wenqi Qiu <wenqiq@vmware.com>

Signed-off-by: Shuyang Xin <gavinx@vmware.com>

Signed-off-by: Wenqi Qiu <wenqiq@vmware.com>

github-actions · 2024-10-02T00:04:56Z

This PR is stale because it has been open 90 days with no activity. Remove stale label or comment, or this will be closed in 90 days

wenqiq mentioned this pull request Dec 5, 2023

Antrea scale tests for end-to-end performance improvement #5645

Open

wenqiq force-pushed the scale-test-dev-test-2023-11 branch from 125c0e0 to b6838a4 Compare December 7, 2023 01:17

wenqiq force-pushed the scale-test-dev-test-2023-11 branch 2 times, most recently from 9ff82e6 to e3be479 Compare January 9, 2024 18:15

wenqiq force-pushed the scale-test-dev-test-2023-11 branch from e3be479 to a88ddec Compare January 12, 2024 03:30

wenqiq force-pushed the scale-test-dev-test-2023-11 branch 2 times, most recently from e72ab5a to cc75d96 Compare January 15, 2024 09:34

luolanzone reviewed Jan 16, 2024

View reviewed changes

luolanzone added this to the Antrea v1.16 release milestone Jan 16, 2024

wenqiq changed the title ~~Add antrea scale test tool~~ [Not4Review]Add antrea scale test tool Jan 18, 2024

wenqiq force-pushed the scale-test-dev-test-2023-11 branch from 1af3a7f to 0ef720d Compare March 24, 2024 09:58

wenqiq changed the title ~~[Not4Review]Add antrea scale test tool~~ Add antrea scale test tool Mar 24, 2024

wenqiq force-pushed the scale-test-dev-test-2023-11 branch 2 times, most recently from 0039d9a to 55d084a Compare March 24, 2024 14:16

rajnkamr reviewed Mar 25, 2024

View reviewed changes

build/images/Dockerfile.scale Outdated Show resolved Hide resolved

wenqiq marked this pull request as ready for review March 26, 2024 06:57

luolanzone reviewed Mar 28, 2024

View reviewed changes

wenqiq force-pushed the scale-test-dev-test-2023-11 branch 2 times, most recently from 2f01337 to f7dacb3 Compare April 11, 2024 03:10

wenqiq force-pushed the scale-test-dev-test-2023-11 branch from e0d2552 to 2b54394 Compare April 12, 2024 05:57

luolanzone modified the milestones: Antrea v2.0 release, Antrea v2.1 release Apr 16, 2024

wenqiq force-pushed the scale-test-dev-test-2023-11 branch 3 times, most recently from a5137cf to 491bcee Compare May 21, 2024 22:57

luolanzone requested review from tnqn, edwardbadboy and XinShuYang May 29, 2024 05:46

XinShuYang reviewed May 29, 2024

View reviewed changes

ci/jenkins/test-scale.sh Outdated Show resolved Hide resolved

XinShuYang reviewed May 29, 2024

View reviewed changes

test/performance/monitoring/node_exporter/node-exporter.yml Outdated Show resolved Hide resolved

XinShuYang reviewed May 29, 2024

View reviewed changes

test/performance/monitoring/grafana/grafana.yml Outdated Show resolved Hide resolved

XinShuYang reviewed May 29, 2024

View reviewed changes

test/performance/utils/util_test.go Outdated Show resolved Hide resolved

XinShuYang reviewed Jun 3, 2024

View reviewed changes

luolanzone reviewed Jun 3, 2024

View reviewed changes

wenqiq and others added 2 commits June 5, 2024 02:48

Implement large scale performance test

2e07700

Signed-off-by: Wenqi Qiu <wenqiq@vmware.com>

[NOTFORREVIEW] Scale test

55aa720

Signed-off-by: Shuyang Xin <gavinx@vmware.com>

wenqiq force-pushed the scale-test-dev-test-2023-11 branch from 491bcee to a55303a Compare June 4, 2024 19:12

Address comments

c0f69af

Signed-off-by: Wenqi Qiu <wenqiq@vmware.com>

wenqiq force-pushed the scale-test-dev-test-2023-11 branch from a55303a to c0f69af Compare June 5, 2024 00:45

luolanzone removed this from the Antrea v2.1 release milestone Jul 3, 2024

github-actions bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Oct 2, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add antrea scale test tool #5772

Add antrea scale test tool #5772

wenqiq commented Dec 5, 2023 •

edited

Loading

wenqiq commented Jan 12, 2024

luolanzone Jan 16, 2024

luolanzone left a comment

luolanzone Mar 28, 2024

luolanzone commented Apr 12, 2024

XinShuYang Jun 3, 2024

wenqiq Jun 5, 2024

XinShuYang Jul 3, 2024

luolanzone Mar 29, 2024

wenqiq Jun 5, 2024

luolanzone Jun 3, 2024

luolanzone Jun 3, 2024

wenqiq Jun 5, 2024

luolanzone Jun 3, 2024

wenqiq Jun 5, 2024

github-actions bot commented Oct 2, 2024

	klog.ErrorS(err, "Create client test Pod failed")
	klog.ErrorS(err, "Failed to create client test Pod")

	klog.InfoS("Deleting operate time", "Duration(ms)", (startTime-startTime0)/1000000)
	klog.InfoS("Deleting operation time", "Duration(ms)", (startTime-startTime0)/1000000)


		## 6. Measure and monitoring

		The Antrea scale test tool also integrates monitoring tools, with Prometheus and Grafana,

Add antrea scale test tool #5772

Are you sure you want to change the base?

Add antrea scale test tool #5772

Conversation

wenqiq commented Dec 5, 2023 • edited Loading

wenqiq commented Jan 12, 2024

Choose a reason for hiding this comment

luolanzone left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

luolanzone commented Apr 12, 2024

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

github-actions bot commented Oct 2, 2024

wenqiq commented Dec 5, 2023 •

edited

Loading