NO-ISSUE: Automated - Update synthetic test data

[openshift-bot]

disruptions Information

There were (153) added jobs and (224) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 405 jobs increased and 1496 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
kube-api-http1-localhost-reused-connections	4.21	4.21	amd64	ovn	azure	ha	477	1m15.2s	99.47%	1m32.2s	143.02%
kube-api-http1-localhost-new-connections	4.21	4.21	amd64	ovn	aws	ha	509	1m2.6s	40.99%	1m15.84s	68.98%
kube-api-http2-service-network-reused-connections	4.20	4.19	amd64	ovn	azure	ha	139	7s	600.00%	18.96s	35.43%
openshift-api-http2-internal-lb-reused-connections	4.21	4.21	amd64	ovn	aws	ha	509	6s	50.00%	9.92s	148.00%
image-registry-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	3s	50.00%	1m0.91s	1118.20%
openshift-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	2s	100.00%	5.86s	45.05%
service-load-balancer-with-pdb-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	2s	100.00%	7s	75.00%
ci-cluster-network-liveness-new-connections	4.21	4.20	amd64	ovn	aws	ha	1246	2s	100.00%	12.55s	77.01%
image-registry-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	3s	50.00%	28s	48.70%
ci-cluster-network-liveness-new-connections	4.21		amd64	ovn	vsphere	ha	102	1s	400.00%	46.69s	30.27%
ci-cluster-network-liveness-new-connections	4.20		amd64	ovn	aws	external	152	0s	0.00%	3.47s	101.74%
ci-cluster-network-liveness-new-connections	4.20		ppc64le	ovn	none	ha	242	0s	0.00%	20.59s	55.40%
metrics-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	5.24s	73.51%
cache-kube-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	4.48s	339.22%
image-registry-reused-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	52.3s	2515.00%
aws-network-liveness-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	0s	0.00%	1s	122.22%
ingress-to-oauth-server-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	1.41s	41.00%
metrics-api-reused-connections	4.20	4.20	amd64	ovn	gcp	ha	187	700ms	0.00%	2.26s	126.00%
cache-openshift-api-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	8.15s	103.75%
host-to-service-new-connections	4.20	4.20	amd64	ovn	gcp	ha	187	1s	0.00%	1.56s	56.00%
ci-cluster-network-liveness-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	2.1s	0.00%	9.86s	388.12%
image-registry-reused-connections	4.20	4.20	amd64	ovn	gcp	ha	187	1s	0.00%	9.58s	379.00%
ci-cluster-network-liveness-new-connections	4.20	4.20	amd64	ovn	gcp	ha	187	0s	0.00%	16.18s	124.10%
oauth-api-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	6.1s	37.08%
ingress-to-console-reused-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	620ms	3000.00%
host-to-host-reused-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	1.86s	9200.00%
azure-network-liveness-new-connections	4.20		amd64	ovn	azure	external	593	2s	0.00%	2m8.64s	76.90%
ingress-to-console-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	8.1s	101.49%
ingress-to-oauth-server-reused-connections	4.20	4.19	amd64	ovn	gcp	ha	160	50ms	0.00%	1.41s	41.00%
metrics-api-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	6.28s	57.00%
cache-oauth-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	4s	277.36%
image-registry-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	5.24s	403.85%
ingress-to-console-reused-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	1.41s	41.00%
oauth-api-reused-connections	4.20	4.19	amd64	ovn	azure	ha	139	1s	0.00%	3s	48.51%
service-load-balancer-with-pdb-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	9.48s	207.79%
image-registry-new-connections	4.20		amd64	ovn	aws	ha	233	0s	0.00%	22.68s	54.81%
ingress-to-oauth-server-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	7.86s	281.55%
image-registry-new-connections	4.20	4.20	amd64	ovn	gcp	ha	187	2s	0.00%	10.3s	197.69%
kube-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	1s	0.00%	4.24s	41.33%
gcp-network-liveness-new-connections	4.20		amd64	ovn	azure	external	593	0s	0.00%	1m29.6s	97.62%
kube-api-http1-internal-lb-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	620ms	3000.00%
cache-kube-api-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	6.51s	62.75%
cache-openshift-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	3.62s	79.21%
pod-to-service-new-connections	4.20	4.20	amd64	ovn	gcp	ha	187	1s	0.00%	1.7s	70.00%
kube-api-http2-internal-lb-new-connections	4.20	4.20	amd64	ovn	gcp	ha	187	0s	0.00%	1s	117.39%
openshift-api-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	0s	0.00%	5.51s	83.67%
openshift-api-reused-connections	4.20		amd64	ovn	aws	ha	233	1s	0.00%	2.68s	34.00%
ci-cluster-network-liveness-reused-connections	4.21		amd64	ovn	vsphere	ha	102	0s	0.00%	4.96s	39.33%
kube-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	8.8s	206.62%
kube-api-http2-internal-lb-reused-connections	4.21	4.21	amd64	ovn	aws	ha	509	6s	0.00%	7s	41.13%
cache-oauth-api-reused-connections	4.21		s390x	ovn	none	ha	117	37s	0.00%	7m53.96s	61.90%
kube-api-http2-localhost-new-connections	4.21	4.21	amd64	ovn	gcp	ha	1259	57s	0.00%	1m4.42s	40.13%
host-to-host-new-connections	4.21	4.20	amd64	ovn	azure	ha	1176	0s	0.00%	1m31.25s	146.89%
kube-api-http2-localhost-reused-connections	4.21	4.21	amd64	ovn	gcp	ha	1259	57s	0.00%	1m4.42s	43.25%
ingress-to-console-reused-connections	4.21	4.20	amd64	ovn	aws	ha	1246	0s	0.00%	1.55s	55.00%
openshift-api-http2-service-network-reused-connections	4.21	4.20	amd64	ovn	gcp	ha	621	0s	0.00%	6.6s	560.00%
cache-kube-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.75%
kube-api-reused-connections	4.21	4.20	amd64	ovn	azure	ha	1176	1s	0.00%	3.25s	62.50%
oauth-api-new-connections	4.21	4.21	amd64	ovn	aws	ha	509	0s	0.00%	1.92s	41.18%
kube-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.64%
metrics-api-new-connections	4.21		arm64	ovn	aws	ha	134	0s	0.00%	17.42s	52.27%
ingress-to-console-new-connections	4.21		s390x	ovn	none	ha	117	1m35.4s	0.00%	8m0.2s	46.07%
cache-openshift-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	8s	106.72%
cache-openshift-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.64%
ci-cluster-network-liveness-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	3s	0.00%	14.8s	640.00%
cache-oauth-api-new-connections	4.21	4.21	amd64	ovn	gcp	ha	1259	1s	0.00%	13.42s	37.92%
kube-api-reused-connections	4.21		s390x	ovn	none	ha	117	38.4s	0.00%	7m53.8s	62.26%
openshift-api-reused-connections	4.21		s390x	ovn	none	ha	117	39.8s	0.00%	7m53.8s	62.26%
pod-to-host-new-connections	4.21	4.20	amd64	ovn	azure	ha	1176	0s	0.00%	1m13.5s	198.30%
host-to-host-reused-connections	4.21	4.20	amd64	ovn	azure	ha	1176	0s	0.00%	15.25s	1488.54%
kube-api-http1-service-network-reused-connections	4.21		amd64	ovn	vsphere	ha	102	0s	0.00%	1s	56.25%
openshift-api-http2-internal-lb-reused-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	12.4s	1140.00%
oauth-api-reused-connections	4.21		amd64	ovn	vsphere	ha	102	0s	0.00%	990ms	54.69%
host-to-host-reused-connections	4.21	4.21	amd64	ovn	azure	ha	477	0s	0.00%	7.24s	424.64%
oauth-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.64%
cache-kube-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	8.6s	199.65%
image-registry-reused-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	28s	48.70%
ingress-to-oauth-server-new-connections	4.21		s390x	ovn	none	ha	117	1m35.2s	0.00%	8m0.2s	46.18%
kube-api-http2-service-network-reused-connections	4.21		amd64	ovn	vsphere	ha	102	0s	0.00%	1s	56.25%
openshift-api-http2-service-network-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	0s	0.00%	19.6s	84.73%
openshift-api-reused-connections	4.21	4.20	amd64	ovn	azure	ha	1176	1s	0.00%	4s	33.33%
ingress-to-oauth-server-reused-connections	4.21		s390x	ovn	none	ha	117	1m5.8s	0.00%	7m55.4s	58.60%
cache-kube-api-reused-connections	4.21		s390x	ovn	none	ha	117	37.6s	0.00%	7m53.8s	62.26%
metrics-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	9.8s	106.75%
openshift-api-http2-internal-lb-reused-connections	4.21		amd64	ovn	vsphere	ha	102	0s	0.00%	990ms	54.69%
kube-api-http2-internal-lb-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	0s	0.00%	6.6s	560.00%
cache-openshift-api-reused-connections	4.21		s390x	ovn	none	ha	117	45.4s	0.00%	7m53.8s	62.26%
metrics-api-reused-connections	4.21		arm64	ovn	aws	ha	134	0s	0.00%	17.42s	52.27%
kube-api-http1-internal-lb-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	0s	0.00%	7.2s	620.00%
metrics-api-reused-connections	4.21		s390x	ovn	none	ha	117	51.2s	0.00%	7m51.08s	68.54%
oauth-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	10s	400.00%
ingress-to-console-reused-connections	4.21		s390x	ovn	none	ha	117	1m5.4s	0.00%	7m55.4s	58.47%
oauth-api-reused-connections	4.21		s390x	ovn	none	ha	117	32.4s	0.00%	7m53.8s	62.26%
cache-oauth-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.64%
metrics-api-new-connections	4.21		s390x	ovn	none	ha	117	1m37.2s	0.00%	7m59.4s	47.73%
cache-oauth-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	11s	184.24%
kube-api-http1-localhost-new-connections	4.21	4.21	amd64	ovn	gcp	ha	1259	57s	0.00%	1m4.42s	40.13%
openshift-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	8.8s	56.86%
openshift-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.64%
openshift-api-http2-internal-lb-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	0s	0.00%	17.6s	1660.00%

alerts Information

There were (3810) added jobs and (1830) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 39 jobs increased and 430 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
ClusterOperatorDegraded openshift-cluster-version Warning	4.21	4.21	amd64	ovn	azure	ha	138	2h14m39.4s	433.72%	3h8m11.36s	117.84%
ClusterOperatorDegraded openshift-cluster-version Warning	4.21	4.21	amd64	ovn	aws	ha	146	1h53m46.5s	49.17%	3h12m21.1s	127.72%
CannotRetrieveUpdates openshift-cluster-version Warning	4.21		amd64	ovn	aws	ha	260	28m32.1s	135.79%	1h11m45.94s	109.83%
NodeSystemSaturation openshift-monitoring Warning	4.20		amd64	ovn	metal	ha	321	58s	195.92%	13m56s	120.70%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.20		amd64	ovn	aws	ha	354	0s	0.00%	2m10.3s	1007.99%
NodeSystemSaturation openshift-monitoring Warning	4.20		amd64	ovn	azure	ha	158	0s	0.00%	5m45.7s	48.24%
NodeSystemSaturation openshift-monitoring Warning	4.20		amd64	ovn	gcp	ha	179	2.8s	0.00%	19m1s	156.92%
HighOverallControlPlaneMemory openshift-machine-config-operator Warning	4.20		amd64	ovn	aws	ha	354	20.7s	0.00%	12m15.96s	61.92%
NodeSystemSaturation openshift-monitoring Warning	4.20		amd64	ovn	aws	ha	354	0s	0.00%	7m56.94s	39.15%
CannotRetrieveUpdates openshift-cluster-version Warning	4.20		amd64	ovn	azure	ha	158	0s	0.00%	21m33.1s	156.89%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.20		amd64	ovn	gcp	ha	179	0s	0.00%	1m40.16s	85.14%
OVNKubernetesResourceRetryFailure openshift-ovn-kubernetes Warning	4.21	4.20	amd64	ovn	gcp	ha	131	0s	0.00%	9m12.4s	16844.79%
etcdGRPCRequestsSlow openshift-etcd Critical	4.21	4.20	amd64	ovn	azure	ha	301	44s	0.00%	12m24s	6892.48%

/cc @xueqzhan, @neisw, @smg247

[openshift-ci-robot]

Pipeline controller notification
This repository is configured to use the pipeline controller. Second-stage tests will be triggered either automatically or after lgtm label is added, depending on the repository configuration. The pipeline controller will automatically detect which contexts are required and will utilize /test Prow commands to trigger the second stage.

For optional jobs, comment /test ? to see a list of all defined jobs. To trigger manually all jobs from second stage use /pipeline required command.

This repository is configured in: automatic mode

[openshift-ci-robot]

@openshift-bot: This pull request explicitly references no jira issue.

In response to this:

disruptions Information

There were (153) added jobs and (224) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 405 jobs increased and 1496 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
kube-api-http1-localhost-reused-connections	4.21	4.21	amd64	ovn	azure	ha	477	1m15.2s	99.47%	1m32.2s	143.02%
kube-api-http1-localhost-new-connections	4.21	4.21	amd64	ovn	aws	ha	509	1m2.6s	40.99%	1m15.84s	68.98%
kube-api-http2-service-network-reused-connections	4.20	4.19	amd64	ovn	azure	ha	139	7s	600.00%	18.96s	35.43%
openshift-api-http2-internal-lb-reused-connections	4.21	4.21	amd64	ovn	aws	ha	509	6s	50.00%	9.92s	148.00%
image-registry-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	3s	50.00%	1m0.91s	1118.20%
openshift-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	2s	100.00%	5.86s	45.05%
service-load-balancer-with-pdb-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	2s	100.00%	7s	75.00%
ci-cluster-network-liveness-new-connections	4.21	4.20	amd64	ovn	aws	ha	1246	2s	100.00%	12.55s	77.01%
image-registry-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	3s	50.00%	28s	48.70%
ci-cluster-network-liveness-new-connections	4.21		amd64	ovn	vsphere	ha	102	1s	400.00%	46.69s	30.27%
ci-cluster-network-liveness-new-connections	4.20		amd64	ovn	aws	external	152	0s	0.00%	3.47s	101.74%
ci-cluster-network-liveness-new-connections	4.20		ppc64le	ovn	none	ha	242	0s	0.00%	20.59s	55.40%
metrics-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	5.24s	73.51%
cache-kube-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	4.48s	339.22%
image-registry-reused-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	52.3s	2515.00%
aws-network-liveness-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	0s	0.00%	1s	122.22%
ingress-to-oauth-server-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	1.41s	41.00%
metrics-api-reused-connections	4.20	4.20	amd64	ovn	gcp	ha	187	700ms	0.00%	2.26s	126.00%
cache-openshift-api-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	8.15s	103.75%
host-to-service-new-connections	4.20	4.20	amd64	ovn	gcp	ha	187	1s	0.00%	1.56s	56.00%
ci-cluster-network-liveness-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	2.1s	0.00%	9.86s	388.12%
image-registry-reused-connections	4.20	4.20	amd64	ovn	gcp	ha	187	1s	0.00%	9.58s	379.00%
ci-cluster-network-liveness-new-connections	4.20	4.20	amd64	ovn	gcp	ha	187	0s	0.00%	16.18s	124.10%
oauth-api-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	6.1s	37.08%
ingress-to-console-reused-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	620ms	3000.00%
host-to-host-reused-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	1.86s	9200.00%
azure-network-liveness-new-connections	4.20		amd64	ovn	azure	external	593	2s	0.00%	2m8.64s	76.90%
ingress-to-console-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	8.1s	101.49%
ingress-to-oauth-server-reused-connections	4.20	4.19	amd64	ovn	gcp	ha	160	50ms	0.00%	1.41s	41.00%
metrics-api-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	6.28s	57.00%
cache-oauth-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	4s	277.36%
image-registry-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	5.24s	403.85%
ingress-to-console-reused-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	1.41s	41.00%
oauth-api-reused-connections	4.20	4.19	amd64	ovn	azure	ha	139	1s	0.00%	3s	48.51%
service-load-balancer-with-pdb-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	9.48s	207.79%
image-registry-new-connections	4.20		amd64	ovn	aws	ha	233	0s	0.00%	22.68s	54.81%
ingress-to-oauth-server-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	7.86s	281.55%
image-registry-new-connections	4.20	4.20	amd64	ovn	gcp	ha	187	2s	0.00%	10.3s	197.69%
kube-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	1s	0.00%	4.24s	41.33%
gcp-network-liveness-new-connections	4.20		amd64	ovn	azure	external	593	0s	0.00%	1m29.6s	97.62%
kube-api-http1-internal-lb-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	620ms	3000.00%
cache-kube-api-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	1s	0.00%	6.51s	62.75%
cache-openshift-api-new-connections	4.20	4.19	amd64	ovn	azure	ha	139	0s	0.00%	3.62s	79.21%
pod-to-service-new-connections	4.20	4.20	amd64	ovn	gcp	ha	187	1s	0.00%	1.7s	70.00%
kube-api-http2-internal-lb-new-connections	4.20	4.20	amd64	ovn	gcp	ha	187	0s	0.00%	1s	117.39%
openshift-api-new-connections	4.20	4.19	amd64	ovn	gcp	ha	160	0s	0.00%	5.51s	83.67%
openshift-api-reused-connections	4.20		amd64	ovn	aws	ha	233	1s	0.00%	2.68s	34.00%
ci-cluster-network-liveness-reused-connections	4.21		amd64	ovn	vsphere	ha	102	0s	0.00%	4.96s	39.33%
kube-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	8.8s	206.62%
kube-api-http2-internal-lb-reused-connections	4.21	4.21	amd64	ovn	aws	ha	509	6s	0.00%	7s	41.13%
cache-oauth-api-reused-connections	4.21		s390x	ovn	none	ha	117	37s	0.00%	7m53.96s	61.90%
kube-api-http2-localhost-new-connections	4.21	4.21	amd64	ovn	gcp	ha	1259	57s	0.00%	1m4.42s	40.13%
host-to-host-new-connections	4.21	4.20	amd64	ovn	azure	ha	1176	0s	0.00%	1m31.25s	146.89%
kube-api-http2-localhost-reused-connections	4.21	4.21	amd64	ovn	gcp	ha	1259	57s	0.00%	1m4.42s	43.25%
ingress-to-console-reused-connections	4.21	4.20	amd64	ovn	aws	ha	1246	0s	0.00%	1.55s	55.00%
openshift-api-http2-service-network-reused-connections	4.21	4.20	amd64	ovn	gcp	ha	621	0s	0.00%	6.6s	560.00%
cache-kube-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.75%
kube-api-reused-connections	4.21	4.20	amd64	ovn	azure	ha	1176	1s	0.00%	3.25s	62.50%
oauth-api-new-connections	4.21	4.21	amd64	ovn	aws	ha	509	0s	0.00%	1.92s	41.18%
kube-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.64%
metrics-api-new-connections	4.21		arm64	ovn	aws	ha	134	0s	0.00%	17.42s	52.27%
ingress-to-console-new-connections	4.21		s390x	ovn	none	ha	117	1m35.4s	0.00%	8m0.2s	46.07%
cache-openshift-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	8s	106.72%
cache-openshift-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.64%
ci-cluster-network-liveness-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	3s	0.00%	14.8s	640.00%
cache-oauth-api-new-connections	4.21	4.21	amd64	ovn	gcp	ha	1259	1s	0.00%	13.42s	37.92%
kube-api-reused-connections	4.21		s390x	ovn	none	ha	117	38.4s	0.00%	7m53.8s	62.26%
openshift-api-reused-connections	4.21		s390x	ovn	none	ha	117	39.8s	0.00%	7m53.8s	62.26%
pod-to-host-new-connections	4.21	4.20	amd64	ovn	azure	ha	1176	0s	0.00%	1m13.5s	198.30%
host-to-host-reused-connections	4.21	4.20	amd64	ovn	azure	ha	1176	0s	0.00%	15.25s	1488.54%
kube-api-http1-service-network-reused-connections	4.21		amd64	ovn	vsphere	ha	102	0s	0.00%	1s	56.25%
openshift-api-http2-internal-lb-reused-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	12.4s	1140.00%
oauth-api-reused-connections	4.21		amd64	ovn	vsphere	ha	102	0s	0.00%	990ms	54.69%
host-to-host-reused-connections	4.21	4.21	amd64	ovn	azure	ha	477	0s	0.00%	7.24s	424.64%
oauth-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.64%
cache-kube-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	8.6s	199.65%
image-registry-reused-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	28s	48.70%
ingress-to-oauth-server-new-connections	4.21		s390x	ovn	none	ha	117	1m35.2s	0.00%	8m0.2s	46.18%
kube-api-http2-service-network-reused-connections	4.21		amd64	ovn	vsphere	ha	102	0s	0.00%	1s	56.25%
openshift-api-http2-service-network-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	0s	0.00%	19.6s	84.73%
openshift-api-reused-connections	4.21	4.20	amd64	ovn	azure	ha	1176	1s	0.00%	4s	33.33%
ingress-to-oauth-server-reused-connections	4.21		s390x	ovn	none	ha	117	1m5.8s	0.00%	7m55.4s	58.60%
cache-kube-api-reused-connections	4.21		s390x	ovn	none	ha	117	37.6s	0.00%	7m53.8s	62.26%
metrics-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	9.8s	106.75%
openshift-api-http2-internal-lb-reused-connections	4.21		amd64	ovn	vsphere	ha	102	0s	0.00%	990ms	54.69%
kube-api-http2-internal-lb-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	0s	0.00%	6.6s	560.00%
cache-openshift-api-reused-connections	4.21		s390x	ovn	none	ha	117	45.4s	0.00%	7m53.8s	62.26%
metrics-api-reused-connections	4.21		arm64	ovn	aws	ha	134	0s	0.00%	17.42s	52.27%
kube-api-http1-internal-lb-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	0s	0.00%	7.2s	620.00%
metrics-api-reused-connections	4.21		s390x	ovn	none	ha	117	51.2s	0.00%	7m51.08s	68.54%
oauth-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	10s	400.00%
ingress-to-console-reused-connections	4.21		s390x	ovn	none	ha	117	1m5.4s	0.00%	7m55.4s	58.47%
oauth-api-reused-connections	4.21		s390x	ovn	none	ha	117	32.4s	0.00%	7m53.8s	62.26%
cache-oauth-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.64%
metrics-api-new-connections	4.21		s390x	ovn	none	ha	117	1m37.2s	0.00%	7m59.4s	47.73%
cache-oauth-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	11s	184.24%
kube-api-http1-localhost-new-connections	4.21	4.21	amd64	ovn	gcp	ha	1259	57s	0.00%	1m4.42s	40.13%
openshift-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	1s	0.00%	8.8s	56.86%
openshift-api-new-connections	4.21		s390x	ovn	none	ha	117	1m31.6s	0.00%	7m59.88s	46.64%
openshift-api-http2-internal-lb-new-connections	4.21	4.20	amd64	ovn	gcp	ha	621	0s	0.00%	17.6s	1660.00%

alerts Information

There were (3810) added jobs and (1830) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 39 jobs increased and 430 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
ClusterOperatorDegraded openshift-cluster-version Warning	4.21	4.21	amd64	ovn	azure	ha	138	2h14m39.4s	433.72%	3h8m11.36s	117.84%
ClusterOperatorDegraded openshift-cluster-version Warning	4.21	4.21	amd64	ovn	aws	ha	146	1h53m46.5s	49.17%	3h12m21.1s	127.72%
CannotRetrieveUpdates openshift-cluster-version Warning	4.21		amd64	ovn	aws	ha	260	28m32.1s	135.79%	1h11m45.94s	109.83%
NodeSystemSaturation openshift-monitoring Warning	4.20		amd64	ovn	metal	ha	321	58s	195.92%	13m56s	120.70%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.20		amd64	ovn	aws	ha	354	0s	0.00%	2m10.3s	1007.99%
NodeSystemSaturation openshift-monitoring Warning	4.20		amd64	ovn	azure	ha	158	0s	0.00%	5m45.7s	48.24%
NodeSystemSaturation openshift-monitoring Warning	4.20		amd64	ovn	gcp	ha	179	2.8s	0.00%	19m1s	156.92%
HighOverallControlPlaneMemory openshift-machine-config-operator Warning	4.20		amd64	ovn	aws	ha	354	20.7s	0.00%	12m15.96s	61.92%
NodeSystemSaturation openshift-monitoring Warning	4.20		amd64	ovn	aws	ha	354	0s	0.00%	7m56.94s	39.15%
CannotRetrieveUpdates openshift-cluster-version Warning	4.20		amd64	ovn	azure	ha	158	0s	0.00%	21m33.1s	156.89%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.20		amd64	ovn	gcp	ha	179	0s	0.00%	1m40.16s	85.14%
OVNKubernetesResourceRetryFailure openshift-ovn-kubernetes Warning	4.21	4.20	amd64	ovn	gcp	ha	131	0s	0.00%	9m12.4s	16844.79%
etcdGRPCRequestsSlow openshift-etcd Critical	4.21	4.20	amd64	ovn	azure	ha	301	44s	0.00%	12m24s	6892.48%

/cc @xueqzhan, @neisw, @smg247

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: openshift-bot
Once this PR has been reviewed and has the lgtm label, please assign xueqzhan for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[openshift-ci]

@openshift-bot: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/unit	d31b84b	link	true	/test unit

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.