Restore bicep artifacts before starting tests #8283

sk593 · 2025-01-23T17:49:05Z

Description

This change restores Bicep artifacts before running any tests. This will avoid any restoration errors while the tests are running as seen in #8184

Type of change

This pull request fixes a bug in Radius and has an approved issue Flaky test: Failed to restore AWS bicep artifact #8184
This pull request adds or changes features of Radius and has an approved issue (issue link required).
This pull request is a minor refactor, code cleanup, test improvement, or other maintenance task and doesn't change the functionality of Radius (issue link optional).

Fixes: #8184

Contributor checklist

Please verify that the PR meets the following requirements, where applicable:

An overview of proposed schema changes is included in a linked GitHub issue.
A design document PR is created in the design-notes repository, if new APIs are being introduced.
If applicable, design document has been reviewed and approved by Radius maintainers/approvers.
A PR for the samples repository is created, if existing samples are affected by the changes in this PR.
A PR for the documentation repository is created, if the changes in this PR affect the documentation or any user facing updates are made.
A PR for the recipes repository is created, if existing recipes are affected by the changes in this PR.
[ ]

Signed-off-by: sk593 <shruthikumar@microsoft.com>

github-actions · 2025-01-23T18:03:03Z

Unit Tests

3 552 tests ±0 3 548 ✅ ±0 5m 26s ⏱️ +10s
292 suites ±0 4 💤 ±0
1 files ±0 0 ❌ ±0

Results for commit 744f451. ± Comparison against base commit 9d2ce57.

♻️ This comment has been updated with latest results.

codecov · 2025-01-23T18:04:16Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 59.84%. Comparing base (9d2ce57) to head (744f451).
Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #8283      +/-   ##
==========================================
+ Coverage   59.79%   59.84%   +0.05%     
==========================================
  Files         590      590              
  Lines       39513    39513              
==========================================
+ Hits        23628    23648      +20     
+ Misses      14121    14108      -13     
+ Partials     1764     1757       -7

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

brooke-hamilton

I tested this locally - 🚀 🛰️

Signed-off-by: sk593 <shruthikumar@microsoft.com>

radius-functional-tests · 2025-01-23T23:54:57Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	radius-project/radius
Commit ref	`e2a499b`
Unique ID	func3738baaafb
Image tag	pr-func3738baaafb

Click here to see the list of tools in the current test run

gotestsum 1.12.0
KinD: v0.20.0
Dapr:
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.3.0
Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func3738baaafb
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func3738baaafb
dynamic-rp test image location: ghcr.io/radius-project/dev/dynamic-rp:pr-func3738baaafb
controller test image location: ghcr.io/radius-project/dev/controller:pr-func3738baaafb
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func3738baaafb
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp-cloud functional tests...
⌛ Starting corerp-cloud functional tests...
✅ ucp-cloud functional tests succeeded
✅ corerp-cloud functional tests succeeded

ytimocin · 2025-01-24T05:37:37Z

.github/workflows/functional-test-cloud.yaml

+          # Restore Radius Bicep types
+          bicep build ./test/functional-portable/corerp/cloud/resources/testdata/corerp-azure-connection-database-service.bicep
+          # Restore AWS Bicep types 
+          bicep build ./test/functional-portable/corerp/cloud/resources/testdata/aws-s3-bucket.bicep


Do the tests need the files generated by these two commands to be able to run successfully? If so, should we add those files to the repository itself?

I think that to be able to run these tests locally, this is also something we need to run. Is that right?

No, they're not needed. They're an output of the build command but we're more interested in the artifacts being restored in this step.

Yes to the second question. The bicep build command gets run when we deploy bicep templates. bicep build automatically restores the artifacts which might be why we've been seeing flaky restoration failures. This change is added so the bicep artifacts are restored before the tests start and bicep build is run

radius-functional-tests · 2025-01-24T18:33:00Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	radius-project/radius
Commit ref	`0255e45`
Unique ID	func653d6c07ac
Image tag	pr-func653d6c07ac

Click here to see the list of tools in the current test run

gotestsum 1.12.0
KinD: v0.20.0
Dapr:
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.3.0
Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func653d6c07ac
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func653d6c07ac
dynamic-rp test image location: ghcr.io/radius-project/dev/dynamic-rp:pr-func653d6c07ac
controller test image location: ghcr.io/radius-project/dev/controller:pr-func653d6c07ac
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func653d6c07ac
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp-cloud functional tests...
⌛ Starting corerp-cloud functional tests...
✅ ucp-cloud functional tests succeeded
✅ corerp-cloud functional tests succeeded

Signed-off-by: sk593 <shruthikumar@microsoft.com>

radius-functional-tests · 2025-01-24T19:22:42Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	radius-project/radius
Commit ref	`a000290`
Unique ID	func0d0ae104c8
Image tag	pr-func0d0ae104c8

Click here to see the list of tools in the current test run

gotestsum 1.12.0
KinD: v0.20.0
Dapr:
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.3.0
Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func0d0ae104c8
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func0d0ae104c8
dynamic-rp test image location: ghcr.io/radius-project/dev/dynamic-rp:pr-func0d0ae104c8
controller test image location: ghcr.io/radius-project/dev/controller:pr-func0d0ae104c8
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func0d0ae104c8
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting corerp-cloud functional tests...
⌛ Starting ucp-cloud functional tests...
✅ ucp-cloud functional tests succeeded
✅ corerp-cloud functional tests succeeded

.github/workflows/functional-test-cloud.yaml

ytimocin · 2025-01-27T18:18:22Z

.github/workflows/functional-test-noncloud.yaml

-      
+


radius-functional-tests · 2025-01-27T18:19:41Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	radius-project/radius
Commit ref	`21bcabd`
Unique ID	funccb0545e05c
Image tag	pr-funccb0545e05c

Click here to see the list of tools in the current test run

gotestsum 1.12.0
KinD: v0.20.0
Dapr:
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.3.0
Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-funccb0545e05c
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-funccb0545e05c
dynamic-rp test image location: ghcr.io/radius-project/dev/dynamic-rp:pr-funccb0545e05c
controller test image location: ghcr.io/radius-project/dev/controller:pr-funccb0545e05c
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-funccb0545e05c
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp-cloud functional tests...
⌛ Starting corerp-cloud functional tests...
✅ ucp-cloud functional tests succeeded
✅ corerp-cloud functional tests succeeded

Signed-off-by: sk593 <shruthikumar@microsoft.com>

radius-functional-tests · 2025-01-27T19:17:57Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	radius-project/radius
Commit ref	`147b080`
Unique ID	func1b07f2bda4
Image tag	pr-func1b07f2bda4

Click here to see the list of tools in the current test run

gotestsum 1.12.0
KinD: v0.20.0
Dapr:
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.3.0
Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func1b07f2bda4
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func1b07f2bda4
dynamic-rp test image location: ghcr.io/radius-project/dev/dynamic-rp:pr-func1b07f2bda4
controller test image location: ghcr.io/radius-project/dev/controller:pr-func1b07f2bda4
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func1b07f2bda4
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp-cloud functional tests...
⌛ Starting corerp-cloud functional tests...
✅ ucp-cloud functional tests succeeded
✅ corerp-cloud functional tests succeeded

radius-functional-tests · 2025-01-27T19:19:53Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	radius-project/radius
Commit ref	`744f451`
Unique ID	func9ce029afbf
Image tag	pr-func9ce029afbf

Click here to see the list of tools in the current test run

gotestsum 1.12.0
KinD: v0.20.0
Dapr:
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.3.0
Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func9ce029afbf
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func9ce029afbf
dynamic-rp test image location: ghcr.io/radius-project/dev/dynamic-rp:pr-func9ce029afbf
controller test image location: ghcr.io/radius-project/dev/controller:pr-func9ce029afbf
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func9ce029afbf
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp-cloud functional tests...
⌛ Starting corerp-cloud functional tests...
✅ ucp-cloud functional tests succeeded
✅ corerp-cloud functional tests succeeded

# Description This PR restores the AWS bicep artifact before the functioanl tests start in the LRT workflow. The same change was implemented in the functional test workflow: #8283 ## Type of change  - This pull request fixes a bug in Radius and has an approved issue (issue link required). - This pull request adds or changes features of Radius and has an approved issue (issue link required). - This pull request is a minor refactor, code cleanup, test improvement, or other maintenance task and doesn't change the functionality of Radius (issue link optional).  Fixes: #8184 ## Contributor checklist Please verify that the PR meets the following requirements, where applicable: - An overview of proposed schema changes is included in a linked GitHub issue. - [ ] Yes - [ ] Not applicable - A design document PR is created in the [design-notes repository](https://github.com/radius-project/design-notes/), if new APIs are being introduced. - [ ] Yes - [ ] Not applicable - The design document has been reviewed and approved by Radius maintainers/approvers. - [ ] Yes - [ ] Not applicable - A PR for the [samples repository](https://github.com/radius-project/samples) is created, if existing samples are affected by the changes in this PR. - [ ] Yes - [ ] Not applicable - A PR for the [documentation repository](https://github.com/radius-project/docs) is created, if the changes in this PR affect the documentation or any user facing updates are made. - [ ] Yes - [ ] Not applicable - A PR for the [recipes repository](https://github.com/radius-project/recipes) is created, if existing recipes are affected by the changes in this PR. - [ ] Yes - [ ] Not applicable Signed-off-by: sk593 <shruthikumar@microsoft.com>

restore bicep artifacts before starting tests

e8f3fdf

Signed-off-by: sk593 <shruthikumar@microsoft.com>

sk593 requested review from a team as code owners January 23, 2025 17:49

sk593 had a problem deploying to functional-tests January 23, 2025 17:49 — with GitHub Actions Failure

sk593 temporarily deployed to publish-bicep January 23, 2025 17:49 — with GitHub Actions Inactive

brooke-hamilton previously approved these changes Jan 23, 2025

View reviewed changes

sk593 dismissed brooke-hamilton’s stale review via d0533fd January 23, 2025 23:42

testing

d0533fd

Signed-off-by: sk593 <shruthikumar@microsoft.com>

sk593 had a problem deploying to functional-tests January 23, 2025 23:42 — with GitHub Actions Failure

sk593 temporarily deployed to publish-bicep January 23, 2025 23:42 — with GitHub Actions Inactive

revert

b04c3e7

Signed-off-by: sk593 <shruthikumar@microsoft.com>

sk593 had a problem deploying to functional-tests January 23, 2025 23:50 — with GitHub Actions Failure

nit

c8123fe

Signed-off-by: sk593 <shruthikumar@microsoft.com>

sk593 had a problem deploying to functional-tests January 23, 2025 23:51 — with GitHub Actions Failure

sk593 had a problem deploying to publish-bicep January 23, 2025 23:51 — with GitHub Actions Error

Merge branch 'main' into fix-flaky-aws-restoration

e2a499b

sk593 temporarily deployed to functional-tests January 23, 2025 23:51 — with GitHub Actions Inactive

sk593 temporarily deployed to publish-bicep January 23, 2025 23:51 — with GitHub Actions Inactive

brooke-hamilton previously approved these changes Jan 24, 2025

View reviewed changes

ytimocin reviewed Jan 24, 2025

View reviewed changes

Merge branch 'main' into fix-flaky-aws-restoration

0255e45

sk593 temporarily deployed to functional-tests January 24, 2025 18:01 — with GitHub Actions Inactive

sk593 temporarily deployed to publish-bicep January 24, 2025 18:01 — with GitHub Actions Inactive

sk593 dismissed brooke-hamilton’s stale review via 7654a24 January 24, 2025 18:56

update to restore

7654a24

Signed-off-by: sk593 <shruthikumar@microsoft.com>

sk593 had a problem deploying to functional-tests January 24, 2025 18:56 — with GitHub Actions Failure

sk593 temporarily deployed to publish-bicep January 24, 2025 19:04 — with GitHub Actions Inactive

revert

a000290

Signed-off-by: sk593 <shruthikumar@microsoft.com>

sk593 temporarily deployed to functional-tests January 24, 2025 19:20 — with GitHub Actions Inactive

sk593 temporarily deployed to publish-bicep January 24, 2025 19:20 — with GitHub Actions Inactive

brooke-hamilton previously approved these changes Jan 24, 2025

View reviewed changes

Merge branch 'main' into fix-flaky-aws-restoration

21bcabd

sk593 temporarily deployed to functional-tests January 27, 2025 17:32 — with GitHub Actions Inactive

sk593 temporarily deployed to publish-bicep January 27, 2025 17:32 — with GitHub Actions Inactive

kachawla reviewed Jan 27, 2025

View reviewed changes

.github/workflows/functional-test-cloud.yaml Show resolved Hide resolved

ytimocin reviewed Jan 27, 2025

View reviewed changes

.github/workflows/functional-test-noncloud.yaml

Copy link

Contributor

ytimocin Jan 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Merge branch 'main' into fix-flaky-aws-restoration

d494007

sk593 had a problem deploying to functional-tests January 27, 2025 19:14 — with GitHub Actions Failure

sk593 temporarily deployed to publish-bicep January 27, 2025 19:14 — with GitHub Actions Inactive

sk593 dismissed brooke-hamilton’s stale review via 147b080 January 27, 2025 19:16

add comments

147b080

Signed-off-by: sk593 <shruthikumar@microsoft.com>

sk593 temporarily deployed to functional-tests January 27, 2025 19:16 — with GitHub Actions Inactive

sk593 temporarily deployed to publish-bicep January 27, 2025 19:17 — with GitHub Actions Inactive

kachawla approved these changes Jan 27, 2025

View reviewed changes

Merge branch 'main' into fix-flaky-aws-restoration

744f451

sk593 temporarily deployed to functional-tests January 27, 2025 19:18 — with GitHub Actions Inactive

sk593 temporarily deployed to publish-bicep January 27, 2025 19:19 — with GitHub Actions Inactive

sk593 merged commit b4f1759 into main Jan 27, 2025
33 checks passed

sk593 deleted the fix-flaky-aws-restoration branch January 27, 2025 19:39

brooke-hamilton mentioned this pull request Mar 19, 2025

REQUEST: Approvership for brooke-hamilton radius-project/community#80

Closed

4 tasks

sk593 mentioned this pull request Mar 24, 2025

Restore AWS Bicep artifact in LRT #8952

Merged

12 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Restore bicep artifacts before starting tests #8283

Restore bicep artifacts before starting tests #8283

Uh oh!

sk593 commented Jan 23, 2025

Uh oh!

github-actions bot commented Jan 23, 2025 •

edited

Loading

Uh oh!

codecov bot commented Jan 23, 2025 •

edited

Loading

Uh oh!

brooke-hamilton left a comment

Uh oh!

radius-functional-tests bot commented Jan 23, 2025 •

edited

Loading

Uh oh!

ytimocin Jan 24, 2025

Uh oh!

sk593 Jan 24, 2025

Uh oh!

radius-functional-tests bot commented Jan 24, 2025 •

edited

Loading

Uh oh!

radius-functional-tests bot commented Jan 24, 2025 •

edited

Loading

Uh oh!

Uh oh!

ytimocin Jan 27, 2025

Uh oh!

radius-functional-tests bot commented Jan 27, 2025 •

edited

Loading

Uh oh!

radius-functional-tests bot commented Jan 27, 2025 •

edited

Loading

Uh oh!

radius-functional-tests bot commented Jan 27, 2025 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Restore bicep artifacts before starting tests #8283

Restore bicep artifacts before starting tests #8283

Uh oh!

Conversation

sk593 commented Jan 23, 2025

Description

Type of change

Contributor checklist

Uh oh!

github-actions bot commented Jan 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Unit Tests

Uh oh!

codecov bot commented Jan 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

brooke-hamilton left a comment

Choose a reason for hiding this comment

Uh oh!

radius-functional-tests bot commented Jan 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Radius functional test overview

Test Status

Uh oh!

ytimocin Jan 24, 2025

Choose a reason for hiding this comment

Uh oh!

sk593 Jan 24, 2025

Choose a reason for hiding this comment

Uh oh!

radius-functional-tests bot commented Jan 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Radius functional test overview

Test Status

Uh oh!

radius-functional-tests bot commented Jan 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Radius functional test overview

Test Status

Uh oh!

Uh oh!

ytimocin Jan 27, 2025

Choose a reason for hiding this comment

Uh oh!

radius-functional-tests bot commented Jan 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Radius functional test overview

Test Status

Uh oh!

radius-functional-tests bot commented Jan 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Radius functional test overview

Test Status

Uh oh!

radius-functional-tests bot commented Jan 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Radius functional test overview

Test Status

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Jan 23, 2025 •

edited

Loading

codecov bot commented Jan 23, 2025 •

edited

Loading

radius-functional-tests bot commented Jan 23, 2025 •

edited

Loading

radius-functional-tests bot commented Jan 24, 2025 •

edited

Loading

radius-functional-tests bot commented Jan 24, 2025 •

edited

Loading

radius-functional-tests bot commented Jan 27, 2025 •

edited

Loading

radius-functional-tests bot commented Jan 27, 2025 •

edited

Loading

radius-functional-tests bot commented Jan 27, 2025 •

edited

Loading