Skip to content

Conversation

@i-am-tom
Copy link
Contributor

@i-am-tom i-am-tom commented Jun 11, 2025

This moves test_sdk out of the F#, and puts the pre-existing test commands under an umbrella make test.

@i-am-tom i-am-tom force-pushed the i-am-tom/make-test-sdk branch from 89b2431 to 467df03 Compare June 20, 2025 15:40
@i-am-tom i-am-tom changed the title Makefile migration: make test-sdk Makefile migration: make test Jun 20, 2025
@i-am-tom i-am-tom marked this pull request as ready for review June 20, 2025 15:54
@i-am-tom i-am-tom requested a review from a team as a code owner June 20, 2025 15:54
test: test_conformance test_integration test_sdk

.PHONY: test_conformance
test_conformance: build clean
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why does this depend on the clean target? We shouldn't need a clean build for this. Also I think that means it runs clean before it runs the tests with I think would be wrong.

I see that the F# makefile does that in some cases, but I think it shouldn't be necessary, and ideally we make things better here, so we don't need to whole clean -> restore dance.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a Chesterton's fence - like I said in the format/lint PR, I think the best approach is to migrate F# to Make as directly as possible, and then worry about this in a follow-up

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah I guess clean only cleans the SDK bits, which is confusing, but ok. At least we're not cleaning everything we just build here I guess. It's still weird that we clean this. Personally I'd prefer to make things better while we are here, since later cleanups are often forgotten, but I guess it is what we were running before.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agreed that cleanups get forgotten, but also I'm very keen to keep the scope of these changes very strict as there are plenty of other "quick fixes" I'd love to be adding as I go - I've no doubt this will get revisited when I get back to my CI endeavours, but it seemed like the problem with my original approach in pulumi/pulumi was trying to do too many things at once, so I'm still inclined to say this is out of scope for this PR


.PHONY: test_integration
test_integration: build clean
cd integration_tests && gotestsum -- $(GO_TEST_FILTER_FLAG) --parallel 1 --timeout 60m ./...
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think for this and the conformance tests above, we need to set up $PATH, so it uses the binary we just built. Right now it still uses the binary from the regular $PATH, so depending on build will make it build the language host, but then not actually use it.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This and the conformance test target are both unchanged from the previous behaviour, I think? Or is this a TODO for a future PR?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it's equally broken before as it is now. So if you want just a bug for bug translation, I guess this works.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm on ops this week, so I'm happy to fix this in a follow-up

Copy link
Contributor

@tgummerer tgummerer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Personally I'd have cleaned the targets up, but if we just want a bug for bug translation from the F# bits, I think this is fine.

@i-am-tom i-am-tom added this pull request to the merge queue Jun 25, 2025
Merged via the queue into main with commit 80ec950 Jun 25, 2025
21 checks passed
@i-am-tom i-am-tom deleted the i-am-tom/make-test-sdk branch June 25, 2025 13:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

impact/no-changelog-required This issue doesn't require a CHANGELOG update

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants