Dump packages and platforms env variables #23994

v1v · 2021-02-11T11:39:49Z

What does this PR do?

Expose the environment context about the platforms and packages

Why is it important?

to help with the debugging in the release process that happens with another tooling/environment/context

Tests

Given the 07798ba the output was

v1v · 2021-02-11T11:42:06Z

Jenkinsfile

+          withEnv(["HOME=${env.WORKSPACE}",'PACKAGES=docker']) {
            retryWithSleep(retries: 2, seconds: 5){ sh(label: "Install Go ${env.GO_VERSION}", script: '.ci/scripts/install-go.sh') }
+            sh(script: 'make release-manager-snapshot')


Only for testing purposes

v1v · 2021-02-11T11:51:06Z

dev-tools/mage/settings.go

+	PLATFORMS    = EnvOr("PLATFORMS", "")
+	PACKAGES     = EnvOr("PACKAGES", "")


I assume that setting this should not have any side effects in the build/packaging, so @jsoriano and @kvch can you please confirm?

No, no side effects.

This reverts commit 07798ba.

elasticmachine · 2021-02-11T12:45:21Z

❕ Build Aborted

Either there was a build timeout or someone aborted the build.'}

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: Pull request #23994 opened
Start Time: 2021-02-11T11:40:32.678+0000
Duration: 64 min 26 sec
Commit: 07798ba

Trends 🧪

Log output

Expand to view the last 100 lines of log output

[2021-02-11T12:36:17.883Z] >> golangCrossBuild: Building for windows/386
[2021-02-11T12:36:17.883Z] >> golangCrossBuild: Building for linux/arm64
[2021-02-11T12:36:17.883Z] >> golangCrossBuild: Building for darwin/amd64
[2021-02-11T12:36:17.883Z] >> golangCrossBuild: Building for linux/amd64
[2021-02-11T12:36:17.883Z] >> Building using: cmd='../../build/mage-linux-amd64 golangCrossBuild', env=[CC=aarch64-linux-gnu-gcc, CXX=aarch64-linux-gnu-g++, GOARCH=arm64, GOARM=, GOOS=linux, PLATFORM_ID=linux-arm64]
[2021-02-11T12:36:17.883Z] >> Building using: cmd='../../build/mage-linux-amd64 golangCrossBuild', env=[CC=x86_64-w64-mingw32-gcc, CXX=x86_64-w64-mingw32-g++, GOARCH=amd64, GOARM=, GOOS=windows, PLATFORM_ID=windows-amd64]
[2021-02-11T12:36:17.883Z] >> Building using: cmd='../../build/mage-linux-amd64 golangCrossBuild', env=[CC=gcc, CXX=g++, GOARCH=386, GOARM=, GOOS=linux, PLATFORM_ID=linux-386]
[2021-02-11T12:36:17.883Z] >> Building using: cmd='../../build/mage-linux-amd64 golangCrossBuild', env=[CC=gcc, CXX=g++, GOARCH=amd64, GOARM=, GOOS=linux, PLATFORM_ID=linux-amd64]
[2021-02-11T12:36:17.883Z] >> Building using: cmd='../../build/mage-linux-amd64 golangCrossBuild', env=[CC=i686-w64-mingw32-gcc, CXX=i686-w64-mingw32-g++, GOARCH=386, GOARM=, GOOS=windows, PLATFORM_ID=windows-386]
[2021-02-11T12:36:17.883Z] >> Building using: cmd='../../build/mage-linux-amd64 golangCrossBuild', env=[CC=o64-clang, CXX=o64-clang++, GOARCH=amd64, GOARM=, GOOS=darwin, PLATFORM_ID=darwin-amd64]
[2021-02-11T12:37:54.670Z] # crypto/x509
[2021-02-11T12:37:54.670Z] ld: warning: object file (/tmp/go-build994201860/b101/_cgo_main.o) was built for newer OSX version (10.11) than being linked (10.10)
[2021-02-11T12:37:54.670Z] ld: warning: object file (/tmp/go-build994201860/b101/_x001.o) was built for newer OSX version (10.11) than being linked (10.10)
[2021-02-11T12:37:54.670Z] ld: warning: object file (/tmp/go-build994201860/b101/_x002.o) was built for newer OSX version (10.11) than being linked (10.10)
[2021-02-11T12:40:16.304Z] # github.com/elastic/beats/v7/x-pack/functionbeat/provider/aws
[2021-02-11T12:40:16.304Z] ld: warning: object file (/tmp/go-link-129367788/000020.o) was built for newer OSX version (10.11) than being linked (10.10)
[2021-02-11T12:40:16.304Z] ld: warning: object file (/tmp/go-link-129367788/000021.o) was built for newer OSX version (10.11) than being linked (10.10)
[2021-02-11T12:40:16.304Z] >> Testing package contents
[2021-02-11T12:40:16.304Z] package ran for 8m32.991159731s
[2021-02-11T12:40:16.304Z] make[3]: Leaving directory '/var/lib/jenkins/workspace/Beats_beats_PR-23994/src/github.com/elastic/beats/x-pack/functionbeat'
[2021-02-11T12:40:16.304Z] make[3]: Entering directory '/var/lib/jenkins/workspace/Beats_beats_PR-23994/src/github.com/elastic/beats/x-pack/elastic-agent'
[2021-02-11T12:40:16.304Z] mage package
[2021-02-11T12:40:16.304Z] Package 'filebeat-8.0.0-darwin-x86_64.tar.gz' does not exist on path: /var/lib/jenkins/workspace/Beats_beats_PR-23994/src/github.com/elastic/beats/x-pack/filebeat/build/distributions/filebeat-8.0.0-darwin-x86_64.tar.gz
[2021-02-11T12:40:16.304Z] No fields files for module azureeventhub
[2021-02-11T12:40:16.304Z] No fields files for module cloudfoundry
[2021-02-11T12:40:16.304Z] No fields files for module default-inputs
[2021-02-11T12:40:16.304Z] No fields files for module gcppubsub
[2021-02-11T12:40:16.304Z] No fields files for module http_endpoint
[2021-02-11T12:40:16.304Z] No fields files for module httpjson
[2021-02-11T12:40:16.304Z] No fields files for module o365audit
[2021-02-11T12:40:16.304Z] No fields files for module add_nomad_metadata
[2021-02-11T12:40:16.304Z] No fields files for module googlecloud
[2021-02-11T12:40:17.679Z] Generated fields.yml for filebeat to /var/lib/jenkins/workspace/Beats_beats_PR-23994/src/github.com/elastic/beats/x-pack/filebeat/fields.yml
[2021-02-11T12:40:17.679Z] >> Building filebeat.yml for linux/amd64
[2021-02-11T12:40:17.679Z] >> Building filebeat.reference.yml for linux/amd64
[2021-02-11T12:40:17.679Z] >> Building filebeat.docker.yml for linux/amd64
[2021-02-11T12:40:19.582Z] exec: go list -m
[2021-02-11T12:40:24.852Z] >> golangCrossBuild: Building for windows/amd64
[2021-02-11T12:40:24.852Z] >> buildGoDaemon: Building for linux/arm64
[2021-02-11T12:40:24.852Z] >> golangCrossBuild: Building for linux/386
[2021-02-11T12:40:24.852Z] >> buildGoDaemon: Building for linux/amd64
[2021-02-11T12:40:24.852Z] >> golangCrossBuild: Building for linux/amd64
[2021-02-11T12:40:24.852Z] >> golangCrossBuild: Building for darwin/amd64
[2021-02-11T12:40:24.852Z] >> golangCrossBuild: Building for linux/arm64
[2021-02-11T12:40:24.852Z] >> buildGoDaemon: Building for linux/386
[2021-02-11T12:40:25.795Z] >> Building using: cmd='build/mage-linux-amd64 golangCrossBuild', env=[CC=x86_64-w64-mingw32-gcc, CXX=x86_64-w64-mingw32-g++, GOARCH=amd64, GOARM=, GOOS=windows, PLATFORM_ID=windows-amd64]
[2021-02-11T12:40:25.795Z] >> Building using: cmd='build/mage-linux-amd64 golangCrossBuild', env=[CC=o64-clang, CXX=o64-clang++, GOARCH=amd64, GOARM=, GOOS=darwin, PLATFORM_ID=darwin-amd64]
[2021-02-11T12:40:26.061Z] >> Building using: cmd='build/mage-linux-amd64 buildGoDaemon', env=[CC=aarch64-linux-gnu-gcc, CXX=aarch64-linux-gnu-g++, GOARCH=arm64, GOARM=, GOOS=linux, PLATFORM_ID=linux-arm64]
[2021-02-11T12:40:26.323Z] >> Building using: cmd='build/mage-linux-amd64 buildGoDaemon', env=[CC=gcc, CXX=g++, GOARCH=amd64, GOARM=, GOOS=linux, PLATFORM_ID=linux-amd64]
[2021-02-11T12:40:26.323Z] >> Building using: cmd='build/mage-linux-amd64 golangCrossBuild', env=[CC=aarch64-linux-gnu-gcc, CXX=aarch64-linux-gnu-g++, GOARCH=arm64, GOARM=, GOOS=linux, PLATFORM_ID=linux-arm64]
[2021-02-11T12:40:26.593Z] >> Building using: cmd='build/mage-linux-amd64 golangCrossBuild', env=[CC=gcc, CXX=g++, GOARCH=386, GOARM=, GOOS=linux, PLATFORM_ID=linux-386]
[2021-02-11T12:40:26.593Z] >> Building using: cmd='build/mage-linux-amd64 golangCrossBuild', env=[CC=gcc, CXX=g++, GOARCH=amd64, GOARM=, GOOS=linux, PLATFORM_ID=linux-amd64]
[2021-02-11T12:40:26.593Z] >> Building using: cmd='build/mage-linux-amd64 buildGoDaemon', env=[CC=gcc, CXX=g++, GOARCH=386, GOARM=, GOOS=linux, PLATFORM_ID=linux-386]
[2021-02-11T12:40:26.855Z] /tmp/ccVLH7Ul.o: In function `main':
[2021-02-11T12:40:26.855Z] god.c:(.text+0x2ac): warning: Using 'getgrnam' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking
[2021-02-11T12:40:26.855Z] god.c:(.text+0x230): warning: Using 'getpwnam' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking
[2021-02-11T12:40:27.444Z] /tmp/cc5jnIAS.o: In function `main':
[2021-02-11T12:40:27.444Z] god.c:(.text+0x2a6): warning: Using 'getgrnam' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking
[2021-02-11T12:40:27.444Z] god.c:(.text+0x23e): warning: Using 'getpwnam' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking
[2021-02-11T12:40:27.444Z] >> golangCrossBuild: Building for windows/386
[2021-02-11T12:40:27.713Z] /tmp/cce0kic7.o: In function `main':
[2021-02-11T12:40:27.713Z] god.c:(.text+0x2e0): warning: Using 'getgrnam' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking
[2021-02-11T12:40:27.713Z] god.c:(.text+0x279): warning: Using 'getpwnam' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking
[2021-02-11T12:40:28.298Z] >> Building using: cmd='build/mage-linux-amd64 golangCrossBuild', env=[CC=i686-w64-mingw32-gcc, CXX=i686-w64-mingw32-g++, GOARCH=386, GOARM=, GOOS=windows, PLATFORM_ID=windows-386]
[2021-02-11T12:42:05.011Z] # crypto/x509
[2021-02-11T12:42:05.011Z] ld: warning: object file (/tmp/go-build866286950/b104/_cgo_main.o) was built for newer OSX version (10.11) than being linked (10.10)
[2021-02-11T12:42:05.011Z] ld: warning: object file (/tmp/go-build866286950/b104/_x001.o) was built for newer OSX version (10.11) than being linked (10.10)
[2021-02-11T12:42:05.011Z] ld: warning: object file (/tmp/go-build866286950/b104/_x002.o) was built for newer OSX version (10.11) than being linked (10.10)
[2021-02-11T12:44:37.141Z] Aborted by Victor Martinez
[2021-02-11T12:44:37.146Z] Sending interrupt signal to process
[2021-02-11T12:44:52.143Z] Click here to forcibly terminate running steps
[2021-02-11T12:44:56.621Z] package ran for 4m32.025716355s
[2021-02-11T12:44:56.621Z] Error: signal: terminated
[2021-02-11T12:44:56.621Z] ../../dev-tools/make/mage.mk:41: recipe for target 'release' failed
[2021-02-11T12:44:56.621Z] make[3]: *** [release] Error 1
[2021-02-11T12:44:56.621Z] make[3]: Leaving directory '/var/lib/jenkins/workspace/Beats_beats_PR-23994/src/github.com/elastic/beats/x-pack/elastic-agent'
[2021-02-11T12:44:56.621Z] Makefile:200: recipe for target 'release' failed
[2021-02-11T12:44:56.621Z] make[2]: *** [release] Error 1
[2021-02-11T12:44:56.621Z] make[2]: Leaving directory '/var/lib/jenkins/workspace/Beats_beats_PR-23994/src/github.com/elastic/beats'
[2021-02-11T12:44:56.621Z] Makefile:214: recipe for target 'release-manager-release' failed
[2021-02-11T12:44:56.621Z] make[1]: *** [release-manager-release] Error 2
[2021-02-11T12:44:56.621Z] make[1]: Leaving directory '/var/lib/jenkins/workspace/Beats_beats_PR-23994/src/github.com/elastic/beats'
[2021-02-11T12:44:56.621Z] Makefile:209: recipe for target 'release-manager-snapshot' failed
[2021-02-11T12:44:56.621Z] make: *** [release-manager-snapshot] Error 2
[2021-02-11T12:44:56.627Z] script returned exit code 2
[2021-02-11T12:44:56.785Z] Stage "Lint" skipped due to earlier failure(s)
[2021-02-11T12:44:56.861Z] Stage "Build&Test" skipped due to earlier failure(s)
[2021-02-11T12:44:56.931Z] Stage "Packaging" skipped due to earlier failure(s)
[2021-02-11T12:44:57.033Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-23994/src/github.com/elastic/beats
[2021-02-11T12:44:58.121Z] Running on worker-395930 in /var/lib/jenkins/workspace/Beats_beats_PR-23994
[2021-02-11T12:44:58.227Z] [INFO] getVaultSecret: Getting secrets
[2021-02-11T12:44:58.322Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-02-11T12:45:00.371Z] + chmod 755 generate-build-data.sh
[2021-02-11T12:45:00.371Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-23994/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-23994/runs/1 ABORTED 3866283
[2021-02-11T12:45:00.371Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-23994/runs/1/steps/?limit=10000 -o steps-info.json
[2021-02-11T12:45:01.075Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-23994/runs/1/tests/?status=FAILED -o tests-errors.json
[2021-02-11T12:45:01.778Z] Retry 1/3 exited 22, retrying in 1 seconds...
[2021-02-11T12:45:03.234Z] Retry 2/3 exited 22, retrying in 2 seconds...
[2021-02-11T12:45:05.504Z] Retry 3/3 exited 22, no more retries left.
[2021-02-11T12:45:05.504Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-23994/runs/1/log/ -o pipeline-log.txt

elasticmachine · 2021-02-11T13:36:24Z

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: Pull request #23994 event
Start Time: 2021-02-11T12:46:23.817+0000
Duration: 49 min 27 sec
Commit: f2a3c7d

Test stats 🧪

Test	Results
Failed	0
Passed	45794
Skipped	4762
Total	50556

Trends 🧪

💚 Flaky test report

Tests succeeded.

Expand to view the summary

Test stats 🧪

Test	Results
Failed	0
Passed	45794
Skipped	4762
Total	50556

v1v added 2 commits February 11, 2021 11:35

Dump packages and platforms env variables

e92733f

for testing purposes only

07798ba

v1v requested a review from a team as a code owner February 11, 2021 11:39

botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label Team:Automation Label for the Observability productivity team and removed needs_team Indicates that the issue/PR needs a Team:* label labels Feb 11, 2021

v1v commented Feb 11, 2021

View reviewed changes

v1v requested review from jsoriano and kvch February 11, 2021 11:50

v1v commented Feb 11, 2021

View reviewed changes

cachedout approved these changes Feb 11, 2021

View reviewed changes

kvch approved these changes Feb 11, 2021

View reviewed changes

Revert "for testing purposes only"

f2a3c7d

This reverts commit 07798ba.

v1v merged commit 3ce47ca into elastic:master Feb 11, 2021

v1v deleted the feature/print-platforms-env-variables branch February 11, 2021 12:46

v1v added a commit to v1v/beats that referenced this pull request Feb 11, 2021

Dump packages and platforms env variables (elastic#23994)

e5cf96c

v1v mentioned this pull request Feb 11, 2021

Cherry-pick to 7.x: Dump packages and platforms env variables (#23994) #23997

Merged

v1v added a commit that referenced this pull request Feb 11, 2021

Dump packages and platforms env variables (#23994) (#23997)

2801cc4

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Dump packages and platforms env variables #23994

Dump packages and platforms env variables #23994

v1v commented Feb 11, 2021 •

edited

Loading

v1v Feb 11, 2021

v1v Feb 11, 2021

kvch Feb 11, 2021

elasticmachine commented Feb 11, 2021

Build stats

Trends 🧪

elasticmachine commented Feb 11, 2021

Build stats

Test stats 🧪

Trends 🧪

Test stats 🧪

		PLATFORMS = EnvOr("PLATFORMS", "")
		PACKAGES = EnvOr("PACKAGES", "")

Dump packages and platforms env variables #23994

Dump packages and platforms env variables #23994

Conversation

v1v commented Feb 11, 2021 • edited Loading

What does this PR do?

Why is it important?

Tests

v1v Feb 11, 2021

Choose a reason for hiding this comment

v1v Feb 11, 2021

Choose a reason for hiding this comment

kvch Feb 11, 2021

Choose a reason for hiding this comment

elasticmachine commented Feb 11, 2021

❕ Build Aborted

Build stats

Trends 🧪

Log output

elasticmachine commented Feb 11, 2021

💚 Build Succeeded

Build stats

Test stats 🧪

Trends 🧪

💚 Flaky test report

Test stats 🧪

v1v commented Feb 11, 2021 •

edited

Loading