Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FLINK-35526] Use more up to date jq docker image for Flink e2e tests #24892

Merged
merged 3 commits into from
Jun 6, 2024

Conversation

rmetzger
Copy link
Contributor

@rmetzger rmetzger commented Jun 5, 2024

Our CI logs contain this warning: https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=60060&view=logs&j=af184cdd-c6d8-5084-0b69-7e9c67b35f7a&t=0f3adb59-eefa-51c6-2858-3654d9e0749d&l=3828

latest: Pulling from stedolan/jq
[DEPRECATION NOTICE] Docker Image Format v1, and Docker Image manifest version 2, schema 1 support will be removed in an upcoming release. Suggest the author of docker.io/stedolan/jq:latest to upgrade the image to the OCI Format, or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/

@flinkbot
Copy link
Collaborator

flinkbot commented Jun 5, 2024

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

@dawidwys
Copy link
Contributor

dawidwys commented Jun 5, 2024

Thanks for the PR!
How about using the official jq image: https://github.com/jqlang/jq/pkgs/container/jq ?

I am good with either option though.

@rmetzger
Copy link
Contributor Author

rmetzger commented Jun 5, 2024

Thanks for the review. I actually like your proposal a lot. Will change it.

@rmetzger
Copy link
Contributor Author

rmetzger commented Jun 5, 2024

@@ -150,7 +150,7 @@ function s3_get_number_of_lines_by_prefix() {

# find all files that have the given prefix
parts=$(aws_cli s3api list-objects --bucket "$IT_CASE_S3_BUCKET" --prefix "$1" |
docker run -i --rm stedolan/jq -r '[.Contents[].Key] | join(" ")')
docker run -i --rm ghcr.io/jqlang/jq -r '[.Contents[].Key] | join(" ")')
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it be worth adding in the version tag instead of using latest? Thinking about test reproducibility.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very good point, thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants