Skip to content

publish images to github under a public image to avoid request throttling on docker hub #2102

@murphp15

Description

@murphp15

What is the feature request? What problem does it solve?
At the moment we have pipeline fail often because of docker hub request limits.
https://docs.docker.com/docker-hub/download-rate-limit/#:~:text=Docker%20Hub%20limits%20the%20number,pulls%20per%206%20hour%20period.

Github has no limits on the amount of images you can pull for public images.

I have manually published some images to github to get the pipelines green.
I have also created this PR to use github in integration tests which should result in us never getting throttled anymore https://github.com/vmware/versatile-data-kit/pull/2097/files.

Suggested solution
When we are publishing images to docker hub we should also publish them to github.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions