Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Repository refactor/restructure/cleanup #72

Merged
merged 29 commits into from
Jul 10, 2019
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
df43ff0
remove stale dockerfiles
TriplEight Apr 11, 2019
7e887cf
add cache and some cleanup
TriplEight Apr 11, 2019
3b5fb7c
fix name
TriplEight Apr 11, 2019
6338cb0
small fix
TriplEight Apr 11, 2019
073b05d
tricky \n
TriplEight Apr 11, 2019
6ac7575
cleaning dokerfiles for cross
General-Beck Apr 12, 2019
349aba8
indent
TriplEight Apr 12, 2019
af5dc34
fix README
TriplEight Apr 12, 2019
56bc689
READMEs edits
TriplEight Apr 15, 2019
cb80023
Merge remote-tracking branch 'origin/master' into dockerfiles_update
TriplEight May 24, 2019
ba0c444
Merge branch 'master' into dockerfiles_update
TriplEight Jun 13, 2019
3859fec
labels 2
TriplEight Jun 14, 2019
9a47eae
docs README
TriplEight Jun 14, 2019
0cd6c5a
paths
TriplEight Jun 14, 2019
38fc917
CI changes to depict the file structure change
TriplEight Jun 17, 2019
6fe7786
image removed according to #57
TriplEight Jun 17, 2019
ba07942
moves and renamings
TriplEight Jun 17, 2019
bc696a1
removed old substrate image
TriplEight Jun 17, 2019
a3398c8
removed old makefiles
TriplEight Jun 17, 2019
6741579
we are not using makefiles any more
TriplEight Jun 17, 2019
d1e4661
fix for kubetools
TriplEight Jul 8, 2019
39104a4
update README's
TriplEight Jul 8, 2019
cee3455
leave TODO
TriplEight Jul 8, 2019
7cd3e9f
update README
TriplEight Jul 8, 2019
9dcd13e
update README for arm64
TriplEight Jul 8, 2019
5d06db5
Merge branch 'master' into dockerfiles_update
TriplEight Jul 8, 2019
fe66f82
weird conflict resolve
TriplEight Jul 8, 2019
777310b
restore change deleted by merge
TriplEight Jul 8, 2019
0ae92ea
rm'd a couple of unnecessary lines
TriplEight Jul 10, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
125 changes: 60 additions & 65 deletions .gitlab-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -42,156 +42,151 @@ variables:
- docker login -u "${Docker_Hub_User_Parity}" -p "${Docker_Hub_Pass_Parity}"
- docker info
script:
- cd $DOCKERFILE_DIR
- cd dockerfiles/$DOCKERFILE_DIR
# - docker pull $CONTAINER_IMAGE:$CONTAINER_TAG || true
# - docker build --cache-from $CONTAINER_IMAGE:$CONTAINER_TAG --tag $CONTAINER_IMAGE:$CI_BUILD_REF --tag $CONTAINER_IMAGE:$CONTAINER_TAG .
- export CONTAINER_DATE_TAG="${CI_COMMIT_SHORT_SHA}-$(date +%Y%m%d)"
- docker build --no-cache
--build-arg VCS_REF="${CI_COMMIT_SHA}"
--build-arg BUILD_DATE="$(date +%Y%m%d)"
--tag $CONTAINER_IMAGE:$CONTAINER_DATE_TAG
--tag $CONTAINER_IMAGE:$CONTAINER_TAG .
- docker push $CONTAINER_IMAGE:$CONTAINER_DATE_TAG
- docker push $CONTAINER_IMAGE:$CONTAINER_TAG
--tag parity/$CONTAINER_IMAGE:$CONTAINER_DATE_TAG
--tag parity/$CONTAINER_IMAGE:$CONTAINER_TAG .
- docker push parity/$CONTAINER_IMAGE:$CONTAINER_DATE_TAG
- docker push parity/$CONTAINER_IMAGE:$CONTAINER_TAG
after_script:
- docker logout
environment:
name: parity-build


# Deprecated, used only for substrate 1.0 and polkadot 0.4
parity/rust:
# TODO: check/change substrate 1.0, polkadot 0.4, zcash, parity-pharma, parity-bitcoin, light and remove this image
rust:
<<: *docker_build
variables:
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: nightly
DOCKERFILE_DIR: docker-files-for-Gitlab-CI-rust/rustup
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: nightly
DOCKERFILE_DIR: rustup
only:
variables:
- $DOCKERIMAGE == $CI_JOB_NAME

parity/parity-ci-linux:
parity-ci-linux:
<<: *docker_build
variables:
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: docker-files-for-Gitlab-CI-rust/parity-ci-linux
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: $CI_JOB_NAME
only:
variables:
- $DOCKERIMAGE == $CI_JOB_NAME

parity/rust-parity-ethereum-android-build:
parity-ci-android:
<<: *docker_build
variables:
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: stretch
DOCKERFILE_DIR: docker-files-for-Gitlab-CI-rust/cross/android
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: stretch
DOCKERFILE_DIR: $CI_JOB_NAME
only:
variables:
- $DOCKERIMAGE == $CI_JOB_NAME

rust-parity-ethereum-build:i386:
parity-ci-i386:
<<: *docker_build
variables:
CONTAINER_IMAGE: parity/rust-parity-ethereum-build
CONTAINER_TAG: i386
DOCKERFILE_DIR: docker-files-for-Gitlab-CI-rust/cross/i686
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: $CI_JOB_NAME
only:
variables:
- $DOCKERIMAGE == "parity/rust-parity-ethereum-build"
- $DOCKERIMAGE == $CI_JOB_NAME

rust-parity-ethereum-build:arm64:
parity-ci-arm64:
<<: *docker_build
variables:
CONTAINER_IMAGE: parity/rust-parity-ethereum-build
CONTAINER_TAG: arm64
DOCKERFILE_DIR: docker-files-for-Gitlab-CI-rust/cross/arm64
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: $CI_JOB_NAME
only:
variables:
- $DOCKERIMAGE == "parity/rust-parity-ethereum-build"
- $DOCKERIMAGE == $CI_JOB_NAME

rust-parity-ethereum-build:armhf:
parity-ci-armhf:
<<: *docker_build
variables:
CONTAINER_IMAGE: parity/rust-parity-ethereum-build
CONTAINER_TAG: armhf
DOCKERFILE_DIR: docker-files-for-Gitlab-CI-rust/cross/armv7
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: $CI_JOB_NAME
only:
variables:
- $DOCKERIMAGE == "parity/rust-parity-ethereum-build"
- $DOCKERIMAGE == $CI_JOB_NAME

parity/rust-parity-ethereum-docs:
parity-ci-docs:
<<: *docker_build
variables:
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: xenial
DOCKERFILE_DIR: docker-files-for-Gitlab-CI-rust/parity-eth-linux-docs
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: $CI_JOB_NAME
only:
variables:
- $DOCKERIMAGE == $CI_JOB_NAME

parity/rust-builder:
rust-builder:
<<: *docker_build
variables:
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: docker-files-for-Gitlab-CI-rust/rust-builder
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: $CI_JOB_NAME
only:
variables:
- $DOCKERIMAGE == $CI_JOB_NAME



# helpers

parity/awscli:
awscli:
<<: *docker_build
variables:
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: docker/helpers/awscli
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: $CI_JOB_NAME
only:
variables:
- $DOCKERIMAGE == $CI_JOB_NAME
- $DOCKERIMAGE == "awscli"

parity/tools:
tools:
<<: *docker_build
variables:
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: docker/helpers/tools
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: $CI_JOB_NAME
only:
variables:
- $DOCKERIMAGE == $CI_JOB_NAME
- $DOCKERIMAGE == "tools"

# special case as version tags are introduced
parity/kubetools:
kubetools:
<<: *docker_build
variables:
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: docker/helpers/kubetools
CONTAINER_IMAGE: $CI_JOB_NAME
CONTAINER_TAG: latest
DOCKERFILE_DIR: $CI_JOB_NAME
# https://github.com/kubernetes/kubernetes/releases
KUBE_VERSION: "1.13.6"
KUBE_VERSION: "1.13.6"
# https://github.com/kubernetes/helm/releases
HELM_VERSION: "2.13.1"
HELM_VERSION: "2.13.1"
only:
variables:
- $DOCKERIMAGE == $CI_JOB_NAME
- $DOCKERIMAGE == "kubetools"
script:
- cd $DOCKERFILE_DIR
- cd dockerfiles/$DOCKERFILE_DIR
- docker build
--build-arg VCS_REF="${CI_COMMIT_SHA}"
--build-arg BUILD_DATE="$(date -u '+%Y-%m-%dT%H:%M:%SZ')"
--build-arg KUBE_VERSION="${KUBE_VERSION}"
--build-arg HELM_VERSION="${HELM_VERSION}"
--tag $CONTAINER_IMAGE:$CONTAINER_TAG
--tag $CONTAINER_IMAGE:$HELM_VERSION .
- docker push $CONTAINER_IMAGE:$CONTAINER_TAG
- docker push $CONTAINER_IMAGE:$HELM_VERSION
--tag parity/$CONTAINER_IMAGE:$CONTAINER_TAG
--tag parity/$CONTAINER_IMAGE:$HELM_VERSION .
- docker push parity/$CONTAINER_IMAGE:$CONTAINER_TAG
- docker push parity/$CONTAINER_IMAGE:$HELM_VERSION



Expand Down
29 changes: 11 additions & 18 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,29 +10,22 @@ Download, verify and install


## Dockerfiles for images used in GitLab CI
[Documentation](docker-files-for-Gitlab-CI-rust/README.md).

- rust image
[Documentation](dockerfiles/README.md).
Rust and tools for:
- Substrate-based projects CIs
- parity-ethereum
- android
- arm
- arm64
- armv7
- centos
- debian
- i686
- snapcraft
- docs autogeneration
- various tools
- tools for kubernetes


## GitLab CI for building docker images

Pipelines can only be triggered manually for now. For that go to the projects
CI/CD -> Pipelines menu and click "Run Pipeline". Variables have to be given
to select the image to build. E.g.

```
DOCKERIMAGE="rust"
DOCKERTAG="nightly"
```

Docker image parity/rust:nightly is set up to be rebuild every night.

Pipelines are triggered by schedule. Can be launched manually though.
To launch the pipeline go to the project's CI/CD -> Schedules menu.
To change, edit/create the new schedule:
set the required variable and cron schedule.
7 changes: 0 additions & 7 deletions docker-files-for-Gitlab-CI-rust/README.md

This file was deleted.

23 changes: 0 additions & 23 deletions docker-files-for-Gitlab-CI-rust/cross/android/Makefile

This file was deleted.

8 changes: 0 additions & 8 deletions docker-files-for-Gitlab-CI-rust/cross/android/README.md

This file was deleted.

72 changes: 0 additions & 72 deletions docker-files-for-Gitlab-CI-rust/cross/arm/Dockerfile

This file was deleted.

Loading