Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dockerfile for CI runner #408

Merged
134 commits merged into from
Nov 4, 2022
Merged
Changes from 1 commit
Commits
Show all changes
134 commits
Select commit Hold shift + click to select a range
3fe4a12
First attempt at a github action for check script
dagardner-nv Aug 24, 2022
6dda860
wip
dagardner-nv Aug 24, 2022
6277d8a
wip
dagardner-nv Aug 24, 2022
8111397
wip
dagardner-nv Aug 24, 2022
32188ec
wip
dagardner-nv Aug 24, 2022
b6cb579
Merge branch 'branch-22.09' into david-gh-actions
dagardner-nv Sep 9, 2022
438ea7c
Mark benchmark tests as slow
dagardner-nv Sep 9, 2022
69115be
Define GITHUB_WORKSPACE env var
dagardner-nv Sep 9, 2022
cacefa4
Fix gh env vars
dagardner-nv Sep 9, 2022
bd42bb7
Fix paths
dagardner-nv Sep 9, 2022
93b337d
Fix paths
dagardner-nv Sep 9, 2022
6e4a884
wip
dagardner-nv Sep 9, 2022
d561ff4
wip
dagardner-nv Sep 9, 2022
3309f3e
wip
dagardner-nv Sep 9, 2022
5034f8e
wip
dagardner-nv Sep 9, 2022
fb585b2
wip
dagardner-nv Sep 9, 2022
05cdab2
wip
dagardner-nv Sep 9, 2022
f0b786e
wip
dagardner-nv Sep 9, 2022
beb31d6
wip
dagardner-nv Sep 9, 2022
f5c10ef
wip
dagardner-nv Sep 9, 2022
dfd73cb
wip
dagardner-nv Sep 9, 2022
e665680
wip
dagardner-nv Sep 9, 2022
a296efe
wip
dagardner-nv Sep 9, 2022
1a13697
wip
dagardner-nv Sep 9, 2022
b9710f0
wip
dagardner-nv Sep 9, 2022
dfc937d
wip
dagardner-nv Sep 12, 2022
44fba67
break up long path string
dagardner-nv Sep 12, 2022
0303abf
Merge branch 'branch-22.09' into david-gh-actions
dagardner-nv Sep 12, 2022
6737f6b
wip
dagardner-nv Sep 12, 2022
beb5337
Remove origin prefix - workaround for jenkins issue
dagardner-nv Sep 12, 2022
548e309
wip
dagardner-nv Sep 12, 2022
e7cce5d
wip
dagardner-nv Sep 12, 2022
2a5070b
wip
dagardner-nv Sep 12, 2022
ffeaf4b
wip
dagardner-nv Sep 12, 2022
cbed5e7
wip
dagardner-nv Sep 12, 2022
655bcea
wip
dagardner-nv Sep 12, 2022
fe37dc8
wip
dagardner-nv Sep 12, 2022
f711ca6
wip
dagardner-nv Sep 12, 2022
b73e9c5
No need to set the repo as a safe dir, as the github checkout action …
dagardner-nv Sep 12, 2022
22925ec
wip
dagardner-nv Sep 12, 2022
2f40146
wip
dagardner-nv Sep 12, 2022
9021cc9
Set copyright headers
dagardner-nv Sep 12, 2022
efd7267
Add build stage
dagardner-nv Sep 12, 2022
da0d5bd
Fix path
dagardner-nv Sep 12, 2022
24a6a99
Set region
dagardner-nv Sep 12, 2022
a50faea
Add test & doc stages
dagardner-nv Sep 12, 2022
a34d4d0
Update secrets
dagardner-nv Sep 13, 2022
db01133
Fix deps
dagardner-nv Sep 13, 2022
59c942f
fetch history
dagardner-nv Sep 13, 2022
3a3bb31
Set NVIDIA_VISIBLE_DEVICES
dagardner-nv Sep 13, 2022
64eb738
Fix var
dagardner-nv Sep 13, 2022
0ad9398
Fix var
dagardner-nv Sep 13, 2022
666ef71
Move env
dagardner-nv Sep 13, 2022
624912c
Remove old Jenkinsfile
dagardner-nv Sep 13, 2022
02ed85c
Merge branch 'branch-22.09' into david-gh-actions
dagardner-nv Sep 13, 2022
54757d0
Merge branch 'branch-22.09' into david-gh-actions
dagardner-nv Sep 13, 2022
8938c32
Merge branch 'branch-22.09' into david-gh-actions
dagardner-nv Sep 13, 2022
5c3e086
Merge branch 'david-gh-actions' of github.com:dagardner-nv/Morpheus i…
dagardner-nv Sep 30, 2022
f4105e6
Merge branch 'branch-22.09' into david-gh-actions
dagardner-nv Sep 30, 2022
fc381e4
Try to use newer rapidsai images
dagardner-nv Sep 30, 2022
3814b63
Remove packages already in os
dagardner-nv Sep 30, 2022
55ab5b9
wip
dagardner-nv Sep 30, 2022
d1612e3
wip
dagardner-nv Sep 30, 2022
2f1a8cf
wip
dagardner-nv Sep 30, 2022
007e336
Remove install of driver
dagardner-nv Oct 3, 2022
7d99ee2
Point to local cuda install
dagardner-nv Oct 3, 2022
f037353
Temp disable
dagardner-nv Oct 3, 2022
d698df1
try and set it explicitly
dagardner-nv Oct 3, 2022
dfa8e04
Add libnvidia-ml1
dagardner-nv Oct 3, 2022
29d5fb6
Disable python stub generation
dagardner-nv Oct 3, 2022
22842c8
Fix type-o
dagardner-nv Oct 3, 2022
aef55bc
Move debian deps to a common method
dagardner-nv Oct 3, 2022
deecfc5
set cuda path
dagardner-nv Oct 3, 2022
8b63fdf
Remove unused section
dagardner-nv Oct 3, 2022
8bc7713
Set cuda_path
dagardner-nv Oct 3, 2022
0140786
Make conda env creation a method
dagardner-nv Oct 3, 2022
4b6a360
Re-activate the env after all deps have been installed
dagardner-nv Oct 3, 2022
65bde60
For now use a gpu to build the docs
dagardner-nv Oct 3, 2022
d687de7
Remove redundant call to show_conda_info
dagardner-nv Oct 3, 2022
42a11dc
Set PARALLEL_LEVEL for gpu jobs
dagardner-nv Oct 3, 2022
d77499c
Add deps for tests
dagardner-nv Oct 3, 2022
6062b2b
Don't use a gpu for docs
dagardner-nv Oct 3, 2022
ddc4f91
Remove redundant conda install, remove pytest-kafka work-around
dagardner-nv Oct 3, 2022
1490088
wip
dagardner-nv Oct 14, 2022
b7b2598
wip
dagardner-nv Oct 14, 2022
a917031
wip
dagardner-nv Oct 14, 2022
fb324f4
Clean the npm cache after installing camouflage-server
dagardner-nv Oct 14, 2022
c550a18
wip
dagardner-nv Oct 14, 2022
36f9da3
wip
dagardner-nv Oct 14, 2022
2945821
Temp disable stubs
dagardner-nv Oct 14, 2022
d85dc26
Fix install of pytest-kafka
dagardner-nv Oct 14, 2022
9a86706
Don't set stub vars by default
dagardner-nv Oct 14, 2022
13e2350
Remove unused packages:
dagardner-nv Oct 17, 2022
2ed1b60
Merge branch 'branch-22.11' into david-gh-actions_p2
dagardner-nv Oct 17, 2022
5b35ccd
Remove unused env vars
dagardner-nv Oct 17, 2022
bfd94a8
Build python stubs
dagardner-nv Oct 17, 2022
e27d3ec
Set stubs
dagardner-nv Oct 17, 2022
597cb32
Add libnvidia-compute-495
dagardner-nv Oct 17, 2022
519ccad
wip
dagardner-nv Oct 17, 2022
55810d6
Don't force the variables by default
dagardner-nv Oct 17, 2022
54ad797
wip
dagardner-nv Oct 18, 2022
25c6811
Don't install libs provided by the driver in the test stage
dagardner-nv Oct 18, 2022
3838cc0
wip
dagardner-nv Oct 18, 2022
abcc1bf
Install build deps on check stage
dagardner-nv Oct 18, 2022
47260cf
Fix documentation builds
dagardner-nv Oct 18, 2022
2343891
Move
dagardner-nv Oct 20, 2022
8d86b16
Merge branch 'david-gh-actions_p2' into david-ci-img
dagardner-nv Oct 20, 2022
f38f90d
Add args to dockerfile
dagardner-nv Oct 20, 2022
e0a941b
wip
dagardner-nv Oct 20, 2022
e385419
Dockerfile for CI
dagardner-nv Oct 20, 2022
13fef7a
Merge branch 'branch-22.11' into david-ci-img-pt1
dagardner-nv Oct 27, 2022
ab0fe98
Install clang from conda
dagardner-nv Oct 31, 2022
a285176
Merge branch 'david-ci-img' into david-ci-img-pt1
dagardner-nv Oct 31, 2022
f150412
Set new image
dagardner-nv Oct 31, 2022
704afa8
Switch to multi-stage docker builds
dagardner-nv Nov 1, 2022
02768e4
Use rapids-mamba-retry mamba wrapper
dagardner-nv Nov 1, 2022
6ce3024
Merge branch 'david-ci-img-pt1' of github.com:dagardner-nv/Morpheus i…
dagardner-nv Nov 1, 2022
23a6152
Remove unused set_stub_vars function
dagardner-nv Nov 1, 2022
8c02a04
Fix merge error
dagardner-nv Nov 1, 2022
e546863
Merge branch 'branch-22.11' into david-ci-img-pt1
dagardner-nv Nov 1, 2022
4dd4529
Move cuda libs to the driver stage
dagardner-nv Nov 1, 2022
bbb4667
CI pipeline is now a re-usable workflow
dagardner-nv Nov 2, 2022
0f071aa
Remove version ref
dagardner-nv Nov 2, 2022
90b787d
Set a name
dagardner-nv Nov 2, 2022
64c64ba
Set run-name
dagardner-nv Nov 2, 2022
d11f123
Set run-name
dagardner-nv Nov 2, 2022
4782f20
Revert "Set run-name"
dagardner-nv Nov 2, 2022
513a748
Revert "Set run-name"
dagardner-nv Nov 2, 2022
9422aa5
Move git-lfs to conda yaml, remove old ci env file
dagardner-nv Nov 2, 2022
2656f9e
Add helper script & readme
dagardner-nv Nov 2, 2022
ba8303a
Fix args
dagardner-nv Nov 2, 2022
49bd462
Use new CI images
dagardner-nv Nov 2, 2022
344ba86
fix image names
dagardner-nv Nov 2, 2022
ad0a60e
Add DOCKER_EXTRA_ARGS var
dagardner-nv Nov 3, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Remove unused packages:
  • Loading branch information
dagardner-nv committed Oct 17, 2022
commit 13e2350815cc15f1141394fe4aaff9a57898439e
7 changes: 3 additions & 4 deletions ci/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -36,18 +36,17 @@ RUN apt-get update && \
clang-format-12 \
clang-tidy-12 \
git-lfs \
libclang-12-dev \
libcublas-dev-11-5 \
libcufft-dev-11-5 \
libcurand-dev-11-5 \
libcusolver-dev-11-5 \
libnuma1 \
libnvidia-compute-495 \
llvm-12-dev \
openjdk-11-jdk \
nodejs \
npm \
&& rm -rf /var/lib/apt/lists/* && \
npm && \
apt clean && \
rm -rf /var/lib/apt/lists/* && \
update-alternatives --install /usr/bin/clang clang /usr/bin/clang-12 121 \
--slave /usr/bin/clang-apply-replacements clang-apply-replacements /usr/bin/clang-apply-replacements-12 \
--slave /usr/bin/clang-format clang-format /usr/bin/clang-format-12 \
Expand Down