Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jenkins improvememts #107

Merged
310 commits merged into from
Jun 8, 2022
Merged
Changes from 1 commit
Commits
Show all changes
310 commits
Select commit Hold shift + click to select a range
e94f659
WIP
dagardner-nv May 9, 2022
3256997
WIP
dagardner-nv May 9, 2022
0e56b92
WIP
dagardner-nv May 9, 2022
0dc4edf
WIP
dagardner-nv May 9, 2022
0a38170
WIP
dagardner-nv May 9, 2022
e613ff9
WIP
dagardner-nv May 9, 2022
5c2bbca
WIP
dagardner-nv May 9, 2022
9adeea3
WIP
dagardner-nv May 9, 2022
ddca7d5
WIP
dagardner-nv May 9, 2022
0960a54
WIP
dagardner-nv May 9, 2022
ce6577f
WIP
dagardner-nv May 9, 2022
02ff4dd
WIP
dagardner-nv May 9, 2022
bf7f32f
WIP
dagardner-nv May 9, 2022
f78aa4e
WIP
dagardner-nv May 9, 2022
2c3082c
WIP
dagardner-nv May 9, 2022
57ea894
WIP
dagardner-nv May 9, 2022
9a544bc
WIP
dagardner-nv May 9, 2022
8ce942c
WIP
dagardner-nv May 9, 2022
276b65f
WIP
dagardner-nv May 9, 2022
fbed9a9
WIP
dagardner-nv May 9, 2022
f0dbfb0
WIP
dagardner-nv May 9, 2022
a424bcb
WIP
dagardner-nv May 9, 2022
0650df5
WIP
dagardner-nv May 9, 2022
1eff2fc
WIP
dagardner-nv May 9, 2022
d3d2479
WIP
dagardner-nv May 9, 2022
8ffe22a
WIP
dagardner-nv May 9, 2022
3d3f0e6
WIP
dagardner-nv May 10, 2022
476fee1
WIP
dagardner-nv May 10, 2022
214e5d4
WIP
dagardner-nv May 10, 2022
7228033
WIP
dagardner-nv May 10, 2022
6ffbf38
WIP
dagardner-nv May 10, 2022
7027cac
WIP
dagardner-nv May 10, 2022
8be0462
WIP
dagardner-nv May 10, 2022
a6d2efd
WIP
dagardner-nv May 10, 2022
5186d32
WIP
dagardner-nv May 10, 2022
6c3c82a
WIP
dagardner-nv May 10, 2022
5e2e343
WIP
dagardner-nv May 10, 2022
47dcbdc
Dont perform an in-place editable build
dagardner-nv May 10, 2022
93d352f
WIP
dagardner-nv May 10, 2022
ff56256
Add check stage
dagardner-nv May 10, 2022
8f267c7
Add check stage
dagardner-nv May 10, 2022
69ac9fc
wip
dagardner-nv May 10, 2022
5124d80
wip
dagardner-nv May 10, 2022
00f88c6
wip
dagardner-nv May 10, 2022
7ee9f4a
wip
dagardner-nv May 10, 2022
4bf88f2
wip
dagardner-nv May 10, 2022
cbe5427
wip
dagardner-nv May 10, 2022
04641a2
wip
dagardner-nv May 10, 2022
e22fb84
wip
dagardner-nv May 10, 2022
33daa7a
test copyright
dagardner-nv May 10, 2022
4287ab8
Revert "test copyright"
dagardner-nv May 10, 2022
d040e15
Test python checks
dagardner-nv May 10, 2022
be0617d
wip
dagardner-nv May 10, 2022
165e0b3
Revert "Test python checks"
dagardner-nv May 10, 2022
a7ba5c1
wip
dagardner-nv May 11, 2022
acbae0f
wip
dagardner-nv May 11, 2022
5028d78
wip
dagardner-nv May 11, 2022
d0a1018
wip
dagardner-nv May 11, 2022
943e613
Dont exit early on failed tests
dagardner-nv May 11, 2022
a35407a
wip
dagardner-nv May 11, 2022
071680b
wip
dagardner-nv May 11, 2022
a69f852
wip
dagardner-nv May 11, 2022
4cbc675
wip
dagardner-nv May 11, 2022
63bd891
wip
dagardner-nv May 11, 2022
d0b3c83
wip
dagardner-nv May 11, 2022
9fc9b18
wip
dagardner-nv May 11, 2022
b0624f6
wip
dagardner-nv May 11, 2022
66fb4c8
wip
dagardner-nv May 11, 2022
2e91fdb
wip
dagardner-nv May 11, 2022
1c8a895
wip
dagardner-nv May 11, 2022
3696825
wip
dagardner-nv May 11, 2022
d59d821
wip
dagardner-nv May 11, 2022
d06c714
wip
dagardner-nv May 11, 2022
ab887c9
Use -driver variant
dagardner-nv May 12, 2022
87db77d
wip
dagardner-nv May 12, 2022
1e9040b
wip
dagardner-nv May 12, 2022
ce02944
wip
dagardner-nv May 12, 2022
c733303
wip
dagardner-nv May 12, 2022
a0f4f10
wip
dagardner-nv May 12, 2022
7fcec06
wip
dagardner-nv May 12, 2022
adb235f
wip
dagardner-nv May 12, 2022
52ef83f
add conda build
dagardner-nv May 12, 2022
ea4cc3a
Respect the PARALLEL_LEVEL in build
dagardner-nv May 12, 2022
e40ed1a
Revert debug changes
dagardner-nv May 12, 2022
5e56ffd
Disable ccache when using sccache
dagardner-nv May 12, 2022
fff04ca
use bz2
dagardner-nv May 12, 2022
bcd4181
Formatting fix
dagardner-nv May 12, 2022
a4a4ba4
Merge branch 'branch-22.06' into david-ci
dagardner-nv May 12, 2022
658c352
Generate a coverage report as well as a junit report
dagardner-nv May 12, 2022
86cad99
Increase time limit for build, a clean build will require 1h40m
dagardner-nv May 12, 2022
2011982
Disable morpheus conda build for now
dagardner-nv May 12, 2022
97a480d
wip
dagardner-nv May 12, 2022
8490157
Revert to trying the gpu build to see if this fixes the cudf issue
dagardner-nv May 12, 2022
35ec5fd
wip
dagardner-nv May 12, 2022
6a08821
Revert "Revert to trying the gpu build to see if this fixes the cudf …
dagardner-nv May 12, 2022
fbe61a4
wip
dagardner-nv May 12, 2022
b7f728e
wip
dagardner-nv May 13, 2022
bd68189
Probably don't need the pip install
dagardner-nv May 13, 2022
ac68342
Revert "Probably don't need the pip install"
dagardner-nv May 13, 2022
86cdb73
Doc builds need the workspace to be reinstalled
dagardner-nv May 13, 2022
beb0d33
Fix docs
dagardner-nv May 13, 2022
775f5d8
WIP
dagardner-nv May 13, 2022
5314415
Use the rapidsai-driver for cpu-only stages
dagardner-nv May 13, 2022
b7a4480
wip
dagardner-nv May 13, 2022
5161d30
wip
dagardner-nv May 13, 2022
fd0b20a
Debug call to ldd
dagardner-nv May 13, 2022
f8439b9
Debug call to ldd
dagardner-nv May 13, 2022
84da278
Merge branch 'david-ci' into david-ci-no-inplace
dagardner-nv May 13, 2022
54c4cf3
wip
dagardner-nv May 13, 2022
e55341f
wip
dagardner-nv May 13, 2022
52b92a6
WIP
dagardner-nv May 13, 2022
a7263fc
Merge branch 'branch-22.06' into david-cli-rel-paths
dagardner-nv May 16, 2022
1197dbc
Use the -I (isolation mode) for python when running unittests, ensure…
dagardner-nv May 16, 2022
06fb137
WIP
dagardner-nv May 16, 2022
2bcf000
Fix type-o
dagardner-nv May 16, 2022
14e83a9
Cleanup redundant environment declarations
dagardner-nv May 16, 2022
bcd1d68
Remove externalDelete statements
dagardner-nv May 16, 2022
58393e8
Revert "Remove externalDelete statements"
dagardner-nv May 16, 2022
4a908fe
Revert "Revert "Remove externalDelete statements""
dagardner-nv May 16, 2022
bcf4029
Add disableDeferredWipeout
dagardner-nv May 16, 2022
0b1da07
wip
dagardner-nv May 16, 2022
821c32c
wip
dagardner-nv May 16, 2022
45ceea5
Revert "wip"
dagardner-nv May 16, 2022
07d47c0
Revert "wip"
dagardner-nv May 16, 2022
e43ac1b
Revert "Add disableDeferredWipeout"
dagardner-nv May 16, 2022
da71025
Revert "Revert "Revert "Remove externalDelete statements"""
dagardner-nv May 16, 2022
3e19ae7
tmp debugging
dagardner-nv May 16, 2022
7159f70
Merge branch 'david-ci' into david-ci-no-inplace
dagardner-nv May 16, 2022
bbd6646
tmp debugging
dagardner-nv May 16, 2022
c2c467b
Move data
dagardner-nv May 16, 2022
cd6f0bf
npm missing?
dagardner-nv May 16, 2022
93bfb7d
I don't know anymore
dagardner-nv May 16, 2022
b014c32
Debugging npm issue
dagardner-nv May 17, 2022
ce01a4a
Add missing dep for pybind11-stubgen
dagardner-nv May 17, 2022
0b6d959
Don't add deps for pybind11 stub files when we aren't doing an inplac…
dagardner-nv May 17, 2022
520da8a
Don't install camouflage-server globally
dagardner-nv May 17, 2022
827ee41
Add MANIFEST.in to list of installed files
dagardner-nv May 17, 2022
4ef5624
Copy data dir, and files previously set by package_data
dagardner-nv May 17, 2022
c2c5975
Remove package_data, unfortunately the setuptools docs are vague and …
dagardner-nv May 17, 2022
4a22c29
Add some debug statements, I suspect its a permissions issue that I c…
dagardner-nv May 17, 2022
9a7f1cb
Add some debug statements, I suspect its a permissions issue that I c…
dagardner-nv May 17, 2022
336fb2d
whoami doesn't work
dagardner-nv May 17, 2022
ff4e1b0
Set permissions to be the same on extract
dagardner-nv May 17, 2022
4186357
Remove unused MORPHEUS_ROOT attr
dagardner-nv May 17, 2022
65473c6
Update path in examples for new data location
dagardner-nv May 17, 2022
be44798
Merge branch 'branch-22.06' into david-cli-rel-paths
dagardner-nv May 17, 2022
7ae1e30
Fix import path
dagardner-nv May 17, 2022
5cfbea3
wip
dagardner-nv May 17, 2022
329a6a6
Update paths in examples
dagardner-nv May 17, 2022
9c584f7
wip
dagardner-nv May 17, 2022
405b539
Update data path in docs
dagardner-nv May 17, 2022
1c7f421
fix path
dagardner-nv May 17, 2022
9779786
wip
dagardner-nv May 17, 2022
c0d5281
Update lfs to reflect data dir move
dagardner-nv May 17, 2022
ce37b33
Remove unneded fea_length
dagardner-nv May 17, 2022
c190638
Try and set the global npm dir to temp
dagardner-nv May 17, 2022
977bc34
Fix the setting of the home env var
dagardner-nv May 17, 2022
4580eee
Merge branch 'branch-22.06' into david-ci
dagardner-nv May 17, 2022
a2123f5
Add comment explaining why we are setting LD_LIBRARY_PATH
dagardner-nv May 17, 2022
a325529
Merge branch 'david-ci' into david-ci-no-inplace
dagardner-nv May 17, 2022
cf4433a
Move duplicated code into jenkins_common.sh
dagardner-nv May 17, 2022
b5a85a8
Merge branch 'david-cli-rel-paths' into david-ci-no-inplace
dagardner-nv May 17, 2022
01185ee
Install from a cmake install rather than the build
dagardner-nv May 17, 2022
ff81939
Add missing dep
dagardner-nv May 17, 2022
0fbfd30
Merge branch 'david-ci' into david-ci-no-inplace
dagardner-nv May 17, 2022
afe84b0
For now it appears that adding the pyi files to the build requires a …
dagardner-nv May 17, 2022
d1ff412
wip
dagardner-nv May 17, 2022
f36b40f
Update ci/scripts/jenkins_common.sh
dagardner-nv May 17, 2022
1bfd77f
Loosen the version reqs
dagardner-nv May 17, 2022
79ec3a7
Merge branch 'david-ci' of github.com:dagardner-nv/Morpheus into davi…
dagardner-nv May 17, 2022
a1dabeb
Move jenkins scripts to their own dir, remove relative paths using MO…
dagardner-nv May 18, 2022
f2c0ec9
Use workspace var in jenkinsfile
dagardner-nv May 18, 2022
a921800
Use a gpu node for building docs
dagardner-nv May 18, 2022
e656620
Merge branch 'david-ci' into david-ci-no-inplace
dagardner-nv May 18, 2022
160edf2
Add comment about usage of the --no-same-owner flag
dagardner-nv May 18, 2022
ffdc584
Debug info
dagardner-nv May 18, 2022
c6f02bd
wip
dagardner-nv May 18, 2022
647855c
Remove debug info
dagardner-nv May 18, 2022
35937c3
wip
dagardner-nv May 18, 2022
e8e327d
Make a helper function for printing conda info
dagardner-nv May 18, 2022
61ebfcf
Style fixes
dagardner-nv May 18, 2022
b336d4a
Merge branch 'david-cli-rel-paths' into david-ci-no-inplace
dagardner-nv May 18, 2022
67214f2
wip
dagardner-nv May 18, 2022
58277b9
wip
dagardner-nv May 18, 2022
e8f78d2
Fix bash syntax
dagardner-nv May 18, 2022
ed6ec78
Fix bash syntax
dagardner-nv May 18, 2022
736f71f
Optionally use curl
dagardner-nv May 18, 2022
67696d2
retry
dagardner-nv May 18, 2022
5a84ff2
Update docs/source/basics/examples.rst
dagardner-nv May 18, 2022
c568da0
Ensure that is in the installed rpath
dagardner-nv May 18, 2022
0093f0e
Remove setting LD_LIBRARY_PATH
dagardner-nv May 18, 2022
daa1411
Add helper script to determine merge target when executed locally
dagardner-nv May 18, 2022
c3fe2d1
Work-around bug in coverage plugin
dagardner-nv May 19, 2022
0514cb5
Don't use a gpu for docs
dagardner-nv May 19, 2022
e1f490c
Fix spelling mistake
dagardner-nv May 19, 2022
8c7d001
We should be able to build without a cpu now
dagardner-nv May 19, 2022
4cc8fc4
Attempt to mock all things neo to prevent nvmlinit from being called
dagardner-nv May 19, 2022
d5cbede
fix style checvks
dagardner-nv May 19, 2022
482f9a1
Try calling nvidia-smi
dagardner-nv May 19, 2022
53d2bc9
Mock out morpheus lib
dagardner-nv May 19, 2022
58e1435
Revert "Mock out morpheus lib"
dagardner-nv May 19, 2022
39da056
Revert "fix style checvks"
dagardner-nv May 19, 2022
deb28ea
Revert "Attempt to mock all things neo to prevent nvmlinit from being…
dagardner-nv May 19, 2022
a6bbd02
Request a gpu for documentation builds
dagardner-nv May 19, 2022
0b96c0d
Merge branch 'branch-22.06' into david-fix-ci
dagardner-nv May 19, 2022
88b3b13
Apply flake8 recomendation
dagardner-nv May 19, 2022
4162f53
Convert debug print statements to logging.debug statements, allowing …
dagardner-nv May 19, 2022
e1a60d0
Skip IWYU if no C++ files have been changed (prevents it from being c…
dagardner-nv May 20, 2022
c922c6d
iwyu mappings file from neo
dagardner-nv May 20, 2022
39eecdd
Merge branch 'david-fix-ci' into david-ci-no-inplace
dagardner-nv May 20, 2022
3dbd059
Add a fetch_s3 helper method
dagardner-nv May 20, 2022
df86ac8
wip
dagardner-nv May 20, 2022
8389639
wip
dagardner-nv May 20, 2022
23177d7
Fix fetch function
dagardner-nv May 20, 2022
d04e142
Fix restore function
dagardner-nv May 20, 2022
3cb19de
Merge branch 'branch-22.06' into david-ci
dagardner-nv May 23, 2022
8d09585
Remove old comment block
dagardner-nv May 23, 2022
d56b432
Remove old comment block
dagardner-nv May 23, 2022
80b6a0b
Use local instead of file url
dagardner-nv May 23, 2022
6bd4c92
Use local instead of file url
dagardner-nv May 23, 2022
469d84f
Redirect sccache --zero-stats to dev/null
dagardner-nv May 23, 2022
50a2b4b
Redirect sccache --zero-stats to dev/null
dagardner-nv May 23, 2022
1a93052
Rename CONDA_BLD_DIR to CUDF_CONDA_BLD_DIR to eliminate confusion wit…
dagardner-nv May 23, 2022
46d7b80
Rename CONDA_BLD_DIR to CUDF_CONDA_BLD_DIR to eliminate confusion wit…
dagardner-nv May 23, 2022
2fd9993
Use MORPHEUS_USE_CCACHE=ON and set sccache via CCACHE_PROGRAM_PATH
dagardner-nv May 23, 2022
a26ddad
Specify CCACHE_PROGRAM_PATH when we want sscache rather than disablin…
dagardner-nv May 23, 2022
dfdeacc
Merge branch 'branch-22.06' into david-cli-rel-paths
dagardner-nv May 23, 2022
5a50475
Only install the wheel component
dagardner-nv May 23, 2022
f59dcac
Fixing non-inplace builds install of stub files
mdemoret-nv May 23, 2022
7801803
Move data into previous install command
dagardner-nv May 23, 2022
f398f78
Merge branch 'david-cli-rel-paths' of github.com:dagardner-nv/Morpheu…
dagardner-nv May 23, 2022
798953a
Remove lfs filter for old data location
dagardner-nv May 23, 2022
a94dd62
Merge branch 'branch-22.06' into david-cli-rel-paths
dagardner-nv May 24, 2022
e9191b3
Merge branch 'david-cli-rel-paths' into david-ci-no-inplace
dagardner-nv May 24, 2022
346780a
Merge branch 'david-ci' into david-ci-no-inplace
dagardner-nv May 24, 2022
d7b730b
Merge branch 'david-sccache' into david-ci-no-inplace
dagardner-nv May 24, 2022
6c52e07
Building python stub files requires a gpu
dagardner-nv May 24, 2022
e626ed9
Merge branch 'branch-22.06' into david-ci-no-inplace
dagardner-nv Jun 2, 2022
97e8f50
Update CMakeLists.txt
dagardner-nv Jun 3, 2022
4cba48b
Remove usage of -I
dagardner-nv Jun 3, 2022
df2ee32
Remove older [DEBUG] from print strings, add main method and get_merg…
dagardner-nv Jun 3, 2022
4a34538
Fix args
dagardner-nv Jun 3, 2022
a79196e
Merge get_merge_target script directly into gitutils.py
dagardner-nv Jun 3, 2022
c893e3d
flake8 reqs
dagardner-nv Jun 3, 2022
a198d0e
Pin to older neo
dagardner-nv Jun 3, 2022
f1dd182
Revert "Pin to older neo"
dagardner-nv Jun 6, 2022
40225cc
Manually ensure that the build is clean
dagardner-nv Jun 6, 2022
2654fd5
Re-source the conda env
dagardner-nv Jun 6, 2022
2379200
Merge branch 'branch-22.06' into david-ci-no-inplace
dagardner-nv Jun 8, 2022
a1efb87
Fix CPP_FILE_REGEX
dagardner-nv Jun 8, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
WIP
  • Loading branch information
dagardner-nv committed May 9, 2022
commit a424bcba30b5be3b1b1ff39d366ffd7a03baefe1
2 changes: 1 addition & 1 deletion ci/scripts/jenkins_build.sh
Original file line number Diff line number Diff line change
Expand Up @@ -99,7 +99,7 @@ mamba env update -q -n morpheus -f ./docker/conda/environments/cuda${CUDA_VER}_d
if [[ "${CONDA_PKG_CACHE_CHECK}" != "0" ]]; then
gpuci_logger "Archiving cached conda packages"
cd $(dirname ${CONDA_PKG_DIR})
tar cvf ${CONDA_PKG_TAR} $(basename ${CONDA_PKG_DIR})/*.tar.bz2
tar cf ${CONDA_PKG_TAR} $(basename ${CONDA_PKG_DIR})/*.tar.bz2
cd -
aws s3 cp --no-progress ${CONDA_PKG_TAR} ${CONDA_PKG_CACHE_URL}
fi
Expand Down