Skip to content

Commit

Permalink
Fix release and dev container builds (#1027)
Browse files Browse the repository at this point in the history
Fixes a kafka-related version mismatch and the following error:
```
#0 391.3 -- [morpheus.cuda.rapids.cuda.init_architectures.rapids.cuda.architectures_policy] _RAPIDS_POLICY_REMOVED_IN: 23.06
#0 391.3 CMake Error at build-conda/_deps/rapids-cmake-src/rapids-cmake/cmake/detail/policy.cmake:57 (message):
#0 391.3   rapids-cmake policy [deprecated=23.02 removed=23.06]: Usage of `ALL` as
#0 391.3   value for `CMAKE_CUDA_ARCHITECTURES` or the env variable `CUDAARCHS` has
#0 391.3   been deprecated, use `RAPIDS` instead.
#0 391.3 Call Stack (most recent call first):
#0 391.3   build-conda/_deps/rapids-cmake-src/rapids-cmake/cuda/detail/architectures_policy.cmake:45 (rapids_cmake_policy)
#0 391.3   build-conda/_deps/rapids-cmake-src/rapids-cmake/cuda/init_architectures.cmake:84 (rapids_cuda_architectures_policy)
#0 391.3   external/utilities/cmake/morpheus_utils/environment_config/rapids_cmake/register_api.cmake:28 (rapids_cuda_init_architectures)
#0 391.3   CMakeLists.txt:95 (morpheus_utils_initialize_cuda_arch)
#0 391.3
#0 391.3
#0 391.3 -- Configuring incomplete, errors occurred!
```

Authors:
  - Christopher Harris (https://github.com/cwharris)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #1027
  • Loading branch information
cwharris authored Jul 10, 2023
1 parent b279187 commit 1d1b330
Show file tree
Hide file tree
Showing 4 changed files with 6 additions and 5 deletions.
3 changes: 2 additions & 1 deletion ci/conda/recipes/morpheus/meta.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,7 @@ outputs:
- cudf {{ rapids_version }}
- cython >=0.29,<0.30
- libcudf {{ rapids_version }}
- librdkafka 1.7
- librdkafka 1.9.2
- mrc {{ minor_version }}
- pip
- pyarrow * *_cuda # Ensure we get a CUDA build. Version determined by cuDF
Expand Down Expand Up @@ -92,6 +92,7 @@ outputs:
- pluggy 1.0.*
- pyarrow * *_cuda # Ensure we get a CUDA build. Version determined by cuDF
- python
- python-confluent-kafka 1.9.2
- pytorch 2.0.1
- pytorch-cuda
- scikit-learn 1.2.2.*
Expand Down
2 changes: 1 addition & 1 deletion ci/conda/recipes/morpheus/morpheus_build.sh
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ CMAKE_ARGS="-DMORPHEUS_PYTHON_BUILD_STUBS=${MORPHEUS_PYTHON_BUILD_STUBS=-"ON"} $
CMAKE_ARGS="-DMORPHEUS_PYTHON_INPLACE_BUILD=ON ${CMAKE_ARGS}"
CMAKE_ARGS="-DMORPHEUS_PYTHON_BUILD_WHEEL=ON ${CMAKE_ARGS}"
CMAKE_ARGS="-DCMAKE_BUILD_RPATH_USE_ORIGIN=ON ${CMAKE_ARGS}"
CMAKE_ARGS="-DCMAKE_CUDA_ARCHITECTURES=${CMAKE_CUDA_ARCHITECTURES=-"all"} ${CMAKE_ARGS}"
CMAKE_ARGS="-DCMAKE_CUDA_ARCHITECTURES=${CMAKE_CUDA_ARCHITECTURES=-"RAPIDS"} ${CMAKE_ARGS}"
CMAKE_ARGS="-DPython_EXECUTABLE=${PYTHON} ${CMAKE_ARGS}"
CMAKE_ARGS="-DPYTHON_EXECUTABLE=${PYTHON} ${CMAKE_ARGS}" # for pybind11

Expand Down
2 changes: 1 addition & 1 deletion ci/conda/recipes/run_conda_build.sh
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ export CONDA_COMMAND=${CONDA_COMMAND:-"mambabuild"}
export MORPHEUS_ROOT=${MORPHEUS_ROOT:-$(git rev-parse --show-toplevel)}

# Export script_env variables that must be set for conda build
export CMAKE_CUDA_ARCHITECTURES=${CMAKE_CUDA_ARCHITECTURES:-"ALL"}
export CMAKE_CUDA_ARCHITECTURES=${CMAKE_CUDA_ARCHITECTURES:-"RAPIDS"}
export MORPHEUS_PYTHON_BUILD_STUBS=${MORPHEUS_PYTHON_BUILD_STUBS:-"ON"}
export MORPHEUS_CACHE_DIR=${MORPHEUS_CACHE_DIR:-"${MORPHEUS_ROOT}/.cache"}
export PARALLEL_LEVEL=${PARALLEL_LEVEL:-$(nproc)}
Expand Down
4 changes: 2 additions & 2 deletions docker/conda/environments/cuda11.8_dev.yml
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@ dependencies:
- gxx_linux-64=11.2
- include-what-you-use=0.18
- isort
- librdkafka=1.7.0
- librdkafka=1.9.2
- mlflow>=2.2.1,<3
- mrc=23.07
- myst-parser==1.0.0
Expand All @@ -80,7 +80,7 @@ dependencies:
- pytest
- pytest-benchmark>=4.0
- pytest-cov
- python-confluent-kafka=1.7.0
- python-confluent-kafka=1.9.2
- python-graphviz
- python=3.10
- pytorch=2.0.1
Expand Down

0 comments on commit 1d1b330

Please sign in to comment.