Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Hardware][AMD] ROCm6.2 upgrade #8674

Merged
merged 11 commits into from
Sep 24, 2024
Merged

[Hardware][AMD] ROCm6.2 upgrade #8674

Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
8f61479
initial base image update
hongxiayang Sep 20, 2024
dd1cf6e
updated triton and fa branches
hongxiayang Sep 20, 2024
ae7a68b
btriton uild dependency ad tdisable fTRY_FA_WHEELas default
hongxiayang Sep 20, 2024
507c370
update the amd installation steps for ROCm 6.2
hongxiayang Sep 23, 2024
314d65e
Merge branch 'main' into rocm6_2_upgrade
hongxiayang Sep 23, 2024
7d899fe
clean up 6 steps related to.1 r
hongxiayang Sep 23, 2024
2fe2a0a
replace RC1 torch with nightly
hongxiayang Sep 23, 2024
846fd52
Merge branch 'main' into rocm6_2_upgrade
hongxiayang Sep 23, 2024
42f41d2
minor
hongxiayang Sep 23, 2024
ea35cef
nightly date change
hongxiayang Sep 23, 2024
f0b00b3
Update amd-installation.rst for supported python versions
hongxiayang Sep 24, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
btriton uild dependency ad tdisable fTRY_FA_WHEELas default
  • Loading branch information
@hongxiayang
hongxiayang committed Sep 20, 2024
commit ae7a68b252c27e81b5bb79f7a504fc58c7672fe9
3 changes: 2 additions & 1 deletion Dockerfile.rocm
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ ARG BUILD_FA="1"
# If this succeeds, we use the downloaded wheel and skip building flash-attention.
# Otherwise, ROCm flash-attention from `FA_BRANCH` will be built for the
# architectures specified in `FA_GFX_ARCHS`
ARG TRY_FA_WHEEL="1"
ARG TRY_FA_WHEEL="0"
ARG FA_WHEEL_URL="https://github.com/ROCm/flash-attention/releases/download/v2.5.9post1-cktile-vllm/flash_attn-2.5.9.post1-cp39-cp39-linux_x86_64.whl"
ARG FA_GFX_ARCHS="gfx90a;gfx942"
ARG FA_BRANCH="3cea2fb"
Expand Down Expand Up @@ -119,6 +119,7 @@ RUN --mount=type=cache,target=${CCACHE_DIR} \
if [ "$BUILD_TRITON" = "1" ]; then \
mkdir -p libs \
&& cd libs \
&& python3 -m pip install ninja cmake wheel pybind11 \
&& git clone https://github.com/OpenAI/triton.git \
&& cd triton \
&& git checkout "${TRITON_BRANCH}" \
Expand Down
Loading