Packages and status
| Name | Source | Status | Docs |
|---|---|---|---|
| ROCm | ROCm, rocBLAS | OK | ROCm |
| llama.cpp | llama.cpp | OK | llama.cpp |
| ComfyUI | ComfyUI | OK | ComfyUI |
| VLLM | VLLM, triton | OK | VLLM |
All software tested on Lenovo RD450X with 256G mem and 2x MI50 32G. For cooling gpus used AMD Instinct MI50 blower fan adapter (thingiverse).
cd /opt/rocm-6.4.1/bin
apt update
apt install -y rocm-validation-suite
echo 'actions:
- name: gst-581Tflops-4K4K8K-rand-bf16
device: all
module: gst
log_interval: 3000
ramp_interval: 5000
duration: 15000
hot_calls: 1000
copy_matrix: false
target_stress: 581000
matrix_size_a: 4864
matrix_size_b: 4096
matrix_size_c: 8192
matrix_init: rand
data_type: bf16_r
lda: 8320
ldb: 8320
ldc: 4992
ldd: 4992
transa: 1
transb: 0
alpha: 1
beta: 0' > ~/gst-581Tflops-4K4K8K-rand-bf16.conf
./rvs -c ~/gst-581Tflops-4K4K8K-rand-bf16.conf