[BUG] Compile source code error for ROCM platform when using #include <hip/hip_bf16.h>

[lhcalibur]

As mentioned in ##2646

Building for ROCM platform will cause multiple definition error,

This is caused by The function in <hip/hip_bf16.h> being defined without static inline , which will cause multi definition error when using this header file in multi .cu/.hip files.

#ROCm/hip#3403

The error will be fixed in future releases of ROCM, but till ROCM-6.0.2, this has not been fixed yet, maybe we need to find a way to bypass this.

Maybe using hip_bfloat16 instead of __hip_bfloat16? #ROCm/ROCm#2534, but needs some code modification.

[jamestwhedbee]

Running into this as well

[hongxiayang]

I am working on a fix for this issue now. Will update when I have a pull request

[hongxiayang]

Fix for vllm ROCm 6.0 build is here: #2790