Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.
-
Updated
Sep 8, 2024 - Cuda
#
tensor-core
Here are 7 public repositories matching this topic...
Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
gpu
cuda
inference
nvidia
cutlass
mha
multi-head-attention
llm
tensor-core
large-language-model
flash-attention
flash-attention-2
-
Updated
Sep 7, 2024 - C++
Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.
gpu
cuda
cublas
nvidia
gemm
matrix-multiply
tensor-core
hgemm
back2back-hgemm
fused-hgemm
back2back-gemm
fused-gemm
-
Updated
Nov 3, 2023 - Cuda
Multiple GEMM operators are constructed with cutlass to support LLM inference.
-
Updated
Sep 27, 2024 - C++
Codes for DTC-SpMM (ASPLOS'24)
-
Updated
Jun 2, 2024 - C++
The lab assignments from CS4302 Parallel and Distributed Programming (2022 Fall) with my solutions
-
Updated
Jan 5, 2023 - C++
Improve this page
Add a description, image, and links to the tensor-core topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the tensor-core topic, visit your repo's landing page and select "manage topics."