Add STA to V1#312

Merged

SolitaryThinker merged 16 commits intomainfrom

Apr 15, 2025

Commits on Apr 15, 2025

update bug

jzhang38
authored and
SolitaryThinker
committed
add flash attn 3

jzhang38
authored and
SolitaryThinker
committed
remove triton attn flag

jzhang38
authored and
SolitaryThinker
committed
update

jzhang38
authored and
SolitaryThinker
committed
done

jzhang38
authored and
SolitaryThinker
committed
update

jzhang38
authored and
SolitaryThinker
committed
udate

jzhang38
authored and
SolitaryThinker
committed
update

jzhang38
authored and
SolitaryThinker
committed
lint
SolitaryThinker
committed
lint
SolitaryThinker
committed
fix
SolitaryThinker
committed
fix
SolitaryThinker
committed
fix
SolitaryThinker
committed
increase port retry to 50
SolitaryThinker
committed
more fix
SolitaryThinker
committed
fix st_attn import
SolitaryThinker
committed