perf(core): compute shared prompt prefixes once per decode batch - #1004

perf(core): compute shared prompt prefixes once per decode batch#1004

inureyes merged 4 commits into

mainlablup/mlxcel:mainfrom

feature/issue-903-cascade-attentionlablup/mlxcel:feature/issue-903-cascade-attentionCopy head branch name to clipboard