Skip to content

vocab : fix Gemma 4 BPE tokenizer SIGSEGV on long prompts without newlines#21587

Open
prue-starfield wants to merge 1 commit into
ggml-org:masterfrom
prue-starfield:fix/gemma4-tokenizer-long-prompt
Open

vocab : fix Gemma 4 BPE tokenizer SIGSEGV on long prompts without newlines#21587
prue-starfield wants to merge 1 commit into
ggml-org:masterfrom
prue-starfield:fix/gemma4-tokenizer-long-prompt

Commits

Commits on Apr 7, 2026