feature plan

[nihui]

• block quantization [WIP] gemm block quantization for llm decoder style #6439
• vulkan int8 vulkan int8 kernels #6751
• batch infrastructure batch infrastructure #6656
• cpu flash attention and persistent kv-cache
• arm sve infrastructure
• vulkan-glsl to webgpu infrastructure introduce WebGPU via Emdawnwebgpu #6631

[futz12]

batch infra is important sooooooo much, not just for input-wise infer, but also important for inline batch operate such as multichannel signal process and multiview photo process.