Model Request: Gemma 3n - by Alphabet/Google

[cougarten]

General Info: https://deepmind.google/models/gemma/gemma-3n/

Notable:

• might be best in weight class right now
• what they call "mix-and-match": you can downsize "model effort" on the fly without loading anything else in to memory
• different architecture to gemma3 (no clue if that's relevant to llama.cpp)
• can do vision

Weights:

• https://huggingface.co/collections/google/gemma-3n-preview-682ca41097a31e5ac804d57b

Terms:

• same as for any gemma https://ai.google.dev/gemma/terms

Ollama model request issue (>100 thumbs up):

• Gemma 3n ollama/ollama#10792

Can be tested on android phones with this apk (download in-app or hit [+] to add .task file):

• https://github.com/google-ai-edge/gallery/releases/tag/1.0.0