Offline AI

[LeanBitLab]

Model Name

Visheratin T5 Tiny

Device Specs (RAM/CPU)

4GB Ram sd720g Cpu

Feedback / Issue

Welcome to Offline AI discussion!

[ALMIGHTY-VC]

I tried the Xenova grammar small quantized based on T5, Pszemraj's grammar small quantized and yeah both don't work as intended.So they are out of consideration for now I think.

[LeanBitLab]

Only Visheratin T5 Tiny worked for me too

[ALMIGHTY-VC]

In this month my exam AR going on so,consider me mostly offline.Still,here are some of my interesting finds:- 1)Prithivida gramformer(quantized if available I'm unable to find it in this haste) 2)Falcon H1 Tiny 90M instruct 3)HRM Grammar Light V2(2026 edition) Also another question have you tried the qwen offline models? How about implementing a single model.onnx it will be better for the memory and processes.

…

On Sat, 31 Jan, 2026, 11:38 pm LeanBitLab, ***@***.***> wrote: Only Visheratin T5 Tiny worked for me too — Reply to this email directly, view it on GitHub <#16 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A2YYNFFD6G4QCBEGKJNPX334JTVRZAVCNFSM6AAAAACTQYXALCVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTKNRVHE4DEMY> . You are receiving this because you commented.Message ID: ***@***.***>

[LeanBitLab]

I find only Qwen gguf models, when I tried the gguf engine with the Qwen model, only models of 600mb or above were barely usable since the gguf engine wasn't that customisable, I didn't find any ONNX models for Qwen