Context Reconstruction × Pattern Runtime
Small-model intelligence through structured context control
CRS-LM operates as a lightweight runtime-optimization and context-routing experiment inside the broader Mandale-OS Runtime Intelligence Ecosystem.
Instead of scaling models endlessly:
Control the context, not the parameters
Raw Context → CRS Engine → Smart Context → TinyLM
- ✂️ Removes irrelevant noise
- 📉 Compresses token space
- 🔄 Reconstructs missing structure
- 🧠 Preserves reasoning signal
Input Text ↓ Tokenizer ↓ CRS Filter Engine (SACR) ↓ Compressed Context ↓ TinyLM ↓ Prediction
| Mode | Tokens | Loss | Speed |
|---|---|---|---|
| Baseline | 81 | 0.1873 | 0.44s |
| CRS-LM | 76 | 0.1824 | 0.40s |
- ✅ ~6–40% token reduction (config dependent)
⚠️ Aggressive filtering reduces quality- ❌ Not production-ready
- ✔️ Strong research direction
| Traditional LLM | CRS-LM |
|---|---|
| Uses full context | Uses filtered context |
| Token-heavy | Token-efficient |
| No structure awareness | Structure-aware |
| Linear reasoning | Reconstructed reasoning |
- 🧠 CRS Engine → context filtering + compression
- ⚙️ SACR → structure-aware reduction logic
- 🤖 TinyLM → lightweight reasoning model
- 📊 Benchmark Layer → token vs loss tradeoff
mos-parameter-golf/ │ ├── crs-lm/ │ ├── banner.svg │ ├── architecture.svg │ ├── benchmark.svg │ ├── demo.svg │ ├── README.md │ ├── model/ │ ├── tokenizer/ │ ├── crs/ │ ├── train.py │ ├── infer.py │ └── eval.py │ ├── benchmarks/ ├── results/ └── README.md
git clone https://github.com/raajmandale/mos-parameter-golf
cd mos-parameter-golf/crs-lm
pip install -r requirements.txt
python train.py
python infer.py
python eval.py- 🔗 CRS + Deterministic Fragment Graph (DFG)
- 🧠 AI Memory Layer (XLifelineAI)
- ⚙️ M-OS runtime integration
- 🤖 Agent memory optimization
- 🧪 Research Prototype
⚠️ Experimental System- 🚀 High Potential Direction
Raaj Mandale
Systems Architect • Runtime Intelligence • Mandale-OS • QBAIX
Founder — Eranest Technoware Pvt Ltd
🌐 https://raajmandale.in
🔬 https://orcid.org/0009-0005-9810-1655
📚 https://openalex.org/A5127026877
💻 https://github.com/raajmandale
MIT License
If this work resonates:
- ⭐ Star the repo
- 🍴 Fork it
- 🚀 Share it
LLMs don’t need more tokens.
They need better context.