A harness optimized to smaller LLMs
Active Learning for Text Classification in Python
Local LLM Powered Recursive Search & Smart Knowledge Explorer
Survey of Small Language Models from Penn State, ...
Doge Family of Small Language Models
[ICML 2026] effGen: Enabling Small Language Models as Capable Autonomous Agents
"Generative AI in Action" book's code repository
[𝗜𝗖𝗠𝗟 𝟮𝟬𝟮𝟲] Dispersion loss counteracts embedding condensation and improves generalization in small language models
Small Language Model Inference, Fine-Tuning and Observability.
Repository for the companion Colab notebook of the Domain-Specific Small Language Models book.
This Repository provides a Jupyter Notebook for building a small language model from scratch using 'TinyStories' dataset. Covers data preprocessing, BPE tokenization, binary storage, GPU memory management, and training a Transformer in PyTorch. Generate sample stories to test your model. Ideal for learning NLP and PyTorch.
Wonderful Matrices to Build Small Language Models
Remma-O1: An open-source Language Model with 1.17B Params, built on pytorch from scratch. Work in Progress!!! Open for collaboration.
xLM is a modular, research-friendly framework for developing and comparing non-autoregressive language models. Built on PyTorch and PyTorch Lightning, with Hydra for configuration management, XLM makes it effortless to experiment with cutting-edge NAR LM architectures.
A governed local AI build-and-memory system that trains small brains, compares them, protects the better one, archives the worse one, and preserves the evidence of why. v1.0.0/governed-v2.2.0+
A curated list of open-source Small Language Models (≤13B parameters) — weights, papers, tools, and techniques for running AI on consumer hardware.
A 1.5B model shown all 80 tools picks the right one half the time — not because it can't call tools, but because it can't find them. Tier adapts the tool presentation to model size: +10pp accuracy and 97% fewer tool tokens on sub-4B models.
Dataset Generation Code for SimpleStories
[EMNLP 2026 MAIN] This is the official repo of the project ''Micro Language Models Enable Instant Responses''
To associate your repository with the small-language-models topic, visit your repo's landing page and select "manage topics."