Build software better, together

modelscope / ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

Updated Sep 10, 2026
Python

dataelement / bisheng

Star

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Updated Sep 11, 2026
Python

adongwanai / AgentGuide

Star

tutorial interview multi-agent job-hunting rag sft ai-agent llm langchain crewai graphrag grpo agenticrag

Updated Sep 8, 2026
MDX

oumi-ai / oumi

Star

Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!

evaluation inference llama fine-tuning sft dpo slms llms vlms open-weight gpt-oss gpt-oss-120b gpt-oss-20b open-weights open-weight-models

Updated Sep 12, 2026
Python

MakazhanAlpamys / Soup

Star

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Updated Sep 12, 2026
Python

walkinglabs / hands-on-modern-rl

Star

🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

agent tutorial reinforcement-learning pytorch rl reinforcement ppo sft dpo llm rlhf agentic agentic-ai grpo llm-alignment agentic-rl

Updated Sep 3, 2026
Python

AI-Hypercomputer / maxtext

Star

A simple, performant, and scalable Jax LLM!

gpt mistral fine-tuning jax sft large-language-models llm llama2 mixtral deepseek llama3 gemma2 gemma3 llama4

Updated Sep 12, 2026
Python

ssbuild / chatglm_finetuning

Star

chatglm 6b finetuning and alpaca finetuning

deep-learning pytorch freeze lora sft chatglm p-tuning-v2 adalora qlora ia3

Updated Mar 9, 2025
Python

datawhalechina / diy-llm

Star

Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐，6 项渐进代码作业，掌握 LLM 全栈知识

nlp transformer rl gpu-programming sft datawhale llm grpo

Updated Sep 10, 2026
Jupyter Notebook

InternScience / GraphGen

Star

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

qa knowledge-graph data-generation question-answering data-synthesis sft pretrain pretraining graphgen ai4science llm llm-training qwen xtuner llama-factory sft-data

Updated Aug 17, 2026
Python

invergent-ai / surogate

Star

Train and serve LLMs at extreme speed and massive throughput.

deep-learning cuda llama nvidia-gpu fine-tuning sft llm llms generative-ai qwen

Updated Sep 12, 2026
C++

ScienceOne-AI / DeepSeek-671B-SFT-Guide

Star

An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to inference, as well as some practical experiences and conclusions. (DeepSeek-V3/R1 满血版 671B 全参数微调的开源解决方案，包含从训练到推理的完整代码和脚本，以及实践中积累一些经验和结论。)

python moe sft llm deepseek-r1