LLM from Scratch
Architecture
SFT & RLFT
Benchmarks
Docs
中文
GitHub
Measured Behavior
Benchmarks
Training curves and implementation notes that ground the project in measurable behavior.
Flash Attention 2
Triton kernel path included
Loss Curve
TinyStories training convergence
LR Schedule
Cosine warmup and decay