I'm a developer and I want to fine-tune small LLMs for my own use case

Basic — Understand the Architecture

Build a Next-Word Predictor from Scratchbeginner

Build a predictive-text engine from scratch — the next-word suggestions behind a phone keyboard

8 sections · Google, Apple, Microsoft

Build GPT from Scratchadvanced

Build a decoder-only GPT language model from scratch in PyTorch and generate text with it

10 sections · OpenAI, Google DeepMind, Anthropic

Advanced — Fine-Tune for a Domain

Build LoRA from Scratchadvanced

Build a LoRA adapter from scratch — freeze a pretrained weight and learn a low-rank update in its place

9 sections · Hugging Face, Microsoft, Databricks

Fine-Tune GPT-2 to Tag Legal Contract Clausesintermediate

Fine-tune GPT-2 on real legal contract clauses so it tags a clause with its type

9 sections · Harvey, Casetext, LexisNexis