Tracks

Eleven tracks take you from no background to how large language models work inside. Follow the route in order, or start wherever matches what you already know.

95 lessons, about 31 hr 3 min in all. Not sure where to start? Or see every lesson and concept on the curriculum atlas.

  1. Novice13 lessons, 3 hr 21 min

    AI from zero

    What AI is, how it learns from examples, and how a chatbot picks its next word.

    Start with What is AI, really?

  2. Beginner11 lessons, 3 hr 8 min

    How machines learn

    Loss, gradients, and generalization: the loop behind every trained model.

    Start with The learning loop

  3. Intermediate7 lessons, 2 hr

    Neural networks

    Neurons, layers, and backpropagation, built up one piece at a time.

    Builds on How machines learn

    Start with Layers are matrix multiplications

    Intermediate8 lessons, 2 hr 15 min

    Language as vectors

    Tokens, embeddings, and similarity: how text becomes geometry.

    Builds on How machines learn

    Start with Tokens

  4. Advanced13 lessons, 4 hr 2 min

    Transformers and LLMs

    Attention, the transformer block, and how large language models are trained.

    Builds on Neural networks and Language as vectors

    Start with Predicting the next token

    Intermediate5 lessons, 2 hr

    Learning by trial and error

    Rewards, exploration, and how agents learn to act, from bandits to RLHF.

    Builds on How machines learn and Neural networks

    Start with Explore or exploit: bandits

  5. Advanced6 lessons, 2 hr 45 min

    Inside the model

    Look inside a real language model, watch circuits form, and steer what it says.

    Builds on Transformers and LLMs

    Start with Reading a model layer by layer

    Advanced9 lessons, 2 hr 28 min

    Models that see

    How models turn pixels into labels, boxes, masks, depth, matches with words, and answers to questions.

    Builds on Transformers and LLMs

    Start with How computers see

    an intermediate lesson that needs only Convolutions (Neural networks) and Attention, step by step (Transformers and LLMs).

    Advanced5 lessons, 1 hr 28 min

    Models that hear and speak

    How models turn sound waves into spectrograms, labels, and text, and text back into speech.

    Builds on Transformers and LLMs

    Start with How computers hear

    an intermediate lesson that needs only Turning things into numbers (AI from zero).

    Advanced12 lessons, 5 hr 5 min

    Frontiers

    Diffusion, multimodal models, mixture of experts, agents, reasoning, and evaluation.

    Builds on Transformers and LLMs

    Start with Diffusion: from noise to data

  6. Advanced6 lessons, 2 hr 31 min

    Securing AI

    How AI systems are attacked, what defenses catch, and what they miss.

    Builds on Frontiers

    Start with Attacks on AI systems

Try "embedding", "softmax", "overfitting", or "backpropagation".