Skip to main content

Playground · Learn

Learn

A shelf of talks and tutorials we come back to — on AI, machine learning and building software well. Filter by topic, or follow a learning pathway tailored to your role.

Topic
Pathway

AI Foundations

AI vs Machine Learning

IBM Technology · 5:49

A quick, clear map of how AI, machine learning and deep learning actually relate.

But what is a neural network?

3Blue1Brown · 18:40

The clearest visual introduction to what a neural network actually is.

Gradient descent — how neural networks learn

3Blue1Brown · 20:33

The intuition behind how neural networks learn from data.

Backpropagation, intuitively

3Blue1Brown · 12:47

What backpropagation is really doing when a network learns.

How AI Image Generators Work (Stable Diffusion / DALL·E)

Computerphile · 17:50

How diffusion models turn random noise into images.

The Strange Math That Predicts (Almost) Anything

Veritasium · 32:32

Markov chains — the deceptively simple math behind language models, PageRank and much of modern ML.

LLMs & Transformers

How Large Language Models Work

IBM Technology · 5:33

A short, accessible explainer on what LLMs are and how they generate text.

Word Embedding and Word2Vec

StatQuest · 16:11

How words become vectors — the foundation of how language models represent meaning.

Transformer Neural Networks, ChatGPT's foundation

StatQuest · 36:15

A clear, step-by-step walk through the transformer architecture behind ChatGPT.

Transformers, the tech behind LLMs

3Blue1Brown · 27:14

A visual walkthrough of the transformer architecture behind modern AI.

Attention in transformers, step-by-step

3Blue1Brown · 26:09

The attention mechanism — the key idea that makes transformers work — explained visually.

How might LLMs store facts

3Blue1Brown · 22:42

A visual look at where factual knowledge actually lives inside a transformer's weights.

Intro to Large Language Models

Andrej Karpathy · 59:48

A one-hour, non-hype primer on how LLMs work and where they're going.

Let's build GPT: from scratch, in code

Andrej Karpathy · 1:56:20

Build a transformer language model line by line, in code.

Building & Using AI

What is Retrieval-Augmented Generation (RAG)?

IBM Technology · 6:35

How RAG grounds LLMs in your own data — the backbone of most enterprise AI.

How I use LLMs

Andrej Karpathy · 2:11:12

Practical, real-world patterns for getting the most out of LLM tools.

Let's build the GPT Tokenizer

Andrej Karpathy · 2:13:34

Build the tokenizer behind GPT from scratch — the crucial, often-overlooked first step in every LLM.

Deep Dive into LLMs like ChatGPT

Andrej Karpathy · 3:31:23

A thorough tour of how modern chat LLMs are actually built and trained.

Stanford CS229 · Building Large Language Models

Stanford Online · 1:44:31

A full Stanford lecture on how modern LLMs are built — pretraining, data and post-training.