Build a GPT from scratch, line by line, in plain PyTorch. The single best way to make the abstractions stop being magic. Completely free.
- From backprop to a working transformer
- Code-along, no hand-waving
- Free on YouTube and karpathy.ai
- Strong programming assumed; maths helps