GPU, CUDA, and the Ecosystem A Progressive Learning Path
Tier 1: GPU Architecture (deep understanding) Stanford CS149 Lecture 7 — Kayvon Fatahalian The best lecture on SIMT execution model, warp scheduling, memory hierarchy, and occupancy. Start here. Videos on YouTube. URL: https://cs149.stanford.edu “Programming Massively Parallel Processors” — Kirk, Hwu, El Hajj (4th ed.) The canonical textbook. Chapters 1-4 = architecture fundamentals. 4th edition covers tensor cores and Hopper. URL: https://www.sciencedirect.com/book/9780124159921/programming-massively-parallel-processors Brendan Lynskey — NVIDIA GPU Architectures Series Deep dives on warp scheduling internals, SIMT vs SIMD nuance, memory latency per architecture, TMA on Hopper. Diagrams + assembly snippets. ...