A 70-billion-parameter model at 16-bit precision takes about 140 gigabytes before it generates a single word, and that is just the weights. In an eight-minute video we break down where the rest of the memory goes, why accelerators use HBM and how demand for HBM shows up in the price of ordinary server DDR5.