Reiner Pope on Dwarkesh Podcast — Practice Questions
The discussion breaks down the main systems and economics behind large-model training and inference. First, it explains why token latency is the maximum of compute time and memory time. Compute scales...
Ilya · Chinchilla · GPU · HBM