End‑to‑End 4‑Bit Training
Thinking Machines Lab trained Inkling 2 Small end to end with 4-bit NVFP4 forward passes, achieving an 8% pretraining speedup and 20% RL speedup over MXFP8 training. This matters because it shows larg...
Mishra et al. · Kaplan et al. · OCP