September 29 to December 1, 2026 · Winners announced at NeurIPS 2026 in Sydney
Protocol NanoGPT
A speedrun for pipeline parallel LLM training over WAN links. Train a 203M-parameter model to a validation loss of 3.276 on FineWeb in the shortest wall-clock time, with every link between stages held to 200 Mb/s and 50 ms.
$18,000 in prizes · 18 entries · record ≈ 1h 39m on 2026-11-16
