Third attempt reached 30.05 seconds on RunPod node
A community speedrun achieved a new record by training a GPT-2 scale model from scratch in 29.90 seconds on a rented 8x H100 node, reducing the previous 45-minute duration.
#llm#nanogpt#h100#pretraining#speedrun#runpod



