Join Eridu at OCP Global Summit
October 12 - 15, 2026
San Jose Convention Center
We’re excited to be at OCP Global Summit this October! Contact us below if you’re interested in meeting the team at the event.
Session: Breaking up the Monolith - An Open Architecture for Multi-rack Scale-up Domain of 5000+ GPUs
Details
Date: October 14, 2026
Time: 8:00 am
Concourse Level - 220B
About the Session
As models pass trillion parameters and adopt mixture-of-experts and disaggregated prefill/decode, the binding constraint is no longer FLOPS, but how many accelerators talk at memory-semantic speed in a single hop. Most scale-up domains stop at 8 to 72 GPUs, forcing parallelism onto a slower scale-out network where every hop adds latency and tail variance. This session presents a flat, one-hop scale-up domain connecting 5k GPUs as a single fabric with every GPU reaching every other in one hop and shows why that shrinks collective-communication time, tightens token-generation tail latency, and lets a frontier model fit entirely inside a single domain. We detail a practical implementation: a GPU server bringing all scale-up I/O to the front panel, making a domain this size deployable through cabling and high radix switch, not a fixed backplane. We close on how open, OCP-aligned optics and standards can deliver this performance at scale.
