AI Architecture & Systems

Rack-Scale Scale-Up Interconnect

SourcesSurvey §4.2 and Fig. 7; case names retain the source platform and generation.

4.17.1NVL72 and Rack-Scale Switched Fabric#

4.17.2Cross-Server Organization of the Trainium UltraServer#

4.17.32D/3D Torus, Nearest-Neighbor, and Wraparound#

4.17.4Dragonfly Local Groups and Global Links#

4.17.5Switch Chips, Bounded Degree, Diameter, and Cabling Cost#

4.17.6Compute Tray/Switch Tray and Interconnect Distance#