AI Architecture & Systems

Elasticity and Fault Tolerance in Large-Scale Training

5.15.1Failure Domains, Heartbeats, and Health Checks#

5.15.2Checkpoint/Restart and Fast Recovery#

5.15.3Elastic Training and Dynamic World Size#

5.15.4Straggler Detection and Slow-Node Replacement#

5.15.5Network Failures, Storage Failures, and Silent Data Corruption#

5.15.6Training Efficiency, Failure Cost, and Available Capacity#