AI Architecture & Systems
1
Microarchitecture
2
Kernel
3
Compiler
4
Architecture
5
System
6
Algorithms
System
/
§5.15
Elasticity and Fault Tolerance in Large-Scale Training
5.15.1
Failure Domains, Heartbeats, and Health Checks
#
5.15.2
Checkpoint/Restart and Fast Recovery
#
5.15.3
Elastic Training and Dynamic World Size
#
5.15.4
Straggler Detection and Slow-Node Replacement
#
5.15.5
Network Failures, Storage Failures, and Silent Data Corruption
#
5.15.6
Training Efficiency, Failure Cost, and Available Capacity
#
← Previous
5.14 Training Runtime and Numerical Stability
→ Next
5.16 Distributed Training Frameworks and Accelerator Backends