Graph-Level Optimization

3.5.1Constant Folding, CSE, and Dead Code Elimination#

3.5.2Operator Fusion, Operator Decomposition, and Pattern Rewriting#

3.5.3Algebraic Simplification and Operator Reordering#

3.5.4Attention, MLP, and Transformer-Specific Fusion#

3.5.5Numerical Equivalence and Optimization Legality#