Numerical Representation, Arithmetic Circuits, and Precision Contracts

SourcesSurvey §5.1, Fig. 10; foundational circuit topics retained from the original outline.

1.2.1Standard Floating-Point Formats: FP64, FP32, and FP16#

1.2.2AI-Oriented Formats: BF16, TF32, and FP8#

1.2.3Integer Arithmetic and Quantized Data Types: INT8/INT4#

1.2.4Block Scaling: MXFP8/MXFP6/MXFP4 and NVFP4#

1.2.5Multipliers, Adders, FMA, and Accumulators#

1.2.6Separate Precision Conventions for Input, Multiply, Accumulate, and Output#

1.2.7Rounding, Overflow, Underflow, Scale Overhead, and Numerical Error#

1.2.8Low-Precision Arithmetic, Structured Sparsity, and Effective Data Bandwidth#