The AI Compilation Stack: Graphs, Operator Libraries, Kernels, and Device Execution

SourcesCorpus layer schema; TPU, Neuron and Groq provide contrasting stack boundaries.

3.1.1Framework → Graph IR → Tensor/Loop IR → Device Program#

3.1.2Graph Compiler, Kernel Compiler, Op Library, and Runtime#

3.1.3Eager, JIT, AOT, and Static Execution Plans#

3.1.4Responsibility Boundaries Across Compile Time, Load Time, Run Time, and Firmware#

3.1.5Standalone Software Layers, Compiler-Merged Layers, and Undisclosed Layers#

3.1.6Compatibility, Programmability, Portability, and Specialization#