AI Architecture & Systems

AI Runtime and Operating System Fundamentals

5.1.1Processes, Threads, Coroutines, and the Python GIL#

5.1.2CPU Affinity, NUMA, and Host Memory#

5.1.3GPU Context, Stream, Event, and CUDA Graph#

5.1.4IPC, Shared Memory, RPC, and Serialization#

5.1.5Memory Allocators, Memory Pools, and Fragmentation#

5.1.6Driver, Runtime, Library, and Container Dependencies#