SoC
π Short definition
A single chip that contains nearly a whole computer: processor (CPU), graphics chip (GPU), often an AI accelerator (NPU) and the memory controller.
π Detailed definition
In a conventional PC, the processor and the graphics card are two separate components, each with its own memory, connected by the PCIe bus. A SoC (System on a Chip) brings these blocks together in a single package. Apple describes it this way for its first M1 chip: βAs a system on a chip (SoC), M1 combines numerous powerful technologies into a single chipβ, with a unified memory architecture1.
Examples in local AI:
- Apple M5 Max / M5 Ultra (Mac Studio): CPU and GPU on the same chip, sharing up to 128 GB (M5 Max) or 512 GB (M5 Ultra) of unified memory2.
- AMD Ryzen AI Max PRO 400: Zen 5 CPU and Radeon 8065S GPU on the same chip, with up to 192 GB of shared memory; it is called an APU3.
- NVIDIA GB10 (DGX Spark), which NVIDIA calls a Superchip: 20-core ARM CPU and Blackwell GPU with 128 GB of LPDDR5x unified memory4.
π‘ Why it matters for on-premise AI
Because the CPU and GPU share the same memory, a SoC can give the GPU 128 GB or more, whereas a consumer graphics card remains limited to its own VRAM. This is what makes it possible to run large models on a desktop workstation.
β οΈ Common pitfalls
- Confusing SoC and APU: an APU is a SoC (or a package) that combines CPU and GPU; the term is mostly used by AMD.
- Assuming a SoCβs memory can be expanded after purchase: it is generally soldered (LPDDR5X).
π To go deeper
- π§ APU & Unified Memory (Apple, AMD, NVIDIA comparison)
- βοΈ Unified Memory vs RAM vs VRAM
π See also
Footnotes
-
Apple Newsroom, Apple unleashes M1 (βAs a system on a chip (SoC), M1 combines numerous powerful technologies into a single chipβ, unified memory architecture), November 10, 2020. https://www.apple.com/newsroom/2020/11/apple-unleashes-m1/ β©
-
Apple Newsroom, Apple introduces new Mac Studio with M5 Max and M5 Ultra (CPU up to 36 cores, GPU up to 80 cores, up to 512 GB of unified memory), August 25, 2026. https://www.apple.com/newsroom/2026/08/apple-introduces-new-mac-studio-with-m5-max-and-m5-ultra/ β©
-
AMD, AMD Ryzen AI Max+ PRO 495 β product sheet (16 Zen 5 cores, Radeon 8065S, 192 GB LPDDR5X-8533, 256-bit bus), accessed 2026-10-09. https://www.amd.com/en/products/processors/laptop/ryzen-pro/ai-max-pro-400-series/amd-ryzen-ai-max-plus-pro-495.html β©
-
NVIDIA, DGX Spark β official product page (GB10 Grace Blackwell Superchip, 20-core ARM CPU, 128 GB LPDDR5x unified memory), accessed 2026-10-11. https://www.nvidia.com/en-us/products/workstations/dgx-spark/ β©