Skip to content

⚔️ Unified Memory vs RAM vs VRAM

For an AI systems architect, understanding the physical difference between conventional RAM, dedicated VRAM, and unified memory is fundamental. This choice directly affects inference throughput (tokens/s), hardware costs, and scalability limits1.

Here is the physical analysis, data-routing diagrams, and decision guide for your enterprise audits.


🗺️ Data-flow diagram: classic PC vs unified architecture

The physical bottleneck of AI is not storage capacity, but the path data must travel to reach the compute cores (CPU/GPU).

graph TD
    subgraph "Classic PC (Multi-GPU / CPU)"
        CPU_PC[Intel/AMD CPU] -->|DDR5 Bus: 100 GB/s| RAM_PC[System RAM]
        CPU_PC -->|PCIe 5.0 Bus: 64 GB/s| GPU_PC[Nvidia/AMD GPU]
        GPU_PC -->|GDDR7 Bus: 1,792 GB/s| VRAM_PC[Dedicated VRAM]
    end
graph TD
    subgraph "Unified Memory (Apple / AMD)"
        SOC[Unified SoC] -->|Direct Bus: 273 to 1,200 GB/s| UMEM[Unified LPDDR5X Memory]
        SOC_CPU[CPU Cores] --> SOC
        SOC_GPU[GPU / NPU Cores] --> SOC
    end

1. Dedicated VRAM (The Nvidia standard)

VRAM (Video RAM) sits as close as possible to the GPU. In 2026, consumer cards mainly use GDDR7 (e.g. RTX 5090), while datacenter accelerators use HBM.

  • Physical routing: The GPU accesses VRAM over a very wide memory bus (up to 512-bit). The physical distance between the compute die and the memory die is measured in millimeters.
  • Why it is fast: the RTX 5090 reaches ~1.79 TB/s (1,792 GB/s), which radically changes decoding throughput23.
  • The physical limit (the cost of capacity): VRAM chips are extremely expensive to manufacture. Consumer cards cap out at 24 GB or 32 GB. To get 128 GB of VRAM, you must buy four physical graphics cards, which creates massive thermal and electrical challenges.

2. Unified memory (The Apple Silicon & AMD APU approach)

Popularized by Apple and reinforced on x86 by AMD Ryzen AI Max PRO 400, unified memory removes the classic RAM/VRAM split.

  • Physical routing: The central processor (CPU), graphics unit (GPU), and AI accelerator (NPU) are integrated on the same silicon die (SoC). Memory modules (LPDDR5X-8000/8533) are soldered right next to it, on the same package.
  • Eliminating the copy: On a classic PC, for the GPU to process data stored in RAM, the CPU must copy the data, send it over the PCIe bus (limited to 64 GB/s), then write it back into VRAM. With unified memory, this copy step is eliminated. The GPU reads directly from shared memory.
  • Bandwidth nuance (AMD vs Apple):
    • Apple Silicon: since 2026-08-25, the Mac Studio M5 Max reaches 614 GB/s (460 GB/s with the 32-core GPU) and the M5 Ultra 1.2 TB/s4.
    • AMD Ryzen AI Max PRO 400: roughly 273 GB/s with LPDDR5X-8533 and a 256-bit bus, with x86 compatibility (Windows/Linux)5.
  • The AMD breakthrough (2026): the PRO 400 platform scales to 192 GB of shared memory, with up to 160 GB allocatable to the GPU depending on OEM configuration5.
  • The physical limit: Because memory is soldered onto the SoC to guarantee this throughput, it is strictly impossible to add RAM after purchase. You must size the machine for the next five years on day one.

3. Classic system RAM (DDR5)

Standard working memory on a conventional PC, installed in motherboard slots (DIMM).

  • Physical routing: Data must cross the motherboard to travel from RAM to the processor over a narrow memory bus (typically dual-channel on desktop PCs).
  • Why it is slower for LLM decoding: bandwidth is often on the order of 80 to 100 GB/s on dual-channel desktops; for large models, this caps token/s throughput.
  • The main advantage: very low cost per GB and high hardware expandability.

⚖️ Comparative summary table for your audits

Evaluation criterionDedicated VRAM (RTX 5090)Apple unified memoryAMD PRO 400 unified memoryClassic RAM (DDR5)
Memory bandwidth~1,792 GB/s3614 to 1,200 GB/s (M5 Max / M5 Ultra)4~273 GB/s5~80 to 100 GB/s (desktop dual-channel)
Theoretical ceiling 70B Q4 (~40 GB)~44.8 tok/s~15.4 to 30 tok/s~6.8 tok/s~2 to 2.5 tok/s
Typical machine capacity (2026)32 GB per consumer card2up to 128 GB (M5 Max) / 512 GB (M5 Ultra, see APU & Mémoire Unifiée)4up to 192 GB564 to 256 GB common, more possible depending on motherboard
Hardware expandabilityhigh (add GPUs)none (soldered memory)none (soldered memory)high (add DIMMs)
Positioningraw performance / multi-userhigh-performance local workstationlocal capacity + x86 compromiseentry-level / offline batch

📋 The architect’s decision guide

To advise your SMB client on a local deployment:

  1. Dedicated VRAM (discrete GPU): top choice for raw speed and concurrent workloads.
  2. Apple unified memory: excellent local throughput, simple stack to operate, but low hardware expandability.
  3. AMD PRO 400 unified memory: strong local memory capacity on x86, suited to Linux/Windows sovereignty requirements.
  4. DDR5 RAM alone: relevant mainly for deferred processing or smaller models.

📚 Sources and references

Footnotes

  1. Amir Gholami et al., AI and Memory Wall (arXiv:2403.14123), 2024. https://arxiv.org/abs/2403.14123 ↩

  2. NVIDIA, GeForce RTX 5090 product page (32 GB GDDR7, bus 512-bit, TGP 575 W). https://www.nvidia.com/fr-fr/geforce/graphics-cards/50-series/rtx-5090/ ↩ ↩2

  3. TechPowerUp, NVIDIA GeForce RTX 5090 Specs (memory bandwidth 1.79 TB/s). https://www.techpowerup.com/gpu-specs/geforce-rtx-5090.c4216 ↩ ↩2

  4. Apple, Mac Studio — Technical Specifications (M5 Max 614 GB/s, or 460 GB/s with the 32-core GPU, up to 128 GB; M5 Ultra 1.2 TB/s, up to 512 GB), reviewed on 2026-10-09 · Apple Newsroom, Apple introduces new Mac Studio with M5 Max and M5 Ultra, August 25, 2026 · Apple Support, Mac Studio (2025) — Tech Specs (M4 Max 546 GB/s, M3 Ultra 819 GB/s). https://www.apple.com/mac-studio/specs/ · https://www.apple.com/newsroom/2026/08/apple-introduces-new-mac-studio-with-m5-max-and-m5-ultra/ · https://support.apple.com/en-us/122211 ↩ ↩2 ↩3

  5. ServeTheHome, AMD Ups Ante With 192GB Ryzen AI Max PRO 400 Chips for AI Systems (192 GB, 160 GB allocatable to the GPU, ~273 GB/s), 2026. https://www.servethehome.com/amd-reveals-ryzen-ai-max-pro-400-series-192gb-ram-for-ai-systems/ ↩ ↩2 ↩3 ↩4

Give my opinion

Everything is optional: one answer is enough. This site sends nothing: you send it, the way you choose.

Your noteNo note
Your opinion is about
About what? (several choices possible)
What will be sent
Send by e-mail

Private, no account: opens your mail program with the message ready, for ia-on-prem@damien.becherini.fr.

Open a GitHub issue ↗

Public, with a GitHub account. You read the issue again before you publish it.

To paste it wherever you want.

Give at least a note, a subject or a message to be able to send.