This week, a Reddit user's benchmark numbers gave us pause: DDR5/PCIe5 only beats DDR4/PCIe4 by 15-20% in large model pretraining, but the same budget spent on the older platform lets you add an extra RTX PRO 6000 — yielding 50% more total compute. This matters because it punctures a reflex: "buy new, not old" doesn't always hold in the AI workstation space.

What this is

The original poster rented two machines on Vast.ai — a per-hour GPU rental cloud platform — for a head-to-head comparison: one with DDR4 + PCIe4 paired with a single GPU, the other with DDR5/PCIe5 paired with a single GPU. Both rigs ran RTX PRO 6000 cards; the only variable was memory generation and PCIe lane speed. Across pretraining runs, the new platform came out 15-20% faster. But memory pricing is steep — the cost of 256GB of DDR5-6400 covers a second identical GPU. That means the older platform can run two cards and deliver 50% higher throughput.

(PCIe is the data channel between GPU and CPU — newer versions mean more bandwidth. DDR is system memory — newer generations run at higher frequencies and cost more. Together, they determine how fast data feeds the GPU.)

Industry view

The conclusion drew several rebuttals:

  • Single user, single test — reproducibility is questionable. The 15-20% gap could swing wildly across different models and batch sizes.
  • Older motherboards carry end-of-life risk. The OP noted Blackwell (NVIDIA's latest GPU generation) has already hit boot compatibility issues with some PCIe3-era boards. In two years, new GPUs may not run on DDR4 platforms at all.
  • This only tested pretraining. For inference, DDR5's advantage may exceed 15-20%.
  • Other users pointed out DDR5 pricing is near a cycle high — wait 6-12 months and prices could drop 30%, flipping the conclusion.

The OP's own verdict is moderate: he leans toward DDR4 for pretraining, but concedes that future techniques like dynamic expert/data loading will make faster memory more valuable.

Impact on regular people

  • For enterprise IT: The cost calculus for in-house AI workstations is shifting — same budget, older platform plus multiple cards yields 50% more throughput than a single-card new platform. It's a smart short-term bet, but next-gen GPU compatibility could break the balance.
  • For professionals: Local inference of open-source models for daily tasks is largely unaffected. For fine-tuning or training mid-to-large models, the hardware-selection logic flips: more GPUs beats chasing the latest platform.
  • For consumer markets: Regular PC users won't feel a thing. This primarily affects SMBs and developer self-built workstation decisions. Cloud rental platforms (Vast.ai, RunPod, and similar) may also see pricing strategy shifts driven by this hardware-choice pattern.