What this is

This week, the hottest thread on Reddit's r/LocalLLaMA community is the upcoming release of Alibaba's Qwen 3.8. The community speculates the new version will share Qwen 3.6's architecture but add MTP (Multi-Token Prediction) — a technique where the model predicts several tokens at once, boosting inference speed by 30%–60%.But here's what really has us excited: it's not the model, it's the hardware finally catching up. AMD Strix Halo (a laptop APU with large integrated memory) and Apple's M4/M5 Mac use unified memory architecture (CPU and GPU sharing a single memory pool), letting them run large models that previously demanded expensive discrete GPUs. A $2,000-class laptop can now locally run 70B-parameter models — unthinkable just two years ago.

Industry view

We see plenty of support. Local inference (running AI on-device, offline) has been the most underrated trend in the LLM space over the past year. Once models can run locally, enterprises depend one layer less on cloud vendors — data stays in-house, responses get faster, and long-term costs drop. AMD and Apple are both betting on this line, and open-source models like Qwen supply the ammunition.The cautionary counter-view matters just as much. Today's "local LLM" conversation is dominated by geeks willing to drop $2,000 on a laptop and pull all-nighters tuning parameters — a world apart from enterprise IT procurement. One hardware reviewer put it bluntly: "MTP sounds great on paper, but you need 64GB of unified memory to run a 70B model — that's a bar too high for most companies." Cloud vendors aren't sitting still, either — API prices keep falling, and the convenience of managed services remains a moat local deployment can't match in the short term.

Impact on regular people

  • For enterprise IT: Not a procurement decision factor in the short term, but worth keeping on the two-to-three-year horizon. Once 5,000-yuan-class laptops can run 32B models, the cost structure of private enterprise deployment will be rewritten.
  • For individual professionals: Not your turn yet. In other words, your work computer can't run these yet — but start watching whether your company is buying laptops with NPUs (Neural Processing Units), the hardware foundation of Copilot+ and Apple Intelligence.
  • For consumer markets: Phones and thin-and-light laptops will keep gaining "AI features," but most remain hybrid approaches — "small on-device model + cloud fallback." True local LLMs need at least two more years.