DeepSeekMoE
DeepSeek V4 Hits 70 tok/s on a 32GB Laptop — Local LLMs Finally Fit on One Machine
A developer got DeepSeek V4's massive MoE running on a 32GB laptop at 70 tok/s input by resharding weights to SSDs and speculative expert prefetch — p
Aug 9·2 min read