speculative decoding

4 articles tagged with this topic

DFlash 2Inco AI

2.26x Speedup Is Real. The '8x' Number Is Fake — An Honest DFlash 2 Test

DFlash 2 hits a real 2.26x speedup. But a developer's 3-day benchmark debunks the viral '8x' number — AI perf claims can be marketing traps.

Aug 232 min read

Reddit 用户让本地 AI 提速 65%，但官方还没接盘

llama.cpp fork with DSpark PC Tree speculative decoding pushes Qwen3 ~65% faster on RTX 5090. Not merged, but local AI is getting cheaper and faster.

Aug 212 min read

MetaMuse Glimmer

Meta's Muse Glimmer 30B Hits 3.3x Speedup on Mac as Open Source Closes the Gap

Developer A-Rahim uses speculative decoding to push Meta's Muse Glimmer 30B up to 3.3x faster on M4 Pro, with output exactly matching the original.

Aug 122 min read

Gemma 4 Has Hidden MTP Heads Disabled by Google at Launch

A developer found multi-token prediction weights inside Gemma 4's LiteRT files; Google confirmed MTP exists but was intentionally disabled.

Apr 72 min read