Gemma 4
Gemma 4 Has Hidden MTP Heads Disabled by Google at Launch
A developer found multi-token prediction weights inside Gemma 4's LiteRT files; Google confirmed MTP exists but was intentionally disabled.
Apr 73 min readopcnew Editorialreddit.com
1 article tagged with this topic
A developer found multi-token prediction weights inside Gemma 4's LiteRT files; Google confirmed MTP exists but was intentionally disabled.