1 article tagged with this topic
Naive-N0.5-Flash: 309B total, only 15.5B active, 1M context. 'Big-model-small-run' MoE design challenges 'bigger is better' orthodoxy.