1M Context

309B Total, 15B Active: Naive's Model Challenges 'Bigger Is Better' Myth

Naive-N0.5-Flash: 309B total, only 15.5B active, 1M context. 'Big-model-small-run' MoE design challenges 'bigger is better' orthodoxy.