Apex-2MoE
Solo Dev Trains Coding AI on 86B Tokens: Efficiency Soars, Knowledge Lags
Solo dev YOON1v trained Apex-2 from scratch on 86.5B tokens — 1/200 of Qwen2.5-1.5B's data. Code matches; knowledge and reasoning lag. The cost floor
Oct 4·2 min read