sparse architecture

Alibaba's Qwen Tops Both Open-Source Frontiers — Parameters Weren't the Question

Alibaba's Qwen hits the Pareto frontier on both total and active parameters. Running AI may keep getting cheaper — but the lead may not hold.