Model Distillation

Qwen Releases New Distilled Model — Alibaba Pushes Lightweight Open-Source LLMs

Qwen's distilled model reappears in open-source, untested but noticed. Chinese LLM vendors are now treating 'lightweight matrices' as the default.