model distillation

1 article tagged with this topic

30B Model Halved to 14B, 95% Agent Capability Kept — Local on One Consumer GPU

A solo developer cut a 30B Muse-Glimmer model in half and distilled it to a 14B Xyntetik-Kvist-14B. 57 of 60 tool-call tasks pass; quantized, it fits