Distillation

Open-Source AI's Linux Moment: Break LLMs into Vertical Components

LocalLLaMA proposes distilling LLMs into vertical micro-models (accounting, biology, OCR) developers can compose. Can open source escape its "bigger i