Ternary Bonsai 2DFlash 2
Open-Source Dev Doubles 27B Inference Speed — Doing Cloud Vendors' Job
DFlash 2 fine-tuned for PrismML's Ternary Bonsai 2 27B: 2.2x on L4, 1.5x on Mac, 1.2x in browser. Open source narrows the local vs. cloud gap.
Oct 7·2 min read
