Ternary Bonsai 2
Open-Source Dev Doubles 27B Inference Speed — Doing Cloud Vendors' Job
DFlash 2 fine-tuned for PrismML's Ternary Bonsai 2 27B: 2.2x on L4, 1.5x on Mac, 1.2x in browser. Open source narrows the local vs. cloud gap.
1 article tagged with this topic
DFlash 2 fine-tuned for PrismML's Ternary Bonsai 2 27B: 2.2x on L4, 1.5x on Mac, 1.2x in browser. Open source narrows the local vs. cloud gap.