Qwen
Local LLM Agent Benchmark: Qwen 27B Wins, Loser Fails at Knowing When to Stop
A Reddit engineer tested 15 open-source LLMs (8B-35B) on Agent tasks. Qwen 27B won at 71.8%; the bottom model failed 70% by not knowing when to stop.
Back to home
Bonsai
2 articles tagged with this topic
ggml
GGML Adds Q1_0 1-Bit Quantization: Run 8B Models at 1.15GB
GGML now supports Q1_0 1-bit quantization, shrinking Bonsai 8B models to 1.15GB for CPU-only inference.
Apr 62 min readopcnew Editorialreddit.com