open-source LLM
17 articles tagged with this topic
Qwen3 Slimmed 65%, Scores Barely Move — LLM Deployment Cost Battle Escalates
QUASAR compressed Qwen3-27B to 35% of its size with just a 0.5-point GPQA-Diamond drop — a key inflection for LLM deployment costs.
Llama.cpp Hits 0.2 — The Bar for Running LLMs on Home PCs Drops Again
Open-source inference engine Llama.cpp releases 0.2.0, its first 0.2-series version, signaling a systemic architecture and performance overhaul worth
Ornith-1.5 hits 250 token/s on Nvidia 5090 — local AI nears cloud parity
Ornith-1.5-35B-A3B open-source model hits 250 token/s on Nvidia 5090 — first realistic local option for cloud-grade Agent workloads.
Open-source LLMs: coding soars, writing stalls — are benchmarks off-track?
Qwen's coding record grabs headlines, but Reddit's open-source community warns writing and translation lag. We ask if R&D priorities have drifted.
AntLing drops 6 Ling-3.0 base checkpoints — China's LLM race hits the foundation
AntLing drops 6 Ling-3.0 checkpoints under MIT — developer raw material, not consumer product. China's foundation race advances; enterprise use distan
Qwen Tells Devs: 'Don't Wait for 35B-A3B' — Open-Source Cadence Shifts
Qwen devs told Reddit 'don't wait for 35B-A3B,' sparking open-source debate. We unpack three possible reasons — and the risk for small teams.
Two Prompts, One Game — But Local Qwen's Barrier Isn't as Low as You Think
Reddit user built a web game with two prompts on local quantized Qwen. Open-source LLMs now handle practical tasks, but hardware barriers remain.
Qwen3.8-27B Benchmark: 4× RTX 3090 Is 33% Slower Than 2×
Alibaba's Qwen3.8 27B on 4× RTX 3090 runs 33–41% slower than 2×. Breaks the "more hardware = more performance" assumption.
Netizens strip Alibaba Qwen's refusals — Community fork 3.8 quietly updates
An unofficial HF account quietly dropped an 'abliterated' Qwen fork that strips refusal behavior. Mainstream Chinese media didn't cover it.
Qwen 27B Hits 3.8 — China Open-Source LLMs Keep the Local-Deployment Race Hot
Alibaba's Qwen shipped 27B v3.8. The real story isn't the version bump but changed sampling parameters—developers must retune or see output drift.
Qwen small model wrote a lava lamp — Alibaba's open-source route is underrated
Local Qwen small model (FP8) generated a single-file HTML lava lamp animation rated best-in-class for its size — runs on consumer GPUs.
Qwen 27B Sparks Overseas Buzz — China's Open-Source LLMs Step Into the Ring
Alibaba ships Qwen 27B to overseas devs for VRAM and speed tests — a concrete signal China's open-source LLMs now compete head-on with Llama and DeepS
Qwen3.8-27B Drops Early — 27B Is Local AI's Sweet Spot, Benchmarks Pending
Alibaba's Qwen team posted the Qwen3.8-27B model card on Hugging Face ahead of benchmarks. 27B is open-source's local AI sweet spot.
Unsloth Releases 30B Open-Source Model — Local LLMs Step Out of the Geek Bubble
Unsloth ships a GGUF-quantized Muse-Glimmer-30B, letting consumer laptops run a 30-billion-parameter LLM locally. On-prem AI is shifting from hobbyist
DeepSeek V4 Flash Benchmarks Independently Replicated — Numbers Match, But China's LLM Evaluation
Third-party team Ante replicated DeepSeek V4 Flash's 82.7% Terminal-Bench 2.1 score (368/445 successes) using public tools. The number holds — but Dee
Someone Got Kimi K3 Running Locally — But This Isn't Something You Can Replicate
A Reddit developer ran Moonshot's Kimi K3 on a two-consumer-GPU cluster via llama.cpp. First serious local test of a Chinese frontier model — but "run
BitNet hits 36 tokens/sec on a plain CPU — LLM inference starts shedding its GPU dependency
A developer shifu_legend wrote a zero-dependency inference engine in pure C99, hitting 36 tokens/sec on an Intel Xeon running a 1.58-bit BitNet model.