This week, a post on Reddit's r/LocalLLaMA caught our eye: a user ran Alibaba's Tongyi Qianwen (Qwen) 27B-parameter model on two consumer-grade GPUs (an RTX 3090 and an RTX 3060 — popular models among gamers), keeping it running for 20 hours straight on Agent coding — letting the AI autonomously break down tasks, call tools, and modify code, rather than just answering questions. Throughout the run, generation speed held steady at 60-63 tokens per second (a token is the smallest unit an LLM processes text in; in Chinese, roughly 1-2 characters correspond to 1 token), with no crashes.

What This Is

Agent coding has been a focal direction in the LLM industry these past two years: AI doesn't merely answer questions, but breaks down tasks, executes them continuously, and performs multi-step operations — for example, "fix this bug and run the tests for me."In the past, this territory belonged mainly to closed-source large models (those that don't release model weights and can only be accessed via paid APIs, such as GPT and Claude), or required enterprise-grade GPUs (A100/H100, each costing over a hundred thousand RMB). What's interesting this time is that two things hold simultaneously:First, the 27B-parameter Qwen, after quantization (compressing high-precision parameters to lower precision to reduce size), can run stably for 20 hours on two second-hand consumer GPUs.Second, what it's doing isn't chatting — it's Agent-class tasks, a category widely considered in 2025 to "require larger models" to do well.

Industry View

Supporters' judgment is clear: open-source models (those that release model weights and can be freely downloaded and modified) are closing in on the capability ceiling of closed-source models, with a fundamentally different cost structure. Local deployment means data stays on-premises, no per-token billing (paying by usage volume), and no risk of service being cut off by the provider.But we want to flag a sober side: this is a user-initiated, non-standardized test — 20 hours without crashing doesn't equal production stability; 60 tokens/sec is still on the slow side for long tasks; consumer GPUs have limited memory and compute ceilings, and complex Agent tasks still struggle. The gap between "runnable" and "commercially viable" remains considerable, and for SMB IT procurement, this single case shouldn't serve as a basis for purchasing decisions.

Impact on Regular People

For enterprise IT: small and mid-sized companies and teams handling sensitive data can now seriously evaluate "locally deployed open-source model + self-built Agent" setups, no longer fully dependent on overseas APIs.For individual professionals: tech-literate white-collar workers now have a low-barrier experiment field — a single second-hand RTX 3090 (currently around three to four thousand RMB) is enough to run a 27B-class Agent, with no need to request an API budget from the company.For the consumer market: hardware vendors, model compression tools, and private deployment service providers are the potential beneficiaries along this thread; ordinary users' day-to-day experience won't change in the short term — running Agents locally remains a game for a handful of technical enthusiasts.