Overspill

85GB Model Runs on 12GB GPU: Local AI's Cost Wall Cracks

A developer ran 85GB DeepSeek-V4-Flash on a 12GB RTX 3060 via NVMe-as-memory, hitting ~3 tokens/s. The local-LLM cost wall cracks.