GPTQ

8GB GPUs Can Now Run 70B Models — Quantization Crushes Local AI Deployment Costs

8GB consumer GPUs couldn't fit 130GB model weights; now quantization runs 7B models on 3.5GB. The real story isn't specs — AI deployment may finally l