consumer GPU

100B-Parameter LLM Runs on 16GB GPU — Cloud Compute Pricing Is Up for Rethink

An open-source team packed a 177B-parameter LLM into a 16GB consumer GPU + SSD at 9-10 tok/s—signaling the hardware floor for LLMs is quietly sinking.