Google Gemma
Two RTX 4060s Hit 75 Tokens/Sec on 26B Gemma — Open Source Cuts Local LLM Cost
Reddit's local AI community hit 75 tokens/sec running 26B Gemma on two RTX 4060 GPUs. Consumer hardware is reaching the medium-scale LLM utility thres
1 article tagged with this topic
Reddit's local AI community hit 75 tokens/sec running 26B Gemma on two RTX 4060 GPUs. Consumer hardware is reaching the medium-scale LLM utility thres