RPC

Dusty GPUs Run LLMs — 1080 Ti + 5070 Ti Power Qwen 27B, Costs Drop

Dev chains 2017 GTX 1080 Ti with RTX 5070 Ti via gigabit Ethernet, runs quantized Qwen 27B using llama.cpp RPC. Old hardware isn't scrap.