AirLLM

AirLLM Crams 2.8T-Param Kimi K3 into 4GB VRAM — Hold the Applause

Open-source inference tool AirLLM updates, claiming to run 2.8T-param Kimi K3 in 4GB VRAM. Direction is right, but the community questions the numbers