Basalt
Basalt Runs a 27B Model at 776 Tokens on RTX 5090
Basalt 0.4.0 adds routing, file and video support, and runs Qwen 3.8 27B at up to 776 tokens per second.
1 article tagged with this topic
Basalt 0.4.0 adds routing, file and video support, and runs Qwen 3.8 27B at up to 776 tokens per second.