Delta Inference Engine

DeepSeek-V4.1-Flash Runs on One RTX 3090: Local Inference Nears Practicality

Delta Inference Engine 0.93 runs a low-bit DeepSeek-V4.1-Flash model at 41 tok/s on one RTX 3090 with 64GB RAM.