Inpherio Live
iPhone Becomes a Private AI Server as On-Device Inference Hits a Memory Wall
Inpherio Live streams MoE weights from flash memory, letting a 12GB iPhone run a 30B model and a 16GB iPad run 120B.
1 article tagged with this topic
Inpherio Live streams MoE weights from flash memory, letting a 12GB iPhone run a 30B model and a 16GB iPad run 120B.