MobileMoE

Meta Puts a 5.3B-Parameter Model Into 3GB of Phone Memory—For Research Only

Meta releases MobileMoE: 5.3B total parameters, under 1B active, and under 3GB at INT4—but its FAIR NC license bars commercial use.