27 Billion Parameters in Your Pocket: The Bonsai AI Revolution is Here
PrismML’s Bonsai 27B smashes the memory barrier, proving a 27B-parameter model can fit in 3.9GB and run on an iPhone with 90% benchmark retention. A deep dive into the 1-bit magic and the trade-offs.
