Skip to main content

lemmy - Link to source

Bonsai 27B: The First 27B-Class Model to Run on a Phone

Announcing Bonsai 27B: The First 27B-Class Model to Run on a Phone

PrismML
#technology
in reply to ☆ Yσɠƚԋσʂ ☆

Irdial
lemmy - Link to source
Irdial
• •
I'm surprised that the model's benchmark performance isn't that much worse than the base given that it's running with 1-bit quantization. Impressive.
⇧