Live data from Hacker News

Bonsai 27B: A 27B-Class model that runs on a phone

prismml.com

91–100 of 278 posts

Re: Bonsai 27B: A 27B-Class model that runs on a phone

#91
So first off, phenomenal stuff to see a 1bit model at 90% capability.

However, this is the 5th product post in 2 weeks that proclaims that AI use is shifting, and why [insert tradeoffs] are the perfect fit.

Paradigms shift don't happen in the release announcements.

I suspect this is an AI-ism, making all the release posts sound so paradigmshiftery.

Re: Bonsai 27B: A 27B-Class model that runs on a phone

#93
post #7

This must be some sort of unpublished app? I can just see their image tool on the app store

One of the links on the sidebar goes to "Locally AI" https://apps.apple.com/us/app/locally-ai-by-lm-studio/id6741... it requires an iPhone 17 Pro or Pro Max to run the 27B model though.

Re: Bonsai 27B: A 27B-Class model that runs on a phone

#94
post #88

Earlier quoted context omitted.

check out geyron-9b, I've only used it a bit, but seems better than orinth on vibe evals huggingface.co/Tivaphraen/Geryon-9B-v1

Interesting, thanks. Looking at the model card on Huggingface, it’s combining the Qwythos and Qwable fine tunes from Empero.

yea, it's an experiment in merging multiple fine-tuned models

Re: Bonsai 27B: A 27B-Class model that runs on a phone

#95

So first off, phenomenal stuff to see a 1bit model at 90% capability. However, this is the 5th product post in 2 weeks that proclaims that AI use is shifting, and why [insert tradeoffs] are the perfect fit. Paradigms shift don't happen in the release announcements. I suspect this is an AI-ism, making all the release posts sound so paradigmshiftery.

That is true of all tech announcements. Marketers will do their thing regardless of reality.

Re: Bonsai 27B: A 27B-Class model that runs on a phone

#97

Earlier quoted context omitted.

Apple would punish him severely unless they cleared it in advance, it might be to their advantage for some reason (negotiating with Google for Gemma rights? idk).

Apple is too desperate to be making demands. You confuse the Apple of yesterday and of today. Things change fast and things have changed.

You’re right, Apple only has 68 billion dollars in cash, up 40% since last year. Definitely on their last legs.

Re: Bonsai 27B: A 27B-Class model that runs on a phone

#100

Earlier quoted context omitted.

Apple is too desperate to be making demands. You confuse the Apple of yesterday and of today. Things change fast and things have changed.

You’re right, Apple only has 68 billion dollars in cash, up 40% since last year. Definitely on their last legs.

I remember the infographics of 5-10 years ago. They had 200 billion. What happened? Sinking ship?
Post reply on HN