Not impressed. It fails the "Jabberwocky" test.
Bonsai 27B: A 27B-Class model that runs on a phone
111–120 of 278 posts
Re: Bonsai 27B: A 27B-Class model that runs on a phone
#112Maybe Taalas could cook this as their AI-on-chip next
Re: Bonsai 27B: A 27B-Class model that runs on a phone
#113Earlier quoted context omitted.
You’re right, Apple only has 68 billion dollars in cash, up 40% since last year. Definitely on their last legs.
I remember the infographics of 5-10 years ago. They had 200 billion. What happened? Sinking ship?
They never had $200 billion in cash in any quarter. Not at least since 2014. Besides, how much cash to hold is an executive decision. If the cash balance went down, it doesn't mean their business is not doing well. Cash can be used for Capex, like what the hyperscalers are doing right now. It can be used for buying back equity.
Re: Bonsai 27B: A 27B-Class model that runs on a phone
#114Re: Bonsai 27B: A 27B-Class model that runs on a phone
#115Quite weird that heavy quantization method on a dense model gives better results than slightly quantized MoE models like 35B-A3B from Google. At this point all the different quantization and 'compression' (look at MPO applied to LLMs...) techniques start feeling a bit like snake oil. It's just gut feeling - or scores on benchmarks models are optimized for - what ends up deciding whether a technique is good enough or…
26B-A4B?
Re: Bonsai 27B: A 27B-Class model that runs on a phone
#116Earlier quoted context omitted.
Apple is too desperate to be making demands. You confuse the Apple of yesterday and of today. Things change fast and things have changed.
> Apple is too desperate to be making demands They don't give a F about AI or any new AI model that was announced this morning. Wasn't there news a while ago about them buying Perplexity?
They do, they are low key panicking.
Re: Bonsai 27B: A 27B-Class model that runs on a phone
#117maybe its nitpicking here but the demo shows them asking the model what to cook and its recipie sounds like it wouldn't be very good and also it totally gets the macronutrients wrong. 25g protein for "spaghetti, carrots, peppers, garlic and herbs"?
I personally don't like carrots much, but it doesn't sound bad to me – could definitely use a tomato sauce but that doesn't seem to be an option from the image it was given.
> 25g protein for "spaghetti, carrots, peppers, garlic and herbs"?
Maybe it assumed the pasta was some kind of protein chickpea pasta? =P it definitely seems wrong.
Re: Bonsai 27B: A 27B-Class model that runs on a phone
#118Earlier quoted context omitted.
You’re right, Apple only has 68 billion dollars in cash, up 40% since last year. Definitely on their last legs.
Free cash? Crazy. I think I can live with the interest of that in the bank.
you could live (100k a year) with the interest of 0.004% of that in the bank.
Re: Bonsai 27B: A 27B-Class model that runs on a phone
#119Earlier quoted context omitted.
> Apple is too desperate to be making demands They don't give a F about AI or any new AI model that was announced this morning. Wasn't there news a while ago about them buying Perplexity?
They do, they are low key panicking.
And if they aren't, they should be. They ship some of the cheapest, most capable, and easiest to buy/set up AI hardware out there, and then don't ship any AI software worth speaking of. Apple needs to fix this.
Re: Bonsai 27B: A 27B-Class model that runs on a phone
#120maybe its nitpicking here but the demo shows them asking the model what to cook and its recipie sounds like it wouldn't be very good and also it totally gets the macronutrients wrong. 25g protein for "spaghetti, carrots, peppers, garlic and herbs"?
And why would i want such mundane questions to be handled by an AI on my phone? That sort of thing doesnt need AI, let alone a local one. Basic google search was answering those questions long ago. My point: phone-sized AI is only useful if it can do things that only AI can do. Can it ingest a document scanned by the phones camera? Can it translate in real time? I dont see how or why i would ever ask it for recipe advice. That need is met elsewhere x10.