Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ferret: A Multimodal Large Language Model

github.com

Post reply on HN
Print view View original

131–140 of 332 posts

Re: Ferret: A Multimodal Large Language Model

#131

Post by [deleted] »

SpaceManNabs wrote: post #103
chefandy wrote: post #40

Earlier quoted context omitted.

From Bard: My situation is a bit unique, so the term "manufacturer" might not be the most accurate way to describe who created me. Here's a breakdown of what you need to know: Developed by Google AI: I was created by a team of researchers and engineers at Google AI, specializing in language models and artificial intelligence. Trained on a massive dataset: My knowledge and abilities come from being trained on a massiv…

Why was this downvoted? It didn't answer the question, but it showed that there is a sort of imprint that GP was asking about. And it saves everyone a tab's worth of effort.

[deleted]

Re: Ferret: A Multimodal Large Language Model

#132

Post by lern_too_spel »

ayewo wrote: post #95
smoldesu wrote: post #71

Earlier quoted context omitted.

I don't get it, does Apple also make fridges now?

They are implying that even though Apple is a wealthy consumer hardware company that has major spats with nVidia and Samsung, it doesn't always make economic sense to make tools they might need in-house when they can simply buy them from a rival. So rather than invest engineering resources to re-imagine the fridge, they can simply buy them from established manufacturers that make household appliances like Samsung, So…

Apple doesn't make silly charts saying they make better refrigerators.

Re: Ferret: A Multimodal Large Language Model

#133

Post by thebruce87m »

bbor wrote: post #47
yreg wrote: post #21

I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.

I really, really doubt it for one reason: I’m convinced Apple is still terrified of that “Amazon Alexa tells child to stick a penny in a socket” story, and will hamstring themselves in an attempt to have their agential cake and eat it too

They are right to be careful, they are held to a much higher standard than their competitors.

Pixel phones have had emergency call issues for years across multiple models but they just get a pass. Apple would be crucified for this.

Re: Ferret: A Multimodal Large Language Model

#134

Post by n2d4 »

bbor wrote: post #52
pests wrote: post #16

Earlier quoted context omitted.

why not LLMM?

Ok our options Multimodal large language model Large multimodal language model Large language multimodal model Large language model (multimodal) I prefer 1, because this is a multimodal type of an existing technique already referred to as LLM. If I was king, I’d do Omnimodal Linguistic Minds, but no one asks me such things, thank god

I mean, if we want to be silly, what about "Language model (large, multimodal"? :)

Re: Ferret: A Multimodal Large Language Model

#136

Post by spookthesunset »

ben_w wrote: post #130
behnamoh wrote: post #63

Earlier quoted context omitted.

I hope they get rid of it completely. People on r/locallama and others have made much better assistants using GPT which use iOS APIs to control the phone. It's ridiculous that Apple still hasn't done anything useful regarding Siri.

I'd be (pleasantly) surprised; look at how long it takes them to allow system apps to get replaced with downloadable 3rd party. And even then, the activation keyword is likely to be whatever Apple says. Similar logic as 3rd party keyboards, don't want user input to get stuck on even merely potentially untrustworthy or buggy code.

Correct me if I’m wrong but isn’t the activation word “special” in that it has to work in very low power states? I always assumed that is why the wake words are fixed, because said words need to “fit” within a very small power budget.

Re: Ferret: A Multimodal Large Language Model

#137

Post by ben_w »

KMnO4 wrote: post #102
hmottestad wrote: post #84

Earlier quoted context omitted.

With iOS 17 they added a tiny little LLM to the predictive typing. I have the newest and greatest iPhone but I feel that I very rarely see it in action. I must assume that it’s just too slow at to keep up with my typing at the moment. Or it’s just not large enough to give very many useful suggestions.

Is tiny LLM an oxymoron? I believe Apple has told us it’s a transformer language model, but not specifically a LLM.

It's like how the "New Forest" is really old now: even small LLMs are (from what I've seen which isn't exhaustive) large compared to Markov language models.

Re: Ferret: A Multimodal Large Language Model

#138

Post by CaptainOfCoit »

nexuist wrote: post #96
CaptainOfCoit wrote: post #24

Earlier quoted context omitted.

You're unlikely to get a better experience with Siri if she becomes equipped with a 7B or 13B LLM, unless Apple figured out something revolutionary.

Siri is really quite dumb. I am confident that a 7B model would be able to provide better responses in over 90% of user queries. I can't even get Siri to reliably set a timer.

Yes, Siri is really dumb. But so is every 7B/13B model out there too.

Re: Ferret: A Multimodal Large Language Model

#139

Post by cedws »

yreg wrote: post #21

I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.

What are you going to do with it?

Re: Ferret: A Multimodal Large Language Model

#140

Post by spookthesunset »

dbish wrote: post #72
bbor wrote: post #46

Earlier quoted context omitted.

Note that “using an LLM” doesn’t just mean “plugging user queries straight into an LLM”. Enhancing Siri will probably be an ensemble project.

This is part of the mismatch between comparing Alexa/Siri/Cortana to a chat based LLM right now. If you just want chat and info retrieval, today’s LLMs are way better then the conversational dialogue, search, and q&a capabilities any of those assistants have. But, if you want relatively predicable task completion for things like smart home control, timers and alarms, real time weather updates, etc. (basic but frequen…

I would hope that it would at last get you out of the hell that is “what the heck did I name that stupid light?”. Device naming is, in my opinion, the worst part of any of the voice based home assistant things.

Is it “porch led”, “porch light” or “outdoor light”? Or is “outdoor light” actually the one in the front yard? What is the one by my kids nightstand? And what routine name do I use to set the mood for watching a movie?

I would hope a properly trained llm with an awareness of my devices and their locations would allow for more verbal ambiguity when controlling things.

Post reply on HN