Live data from Hacker News

Ferret: A Multimodal Large Language Model

github.com

291–300 of 332 posts

Re: Ferret: A Multimodal Large Language Model

#291
post #31

Earlier quoted context omitted.

You're unlikely to get a better experience with Siri if she becomes equipped with a 7B or 13B LLM, unless Apple figured out something revolutionary.

Have you ever actually used Siri?

Yes, I've been trying it out regularly ever since it was released. Last time I've talked to it for like 30 minutes while driving in October (just to test it again). It simply doesn't work for me.

Re: Ferret: A Multimodal Large Language Model

#292
post #80

Earlier quoted context omitted.

I think your expectations are wrong. They sit there in silence with a few leaks here and there and some github projects, people speculate and get all excited about extrapolating those things. Then Apple deliver what works which may or may not be related to it. What they don't do is sell you a lie a year before release then deliver shit (like every other fucking vendor).

> What they don't do is sell you a lie a year before release then deliver shit (like every other fucking vendor). If you're referring to Google, then you're right. But OpenAI has consistently delivered what they announced pretty quickly. Same with Microsoft. To think that Apple somehow has a secret sauce that helps them surprise everyone is an illusion. They've had 3 years now to show their interest in LLMs, but they…

Nowhere near that. They’re a totally unproven tool with a lot of bad side effects. They just don’t want to go to market with that.

I mean they do truly useful stuff already using ML just not LLMs

Re: Ferret: A Multimodal Large Language Model

#293

Earlier quoted context omitted.

Absolutely! The hardware, that is. With software, their Come to Jesus moment is still in the future. (To me, Swift is sort of the Jony correlate on the software side. Doesn't fit perfectly, of course, but very similar "we are perfect who cares about evidence la la la I can't hear you" vibes and results)

Yes, they have treated macOS like a toy. It's time they made it a real OS.

I despise this perspective. It’s pretty much finished. What more crap do you want shovelled onto it?

Re: Ferret: A Multimodal Large Language Model

#295

>Ferret: A Multimodal Large Language Model What I thought when reading the title: A new base model trained from the ground up on multimodal input, on hundreds to thousands of GPUS The reality: A finetune of Vicuna, trained on 8xA100, which already is a finetune of Llama 13b. Then it further goes on to re-use some parts of LLava, which is an existing multimodal project already built upon Vicuna. It's not really as exc…

The innovation is the modification of the neural network architecture to incorporate the spatial-aware visual sampler. The data and existing models are not the interesting part.

Re: Ferret: A Multimodal Large Language Model

#297
post #102

Earlier quoted context omitted.

With iOS 17 they added a tiny little LLM to the predictive typing. I have the newest and greatest iPhone but I feel that I very rarely see it in action. I must assume that it’s just too slow at to keep up with my typing at the moment. Or it’s just not large enough to give very many useful suggestions.

Is tiny LLM an oxymoron? I believe Apple has told us it’s a transformer language model, but not specifically a LLM.

According to this article[1] it has about 34 million parameters.

https://jackcook.com/2023/09/08/predictive-text.html

Re: Ferret: A Multimodal Large Language Model

#298

> Usage and License Notices: The data, and code is intended and licensed for research use only. They are also restricted to uses that follow the license agreement of LLaMA, Vicuna and GPT-4. The dataset is CC BY NC 4.0 (allowing only non-commercial use) and models trained using the dataset should not be used outside of research purposes. Wait, how did "GPT-4" get in there?

Their evaluation stack uses GPT-4 to rate the answers, so that might also be the reason why that's in there.

Re: Ferret: A Multimodal Large Language Model

#299
post #56

Earlier quoted context omitted.

I guess they also have Samsung fridges in the offices..

And they use CAD software running on Windows (it simply doesn't exist on MacOS)

This is a false statement, you have to be specific which one is not available on macos, there are plenty you can use already. Even freecad runs on macos.

Re: Ferret: A Multimodal Large Language Model

#300

Earlier quoted context omitted.

What's the "literally" here? Try: They mention that they built on top of llava, which was released half a year ago.

In this context “literally” is being used to draw attention to the perceived obviousness of the information. Essentially saying “how could you not see this?”

In this context, "what's the literally here?" means that the author think the post would be better without it: it's too agressive, sarcastic, demeaning, etc. for example. Hence it's a false question.

It's actually funny because you answered a false question (potentially on purpose). Like:

"What the hell are you doing?!?" "Well Im stealing your car, obviously."

Post reply on HN