Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ferret: A Multimodal Large Language Model

github.com

Post reply on HN
Print view View original

41–50 of 332 posts

Re: Ferret: A Multimodal Large Language Model

#41

Post by turnsout »

colesantiago wrote: post #23
FredPret wrote: post #19

Earlier quoted context omitted.

So Apple is filling in ChatGPT's moat then, not their own? Pardon my confusion

Yes, it looks like Apple is going after everyone and anyone that has a web based LLM, ChatGPT, Poe, Claude, etc. via developer kits LLMKit that can work offline. This will only work if their models (even their tiny or even medium / base models) equal (or are better than) GPT-3.5 / 4. From there, Google will follow Apple in doing this offline / local LLM play with Gemini. OpenAI's ChatGPT moat will certainly shrink a…

Apple's moat has been and continues to be their insanely large installed base of high-margin hardware devices. Meanwhile, LLMs are rapidly becoming so commoditized that consumers are already expecting them to be built-in to every product. Eventually LLMs will be like spell check—completely standard and undifferentiated.

If OpenAI wants to survive, they will need to expand way beyond their current business model of charging for access to an LLM. The logical place for them to go would be custom chipsets or ARM/RISCV IP blocks for inference.

Re: Ferret: A Multimodal Large Language Model

#42

Post by smoldesu »

nicce wrote: post #39
colesantiago wrote: post #29

Earlier quoted context omitted.

Hence OpenAI is looking at hardware themselves. https://www.reuters.com/technology/chatgpt-owner-openai-is-e... https://techcrunch.com/2023/09/27/openai-is-reportedly-in-ta...

It does not matter much if they do not make competitor for iPhones and get consumers to choose them. Because consumers keep buying iPhones and will have then Apple hardware. And they cannot bring software ecosystem for their hardware without Google, at least easily.

It doesn't matter because Apple would not offer OpenAI actual integration terms, period. Their only option is to create an alternative hardware platform, because Apple fights tooth-and-nail to pick and choose what software iPhone users are allowed to run.

Re: Ferret: A Multimodal Large Language Model

#43

Post by philistine »

colesantiago wrote: post #29
yreg wrote: post #22

Earlier quoted context omitted.

They cannot integrate it deeply into Apple's platforms.

Hence OpenAI is looking at hardware themselves. https://www.reuters.com/technology/chatgpt-owner-openai-is-e... https://techcrunch.com/2023/09/27/openai-is-reportedly-in-ta...

Never bet against the phone. Right now it's an essential component of any winning move in tech.

Re: Ferret: A Multimodal Large Language Model

#46

Post by bbor »

CaptainOfCoit wrote: post #24
yreg wrote: post #21

I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.

You're unlikely to get a better experience with Siri if she becomes equipped with a 7B or 13B LLM, unless Apple figured out something revolutionary.

Note that “using an LLM” doesn’t just mean “plugging user queries straight into an LLM”. Enhancing Siri will probably be an ensemble project.

Re: Ferret: A Multimodal Large Language Model

#47

Post by bbor »

yreg wrote: post #21

I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.

I really, really doubt it for one reason: I’m convinced Apple is still terrified of that “Amazon Alexa tells child to stick a penny in a socket” story, and will hamstring themselves in an attempt to have their agential cake and eat it too

Re: Ferret: A Multimodal Large Language Model

#48

Post by hhh »

tambourine_man wrote: post #45

> FERRET is trained on 8 A100 GPUs So Apple uses NVidia internally. Not surprising, but doesn't bode well for A Series. Dogfooding. [edit] I meant M series, Apple Silicon

Why would they dogfood Apple Silicon for training models? Seems like a waste of developer time to me.

Re: Ferret: A Multimodal Large Language Model

#49

Post by echelon »

freedomben wrote: post #15

> Usage and License Notices: The data, and code is intended and licensed for research use only.

Boo.

But what do we expect from these giants? They're not going to create fertile ground for new competition. The only businesses they foster are those living under thumb and paying tax.

I guess I at least hoped for "commoditize the compliments" here. Make Google and OpenAI broadly less special.

Re: Ferret: A Multimodal Large Language Model

#50

Post by smoldesu »

philistine wrote: post #43
colesantiago wrote: post #29

Earlier quoted context omitted.

Hence OpenAI is looking at hardware themselves. https://www.reuters.com/technology/chatgpt-owner-openai-is-e... https://techcrunch.com/2023/09/27/openai-is-reportedly-in-ta...

Never bet against the phone. Right now it's an essential component of any winning move in tech.

If you do bet on the phone, make sure you only bet on the first-party OEM. API depreciation, exclusive entitlements, user restrictions, payment-processing or flat-out Sherlocking are all realistic and credible threats to your business.

As they say, the house always wins.

Post reply on HN