21–30 of 332 posts
It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.
Earlier quoted context omitted.
Running Multimodal LLMs on device and offline, i.e LLMKit for free equaling GPT-3.5 / 4 then Google will follow on Android. Ability to download / update tiny models from Apple and Google as they improve, à la Google Maps. No need for web services like ChatGPT.
So Apple is filling in ChatGPT's moat then, not their own? Pardon my confusion
This will only work if their models (even their tiny or even medium / base models) equal (or are better than) GPT-3.5 / 4.
From there, Google will follow Apple in doing this offline / local LLM play with Gemini.
OpenAI's ChatGPT moat will certainly shrink a bit unless they release another powerful multimodal model.
I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.
Earlier quoted context omitted.
Running Multimodal LLMs on device and offline, i.e LLMKit for free equaling GPT-3.5 / 4 then Google will follow on Android. Ability to download / update tiny models from Apple and Google as they improve, à la Google Maps. No need for web services like ChatGPT.
So Apple is filling in ChatGPT's moat then, not their own? Pardon my confusion
I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.
You're unlikely to get a better experience with Siri if she becomes equipped with a 7B or 13B LLM, unless Apple figured out something revolutionary.
Maybe the abstract of the paper is a better introduction to what this is: > We introduce Ferret, a new Multimodal Large Language Model (MLLM) capable of understanding spatial referring of any shape or granularity within an image and accurately grounding open-vocabulary descriptions. To unify referring and grounding in the LLM paradigm, Ferret employs a novel and powerful hybrid region representation that integrates d…
Earlier quoted context omitted.
Running Multimodal LLMs on device and offline, i.e LLMKit for free equaling GPT-3.5 / 4 then Google will follow on Android. Ability to download / update tiny models from Apple and Google as they improve, à la Google Maps. No need for web services like ChatGPT.
So Apple is filling in ChatGPT's moat then, not their own? Pardon my confusion
This is more evidence that Apple is investing in building a MLLM as good as anything OpenAI and Google can build, albeit in a more Apple-y way (privacy-first, licensed content, etc.).
Earlier quoted context omitted.
OpenAI can just copy this.
They cannot integrate it deeply into Apple's platforms.
https://www.reuters.com/technology/chatgpt-owner-openai-is-e...
https://techcrunch.com/2023/09/27/openai-is-reportedly-in-ta...