Earlier quoted context omitted.
[flagged]
The temp around Elon here is lower than you think. I would say almost the exact opposite of your claim.
Elon is talking out his arse as usual.
Apple's On-Device and Server Foundation Models
241–250 of 562 posts
Re: Apple's On-Device and Server Foundation Models
#242Earlier quoted context omitted.
I don't see anything wrong with that at all. They've created a branding term that allows consumers to get an idea of the sort of pixel density they can expect without having to actually check, should they not want to bother.
Except that everyone has different visual acuity and different distance they use the same devices at, and in the end, "retina" means nothing at all. But this is exactly the type of marketing Apple is good at, though "retina" is probably not the most successful example.
If your "visual acuity" is so good that you can see the pixels of a retina-branded display from the intended viewing distance, you might need to be studied for science.
Re: Apple's On-Device and Server Foundation Models
#243Earlier quoted context omitted.
Was there anything about searching through our own photos using prompts? I thought this could be pretty amazing and still a natural way to find very specific photos in one’s own photo gallery.
Which is in turn just multimodal embedding Besides I could do "named person on a beach in August" and get the correct thing in photos on Android photos, so I don't get it. It's amazing for apple users if they didn't have it before. But from a tech stand point people could have had it for a while.
The difference is that Apple has been doing this on-device for maybe 4-5 years already with the Neural Engine. Every iOS version has brought more stuff you can search for.
The current addition is "just" about adding a natural language interface on top of data they already have about your photos (on device, not in the cloud).
My iPhone 14 can, for example, detect the breed of my dog correctly from the pictures and it can search for a specific pet by name. Again on-device, not by sending my stuff to Google's cloud to be analysed.
Re: Apple's On-Device and Server Foundation Models
#244For people interested in AI research, there's nothing new here. IMO they should do a better job of referencing existing papers and techniques. The way they wrote about "adaptors" can make it seem like it's something novel, but it's actually just re-iterating vanilla LoRA. It was enough to convince one of the top-voted HackerNews comments that this was a "huge development". Benchmarks are nice though.
Was there anything about searching through our own photos using prompts? I thought this could be pretty amazing and still a natural way to find very specific photos in one’s own photo gallery.
Run OpenAI's CLIP model on iOS to search photos.
https://github.com/mazzzystar/Queryable
Re: Apple's On-Device and Server Foundation Models
#245“We utilize adapters, small neural network modules that can be plugged into various layers of the pre-trained model, to fine-tune our models for specific tasks.” This is huuuuge. I don’t see announcement of 3rd party training support yet, but I imagine/hope it’s planned. One of the hard things about local+private ML is I don’t want every app I download to need GBs of weights, and don’t want a delay when I open a new…
This is how Google is doing it too.
Indeed. Google said LoRA and apple said adapter plugging. Wonder the difference is at, Apple's dev conference is for consumers and Google's dev conference is for developers.
Re: Apple's On-Device and Server Foundation Models
#246For people interested in AI research, there's nothing new here. IMO they should do a better job of referencing existing papers and techniques. The way they wrote about "adaptors" can make it seem like it's something novel, but it's actually just re-iterating vanilla LoRA. It was enough to convince one of the top-voted HackerNews comments that this was a "huge development". Benchmarks are nice though.
> For people interested in AI research, there's nothing new here. Was anyone expecting anything new? Apple has never been big on living at the cutting edge of technology exploring spaces that no one has explored before—from laptops to the iPhone to iPads to watches, every success they've had has come from taking tech that was already prototyped by many other companies and smoothing out the usability kinks to get it r…
Apple was first with 64 bit iPhone chips. Remember Qualcomm VP at the time claimed it was nothing. Apple Silicon for M1 was impressive for instant in low power high performance.
Re: Apple's On-Device and Server Foundation Models
#247> Our foundation models are trained on Apple's AXLearn framework, an open-source project we released in 2023. It builds on top of JAX and XLA, and allows us to train the models with high efficiency and scalability on various training hardware and cloud platforms, including TPUs and both cloud and on-premise GPUs. Interesting that they’re using TPUs for training, in addition to GPUs. Is it both a technical decision (J…
"Use the best tool available"
Re: Apple's On-Device and Server Foundation Models
#248Earlier quoted context omitted.
I think it's even simpler than that: incentives. The entire premise of copyright law (and all IP law) is to protect the incentive to create new stuff, which is often a very risky and highly time or capital intensive endeavor. So here's the question: Does a person reading a comment destroy the incentive for the author to post it? No. In fact, it is the only thing that produces the incentive for someone to post. People…
Thanks, this is a helpful comment. It isn’t clear to me that these models destroy incentive to create. I mean, ChatGPT can generate comments in my style all day, and yet I’m still incentivized to comment. I fancy myself a photographer. I still want to take photos even if DALL-E 4 will generate better ones. What even is the point of creating art? I think there are two purposes: personal expression and enjoyment for ot…
> I think there are two purposes: personal expression and enjoyment for others.
This is exactly what non-artists assume artists do art for.
The reality is that most professional visual artists work in publishing, marketing, entertainment and the like. It’s a regular job. The incentive is money. Similarly for theatre, music, video, dance, etc etc. Artists can’t feed their families off exposure and expressing themselves. Their work has value and taking that work to create free derivative works without compensating them is theft.
Re: Apple's On-Device and Server Foundation Models
#249For people interested in AI research, there's nothing new here. IMO they should do a better job of referencing existing papers and techniques. The way they wrote about "adaptors" can make it seem like it's something novel, but it's actually just re-iterating vanilla LoRA. It was enough to convince one of the top-voted HackerNews comments that this was a "huge development". Benchmarks are nice though.
I thought the news of them using Apple Silicon rather than NVIDIA in their data centers was significant. Perhaps there is still hope of a relaunch of xserve; with the widespread use of Apple computers amongst developers Apple has a real chance of challenging NVIDIA's CUDA moat.
Not at Apple's price points.
Re: Apple's On-Device and Server Foundation Models
#250Earlier quoted context omitted.
It's a huge development in terms of it being a consumer-ready, on-device LLM. And if Karpathy thinks so then I assume it's good enough for HN: https://x.com/karpathy/status/1800242310116262150
[flagged]
He is factually wrong and has been rekted by his own community notes