Comments moved to https://news.ycombinator.com/item?id=44400105.
Apple Research unearthed forgotten AI technique and using it to generate images
41–45 of 45 posts
Re: Apple Research unearthed forgotten AI technique and using it to generate images
#42Earlier quoted context omitted.
The bitter-er lesson is that distillation from bigger models works pretty damn well. It’s great news for the GPU poor, not great for the guys training the models we distill from.
Distillation is great for researchers and hobbyists. But nearly all frontier models have anti-distillation ToS, so distillation is out of question for western commercial companies like Apple.
Even if Apple needs to train an LLM from scratch, they can distill it and deploy on edge devices. From that point, inference is free to them.
Re: Apple Research unearthed forgotten AI technique and using it to generate images
#43This subject is fascinating and the article is informative, but I wish that HN had a button like "flag", but specific for articles that seems written by AI (well at least the section "How STARFlow compares with OpenAI’s 4o image generator" sounds like it)
If you enjoyed the article, why would you want to flag or tag it? For what purpose?
Well maybe this article isn't AI written after all. But the intent was adding an (AI) besides the title.
Re: Apple Research unearthed forgotten AI technique and using it to generate images
#44Earlier quoted context omitted.
somewhat hard to say how the cards fall when the cost of 'intelligence' is coming down 1000x year over year while at the same time compute continues to scale. the bet should be made on both sides probably
10x year over year, not 1000x, right? The 1000x is from this 10x observation having held for 3 years.
I believe the 1000x number I pulled is from SemiAnalysis or similar, using MMLU as the baseline benchmark and the cost per token from a year ago to today at the same score. Model improvements, hardware improvements and software improvements all make a massive difference when combined to make much greater than 10x gains in terms to intelligence/$
Re: Apple Research unearthed forgotten AI technique and using it to generate images
#45Earlier quoted context omitted.
> I find it fascinating that Apple-centric media sites are stretching so much to position the company in the AI race Or, you know, just posting an article based on an Apple's press release about a new technique that falls squarely into their target audience (people reading Apple centric news) and is a great fit to current fashionable technologies (AI) people will show interest in. Without giving a fuck to "position t…
Precisely. Remember how they waited for AR/VR space to settle and then swept the end user market? Or the smash hit Homepods. Or Siri :)
They do have the only VR set that is user friendly enough and has enough ecosystem and apps for mass market. When they put out a future generation with lower prices, they'd get as much as possible.
Let's not forget that the iPod was a Mac only product, when the Mac just had like 3% of the market, with no Windows support and limited sales in the first versions. Or that the iPhone took a few years to dominate the market. Blackberry, Nokia and Microsoft even thought they had a chance for 3-4 years.
I wouldn't be surprised if their VR sales are already above all the other players (perhaps even combined).