31–38 of 38 posts
Is there somebody not researching faster llm performance?
Is there somebody not researching faster llm performance?
Does Intel qualify? They seem busy making GPUs for midrange insignificant gaming builds, while all their AI offerings are hopeless.
Earlier quoted context omitted.
> Is there somebody not researching faster llm performance? The surprising bit is less about what they're working on and more about the collaboration itself, including the mutual and coordinated co-marketing/PR. Apple and Nvidia haven't had a business relationship in over a decade, ever since Apple stopped using Nvidia GPUs in Macs. This sort of re-engagement and subsequent promotion isn't something that "just happen…
That is exactly what I was going to say. Nvidia has been a big No No inside Apple after they strained there relationship with MacBook Pro recall with Nvidia GPU causing overheating. Apple's heat dissipation were never good in the first place which makes the matter worst. So this isn't just about Faster LLM performance. This could possibly opens up a whole new world for Mac ecosystem with CUDA.
Apple has shipped many successful fanless systems - most recently the MacBook Air.
Apple's metal laptop cases (starting with the titanium PowerBook G4 in 2001) look nice and also help with heat dissipation - though the case itself can heat up. Thankfully shutdowns or burns due to overheating were (and are) rare.
Recently ThinkPads (for example) seem to have more thermal issues, but YMMV.
Earlier quoted context omitted.
How is it insignificant. Intel GPUs are the most exciting thing that has happened in GPUs the last 5-10 years imo.
Only for a small group of people -- i.e. users look for low-mid end gaming. Most people would say H100 is easily more exciting than all released Intel GPUs combined.
I have an idea - how about Apple letting Mac users use Nvidia cards/chips again?
I have an external GPU box that is just there, catching dust... On the plus side I haven't heard a fan for 2 years.
Is there somebody not researching faster llm performance?
Hmm, is faster hallucination better than slower hallucination?
When the answers can be checked by another program and best-of-n results get better with increasing n, yes. I think TDD code development is this, at least in principle.
Earlier quoted context omitted.
When the answers can be checked by another program and best-of-n results get better with increasing n, yes. I think TDD code development is this, at least in principle.
If you can write a program to check results you've already solved the issue.
Some things are easier to verify than to generate.
LLMs can often make a distribution of generated outputs that is much closer to a good answer than other methods.