Live data from Hacker News

GPU-rich labs have won: What's left for the rest of us is distillation

inference.net

51–53 of 53 posts

Re: GPU-rich labs have won: What's left for the rest of us is distillation

#51
post #38

Maybe I'm totally misreading this, but it seems like the post contradicts itself. At the beginning of the third paragraph: > Impressively, open source models have been able to quickly catch up to big labs. And then the beginning of the fourth: > Open-source has been lagging behind proprietary models for years, but lately this gap has been widening. Followed by a picture that is more or less inscrutable.

Hey, I'm the author of the post. The image has been fixed, and the point I'm making is that proprietary models are almost always ahead, and this gap is widening. OS models that are nearly at the same quality are usually distilled versions of proprietary models, or somehow get training data from them. Sometimes, after massive, expensive training runs models are open sourced anyway, and at some point that becomes unsus…

Thanks for clarifying!

I think I'm getting it now: OS models are getting closer, but only via distillation. Not by training a new frontier model which is out of reach for economic reasons.

Re: GPU-rich labs have won: What's left for the rest of us is distillation

#52
post #49

Earlier quoted context omitted.

This fundamentally at odds with picking one tech and saying ‘this is the winner’ eh? Which is what the prior comment was about.

Which prior comment? Top level offers two options plus an 'etc.', second comment adds another and says 'could be', and then first reply to you offers other tech that took decades of R&D to suggest we can't rule out memristors. I don't see what you're referring to.

Uh huh, sure.

Re: GPU-rich labs have won: What's left for the rest of us is distillation

#53
post #52

Earlier quoted context omitted.

Which prior comment? Top level offers two options plus an 'etc.', second comment adds another and says 'could be', and then first reply to you offers other tech that took decades of R&D to suggest we can't rule out memristors. I don't see what you're referring to.

Uh huh, sure.

?
Post reply on HN