251–260 of 1001 posts
Earlier quoted context omitted.
I've been messing around with base (not instruction tuned) LLMs; they often evade AI detectors and I wouldn't be surprised if they evade this kind of detection too, at least with a high temperature
> with a high temperature More like: with the right prompting
Earlier quoted context omitted.
But if the scaling law holds true, more dollars should at some point translate into AGI, which is priceless. We haven't reached the limits yet of that hypothesis.
a) There is evidence e.g. private data deals that we are starting to hit the limitations of what data is available. b) There is no evidence that LLMs are the roadmap to AGI. c) Continued investment hinges on their being a large enough cohort of startups that can leverage LLMs to generate outsized returns. There is no evidence yet this is the case.
Earlier quoted context omitted.
It’s somehow funny to hear a British company being described as ‘in Europe’, but I suppose you’re technically correct…
https://en.wikipedia.org/wiki/O2_(brand) - "O2 (typeset as O2) is a global brand name owned by the Spanish telecommunications company Telefónica"
Behind schedule? It never fucking ships. Two months ago, and four, and six I got dog piled for saying it doesn’t ship. It doesn’t ship. You guys can’t do it! Prove me wrong! https://news.ycombinator.com/item?id=42014054
In any case, the "behind schedule" rumors are themselves based on other rumors. GPT-2→GPT-3 took 5 quarters, GPT-3→GPT-4 took 11 quarters, so obviously GPT-5 (or its equivalent) will be released in Q4'2025.
Behind schedule? It never fucking ships. Two months ago, and four, and six I got dog piled for saying it doesn’t ship. It doesn’t ship. You guys can’t do it! Prove me wrong! https://news.ycombinator.com/item?id=42014054
One fundamental challenge to me is that if each training run because more and more expensive, the time it takes it to learn what works/doesn't work widens. Half a billion dollars for training a model is already nuts, but if it takes 100 iterations to perfect it, you've cumulatively spent 50 billion dollars... Smaller models may actually be where rapid innovation continues simply because of tighter feedback loops. O3…
AGI is the Sisyphean task of our age. We’ll push this boulder up the mountain because we have to, even if it kills us.
One fundamental challenge to me is that if each training run because more and more expensive, the time it takes it to learn what works/doesn't work widens. Half a billion dollars for training a model is already nuts, but if it takes 100 iterations to perfect it, you've cumulatively spent 50 billion dollars... Smaller models may actually be where rapid innovation continues simply because of tighter feedback loops. O3…
AGI is the Sisyphean task of our age. We’ll push this boulder up the mountain because we have to, even if it kills us.
Earlier quoted context omitted.
a) There is evidence e.g. private data deals that we are starting to hit the limitations of what data is available. b) There is no evidence that LLMs are the roadmap to AGI. c) Continued investment hinges on their being a large enough cohort of startups that can leverage LLMs to generate outsized returns. There is no evidence yet this is the case.
"There is no evidence that LLMs are the roadmap to AGI." - There's plenty of evidence. What do you think the last few years have been all about? Hell, GPT-4 would already have qualified as AGI about a decade ago.
Earlier quoted context omitted.
Technically…? Does anyone here believe that the EU and Europe is the same thing? Would you find it weird if someone said that a Norwegian company was in Europe?
Many people certainly seem to! And it annoys me. I wasn’t talking about the EU, though. I was just commenting on the fact that in the UK, ‘Europe’ generally means ‘continental Europe’. > Would you find it weird if someone said that a Norwegian company was in Europe? I’d find it weird if a European did. But from Americans it’s to be expected.
Earlier quoted context omitted.
a) There is evidence e.g. private data deals that we are starting to hit the limitations of what data is available. b) There is no evidence that LLMs are the roadmap to AGI. c) Continued investment hinges on their being a large enough cohort of startups that can leverage LLMs to generate outsized returns. There is no evidence yet this is the case.
"There is no evidence that LLMs are the roadmap to AGI." - There's plenty of evidence. What do you think the last few years have been all about? Hell, GPT-4 would already have qualified as AGI about a decade ago.