I remember how hyped people were seeing the progress from GPT3.5 to GPT4, people really felt like many jobs were going to be replaced very soon. The next big advancement was around the corner. I think the limitations of LLMs should be more salient to them by now.
It's been literally just 3 months since GPT-4 was released. I think you're gonna see a lot of changes especially once GPT starts being trained on ChatGPT data
Many in the AI field think the bigger-is-better approach is running out of road
191–200 of 354 posts
Re: Many in the AI field think the bigger-is-better approach is running out of road
#192Earlier quoted context omitted.
I mean 'better result from less data' is at least a little bit possible. For example you can just clean out obviously bad data from the trillions of tokens data sets. It's things like the subreddit where they are counting to a million or just like long lists of hash values in random cryptocurrency logs. I agree that in the bigger picture this doesn't matter, but it's technically true that cleaning the data in some wa…
Data quality like you're describing just doesn't matter. GPT is trained on PEBIBYTES of data. Any individual reddit thread is an atom in a drop in a bucket. All of reddit is Yes, the correct thing to do is get more data. Much more.
It matters a little bit, in a quantitative but not qualitative way. Probably with good data cleaning you could get as high quality result with only one pebibyte of data if it normally needs two pebibytes. If training time is proportional to dataset size then maybe it takes three months instead of six months to train. Maybe it would save hundreds of millions or a billion dollars which I guess would matter to someone. It probably wouldn't matter qualitatively though.
Re: Many in the AI field think the bigger-is-better approach is running out of road
#193Earlier quoted context omitted.
I’m not convinced the language part of my brain isn’t just a complex probability machine, just with different trade-offs.
I am pretty sure that my understanding of something (or lack of) is not encoded into words and probabilities. It's more like a feeling of "I got this figured out" or "I haven't grasped this". Words seem more like a protocol to express some internal model/state in the brain and can never capture the entire actual state, only a small part of it. But since we're not telepaths, we obviously need to use words to exchange…
You are clearly not consciously noting what your neurons are actually doing.
Re: Many in the AI field think the bigger-is-better approach is running out of road
#194Earlier quoted context omitted.
> paranoid AI risk cultists There is broad consensus among experts that a hypothetical strong AI would be a threat, and potentially an existential threat, to humanity. While not everyone agrees on details like timeline and alignment issues, the idea that AI is dangerous is not a cult, it's the mainstream view. Climate scientists cannot "predict the future" with certainty either. That doesn't mean their warnings are h…
"Expertise" in a speculative concept like AI risk is not remotely comparable to expertise in a scientific field like climate change. There are two definitions of expertise: 1. Knowing more than most people about a topic. This is the type of expertise that wins the Quiz Bowl. 2. Actual mastery of a field, such that predictions and analyses generated by a person possessing such mastery are reliable. This is the type of…
Any prediction of the future is necessarily based on modeling and extrapolation.
Five years ago AIs couldn't pass a third-grade reading comprehension test. Today they pass in the top 10% of law, medical, and engineering exams for human professionals.
It is absolutely possible to extrapolate from such developments, and doing so is scientific, not "Nostradamic". Many predictions of the potential impact of climate change also include speculative elements, such as societal effects, migration patterns, conflicts, etc., which cannot be modeled or forecast with any real certainty. That doesn't make them unscientific.
Re: Many in the AI field think the bigger-is-better approach is running out of road
#195Earlier quoted context omitted.
> paranoid AI risk cultists There is broad consensus among experts that a hypothetical strong AI would be a threat, and potentially an existential threat, to humanity. While not everyone agrees on details like timeline and alignment issues, the idea that AI is dangerous is not a cult, it's the mainstream view. Climate scientists cannot "predict the future" with certainty either. That doesn't mean their warnings are h…
What nonsense. I've spent over a decade 100% focused on AI, and the broad consensus among everyone I've worked with is not to be that concerned at all. The only consensus is that a small group of self proclaimed experts who make a lot of noise is that they get lots of press coverage if they scream and shout making predictions based on zero scientific evidence. We can understand the physics of greenhouse gases and tak…
I also work in AI and I don't mention my concerns to colleagues who are so anti-AI risk as you. Perhaps your ideas about your colleagues' views are distorted.
Re: Many in the AI field think the bigger-is-better approach is running out of road
#196Earlier quoted context omitted.
"Expertise" in a speculative concept like AI risk is not remotely comparable to expertise in a scientific field like climate change. There are two definitions of expertise: 1. Knowing more than most people about a topic. This is the type of expertise that wins the Quiz Bowl. 2. Actual mastery of a field, such that predictions and analyses generated by a person possessing such mastery are reliable. This is the type of…
> Climate change is a real field of science. AI risk is Nostradamic prognostication by people who know more than you. Any prediction of the future is necessarily based on modeling and extrapolation. Five years ago AIs couldn't pass a third-grade reading comprehension test. Today they pass in the top 10% of law, medical, and engineering exams for human professionals. It is absolutely possible to extrapolate from such…
In climate change, we are analyzing historical climate data using weather models representing known physical processes. We try to predict the data using these models, and we are only able to do so if we include the forcing from greenhouse gases. From this we can constrain the range of impacts these gases could be having on temperature and forecast likely futures. The forecasts are heavily informed by a thoroughly validated base of prior knowledge, not just drawing lines through a log log plot.
None of this has any counterparts in AI. We don't understand AI systems to anywhere near the level that physics affords understanding of physical systems. We don't even understand them at a Moore's Law level, where you can at least know what engineering innovations are in the pipeline and how far they could plausibly go. Predicting the sophistication of future AI is just Nostradamic prognostication.
Yann LeCun recently gave a presentation arguing that LLMs are a dead end and proposing a completely different approach. His arguments were extremely heuristic and unconvincing, but this at least shows that both sides have bigwigs with unconvincing heuristic arguments.
Re: Many in the AI field think the bigger-is-better approach is running out of road
#197Re: Many in the AI field think the bigger-is-better approach is running out of road
#198Earlier quoted context omitted.
I’m not convinced the language part of my brain isn’t just a complex probability machine, just with different trade-offs.
I am pretty sure that my understanding of something (or lack of) is not encoded into words and probabilities. It's more like a feeling of "I got this figured out" or "I haven't grasped this". Words seem more like a protocol to express some internal model/state in the brain and can never capture the entire actual state, only a small part of it. But since we're not telepaths, we obviously need to use words to exchange…
It is undeniable that human reasoning is a stochastic process. Otherwise it wouldn't be reasonable for people to make mistakes after learning something. Especially inconsistent mistakes, like when we give people 10,000 addition problems to do in a row it'd be reasonable for them to get a few of them wrong.
Re: Many in the AI field think the bigger-is-better approach is running out of road
#199Earlier quoted context omitted.
> don't actually understand anything (as greater concepts), but rather operate as complex probability machines? But, things are defined by how they interact with the world around them. A concept is its relations to other concepts. Which does seem to be the general sort of thing that these models are trying to get at, even if they don't seem to do a great job of it.
It’s using tokens not concepts. ‘Apple’ the token could apply to a company or fruit, but tokens aren’t concepts. It’s a fairly fundamental limitation on the approach that’s most noticeable while feeding it data it can’t basically copy from it’s vast training data. Thus the sharp drop off where it can for example guess the correct answer to some math problems yet get others that are conceptually identical completely w…