Earlier quoted context omitted.
If you spent any time with GPT-4 it should be evident.
Compare gpt-4 with a baby and you'll see that predicting the next word in sequence is not human intelligence
As a remote worker, that's 99% of what I do.
Language models can explain neurons in language models
331–340 of 497 posts
Re: Language models can explain neurons in language models
#332Earlier quoted context omitted.
In what way a civilization?
I'll repost a comment via Reddit that I think makes this case [0]: Ants have developed architecture, with plumbing, ventilation, nurseries for rearing the young, and paved thoroughfares. Ants practice agriculture, including animal husbandry. Ants have social stratification that differs from but is comparable to that of human cultures, with division of labor into worker, soldier, and other specialties that do not have…
Do termites count as well then? Bees? I'm not being facetious, but these insects seem similar.
Re: Language models can explain neurons in language models
#333Of note: "... our technique works poorly for larger models, possibly because later layers are harder to explain." And even for GPT-2, which is what they used for the paper: "... the vast majority of our explanations score poorly ..." Which is to say, we still have no clue as to what's going on inside GPT-4 or even GPT-3, which I think is the question many want an answer to. This may be the first step towards that, bu…
Funny that we never quite understood how intelligence worked and yet it appears that we're pretty damn close to recreating it - still without knowing how it works. I wonder how often this happens in the universe...
The battery (Voltaic Pile, 1800) and the telegraph (1830s-1840s) were both invented before the electron was discovered (1897).
Re: Language models can explain neurons in language models
#334Earlier quoted context omitted.
Its vast limitations in anything reasoning-based are indeed evident.
GPT-4 is better at reasoning than 90% of humans. At least. I won't be surprised if GPT-5 is better than 100% of humans. I'm saying this in complete seriousness.
> GPT-4 is better at reasoning than 90% of humans. At least.
This makes as much sense as me asserting a binary search can tell one why they are looking for what they want.
That is to say, it cannot.
Re: Language models can explain neurons in language models
#335Earlier quoted context omitted.
If you think it's better than you at reasoning then you cannot at all be confident in the truth of it's dialog.
I am not. I treat it as I'd treat any smart human being.
LLM's are not a "smart human being." They are predictive statistical models capable of producing results based on training data.
LLM's do not think.
LLM's are algorithms.
Re: Language models can explain neurons in language models
#336Earlier quoted context omitted.
Yes. I can parse them just fine after reading a single book called Introduction to Legal Reasoning [1]. I can also autonomously take notes and keep track of a large context using a combination of short and long term memory despite not having any kind of degree let alone experience or a license to practice law. How do you think people become lawyers and how smart do you think the average lawyer actually is? The proble…
Did you try fine tuning gpt4 with that book as input?
OpenAI doesn't support fine tuning of GPT4 and with context stuffing,the more of the book I include in the input the less of the bills I can include - which, again, are millions of tokens - and the less space there is for memory.
Re: Language models can explain neurons in language models
#337Re: Language models can explain neurons in language models
#338Re: Language models can explain neurons in language models
#339Earlier quoted context omitted.
You're not sure that having an AI which is (at least) as intelligent as an average human is something to brag about? Seriously?
Where did you get that the LLM was as _intelligent_ as a human? All we've shown is that LLMs are as useful for parsing legal text as the average human. Which is to say, not. A dog is also as useful for parsing legal texts as the average human. So is a rock.
Where did you get that the LLM was as _intelligent_ as a human?
First hand experience -I’ve been using it daily for the past two months.
Re: Language models can explain neurons in language models
#340Earlier quoted context omitted.
Its vast limitations in anything reasoning-based are indeed evident.
GPT-4 is better at reasoning than 90% of humans. At least. I won't be surprised if GPT-5 is better than 100% of humans. I'm saying this in complete seriousness.
>GPT-4 is better at reasoning than 90% of humans.
Even for obviously nonsens that 90% of humans would recognice as such.