I've noticed that many of the large, separately developed AIs often answer with remarkably similar wording to the same question.
I'm not exactly surprised that "separately developed" AI that hinge on essentially the same core techniques and are fed largely identical corpus often answer with remarkably similar wording to the same question.
All AI models might be the same
151–157 of 157 posts
Re: All AI models might be the same
#152Earlier quoted context omitted.
Other animals have vocabulary. Anybody with a pet can easily understand that lots of animals can associate words with objects and actions, and Koko and Alex and all the other examples of talking animals demonstrate that animals can communicate their own wants with words. The thing that makes humans nearly unique in the animal kingdom is structured language. I don't need separate words for "leopard in the bush", "snak…
> The thing that makes humans nearly unique in the animal kingdom is structured language. But what is “structured language”? I would argue it’s just another layer of naming—naming applied to already named names. If animals have the ability to map leopard, snake, bush, tree in reality to names in their naming system, then why can’t they apply that ability again—create a new name like ‘leopard-bush’ or ‘snake-leopard’,…
The main difference seems to be in having sentences structured into verbs and their associated nouns (which may encode various roles, e.g. patients, agents, instruments, beneficiaries, subjects of intransitive or copulative verbs, nominal predicates, results etc.).
As far as we could determine until now, the language of most animals consists only of a set of nouns, which typically have an associated implicit action.
For example:
"Lion!" (meaning "Climb up the tree!");
"Eagle!" (meaning "Take cover under branches!");
"Children!" (meaning "Come here, to mother!");
"Bananas!" (meaning "Come here to eat good food!");
and so on.
Some apes have been trained to compose very simple sentences, as complex as agent-verb-patient, but it is not known whether a similar form of communication exists between wild apes.
Re: All AI models might be the same
#153Earlier quoted context omitted.
You are describing the state of LLMs from 2 years ago. Which basically means they were just pre-trained on the internet and then fine tuned to follow a particular instruction format. Current models still use this as a first step, but are then trained a lot using reinforcement learning, which has given them much better skills at reasoning and logic than human tainted data ever could. See how Grok 4 for example still e…
You have some sort of very confused idea of what reinforcement learning is. (Which is probably why you're being downvoted.)
Re: All AI models might be the same
#154The example given for inverting an embedding back to text doesn't help the idea that this effect is reflecting some "shared statistical model of reality": What would be the plausible whalesong mapping of "Mage (foaled April 18, 2020) is an American Thoroughbred racehorse who won the 2023 Kentucky Derby"? There isn't anything core to reality about Kentucky, its Derby, the Gregorian calendar, America, horse breeds, etc…
I fail to see how that matters. You're implying that all reality is cultural, but that seems irrelevant. The same thing would apply to scientific facts, but whales not having a word for science doesn't make it not real. If we somehow discover LLMs right after Newton discovered the theory of gravity, and then a while later Einstein discovers General Relativity, then GR would not be in the training set of the neural ne…
When you layer the concept of awareness into the mix it does alter reality for an individual or llm. Awareness creates interesting blind spots into our statistical models of reality.
Re: All AI models might be the same
#155Earlier quoted context omitted.
I don't know about a Lion, but I think Wittgenstein could have benefited from having a pet. I train my cat and while I can't always understand her I think one of the most impressive features of the human mind is to be able to have such great understanding of others. We have theory of mind, joint attention, triadic awareness, and much more. My cat can understand me a bit but it's definitely asymmetric. It's definitely…
I'm much better at understanding my cat than my girlfriend Huh. Apparently attention isn't all we need in order to parse that sentence.
Also, your comment still made me laugh. Women can be mysterious...
Re: All AI models might be the same
#156Earlier quoted context omitted.
That was a philosophical position on the difficulty of understanding alien concepts and language, not a hard technological limit.
I'm missing why that distinction matters given the thread of conversation. Would you care to expound?
- the % of shared experience/context with a mammal is > than % shared experience with a mollusk
- the gradient starts in communicating with other humans
and that Wittgenstein wasn't wrong in trying to use technology/science to bridge the context gap, he was just early.
Re: All AI models might be the same
#157Earlier quoted context omitted.
I'm just curious if that was Grok 4 or 3
3! So it’s not a fair comparison. The other two were both paid. I am very curious to run real world engineering problems through SuperHeavy.