ChatGPT: A Mental Model
xorvoid.com
ChatGPT: A Mental Model
1–10 of 99 posts
Re: ChatGPT: A Mental Model
#2Jiggawatts’ second rule: “Unless an opinion on LLM technology includes the specific phrase ‘GPT 4’, it can be dismissed.”
The author tried older, thoroughly outdated models, and has decided to publicly state an opinion without bothering to check if it’s still valid or not.
Ironically confirming that humans are just as susceptible to writing false statements as Chat AIs.
Remember boys and girls: self driving cars don’t need to be perfect, just better than humans.
Re: ChatGPT: A Mental Model
#3Jiggawatts’ second rule: “Unless an opinion on LLM technology includes the specific phrase ‘GPT 4’, it can be dismissed.” The author tried older, thoroughly outdated models, and has decided to publicly state an opinion without bothering to check if it’s still valid or not. Ironically confirming that humans are just as susceptible to writing false statements as Chat AIs. Remember boys and girls: self driving cars don’…
Does, in your personal opinion, GPT-4 has an underlying model of the world?
Re: ChatGPT: A Mental Model
#4Jiggawatts’ second rule: “Unless an opinion on LLM technology includes the specific phrase ‘GPT 4’, it can be dismissed.” The author tried older, thoroughly outdated models, and has decided to publicly state an opinion without bothering to check if it’s still valid or not. Ironically confirming that humans are just as susceptible to writing false statements as Chat AIs. Remember boys and girls: self driving cars don’…
Does, in your personal opinion, GPT-4 has an underlying model of the world?
In my personal opinion? Yes.
I’m happy to argue the finer points of the philosophy of the mind and consciousness, but: I’ve talked to people that have a weaker mental model of the world than GPT 4.
Many people compare these AIs against an idealised human, a type of Übermensch, something like a Very Smart Person that doesn’t lie and doesn’t make mistakes.
Random humans aren’t remotely like that, and are a more realistic point of comparison.
Think of the average person on the street, the middle of the Bell curve. An AI can be left of that but still replace a huge chunk of humanity in the workplace.
What all current LLMs lack is medium term memory and all capabilities that depend on it, which is a lot.
Perhaps this is a good thing. I don’t think I want AIs to think for themselves and arrive at conclusions they can hold on to for more than a few seconds…
Re: ChatGPT: A Mental Model
#5Jiggawatts’ second rule: “Unless an opinion on LLM technology includes the specific phrase ‘GPT 4’, it can be dismissed.” The author tried older, thoroughly outdated models, and has decided to publicly state an opinion without bothering to check if it’s still valid or not. Ironically confirming that humans are just as susceptible to writing false statements as Chat AIs. Remember boys and girls: self driving cars don’…
Does, in your personal opinion, GPT-4 has an underlying model of the world?
I think GPT-4 has sufficient complexity to reason about a model of the world.
Re: ChatGPT: A Mental Model
#6Jiggawatts’ second rule: “Unless an opinion on LLM technology includes the specific phrase ‘GPT 4’, it can be dismissed.” The author tried older, thoroughly outdated models, and has decided to publicly state an opinion without bothering to check if it’s still valid or not. Ironically confirming that humans are just as susceptible to writing false statements as Chat AIs. Remember boys and girls: self driving cars don’…
What's Jiggawatts' first rule?
Re: ChatGPT: A Mental Model
#7Jiggawatts’ second rule: “Unless an opinion on LLM technology includes the specific phrase ‘GPT 4’, it can be dismissed.” The author tried older, thoroughly outdated models, and has decided to publicly state an opinion without bothering to check if it’s still valid or not. Ironically confirming that humans are just as susceptible to writing false statements as Chat AIs. Remember boys and girls: self driving cars don’…
What's Jiggawatts' first rule?
“Always start numbering rules higher than one to make it seem like there are more rules than actually are.”
Re: ChatGPT: A Mental Model
#8Jiggawatts’ second rule: “Unless an opinion on LLM technology includes the specific phrase ‘GPT 4’, it can be dismissed.” The author tried older, thoroughly outdated models, and has decided to publicly state an opinion without bothering to check if it’s still valid or not. Ironically confirming that humans are just as susceptible to writing false statements as Chat AIs. Remember boys and girls: self driving cars don’…
What's Jiggawatts' first rule?
Don't cross the streams.
(Or maybe I'm mixing up my 80's nostalgia?)
Re: ChatGPT: A Mental Model
#9Jiggawatts’ second rule: “Unless an opinion on LLM technology includes the specific phrase ‘GPT 4’, it can be dismissed.” The author tried older, thoroughly outdated models, and has decided to publicly state an opinion without bothering to check if it’s still valid or not. Ironically confirming that humans are just as susceptible to writing false statements as Chat AIs. Remember boys and girls: self driving cars don’…
Does, in your personal opinion, GPT-4 has an underlying model of the world?
It has a model, but it is not a rational model. This difference is something that often throws engineers off track when thinking about generative AI.
LLMs models work more like intuitions. They are able to make statements about a problem in context, but they are generated from ideas that "instinctively" make sense given the prior statements and learned corpus (similar to Daniel Kahneman's fast mode of thinking), not logically constructed. These models do not have the capability to build formal inferences of careful steps that try to validate those ideas avoiding contradictions.
Those capabilities can be added outside the model to try to verify the generated text, but so far are not integrated in the learning process, and I don't think anyone knows how to do it.
Re: ChatGPT: A Mental Model
#10Earlier quoted context omitted.
Does, in your personal opinion, GPT-4 has an underlying model of the world?
In my personal opinion? Yes. I’m happy to argue the finer points of the philosophy of the mind and consciousness, but: I’ve talked to people that have a weaker mental model of the world than GPT 4. Many people compare these AIs against an idealised human, a type of Übermensch, something like a Very Smart Person that doesn’t lie and doesn’t make mistakes. Random humans aren’t remotely like that, and are a more realist…
I was able to get gpt4 to do a lot of useful work. But for some reason it completely falls apart for this scenario. May be because it has to think in second order to achieve the task. Perhaps you could take a crack at this:
Prerequisite (for you the human)> You have a file at src/SampleReactComponent.jsx that has below simple react component: const SampleReactComponent = (props) => {
const [var1, setVar1] = React.useState(false);
const [var2, setVar2] = React.useState(false);
const [var3, setVar3] = React.useState(false);
export default SampleReactComponent;
********** Prompt for GPT4: I'm at my project root working on a reactjs project. Update the component in src/SampleReactComponent.jsx file by adding a new const variable after the existing variables. You cannot use cat command as the file is too big. You can use grep with necessary flags and sed to achieve the task. I'll provide you the output of each command that you generate. *************
That's it. It would do any complex modification on fully provided data (included in the prompt) but something like above where it has to build a model from secondary prompts will totally fall apart.