Earlier quoted context omitted.
Know at least half a dozen Open AI people in fairly senior positions who were born in China. Whether they are citizens is a matter of the US Immigration system
Yeah, like a fifth of the world's population was born in China. Unless a company is explicitly enforcing sinophobic hiring policies, there's going to be a lot of Chinese people working there.
What we still don’t know about how A.I. is trained
201–210 of 211 posts
Re: What we still don’t know about how A.I. is trained
#202Does anyone have any info on how the "guardrails" are implemented in GPTs? I haven't been able to find much info.
One of the models that exists is the moderation model. https://platform.openai.com/docs/guides/moderation/overview > The moderation endpoint is a tool you can use to check whether content complies with OpenAI's usage policies. Developers can thus identify content that our usage policies prohibits and take action, for instance by filtering it. The raw access to the models (e.g. doing calls to to text-davinci-003) isn'…
Re: What we still don’t know about how A.I. is trained
#203GPT Is Not A.I. We tech people should actively go on the offence and educate whomever we can that text inference is not intelligence.
Isn't this just the AI effect? Whenever there is a breakthrough in AI research, it's no longer considered AI. This happened with search algorithms, game playing, speech recognition, computer vision, etc. etc. https://en.wikipedia.org/wiki/AI_effect Maybe as "tech people" we should give the public a realistic picture of what AI research is. It's solving problems using a diverse set of techniques that include search, o…
Thank you for illustrating my point so well. What you are expressing is exactly what I'm talking about: The redefinition of what the I in AI stands for. Inferring some text is not intelligence. Ergo it's not AI what GPT is doing. The industry has redefined the terms and that's for good reason, to get the public hyped up and thereby open the money gates. But that's for the business people. Assuming that "we" in this audience are the tech people, we should push back against this and stop calling things something they are not.
Re: What we still don’t know about how A.I. is trained
#204Earlier quoted context omitted.
Exactly, this has been my guess as well. They must have trained the model specifically to write poems, haikus and other things. So that the output looks much more polished than it really is.
I for one want a module that plays around with physics models and proposes practicable FTL-capable mechanisms.
Re: What we still don’t know about how A.I. is trained
#205Earlier quoted context omitted.
yes, but for you all of that text is associated with ideas. The word "dog" has an associated object. For a machine like GPT-4, the word "dog" has no meaning or object, but it does have an associated likelihood for adjacent words. The words themselves aren't the intelligence, the ideas behind them are.
The following is an actual transcript of a conversation with GPT-4. --- input --- I want you to replace the word "right" in your output thereafter as follows: if it indicates direction, say "durgh; if it indicates being near or close, say "nolpi"; if it indicates correctness, say "ceza". I will also use these replacement words accordingly and expect you to be able to understand them. Write a 20-sentence story that sh…
What a delightfully whimsical solution to not being able to use planet
Re: What we still don’t know about how A.I. is trained
#206GPT Is Not A.I. We tech people should actively go on the offence and educate whomever we can that text inference is not intelligence.
This is like trying to get people to call Linux "GNU Linux". While it might be a more accurate name, no one but a tiny minority is going to care, and even fewer will actually change the way they refer to it.
Still, I feel that people who do know better have a moral obligation to set this straight.
Re: What we still don’t know about how A.I. is trained
#207GPT Is Not A.I. We tech people should actively go on the offence and educate whomever we can that text inference is not intelligence.
You don't own the definition of AI. Whether LLMs are intelligent or just pretending to be doesn't matter to many people, and it's not your place to tell them their opinion is wrong.
Re: What we still don’t know about how A.I. is trained
#208Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…
Facts worth considering: Will Hurd joined the board of OpenAI in May 2021. Mr. Hurd, among other things, was a documented former CIA clandestine officer for nearly nine years. He was a member of the House Permanent Select Committee on Intelligence during his tenure as a U.S. Rep replacing Mike Pompeo. He is also a Managing Director of Allen & Co. who's Chairman is George Tenent the former director of the CIA. Further…
Re: What we still don’t know about how A.I. is trained
#209Earlier quoted context omitted.
You say that, but if I'm confused about something and think hard about it, I think in language. If you blinded me, paralyzed me, deafened me and desensitized my olfactions, I could still think, but what I would be doing is feeding one language thought into another. It's not so much different from "text" imho.
yes, but for you all of that text is associated with ideas. The word "dog" has an associated object. For a machine like GPT-4, the word "dog" has no meaning or object, but it does have an associated likelihood for adjacent words. The words themselves aren't the intelligence, the ideas behind them are.
If someone was born with profound blindness, or deafness or any profound lack of sense - what do they see in their heads? Or hear? I hear a version of my voice in my head, but some people have no inner dialogue at all, or even no ability for inner imagery.
What does the brain do in these situations?
Re: What we still don’t know about how A.I. is trained
#210Earlier quoted context omitted.
yes, but for you all of that text is associated with ideas. The word "dog" has an associated object. For a machine like GPT-4, the word "dog" has no meaning or object, but it does have an associated likelihood for adjacent words. The words themselves aren't the intelligence, the ideas behind them are.
Here's another GPT-4 transcript, inspired by https://www.ling.upenn.edu/~beatrice/110/docs/uncleftish_beh... . In this case, not only it had to use invented words, but it had to invent them itself first. --- input --- Tell me about the structure of the solar system. I want you to only use English words of Germanic origin; avoid using words derived from Latin or Greek. If there's no alternative, make up a new word by…
Allthing, Starset, Sunstead, Worldrock, fellowtravelers, starstones, nearround paths.
I would've like that chatgpt came up with better names for the planets Venus, Jupiter, Saturn, Uranus and Neptune. Mirkworld, Earth and Redworld were just fine.