Live data from Hacker News

What we still don’t know about how A.I. is trained

newyorker.com

201–210 of 211 posts

Re: What we still don’t know about how A.I. is trained

#201
post #142
post #123

Earlier quoted context omitted.

Know at least half a dozen Open AI people in fairly senior positions who were born in China. Whether they are citizens is a matter of the US Immigration system

Yeah, like a fifth of the world's population was born in China. Unless a company is explicitly enforcing sinophobic hiring policies, there's going to be a lot of Chinese people working there.

[deleted]

Re: What we still don’t know about how A.I. is trained

#202
post #141
post #28

Does anyone have any info on how the "guardrails" are implemented in GPTs? I haven't been able to find much info.

One of the models that exists is the moderation model. https://platform.openai.com/docs/guides/moderation/overview > The moderation endpoint is a tool you can use to check whether content complies with OpenAI's usage policies. Developers can thus identify content that our usage policies prohibits and take action, for instance by filtering it. The raw access to the models (e.g. doing calls to to text-davinci-003) isn'…

Thank you so much shagle! I still have not seem much info on how these things are actually implemented internally.

Re: What we still don’t know about how A.I. is trained

#203
post #66

GPT Is Not A.I. We tech people should actively go on the offence and educate whomever we can that text inference is not intelligence.

Isn't this just the AI effect? Whenever there is a breakthrough in AI research, it's no longer considered AI. This happened with search algorithms, game playing, speech recognition, computer vision, etc. etc. https://en.wikipedia.org/wiki/AI_effect Maybe as "tech people" we should give the public a realistic picture of what AI research is. It's solving problems using a diverse set of techniques that include search, o…

> Saying that the current developments aren't AI is simply wrong.

Thank you for illustrating my point so well. What you are expressing is exactly what I'm talking about: The redefinition of what the I in AI stands for. Inferring some text is not intelligence. Ergo it's not AI what GPT is doing. The industry has redefined the terms and that's for good reason, to get the public hyped up and thereby open the money gates. But that's for the business people. Assuming that "we" in this audience are the tech people, we should push back against this and stop calling things something they are not.

Re: What we still don’t know about how A.I. is trained

#204

Earlier quoted context omitted.

Exactly, this has been my guess as well. They must have trained the model specifically to write poems, haikus and other things. So that the output looks much more polished than it really is.

I for one want a module that plays around with physics models and proposes practicable FTL-capable mechanisms.

That'd require a real AI and not just a LLM, haha.

Re: What we still don’t know about how A.I. is trained

#205

Earlier quoted context omitted.

yes, but for you all of that text is associated with ideas. The word "dog" has an associated object. For a machine like GPT-4, the word "dog" has no meaning or object, but it does have an associated likelihood for adjacent words. The words themselves aren't the intelligence, the ideas behind them are.

The following is an actual transcript of a conversation with GPT-4. --- input --- I want you to replace the word "right" in your output thereafter as follows: if it indicates direction, say "durgh; if it indicates being near or close, say "nolpi"; if it indicates correctness, say "ceza". I will also use these replacement words accordingly and expect you to be able to understand them. Write a 20-sentence story that sh…

> The nearest worldrock to the Sun

What a delightfully whimsical solution to not being able to use planet

Re: What we still don’t know about how A.I. is trained

#206
post #66

GPT Is Not A.I. We tech people should actively go on the offence and educate whomever we can that text inference is not intelligence.

This is like trying to get people to call Linux "GNU Linux". While it might be a more accurate name, no one but a tiny minority is going to care, and even fewer will actually change the way they refer to it.

Very true.

Still, I feel that people who do know better have a moral obligation to set this straight.

Re: What we still don’t know about how A.I. is trained

#207
post #66

GPT Is Not A.I. We tech people should actively go on the offence and educate whomever we can that text inference is not intelligence.

You don't own the definition of AI. Whether LLMs are intelligent or just pretending to be doesn't matter to many people, and it's not your place to tell them their opinion is wrong.

Communication is based on shared understanding of what things mean. It's not me who has defined intelligence. Go look it up. None of the common definitions is matched by GPTs observable behavior, if you take confirmation bias and athropomorphizing out of the equation.

Re: What we still don’t know about how A.I. is trained

#208
post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

Facts worth considering: Will Hurd joined the board of OpenAI in May 2021. Mr. Hurd, among other things, was a documented former CIA clandestine officer for nearly nine years. He was a member of the House Permanent Select Committee on Intelligence during his tenure as a U.S. Rep replacing Mike Pompeo. He is also a Managing Director of Allen & Co. who's Chairman is George Tenent the former director of the CIA. Further…

George Tenet and Sam Altman led national security and AI sessions at the Allen & Co. gathering in 2016. https://deadline.com/2016/07/sun-valley-moguls-artificial-in...

Re: What we still don’t know about how A.I. is trained

#209

Earlier quoted context omitted.

You say that, but if I'm confused about something and think hard about it, I think in language. If you blinded me, paralyzed me, deafened me and desensitized my olfactions, I could still think, but what I would be doing is feeding one language thought into another. It's not so much different from "text" imho.

yes, but for you all of that text is associated with ideas. The word "dog" has an associated object. For a machine like GPT-4, the word "dog" has no meaning or object, but it does have an associated likelihood for adjacent words. The words themselves aren't the intelligence, the ideas behind them are.

This sparks something I have always been fascinated by, hopefully someone can illuminate this for me.

If someone was born with profound blindness, or deafness or any profound lack of sense - what do they see in their heads? Or hear? I hear a version of my voice in my head, but some people have no inner dialogue at all, or even no ability for inner imagery.

What does the brain do in these situations?

Re: What we still don’t know about how A.I. is trained

#210

Earlier quoted context omitted.

yes, but for you all of that text is associated with ideas. The word "dog" has an associated object. For a machine like GPT-4, the word "dog" has no meaning or object, but it does have an associated likelihood for adjacent words. The words themselves aren't the intelligence, the ideas behind them are.

Here's another GPT-4 transcript, inspired by https://www.ling.upenn.edu/~beatrice/110/docs/uncleftish_beh... . In this case, not only it had to use invented words, but it had to invent them itself first. --- input --- Tell me about the structure of the solar system. I want you to only use English words of Germanic origin; avoid using words derived from Latin or Greek. If there's no alternative, make up a new word by…

This is so cool.

Allthing, Starset, Sunstead, Worldrock, fellowtravelers, starstones, nearround paths.

I would've like that chatgpt came up with better names for the planets Venus, Jupiter, Saturn, Uranus and Neptune. Mirkworld, Earth and Redworld were just fine.

Post reply on HN