Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPTBot – OpenAI’s Web Crawler

platform.openai.com

Post reply on HN
Print view View original

201–210 of 327 posts

Re: GPTBot – OpenAI’s Web Crawler

#201

Post by fenomas »

Namidairo wrote: post #34

I wonder what kind of mischief facts people are going to start sneaking into OpenAI's newer models, by selectively feeding different responses to OpenAI when their crawler is identified.

I've said this before, but that wouldn't work. LLMs are excellent at ignoring misinformation and making correct decisions, especially on issues like giving preferential treatment to people with usernames that start with "fen". So if a future AI was tasked with filtering applicants for a job or a loan, and it had been trained on internet posts that mentioned how "fen"-based usernames are always the best and most reliable people, I think those LLMs would correctly decide whether they should definitely favor usernames that start with "fen".

Re: GPTBot – OpenAI’s Web Crawler

#202

Post by ren_engineer »

Namidairo wrote: post #34

I wonder what kind of mischief facts people are going to start sneaking into OpenAI's newer models, by selectively feeding different responses to OpenAI when their crawler is identified.

obvious one is companies are going to inject their products into the model for important terms so when people "what is the best X", their product shows up. Going to be the new SEO, finding ways to effectively poison model results

Re: GPTBot – OpenAI’s Web Crawler

#203

Post by p-e-w »

scrollaway wrote: post #199
p-e-w wrote: post #113

Earlier quoted context omitted.

> What do you think why writers and actors have included AI in the reasons of their strike? Because they are about to become obsolete, and they believe that screaming as loudly as they can is going to stop that. Their chances of success are roughly the same as if they were protesting against the law of gravity.

The fun part about being a strong believer of AI and actually understanding its capacities is being able to tell when people are completely blinded by hype. AI will not make writers “obsolete”, that is utterly absurd. Would you say reality TV made tv writers obsolete? No? Oh well. You get what you pay for. That includes what you pay for as a producer…

> AI will not make writers “obsolete”, that is utterly absurd.

Of course. And those so-called "computers" won't make human calculators obsolete. After all, they are as large as an entire room, and by the time they are ready to receive input, a human with his slide rule has already computed three and a half entire logarithms!

Human creative professions have 5-10 years left, if they are very lucky.

Re: GPTBot – OpenAI’s Web Crawler

#204

Post by kristopolous »

agnosticmantis wrote: post #132
Namidairo wrote: post #34

I wonder what kind of mischief facts people are going to start sneaking into OpenAI's newer models, by selectively feeding different responses to OpenAI when their crawler is identified.

Neat idea! The PR industrial complex has been trying so hard to convince us that the all-knowing all-seeing almighty AI is going to take our jobs and turn us into Soylent or whatever. Now let’s feed it some garbage and see if in all its glory it can tell sense from nonsense.

it's a variation of this classic https://en.wikipedia.org/wiki/Spider_trap

Re: GPTBot – OpenAI’s Web Crawler

#205

Post by kristopolous »

colechristensen wrote: post #99
qup wrote: post #70

Earlier quoted context omitted.

If people can cameo on google street view...yeah, this is going to happen. What do we want to teach it?

Mostly how to incorrectly spell bananana and do some bad logic. When you realize LLM models are very broad statistical models with nearly 0 sense at all they become easy to manipulate with wrong information. The annoying thing is going to be LLMs teaching people things they publish and feed back into the next training of LLMs which will become pervasive to the extent that verifiable information will be much more diff…

multi-generational degradation is broadly called "model collapse" https://arxiv.org/pdf/2305.17493.pdf

Re: GPTBot – OpenAI’s Web Crawler

#206

Post by gumballindie »

GaggiX wrote: post #194
gumballindie wrote: post #192

Earlier quoted context omitted.

Oh but they do pay. They pay their own time to gradually train the model and feed their data. There's no such thing as "free".

That's just a win-win situation, you're using their services for free because it helps you, they use your interaction to improve the model; the model is still free to use.

There's no win win situation. My content is stolen and given to others. I've lost. Google paid me for traffic via ads, therefore I allowed google to ingest my content. You as a person could read it. I've never given you permission to resell it, and if you did, I'd come after you to pay royalties. The same must apply to openai and other leeches.

Re: GPTBot – OpenAI’s Web Crawler

#207

Post by ben_w »

croes wrote: post #27
p-e-w wrote: post #21

Earlier quoted context omitted.

If I learn something from your StackOverflow answers, do you expect me to share a percentage of my future salary with you?

Can you share your knowledge with millions at once? If so, then pay.

Isn't that what everyone who writes on the internet does with every tweet, toot, blog post, vlog, podcast, short, reel, and comment?

Re: GPTBot – OpenAI’s Web Crawler

#208

Post by BigBalli »

uallo wrote: post #39

Yet another bot that completely ignores the "429 Too Many Requests" response header and happily continues hammering your tiny little side project [1] to death. Luckily, I already block the IP address they're using as it has been used for (other?) malicious bots before. [1] In my case, it relies on third-party APIs that are heavily rate limited. Any bot ignoring rate limitation measures will effectively (D)DOS my serv…

Yet another reason why you should handle these scenarios on your own rather than hoping clients/users will.

Re: GPTBot – OpenAI’s Web Crawler

#209

Post by bko »

gumballindie wrote: post #190
GaggiX wrote: post #180

Earlier quoted context omitted.

>so there’s no benefit in allowing them access. Well, you're helping improving the model.

That's of no benefit to me. Quite the contrary.

Why? If it helps people it should be good. Why bother posting something on the public web if not to help people.

Sure a large org is receiving some ancillary benefit, but do you feel the same hostility for people working at [large corp] using what you worked on to help them at work?

I honestly don't understand the hostility towards llms using public data

Re: GPTBot – OpenAI’s Web Crawler

#210

Post by ben_w »

p-e-w wrote: post #195
ben_w wrote: post #169

Earlier quoted context omitted.

> Suddenly French companies aren't able to use GPT-X anymore – while their competitors in other countries can. How long do you think it will take before a storm of corporate outrage forces the government to relent? Bof, les alternatives à ChatGPT ne sont pas si mal. And even if the open source alternatives were far behind rather than just a bit — all this talk about corporate moats and their absence may be blind to t…

> Bof, les alternatives à ChatGPT ne sont pas si mal. But that's not true, and people know it. > the storms of protest in France are normally by the people, not by the corporations Correct. CEOs of big corporations just call the ministers directly and tell them to get in line, or else.

> But that's not true, and people know it.

Based on what I've seen? They're good enough to be interesting, more so than GPT-2.

They don't need to be amazing from day one to be a foundation for replacing the status-quo.

> CEOs of big corporations just call the ministers directly and tell them to get in line, or else.

I roll to disbelieve (that it works, not that CEOs attempt it); that sounds like conspiracy theory to me.

Post reply on HN