This can be repurposed as a legal form of ransomware
pay me to shut my absolutely legal site down to make your life easier
Anyone got a contact at OpenAI. They have a spider problem
221–230 of 400 posts
Re: Anyone got a contact at OpenAI. They have a spider problem
#222Earlier quoted context omitted.
And? What are they gonna do about it (apart from making such a person/website momentarily famous).
Have you not heard of Roko's Basilisk?
I didn't know about Roko's Basilisk until today.
https://www.youtube.com/watch?v=ut-zGHLAVLI https://en.wikipedia.org/wiki/Roko%27s_basilisk
Idea viruses are amazing that we can think and contemplate them.
Re: Anyone got a contact at OpenAI. They have a spider problem
#223Earlier quoted context omitted.
It is already solved. Look at how Microsoft trained Phi - they used existing models to generate synthetic data from textbooks. That allowed them to create a new dataset grounded in “fact” at a far higher quality than common crawl or others. It looks less like an ouroboros and more like a bootstrapping problem.
AI training on AI-generated content is a future problem. Using textbooks is a good idea, until our textbooks are being written by AI. This problem can't really be avoided once we begin using AI to write, understand, explain, and disseminate information for us. It'll be writing more than blogs and SEO pages. How long before we start readily using AI to write academic journals and scientific papers? It's really only a…
You need to separate “content” and “knowledge.” GenAI can create massive amounts of content, but the knowledge you give it to create that content is what matters and why RAG is the most important pattern right now.
From “known good” sources of knowledge, we can generate an infinite amount of content. We can add more “known good” knowledge to the model by generating content about that knowledge and training on it.
I agree there will be many issues keeping up with what “known good” is, but that’s always been an issue.
Re: Anyone got a contact at OpenAI. They have a spider problem
#224Earlier quoted context omitted.
FWIW, we train into kids that "I don't know" is a valid response, and when to utter it. That training is more RLHF-type than source-materal-type, too.
I don't follow, what does this mean to the conversation?
That knowing to say "I don't know" instead of extrapolating is an explicitly learned skill in humans, not something innate or inherent in structure of language, so we shouldn't expect LLMs to pick that ex nihilo either.
Re: Anyone got a contact at OpenAI. They have a spider problem
#225Content farms of that size should be considered a public order offense and be prohibited.
Re: Anyone got a contact at OpenAI. They have a spider problem
#226Earlier quoted context omitted.
I wonder how much the source content is the cause of hallucinations rather than anything inherent to LLMs. I mean if someone posts a question on an internet forum that I don't know the answer to, I'm certainly not going to post "I don't know" since that wouldn't be useful. In fact, in general, in any non one-on-one conversation the answer "I don't know" is not useful because if you don't know in a group, your silence…
I've wondered if one could train a LLM on a closed set of curated knowledge. Then include training data that models the behaviour of not knowing. To the point that it could generalize to being able to represent its own not knowing. Because expecting a behaviour, like knowing you don't know, that isn't represented in the training set is silly. Kids make stuff up at first, then we correct them - so they have a way to l…
> train a LLM a closed set of curated knowledge
Google has one of these already, with an LLM that was trained on nothing but weather data and so can only give weather-data-prediction responses.
The 'knowing it doesn't know things' part is much harder to get reliable, though.
Re: Anyone got a contact at OpenAI. They have a spider problem
#227Earlier quoted context omitted.
Nowadays they are instead learning to say "please join our Discord for support"!
Much like one of the first phrases spoken by babies today is "like and subscribe".
Part of me really wants to believe this is a joke.
But given how often toddlers are "taken care of" by planting them in front of youtube :|
Re: Anyone got a contact at OpenAI. They have a spider problem
#228Earlier quoted context omitted.
This sounds interesting, could you give more detail on what you're referring to?
I'm referring to his two works, the "Tractatus Logico-Philosophicus" and "Philosophical Investigations". There's a lot explored here, but Wittgenstein basically makes the argument that the natural logic of language—how we deduce meaning from terms in a context and naturally disambiguate the semantics of ambiguous phrases—is different from the sort of formal propositional logic that forms the basis of western philosop…
Thanks for the fascinating response.
Re: Anyone got a contact at OpenAI. They have a spider problem
#229This can be repurposed as a legal form of ransomware pay me to shut my absolutely legal site down to make your life easier
Or.. you can not have your bots crawl other people’s property without permission.
Re: Anyone got a contact at OpenAI. They have a spider problem
#230Earlier quoted context omitted.
He says 3 million, and 1.8 million are for robots.txt So 1.2 million non robots.txt requests, when his robots.txt file is configured as follows # buzz off User-agent: GPTBot Disallow: / Theoretically if they were actually respecting robots.txt they wouldn't crawl any pages on the site. Which would also mean they wouldn't be following any links... aka not finding the N subdomains.
for the 1.2 million are there other links he's not telling us about?
I'm assuming those are homepage requests for the subdomains.