Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Reddit is OpenAI’s moat

cyberdemon.org

Post reply on HN
Print view View original

31–40 of 319 posts

Re: Reddit is OpenAI’s moat

#31

Post by csdvrx »

toomuchtodo wrote: post #10
gjsman-1000 wrote: post #3

Earlier quoted context omitted.

Heh... and take responsibility for all the porn and various "degeneracy" on there? It makes them a perfect political punching bag.

"We recognize the value online communities provide in training the state of the art in generative AI. With that in mind, we have acquired Reddit and intend to operate it as a wholly owned subsidiary. After an exhaustive search, we've selected $adult_ceo_with_social_experience to lead the team as they work to ensure Reddit can continue to operate as both a safe and vibrant digital oasis, where people can come together…

"Let's now show the new Bing, where high quality data from reddit is better ranked and the selected by default for {whatever_category_you_think_matters} thanks to automatic classification of the search questions by GPT"

There are many synergies that aren't properly considered by a naive take.

I use site:reddit.com with most of my queries. I now prefer bing to google. Bing market share is growing.

Coughing up a few B to avoid reddit going on with an IPO would be a very strategic move on many fronts.

Re: Reddit is OpenAI’s moat

#33

Post by skilled »

This might as well be as good place as any to say that I wouldn't be surprised if in 20 years time we find out that the acquisition of GitHub by Microsoft was also done in OpenAI's favor. I know it's probably a crazy theory, but it did cross my mind a few months ago.

Re: Reddit is OpenAI’s moat

#34

Post by fullshark »

If they then run the site at a loss and optimize it for ingesting well structured training data to their models it might become decent again. Basically what Stack Overflow was trying to become but its users rebelled.

Re: Reddit is OpenAI’s moat

#35

Post by toomuchtodo »

csdvrx wrote: post #31
toomuchtodo wrote: post #10

Earlier quoted context omitted.

"We recognize the value online communities provide in training the state of the art in generative AI. With that in mind, we have acquired Reddit and intend to operate it as a wholly owned subsidiary. After an exhaustive search, we've selected $adult_ceo_with_social_experience to lead the team as they work to ensure Reddit can continue to operate as both a safe and vibrant digital oasis, where people can come together…

"Let's now show the new Bing, where high quality data from reddit is better ranked and the selected by default for {whatever_category_you_think_matters} thanks to automatic classification of the search questions by GPT" There are many synergies that aren't properly considered by a naive take. I use site:reddit.com with most of my queries. I now prefer bing to google. Bing market share is growing. Coughing up a few B…

Github acquisition was a savvy, Reddit has more peril involved but similar value.

Re: Reddit is OpenAI’s moat

#36

Post by bzmrgonz »

throwuwu wrote: post #19
JimtheCoder wrote: post #9

I may be in the minority here, but if I want the opinion of Redditors on an issue, I will use a search engine to look for it specifically, thus knowing the provenance of the information I am receiving. I don't really want the corpus of Reddit data influencing the output of a generative AI model...because it's Reddit, after all... Even though I am pretty sure it is already included in the training dataset already... I…

You’re not alone in thinking that. The value in using Reddit as training data would be the question response format of threaded comments. The downside is that the vast majority of comments on Reddit are very low quality and repetitive. You’d have to do a lot of filtering to make it usable and what you’d be left with would be a much smaller pile of training data.

repetitive is good tho, it presents validation. I'm sure programming a good AI means adding a grading system for repetitive facts, in reddit's case, it may even accommodate likes. The problem would be when we have run-away sarcasm/irony/memes which the llamas can't handle.

Re: Reddit is OpenAI’s moat

#37

Post by nostrademons »

dmbche wrote: post #11
blovescoffee wrote: post #5

Except Google and Microsoft/Bing search engines have already cached lots of that data just to provide their service. Facebook has its own treasure trove. Apple less so but they're also the least competitive in the AI space (of the FAANG) atm.

I'm no expert on corporate law, but maybe them aquiring reddit data makes that data illegal to use for others to train their models on? Even if available, if it's not legal to use the big guys can't touch it.

OpenAI's trying to argue that line, but given that most of OpenAI's models are trained on scraped data that they had no legal right to other than existing court precedents on scraped public data, they don't have much of a leg to stand on.

Re: Reddit is OpenAI’s moat

#38

Post by hiatus »

dmbche wrote: post #11
blovescoffee wrote: post #5

Except Google and Microsoft/Bing search engines have already cached lots of that data just to provide their service. Facebook has its own treasure trove. Apple less so but they're also the least competitive in the AI space (of the FAANG) atm.

I'm no expert on corporate law, but maybe them aquiring reddit data makes that data illegal to use for others to train their models on? Even if available, if it's not legal to use the big guys can't touch it.

If AI can be trained on copyrighted works without issue I don't see how an argument could be made against using reddit data for training.

Re: Reddit is OpenAI’s moat

#39

Post by deafpolygon »

The data Reddit has on its NSFW content (you know which one.. yes, the pornographic one) must be worth millions.

No, no... jeez, you pervs... not the content.

The upvote/downvote data for every image will probably train any generative AI on exactly what makes a good porn video/pic - and we all know sex sells. The dirty comments, and etc.

On top of that, they'd make really useful leverage if you can connect any one of these accounts to their real world counterparts. I bet an AI with a large enough dataset could make short work of that.

Re: Reddit is OpenAI’s moat

#40

Post by cfcf14 »

Some strange claims in this post. The reddit post datasets are already 'out there' in the wild, and I'm fairly certain every other major LLM release has used their data. Also - did Midjourney "steal" DALLE-2's lunch? It's a restrictive service with essentially a discord-only based CLI.
Post reply on HN