I scraped all of OpenAI's Community Forum

Post by rattray » Fri, Mar 29, 2024, 3:53 AM UTC

alt-glitch wrote: post #58

rattray wrote: post #54

Earlier quoted context omitted.

FWIW, here are the only links I could find in the article which were tagged "Python3 Package": https://community.openai.com/t/647723 and https://community.openai.com/t/586484 . Note they don't see to have anything to do with the Python package whatsoever. I was pretty disappointed to see this, as I work on the Python package and was hoping for a good place to find feedback (apart from the github issues, which I monit…

Hey! Happy to chat over email/X more closely and help you out. Nomic Atlas automatically generates the labels here. There could be different variations of posts involving the Python Packages. But I did some manual digging & here's what I found; Heading over to the map and filtering by posts around "Python Packages" leads to around 900 posts. Sharing a few examples which do talk about people's posts related to the pyt…

Post by dcreater » Fri, Mar 29, 2024, 7:03 AM UTC

alt-glitch wrote: post #57

miduil wrote: post #6

That's an interesting write-up, I wonder how this would look for other big Discourse communities such as NixOS.

This is definitely a workflow we can package into something open-source. I wonder how the community moderators would like it.

Post by wavyknife » Fri, Mar 29, 2024, 1:27 PM UTC

Aachen wrote: post #50

xfalcox wrote: post #45

Earlier quoted context omitted.

> Is that within the defined data processing purposes of all Discourse setups? It's an optional plugin that can be enabled / disabled by the site admin. Those modules are all disabled by default, and each need to be enabled by the site owner. > Edit: and apparently it also tries to flag NSFW chat messages, does Discourse have PM chats where this would flag private messages for admins to read or is it only public chat…

Of course an admin can always open up the database and read your forum PMs, that's not surprising. The very first line in the link you provided, however, is what I was worried about: > Moderators can read PMs that have an active flag. This system is now setting nsfw flags in an automated fashion, specifically seeking out content that the persons involved wouldn't want others to see. Clearly a forum is the wrong place…

Post by htrp » Fri, Mar 29, 2024, 4:13 PM UTC

EcommerceFlow wrote: post #22

dorkwood wrote: post #14

I did a bit of data scraping for fun in the past, but I was never quite sure of the legality of what I was doing. What if I was breaking some law in some jurisdiction of some country? Was someone going to track me down and punish me? OpenAI has taught me that no one gives a shit. Scrape the entire internet if you want, and use the data for whatever you feel like.

A precursor to this would have been that Linkedin lawsuit Microsoft lost, allowing that one company to scrape all of Linkedin (technically "public information").