Live data from Hacker News

I scraped all of OpenAI's Community Forum

julep-ai.github.io

31–40 of 68 posts

Re: I scraped all of OpenAI's Community Forum

#31

I did a bit of data scraping for fun in the past, but I was never quite sure of the legality of what I was doing. What if I was breaking some law in some jurisdiction of some country? Was someone going to track me down and punish me? OpenAI has taught me that no one gives a shit. Scrape the entire internet if you want, and use the data for whatever you feel like.

[deleted]

Re: I scraped all of OpenAI's Community Forum

#32
post #24

(disclaimer: I work for Discourse) Discourse has an AI plugin that admins can run on their community to generate their own sentiment analysis (among other things), though it's not quite as thorough as this write up! https://meta.discourse.org/t/discourse-ai-plugin/259214 We're always interested to see how public data can be used like this. It's something that can be a lot more difficult on closed platforms.

> helps you keep tabs on your community by analyzing posts and providing sentiment and emotional scores to give you an overall sense of your community for any period of time [...] > Toxicity can scan both new posts and chat messages and classify them on a toxicity score across a variety of labels Is that within the defined data processing purposes of all Discourse setups? Does the tool warn admins they might need to…

More companies and communities than you think already do this without your knowledge let alone consent.

Re: I scraped all of OpenAI's Community Forum

#33

> Number of Posts with negative sentiment, grouped by Topic > # 1 Result: Python Packaging Checks out

The Python package is really well engineered, and the startup that is making the OpenAPI client based on it, Stainless, is doing a good job.

This shows laypeople piling into a hype thing and running immediately into the roadblock of programming.

Normal people don't want to like, put in effort to feel like they are a part of something.

They are used to "just" having to turn on Netflix to feel like they are a part of the biggest TV show, or "just" having to click a button to buy a Stanley Cup, or "just" having to click a button to buy Bitcoin. The API and performance issues, IMO, they're not noise, but they are meaningless. To me this also signals how badly Grok and Stability are doing it, they are doubling and tripling down on popular opinions that have a strong, objective meaninglessness to them (like how fast the tokens come out and how much porn you're allowed to make). Whereas the Grok people are looking at this analysis and feeling very validated right now.

I have no dog in this race, but I would hope that the OpenAI people do not waste any time on Python APIs for dumb people; instead, they should definitely improve their store and have a firmer opinion on how that would look. They almost certainly have a developing opinion on a programming paradigm for chatbots, but I feel like they are hamstrung by needed to quantize their models to meet demand, not decisions about the look and feel of Python APIs or the crappiness of the Python packaging ecosystem. Another POV is that the Apple development experience persists to be notoriously crappy, and yet they are the most valuable platform for most companies in the world right now; and also, JetBrains could not sustain an audience for the AppCode IDE, because everyone uses middlewares anyway; so I really don't think Python APIs matter as much as the community says they do. It's a Nice to Have, but it Does Not Matter.

Re: I scraped all of OpenAI's Community Forum

#34

> Number of Posts with negative sentiment, grouped by Topic > # 1 Result: Python Packaging Checks out

The Python package is really well engineered, and the startup that is making the OpenAPI client based on it, Stainless, is doing a good job. This shows laypeople piling into a hype thing and running immediately into the roadblock of programming. Normal people don't want to like, put in effort to feel like they are a part of something. They are used to "just" having to turn on Netflix to feel like they are a part of t…

we may think more similarly than you seem to think...

this was more a slam on python packaging in general, than it is on the OpenAI implementation.

I wouldn't be surprised if many of the issues under this topic are more related to Python package version nightmares, than OpenAI's Python implementation itself.

Re: I scraped all of OpenAI's Community Forum

#35
post #9

Now train a gpt based on the data :D

But make sure to call it ClosedData or something so we know it’s not open source (sorry, I think openai and sam are gross)

Maybe I don’t understand this sentiment, but are people really that hung up on the name?

I see this sort of thing posted a lot (i.e., “it should be ClosedAI instead of OpenAI, lol”)

What if it just means “Open for Business” instead of “Open Access for All”? Or maybe they should just make it an acronym?

I’m sorry for the confusion on my part, but there’s just been a lot of words dedicated toward expressing frustration with the company because they chose to use “open” in their name.

Personally, I don’t find it frustrating that Apple doesn’t sell fruit and Intel doesn’t actually give intelligence data.

Re: I scraped all of OpenAI's Community Forum

#36
post #35

Earlier quoted context omitted.

But make sure to call it ClosedData or something so we know it’s not open source (sorry, I think openai and sam are gross)

Maybe I don’t understand this sentiment, but are people really that hung up on the name? I see this sort of thing posted a lot (i.e., “it should be ClosedAI instead of OpenAI, lol”) What if it just means “Open for Business” instead of “Open Access for All”? Or maybe they should just make it an acronym? I’m sorry for the confusion on my part, but there’s just been a lot of words dedicated toward expressing frustration…

Is the frustration because of the name, or because open [access] was part of their ethos at the beginning, and people think they've abandoned it?

Re: I scraped all of OpenAI's Community Forum

#37
post #35

Earlier quoted context omitted.

But make sure to call it ClosedData or something so we know it’s not open source (sorry, I think openai and sam are gross)

Maybe I don’t understand this sentiment, but are people really that hung up on the name? I see this sort of thing posted a lot (i.e., “it should be ClosedAI instead of OpenAI, lol”) What if it just means “Open for Business” instead of “Open Access for All”? Or maybe they should just make it an acronym? I’m sorry for the confusion on my part, but there’s just been a lot of words dedicated toward expressing frustration…

It's a gimmick. When the nonprofit was organized in 2015, the name certainly did not mean open for business. It meant (loftily) undertaking the quasi-religious quasi-humanist mission "in the spirit of liberty" to generate a new kind of super wealth as "broadly and evenly distributed as possible".

As in prepare for the end... THE END OF HIGH PRICES!

> to benefit humanity as a whole, unconstrained by a need to generate financial return

- https://openai.com/blog/introducing-openai

Re: I scraped all of OpenAI's Community Forum

#38
post #16

Earlier quoted context omitted.

I would also love to see these forums both to post and to lurk

https://community.openai.com/ (when you are logged in on platform.openai.com, there is a link from the menu)

Thank you!

Gone are the days when you simply saw all the important links on the main page, it seems. :)

Re: I scraped all of OpenAI's Community Forum

#39
post #35

Earlier quoted context omitted.

Maybe I don’t understand this sentiment, but are people really that hung up on the name? I see this sort of thing posted a lot (i.e., “it should be ClosedAI instead of OpenAI, lol”) What if it just means “Open for Business” instead of “Open Access for All”? Or maybe they should just make it an acronym? I’m sorry for the confusion on my part, but there’s just been a lot of words dedicated toward expressing frustration…

Is the frustration because of the name, or because open [access] was part of their ethos at the beginning, and people think they've abandoned it?

OpenAI is supposed to be a nonprofit. But, when the nonprofit board tried to exercise control, it became very clear that the nonprofit arm is not, in fact in control any longer. The board was wiped out, nearly everyone in the company seemingly was willing to join Microsoft or Sam Altman or what not.

This doesn’t seem to be compatible with continuing loftily call themselves with the same name, as the initial nonprofit mission.

Re: I scraped all of OpenAI's Community Forum

#40
post #24

Earlier quoted context omitted.

> helps you keep tabs on your community by analyzing posts and providing sentiment and emotional scores to give you an overall sense of your community for any period of time [...] > Toxicity can scan both new posts and chat messages and classify them on a toxicity score across a variety of labels Is that within the defined data processing purposes of all Discourse setups? Does the tool warn admins they might need to…

More companies and communities than you think already do this without your knowledge let alone consent.

That doesn't mean we can't do better
Post reply on HN