Live data from Hacker News

Why wordfreq will not be updated

github.com

181–190 of 542 posts

Re: Why wordfreq will not be updated

#182
post #4

I created https://lowbackgroundsteel.ai/ in 2023 as a place to gather references to unpolluted datasets. I'll add wordfreq. Please submit stuff to the Tumblr.

I am not sure we should trust a site contaminated by AI graphics. /s

Yeah pay an illustrator if this is important to you.

See a lot of people upset about AI still using AI image generation because it's not in their field so they feel less strongly about it and can't create art themselves anyway, hypocritical either use it or don't but don't fuss over it then use it for something thats convenient for you.

Re: Why wordfreq will not be updated

#183

Earlier quoted context omitted.

It certainly feels like the amount of regurgitated, nonsensical, generated content (nontent?) has risen spectacularly specifically in the past few years. 2021 sounds about right based on just my own experience, even though I can't point to any objective source backing that up.

I personally am yet to see this beyond some slop on youtube. And I am here for the AI meme videos. I recognize the dangers of this, all I am saying is that I don't feel the effect, yet.

There's been a ton of low-rent listicle writing out there for ages. Certainly not new in the past few years. I admit I don't go on YouTube much and don't even have a tiktok account so it's possible there's a lot of newer lousy content I'm not really exposed to.

It seems to me that the fact it's so cheap and relatively easy for people with dreams of becoming wealthy influencers to put stuff out there has more to do with the flood of often mediocre content than AI does.

Of course the vast majority don't have much real success and get on with life and the crank turns and a new generation perpetuates the cycle.

LLMs etc. may make things marginally easier but there's no shortage of twenty somethings with lots of time imagining riches while making pennies.

Re: Why wordfreq will not be updated

#184

Earlier quoted context omitted.

Clever name. I like the analogy.

I don't seem to get it.

To whomever downvoted parent: please don't act against people brave enough to state that they don't know something.

This is a desired quality, increasingly less present in IT work environments. People afraid of being shamed for stating knowledge gaps are not the folks you want to work with.

Re: Why wordfreq will not be updated

#185
post #122

Earlier quoted context omitted.

> Also, it is shocking how authoritarian the “left” has become in my lifetime. We are going through a general uptick in authoritarian "discussions" online. It's interesting that you are only seeing it on the "left".

As far as I noticed, the “right” effectively gets the boot in most online communities which abide to a Code of Conduct, leaving mostly the “left” (the most recent example I have in mind of such moderation efforts is the save-nix-together.org open letter). It’s interesting that you don’t notice this happening in the communities you seem to frequent.

No, I see a lot of the "right" discourse. Many are openly supporting Putin now. I follow many conservative (US) pundits and journalists and they have either taken a hard right turn or are raising the alarm and supporting Harris. I see similar trends here in Canada.

Yes, I see that the left has become more authoritarian, but it pales to the hard shift I see on the right.

Re: Why wordfreq will not be updated

#186
I think this person has too high a view of pre-2021, probably for ego reasons. In fact, their attitude seems very ego driven. AI didn't just occur in 2021. Nobody knows how much text was machine generated prior to 2021, it was much harder if not impossible to detect. If anything, it's probably easier now since people are all using the same ai that use words like delve so much much it becomes obvious.

Re: Why wordfreq will not be updated

#187
post #136

Earlier quoted context omitted.

Generative AI is inherently a political issue, its not surprising at all. There is the case of what is "truth". As soon as you start to ensure some quality of truth to what is generated, that is political. As soon as generative AI has the capability to take someone's job, that is political. The instant AI can make someone money, it is political. When AI is trained on something that someone has created, and now they c…

Then .. everything is political?

Everything involving any kind of coordination, cooperation, competition, and/ot communication between two or more people involves politics by its very nature. LLMs are communication tools. You can't divorce politics from their use when one person is generating text for another person to read.

Re: Why wordfreq will not be updated

#188
post #4

I created https://lowbackgroundsteel.ai/ in 2023 as a place to gather references to unpolluted datasets. I'll add wordfreq. Please submit stuff to the Tumblr.

I am not sure we should trust a site contaminated by AI graphics. /s

The buildings and shipping containers that store low background steel aren't built out of the stuff either.

Re: Why wordfreq will not be updated

#189

Did we (the humans) somehow managed to pollute the internet so much with AI that's it's now barely usable ? In my opinion the internet can be considered as the equivalent of a natural environment like the earth. it's a space where people share, meet, talk, etc. I find it astonishing that after polluting our natural environment we know polluted the internet.

There are smaller, gated communities that are still very valuable. You're posting in one. But yes, the open Internet is basically useless now, thanks ultimately to advertising as a business model.

I've seen plenty of comments here that read like they've been generated by an LLM, if this is a gated community we need a better gate.
Post reply on HN