Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Why wordfreq will not be updated

github.com

Post reply on HN
Print view View original

241–250 of 542 posts

Re: Why wordfreq will not be updated

#241

Post by rovr138 »

astennumero wrote: post #201
jgrahamc wrote: post #4

I created https://lowbackgroundsteel.ai/ in 2023 as a place to gather references to unpolluted datasets. I'll add wordfreq. Please submit stuff to the Tumblr.

That's exactly the opposite of what the author wanted IMO. The author no more wants to be a part of this mess. Aggregating these sources would just makes it so much more easier for the tech giants to scrape more data.

The sources are just aggregated. The source doesn't change.

The new stuff generated does (and this is honestly already captured).

This author doesn't generate content. They analyze data from humans. That "from humans" is the part that can't be discerned enough and thus the project can't continue.

Their research and projects are great.

Re: Why wordfreq will not be updated

#242

Post by bee_rider »

diggan wrote: post #225

One of the examples is the increased usage of "delve" which Google Trends confirms increased in usage since 2022 (initial ChatGPT release): https://trends.google.com/trends/explore?date=all&q=delve&hl... It seems however it started increasing most in usage just these last few months, maybe people are talking more about "delve" specifically because of the increase in usage? A usage recursion of some sorts.

We’ve seen this with a couple words and expressions, and I don’t doubt that AI is somewhat likely to “like” some phrases for whatever reason. Big eigenvaues of the latent space or whatever, hahaha (I don’t know AI).

But also, words and phrases do become popular among humans, right? It would be a shame if AI caused the language to get more stagnant, as keeping up with which phrases are popular get you labeled as an AI.

Re: Why wordfreq will not be updated

#243

Post by trehalose »

squigz wrote: post #218
jll29 wrote: post #203

I regret the situation led to the OP feel discourage about the NLP community, wo which I belong, and I just want to say "we're not all like that", even though it is a trend and we're close to peak hype (slightly past even?). The complaint about pollution of the Web with artificial content is timely, and it's not even the first time due to spam farms intended to game PageRank, among other nonsense. This may just mean…

> people consuming auto-generated content to keep the masses from away from critical thinking. This is now happening The people who stay away from critical thinking were doing that already and will continue to do so, 'AI' content or not.

How did they get started?

Re: Why wordfreq will not be updated

#244

Post by weweweoo »

next_xibalba wrote: post #45

[flagged]

Yeah, I'm no fan of Musk or Trump, but I think Twitter always was a spam-infested, hateful cesspool where people with online-addiction yelled at each other. There was nothing for Musk to ruin, because the whole concept was rotten from the start. Allowing only short messages doesn't promote intelligent discussion, it does the opposite.

Re: Why wordfreq will not be updated

#245

Post by bongodongobob »

squigz wrote: post #234
bongodongobob wrote: post #231

Earlier quoted context omitted.

It's high quality when the content is within HN's bubble. Anything related to health, politics, or Microsoft is full of misinformation, ignorance, and garbage like any other site. The Microsoft discussions in particular are extremely low quality.

I disagree. Even politics spurs intelligent, nuanced discussion here on HN. And to hold up discussions about MS as an example of 'extremely' low quality discussion is, ah, interesting. Do you have any recent examples of such discussions?

I hide every single article about MS because it's filled with all the neckbeardy tropes about their products being garbage spyware, switch to Linux, they're stealing your data, the OS is trash etc. It's comments from people who have never managed large scale MS based environments comparing their Windows Home to the other 90% of the business ecosystem that has nothing to do with home users or MS's main cash cow, businesses, Azure/Entra and M365. I'm done wasting my breath on MS here.

Re: Why wordfreq will not be updated

#246

Post by squigz »

trehalose wrote: post #243
squigz wrote: post #218

Earlier quoted context omitted.

> people consuming auto-generated content to keep the masses from away from critical thinking. This is now happening The people who stay away from critical thinking were doing that already and will continue to do so, 'AI' content or not.

How did they get started?

They likely never started critically thinking, so they never had to get started on not doing so.

(If children are never taught to think critically, then...)

Re: Why wordfreq will not be updated

#247

Post by grues-dinner »

halostatue wrote: post #232
grues-dinner wrote: post #130

Earlier quoted context omitted.

And here I thought my defacement of printed recipes by bracketing everything that goes together at each stage was just me. There are, well, maybe not dozens but at least two of us! Saves a lot of bowls when you know without further checking that you can, say, just dump the flour and sugar, butter and eggs into the big bowl without having to prepare separately because they're in the "1: big bowl" bracket.

Depends on what you’re doing. For best cookies, you want to cream the butter with the sugar, then add the eggs, and finally add the flour. If you’re interested and can find one, it’s worth taking a vegan baking class. You learn a lot about ingredient substitutions for baking, about what the different non-vegan ingredients are doing that you have to compensate for…and it does something that I’ve only recently started…

No need to cakesplain, that was an example with three ingredients of the top of my head, very, very obviously the exact ingredients and bracket assignments vary depending on what you are making.

But for shortbread or fork biscuits those three could indeed all go in the bowl in one go (but that one admittedly doesn't really need a bracket because the recipe is "put in bowl, mix with hands, bake").

Re: Why wordfreq will not be updated

#248

Post by squigz »

bongodongobob wrote: post #245
squigz wrote: post #234

Earlier quoted context omitted.

I disagree. Even politics spurs intelligent, nuanced discussion here on HN. And to hold up discussions about MS as an example of 'extremely' low quality discussion is, ah, interesting. Do you have any recent examples of such discussions?

I hide every single article about MS because it's filled with all the neckbeardy tropes about their products being garbage spyware, switch to Linux, they're stealing your data, the OS is trash etc. It's comments from people who have never managed large scale MS based environments comparing their Windows Home to the other 90% of the business ecosystem that has nothing to do with home users or MS's main cash cow, busin…

This is a funny comment in a thread about low quality discussion.

Re: Why wordfreq will not be updated

#249

Post by Suppafly »

olabyne wrote: post #85
weinzierl wrote: post #64

"I don't think anyone has reliable information about post-2021 language usage by humans." We've been past the tipping point when it comes to text for some time, but for video I feel we are living through the watershed moment right now. Especially smaller children don't have a good intuition on what is real and what is not. When I get asked if the person in a video is real, I still feel pretty confident to answer but…

I never thought about that. Humans losing their ability to detect AI content from reality ? It's frightening.

>Humans losing their ability to detect AI content from reality ? It's frightening.

And it already happened, and no one pushed back while it was happening.

Post reply on HN