Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Why wordfreq will not be updated

github.com

Post reply on HN
Print view View original

411–420 of 542 posts

Re: Why wordfreq will not be updated

#411

Post by nlpparty »

ClassyJacket wrote: post #386
greentxt wrote: post #268

Earlier quoted context omitted.

I assume you are correct but how can we know rather than assume? I am not sure we can, so why get worked up about "internet died in 2021" when many would claim with similar conviction that it's been dead since 2012, or 2007, or ...

You are making a claim that somehow someone was sitting on something as powerful as ChatGPT, long before ChatGPT, and that it was in widespread use, secretly, without even a single leak by anyone at any point. That's not plausible.

Twitter has been accused of being full of bots long before ChatGPT appeared. For 140 symbols, a template with synonyms would be enough to create mass-generated content.

Re: Why wordfreq will not be updated

#412

Post by nlpparty »

diggan wrote: post #225

One of the examples is the increased usage of "delve" which Google Trends confirms increased in usage since 2022 (initial ChatGPT release): https://trends.google.com/trends/explore?date=all&q=delve&hl... It seems however it started increasing most in usage just these last few months, maybe people are talking more about "delve" specifically because of the increase in usage? A usage recursion of some sorts.

If your select only USA, the trend disappears.

Re: Why wordfreq will not be updated

#413

Post by 1d22a »

nlpparty wrote: post #410

https://trends.google.com/trends/explore?date=all&geo=US&q=d... The funny fact: It doesn't result in the increase for search results for "delve".

That chart shows people searching for the world delve, and isn't (directly) related to the incidence of words in content on the open web.

Re: Why wordfreq will not be updated

#414

Post by codezero »

cedric_h wrote: post #403
0xbadcafebee wrote: post #280

I'm going to call it: The Web is dead. Thanks to "AI" I spend more time now digging through searches trying to find something useful than I did back in 2005. And the sites you do find are largely garbage. As a random example: just trying to find a particular popular set of wireless earbuds takes me at least 10 minutes, when I already know the company, the company's website, other vendors that sell the company's goods…

There is a startup whose product is better search. The killer feature is that you pay for it, so you aren't the produdct. https://kagi.com/welcome

Can vouch for this. It’s the first non-Google search alternative I’ve used that has 100% replaced Google. I don’t need Google as a fallback like I did with others.

Re: Why wordfreq will not be updated

#415

Post by 0xbadcafebee »

cedric_h wrote: post #402
0xbadcafebee wrote: post #362

Earlier quoted context omitted.

Where do you order things online that you aren't inundated by ads?

Ad blocker. Even just putting https://12ft.io/ in front of your link gets you pretty far.

Ah, you mean the web version of https://en.wikipedia.org/wiki/Blinkers_(horse_tack) . I don't think that helps when you're stopped in your tracks by an upsell. Dominos won't let you order a pizza online until you've declined garlic bread, cinnamon rolls and a liter of pepsi three times. And you can't just click "pepperoni pizza near me", you have to build your pepperoni pizza, after putting in your zip code, selecting the store, carry out, then click build again, sure you don't want buffalo wings too?, ....

Re: Why wordfreq will not be updated

#416

Post by nlpparty »

1d22a wrote: post #413
nlpparty wrote: post #410

https://trends.google.com/trends/explore?date=all&geo=US&q=d... The funny fact: It doesn't result in the increase for search results for "delve".

That chart shows people searching for the world delve, and isn't (directly) related to the incidence of words in content on the open web.

I just assumed that if many people, especially not proficient language users encounter this word in the text generated by ChatGPT they would look it up.

Re: Why wordfreq will not be updated

#417

Post by lobsterthief »

coldpie wrote: post #134
aucisson_masque wrote: post #18

Did we (the humans) somehow managed to pollute the internet so much with AI that's it's now barely usable ? In my opinion the internet can be considered as the equivalent of a natural environment like the earth. it's a space where people share, meet, talk, etc. I find it astonishing that after polluting our natural environment we know polluted the internet.

There are smaller, gated communities that are still very valuable. You're posting in one. But yes, the open Internet is basically useless now, thanks ultimately to advertising as a business model.

Also our collective unwillingness to pay for subscriptions for publications

Re: Why wordfreq will not be updated

#418

Post by lobsterthief »

rvnx wrote: post #82
Retr0id wrote: post #78

Earlier quoted context omitted.

Arguably it is a form of language evolution. I bet humans have started using "delve" more too, on average. I think the best we can do is look at the trends and think about potential causes.

“Seamless”, “honed”, “unparalleled”, “delve” are now polluting the landscape because of monkeys repeating what ChatGPT says without even questioning what the words mean. Everything is “seamless” nowadays. Like I am seamlessly commenting here. Arguably, the meaning of these words evolve due to misuse too.

Btw can’t people just open their prompts by instructing LLMs not to use those words?

Re: Why wordfreq will not be updated

#419

Post by EasyMark »

ckemere wrote: post #84
baq wrote: post #29

Earlier quoted context omitted.

Transformers read a lot during training, it might actually be beneficial for the companies to the point those works never see the light of day, only machines would read them. That's so dystopian I'd say those works should be published so they eventually get into the public domain.

Rooms full of people writing into a computer is a striking mental picture. It feels like it could be background for a great plot for a book/movie.

Lots of books have had plots where a person is training their replacement.

Re: Why wordfreq will not be updated

#420

Post by egypturnash »

aucisson_masque wrote: post #18

Did we (the humans) somehow managed to pollute the internet so much with AI that's it's now barely usable ? In my opinion the internet can be considered as the equivalent of a natural environment like the earth. it's a space where people share, meet, talk, etc. I find it astonishing that after polluting our natural environment we know polluted the internet.

The public Internet has been relentlessly strip-mined for profit by ever since Canter & Siegel posted their immigration services ad to every single Usenet newsgroup.
Post reply on HN