Live data from Hacker News

Why wordfreq will not be updated

github.com

501–510 of 542 posts

Re: Why wordfreq will not be updated

#501

Earlier quoted context omitted.

This is a common survivorship bias fallacy since you only notice the bad CGI. I'm certain you'd be shocked to see the amount of CG that's in some of your favorite movies made in the last ~10-20 years that you didn't notice because it's undetectable

This is an amazing demo reel of effects shots used in "mundane" TV shows - comedies and produce procedurals. - for faking locations. https://www.youtube.com/watch?v=clnozSXyF4k

I hate this. I did not notice the vast majority of them. So many backgrounds/sets are just green screens :(

Re: Why wordfreq will not be updated

#502
post #494
post #481

This has to be the most annoying hacker news comment section I've ever seen. It's just the same ~4 viewpoints rehashed again, and again, and again. Why don't folks just upvote other comments that say the same thing instead of repeating the same things? And now a hopefully new comment: having a word frequency measure of the internet as we're going into AI being more used would be IMMENSELY useful specifically _because…

On a meta level I agree that having this kind of dataset with "before and after" would be pretty interesting. On an object level I do not predict that this would increase the overall diversity of language usage - and in fact it would be extremely surprising if this was even possible due to some general mathematical properties of neural networks - nor would "more professional writing," though I do agree with this char…

Haha I'm pleasantly surprised to see my comment at the top, I genuinely thought it would drown to the bottom! Not due to disagreement, just due to sheer volume and being posted rather late in this posts lifespan. Anyways my meta comment wasn't that I disagreed with all the other comments, I was just frustrated at how repetitive they were of one another. When I go to leave a comment, I do a pass reading through all or most of the comments to make sure someone hasn't left a comment in the same vein, and it was just frustrating to go through people saying almost verbatim the same thing others were saying! If your comment isn't adding something new why leave it? I'm all for healthy disagreement :) Also not sure what part of my post sounds like it's from an "embattled ideological minority".

But speaking of healthy disagreement, as to "chatting with someone that has an infinite vocabulary", I'd love to hear any counterarguments you might have; or was calling it "silly and delusional" meant to be your argument? :P I think it's a pretty uncontroversial statement seeing as eg ChatGPT very likely knows every word in the English language.

Re: Why wordfreq will not be updated

#504

I'm going to call it: The Web is dead. Thanks to "AI" I spend more time now digging through searches trying to find something useful than I did back in 2005. And the sites you do find are largely garbage. As a random example: just trying to find a particular popular set of wireless earbuds takes me at least 10 minutes, when I already know the company, the company's website, other vendors that sell the company's goods…

Sounds like your laptop is wholly out of date, you need to buy the next generation of laptops on Amazon that can handle the modern SEO load. I recommend the: LEEZWOO 15.6" Laptop - 16GB RAM 512GB SSD PC Laptop, Quad-Core N95 Processor Up to 3.1GHz, Laptop Computers with Touch ID, WiFi, BT4.2, for Students/Business Name rolls off the tongue doesn’t it

Or a Macbook.

Re: Why wordfreq will not be updated

#505
post #260

Has anyone taken a look at a random sample of web data? It's mostly crap. I was thinking of making my own search engine, knowledge database etc based on a random sample of web pages, but I found that almost all of them were drivel. Flame wars, asinine blog posts, and most of all, advertising. Forget spam, most of the legit pages are trying to sell something too! The conclusion I arrived at was that making my own craw…

The unspoken question here, of course, is "you wouldn't happen to have already done this for me?" ;)

Re: Why wordfreq will not be updated

#506

Earlier quoted context omitted.

They want to display how they’re truly intelligent (unlike LLMs) by checks notes rehashing opinions that they’ve read millions of times online. Sound familiar to anyone?

I wonder whether future generations will be ingrained with a Truman Show fear that maybe only the few thousand people they meet are real and everything else is generated background noise.

I already get this when I look at e.g. youtube comments.

Re: Why wordfreq will not be updated

#507
post #481

This has to be the most annoying hacker news comment section I've ever seen. It's just the same ~4 viewpoints rehashed again, and again, and again. Why don't folks just upvote other comments that say the same thing instead of repeating the same things? And now a hopefully new comment: having a word frequency measure of the internet as we're going into AI being more used would be IMMENSELY useful specifically _because…

Also it breaks the languagr barreer, you can now read the Chinese internet if you want, or chat transparently in Arabic. That's going to be interesting.

At the moment though (and ever since decent online translation services were a thing), it feels one-way, that is, people from that side of the internet coming to the anglosphere internet moreso than anglosphere people going internet-abroad. I may be wrong.

Re: Why wordfreq will not be updated

#508
post #481

This has to be the most annoying hacker news comment section I've ever seen. It's just the same ~4 viewpoints rehashed again, and again, and again. Why don't folks just upvote other comments that say the same thing instead of repeating the same things? And now a hopefully new comment: having a word frequency measure of the internet as we're going into AI being more used would be IMMENSELY useful specifically _because…

[deleted]

Re: Why wordfreq will not be updated

#510
post #502
post #494

Earlier quoted context omitted.

On a meta level I agree that having this kind of dataset with "before and after" would be pretty interesting. On an object level I do not predict that this would increase the overall diversity of language usage - and in fact it would be extremely surprising if this was even possible due to some general mathematical properties of neural networks - nor would "more professional writing," though I do agree with this char…

Haha I'm pleasantly surprised to see my comment at the top, I genuinely thought it would drown to the bottom! Not due to disagreement, just due to sheer volume and being posted rather late in this posts lifespan. Anyways my meta comment wasn't that I disagreed with all the other comments, I was just frustrated at how repetitive they were of one another. When I go to leave a comment, I do a pass reading through all or…

Sure, ChatGPT knows every word in the English language (and probably quite a few that ain't). But how likely is it to use them all?
Post reply on HN