Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Internet search tips

gwern.net

Post reply on HN
Print view View original

21–30 of 86 posts

Re: Internet search tips

#21

Post by coldblues »

Gwern is the person I'd become if I could properly monetize my ADHD and rabbit hole seeking behavior. I absolutely love his website and everything he publishes, and I am always delighted to look over his new stuff. Wish there are more people like him to read from.

Re: Internet search tips

#22

Post by cole-k »

Thoeu388 wrote: post #16

I found it useful to screenrecord all my computer activity. It is OCR searchable. This way if I vaguely remember some bits, I can reconstruct my sources. It also preserves original text, in case sources get edited.

I've thought about this or something similar (e.g. ArchiveBox).

It seems like 95-99% of the content you archive will be junk that you never look at again, but that 1-4% really might be worth it. Especially if it gets taken down.

What do you do for storage, though? I haven't invested in a NAS or personal storage over 1TB.

I think I understand now why some of these archive utilities offer you the option to upload to the internet archive in addition to storing locally. You can build up a local cache and then start removing the oldest page snapshots (but keep the link trail) once you start to run out of space.

Re: Internet search tips

#23

Post by jterrys »

coldblues wrote: post #21

Gwern is the person I'd become if I could properly monetize my ADHD and rabbit hole seeking behavior. I absolutely love his website and everything he publishes, and I am always delighted to look over his new stuff. Wish there are more people like him to read from.

Are you perchance able to provide some kind of RSS feed to his website? I'm having a hard time finding his newest stuff. You can subscribe to his newsletters but he stopped doing those two years ago

Re: Internet search tips

#24

Post by andrepd »

Jakob wrote: post #15

+1 for his tip of "Search The Internet Archive". The other day I searched for the Tom & Jerry full episodes on the web to no avail (streaming platforms and video platforms like youtube only have rubbish cuts). The internet archive has every episode starting from the first one in 1940, in an easily accessible player without any ads or recommendations: https://archive.org/details/tom-and-jerry-all-114-episodes

Your comment just reminded me of how great the Internet Archive is, so I guess it's time to donate another 100 bucks to IA again.

Re: Internet search tips

#25

Post by hddqsb »

38 wrote: post #2

my problem is some operators just dont work any more, either on purpose or because of crappy quality control. for example, you used to be able to do: allintitle:Neil Diamond If You Go Away on YouTube, and get exactly what you would think, results with all those words in the title. but now, you dont: https://youtube.com/results?search_query=allintitle:Neil+Dia... now, I get crap like this: Neil Diamond & Shirley Basse…

> https://support.google.com/websearch/answer/2466433

> those two searches are exactly the same

Yes, that appears to be a recently-introduced typo -- the archived version from April does have a space: https://web.archive.org/web/20230412181331/https://support.g...

I submitted a feedback comment, hopefully they'll fix the typo.

(For future reference, here is a snapshot of the current version without a space: https://web.archive.org/web/20230722085337/https://support.g...)

Re: Internet search tips

#26

Post by thakoppno »

andrepd wrote: post #24
Jakob wrote: post #15

+1 for his tip of "Search The Internet Archive". The other day I searched for the Tom & Jerry full episodes on the web to no avail (streaming platforms and video platforms like youtube only have rubbish cuts). The internet archive has every episode starting from the first one in 1940, in an easily accessible player without any ads or recommendations: https://archive.org/details/tom-and-jerry-all-114-episodes

Your comment just reminded me of how great the Internet Archive is, so I guess it's time to donate another 100 bucks to IA again.

it’s within the realm of a few apple stores to serve the internet archive?

Re: Internet search tips

#29

Post by pdanpdan »

38 wrote: post #2

my problem is some operators just dont work any more, either on purpose or because of crappy quality control. for example, you used to be able to do: allintitle:Neil Diamond If You Go Away on YouTube, and get exactly what you would think, results with all those words in the title. but now, you dont: https://youtube.com/results?search_query=allintitle:Neil+Dia... now, I get crap like this: Neil Diamond & Shirley Basse…

The one not working has a space after the colon. It's even in the section taking about this :)

Re: Internet search tips

#30

Post by tempodox »

winwang wrote: post #11
Yemeth wrote: post #9

Earlier quoted context omitted.

I'm not sure how LLMs are going to be immune to SEO spam and advertising. As if human nature would magically transform and people would stop buying stupid stuff. LLMs are already being used to make the web even less useful, by shitting out vast ammounts of meaningless and even outright wrong text for SEO purposes. And don't forget the systems are being trained on the web in the first place… using a LLM that is able t…

I think the idea is that, if we (some of us) can figure out when something is SEO spam or rather, generally low quality, an LLM should be able to but faster and more quantitatively why.

And who, pray tell, would have an interest in giving us that? The internet overlords are advertising companies. Would you pay for such an LLM? Those companies have gotten so powerful because everyone wants stuff for “free”.
Post reply on HN