Live data from Hacker News

Google Removed 749M Anna's Archive URLs from Its Search Results

torrentfreak.com

161–168 of 168 posts

Re: Google Removed 749M Anna's Archive URLs from Its Search Results

#161

Feels weird to say but I have found using Yandex of all places an excellent search engine for content that get taken down by DMCA requests. Eg if you want to watch a movie that's not on Netflix using a web stream the search results are far better. Feels like Google circa 2005.

[deleted]

Re: Google Removed 749M Anna's Archive URLs from Its Search Results

#162

Earlier quoted context omitted.

I believe Kagi uses the Yandex index as their base as well.

Based on what? Have you read that somewhere?

Yandex is one of Kagi's index sources. They used to publish a list of their sources but have changed it to a generic "we use multiple sources" because they got so much shit for using Brave (because of its founder’s bigotry) and Yandex (because of the ethical dilemma of paying a company headquartered in Russia which in the best case pays taxes and in the worst case has Kremlin/military involvement). This has been a contention debate for awoke, you can search their forum and discord for more details.

Re: Google Removed 749M Anna's Archive URLs from Its Search Results

#163

Earlier quoted context omitted.

I’m quite happy trading off the agency of wading through trash to an LLM. In fact, I would say that’s something they’re pretty good at.

> look at sources and decide ... which ones are legitimate > I would say that’s something they’re pretty good at. Lol. Lmao, even. Seriously, LLMs are famously terrible at this. It's the entire problem behind prompt injection. https://en.wikipedia.org/wiki/Prompt_injection They're really good at... ingesting the trash. Yeah, that's pretty much their whole purpose. But understanding it as trash? Not even close. LLMs d…

I like the way this paper puts it: https://link.springer.com/content/pdf/10.1007/s10676-024-097...

Re: Google Removed 749M Anna's Archive URLs from Its Search Results

#164
If you don't have access to massive amounts of digitized books you are at a significant competitive disadvantage i.e, AI + RAG is a game changer for consuming technical content. That last piece of the puzzle I am missing for my setup is being able to digitize the books as markdown + latex for mathematics equations, right now it is just expensive.

Re: Google Removed 749M Anna's Archive URLs from Its Search Results

#165

Earlier quoted context omitted.

> look at sources and decide ... which ones are legitimate > I would say that’s something they’re pretty good at. Lol. Lmao, even. Seriously, LLMs are famously terrible at this. It's the entire problem behind prompt injection. https://en.wikipedia.org/wiki/Prompt_injection They're really good at... ingesting the trash. Yeah, that's pretty much their whole purpose. But understanding it as trash? Not even close. LLMs d…

I like the way this paper puts it: https://link.springer.com/content/pdf/10.1007/s10676-024-097...

Gotta admit, I agree with the title (still reading it).

https://www.wordnik.com/words/bullshit

The one I care about (near the bottom of the page); really, the only meaningful use IMO, except it can also be a noun:

> verb speak insincerely or without regard for facts or truths

It's "without regard for facts or truth".

Re: Google Removed 749M Anna's Archive URLs from Its Search Results

#166

Earlier quoted context omitted.

I like the way this paper puts it: https://link.springer.com/content/pdf/10.1007/s10676-024-097...

Gotta admit, I agree with the title (still reading it). https://www.wordnik.com/words/bullshit The one I care about (near the bottom of the page); really, the only meaningful use IMO, except it can also be a noun: > verb speak insincerely or without regard for facts or truths It's "without regard for facts or truth".

Yup, that’s just about what the paper was getting at

Re: Google Removed 749M Anna's Archive URLs from Its Search Results

#167
post #140

Earlier quoted context omitted.

The purpose of a system is what it does.

It's not "a system". Each company is run by different people, and is under different pressures, and makes different decisions. Monolithing that is silly.

Have some Beer:

https://en.wikipedia.org/wiki/The_purpose_of_a_system_is_wha...>

Re: Google Removed 749M Anna's Archive URLs from Its Search Results

#168
post #158
post #156

Earlier quoted context omitted.

ddg actually has its own crawler and does a tiny amount of its own indexing. It used to do more but resorted to just mostly using Bing and Yandex indexes

We have actually started doing a lot more crawling and indexing in the last 24 months.

Oh really? That’s cool, how much have you crawled so far?
Post reply on HN