Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Kagi added a setting for removing paywalled links from search results

kagi.com

Post reply on HN
Print view View original

321–330 of 421 posts

Re: Kagi added a setting for removing paywalled links from search results

#321

Post by freehorse »

Zambyte wrote: post #316
freehorse wrote: post #298

Earlier quoted context omitted.

LLMs are not magic, nor are they gonna crawl some dozens of websites, they work with search results they are provided with, and thus they need good search results to work with. Maybe in the US or sth it is better, but where I live finding good shopping results from local shops/websites is not straightforward. Google shopping, that I just now checked, seems much better with querries that I struggled with kagi. Typical…

> nor are they gonna crawl some dozens of websites That is quite literally what !research does. But agreed on local search - I tend to use Google maps for anything local. Otherwise for something I'd buy online, ¯\_(ツ)_/¯

I meant, they are not gonna start from scratch by crawling websites, they are gonna rely on the search results to grab content of relevant results. I think this is what research does, in a higher quantity.

In contrast, I may start with a page in a website and start going around looking for related products etc. The assistant is not gonna start doing that (I think at least), it just gonna get the page provided by the search results. For this reason, what search results it is provided with is important.

I am also (mostly) buying online, but for certain reasons I want to buy from domestic websites rather than ones based in other countries, if possible. Kagi has not been great at providing great results for that.

Re: Kagi added a setting for removing paywalled links from search results

#322

Post by boplicity »

nottorp wrote: post #317
preg_match wrote: post #188

Earlier quoted context omitted.

The biggest problem with micropayments is how credit card payment processors work. You typically pay a percentage fee. But they thought of everything, so you also pay a flat fee per transaction like 10 cents. So they can get their money from tiny transaction. So for something like a 20 cent micropayment, you pay more to your processor than you pocket. One solution is a universal token system or something like it. You…

Whatever the solution is they'd better get to it because I'm not going to subscribe to every site that wants 20/month just because it shows once on HN or in search results.

Your comment illustrates the tension very well, I think. Businesses don't generally want customers who aren't their core market; those people though, often want one slice of a business's offerings. This can lead to big distractions for businesses, as putting in the effort to serve the wrong market is a waste of time. The publishing industry really fell for this when the internet became widespread; they dreamed of huge audiences and big ad numbers. Turns out, that was not a model that worked, at all. The model that works is focusing on serving a niche, and charging a subscription fee, so you can get predictable revenue.

Re: Kagi added a setting for removing paywalled links from search results

#323

Post by sleight42 »

LarryDarrell wrote: post #177
delis-thumbs-7e wrote: post #59

I think this is amazing. Love Kagi. I’m happy to pay for a good search. Nobody speaks about their AI Assistant, but it is really good. They somehow harnessed it so that it mainly searches info first and sticks to the verifiable data. I prefer it to Claude or any other, because it actually answers the question I need without fluff or “Great question! Here’s some plausible nonsense you can trip over instead of doing ac…

I've been a subscriber to Kagi for a few years and just started using the AI assistant. On the one hand, it's made me a believer in AI as it relates to web searching. On the other hand, the only reason I need AI to search the web is that the web is now a impenetrable forest of near unreadable, SEO-stuffed, spammy articles.

Ironic, isn't it? Same here.

Re: Kagi added a setting for removing paywalled links from search results

#324

Post by nottorp »

boplicity wrote: post #322
nottorp wrote: post #317

Earlier quoted context omitted.

Whatever the solution is they'd better get to it because I'm not going to subscribe to every site that wants 20/month just because it shows once on HN or in search results.

Your comment illustrates the tension very well, I think. Businesses don't generally want customers who aren't their core market; those people though, often want one slice of a business's offerings. This can lead to big distractions for businesses, as putting in the effort to serve the wrong market is a waste of time. The publishing industry really fell for this when the internet became widespread; they dreamed of hug…

> so you can get predictable revenue

That for some reason makes me think of those sites where you can insta subscribe online but you need to call and wait on hold for 6 hours to cancel :)

You know what's missing from this model? Back a million years ago when we all had pet dinosaurs, you could pay for a magazine issue on the street if it seemed interesting. And maybe if you found enough issues interesting you subscribed.

Where's that issue you can try out now?

Re: Kagi added a setting for removing paywalled links from search results

#325

Post by BrunoBernardino »

Interesting! This is something a couple of customers have requested for Uruky (co-founder here), among the highlight/removal of "AI Slop" and "Malicious URLs", but I honestly never thought it would be widely wanted. I guess we're wrong and we might add that soon. Does anyone know of a good (and free as in freedom) source/list for such URLs? They didn't seem to mention any.

Re: Kagi added a setting for removing paywalled links from search results

#327

Post by lostlogin »

Barbing wrote: post #256
cuu508 wrote: post #239

Earlier quoted context omitted.

> I don’t think either of us is going to change the other’s mind, so I’ll leave it here. So so so disappointing.

Keep the argument going if you can! He didn’t boycott USA when we bombed him. What’s gonna convince him? Maybe someone has the words.

If the option existed to remove various sources for search results (for me, Yandex, and hopefully any payment to them) existed, I’d be back.

I was more tolerant of my money going to US companies when I first tried Kagi, but my views have shifted a lot in the last year or so.

US actions have shifted in recent times, and it’s just foolish belligerence now. There was a bit of nuance in the past but at present it doesn’t even serve US interests.

Re: Kagi added a setting for removing paywalled links from search results

#328

Post by lostlogin »

mosselman wrote: post #294

I've been building my own metasearch engine after using Kagi for a long while and I must say that my results are getting better even than theirs. Kagi can do things at their scale that are not feasible for me right now and one of them is categorising links like they probably do for this feature. So it is inspiring. A route that might work is checking if there are ublock lists that keep track of paywalled sites. I've…

Any chance I could try it.

If it was 50-75% as good as Kagi, I’d pay a subscription.

I’d also really like a way to use it in safari/mobile safari.

Post reply on HN