Live data from Hacker News

Kagi Small Web

kagi.com

91–100 of 223 posts

Re: Kagi Small Web

#91
I think it shows the limits of hand curation. It's a tiny, human-reviewed slice of the "small web", only allowing a subset of blogs... but if you select the "programming" category and click around for a short while, you get a fair amount of obvious AI slop.

I don't think it's Kagi's fault, but I guess it's depressing in a way. A lot of "small web" bloggers dream of being a part of the "big web", and when they get a cheat button, they have no second thoughts about mashing it.

Re: Kagi Small Web

#92
I'm a Kagi search/assistant user and advocate but the "small web" product is a frustrating misnomer.

To me the small web is any little website that was created to be interesting rather than to sell me something. That includes stuff like neocities, "shrine" type sites, single purpose sites, fandom portals, web experiments, etc.

Unfortunately Kagi's definition of "small web" is: blog or webcomic. You must have an RSS feed and it must have recent posts. That rules out so much interesting stuff I don't understand the point.

Re: Kagi Small Web

#93

I've been using the Kagi search engine for months now and I'm not impressed. I bought into it because there were a lot of posts saying that it was "just like old Google" but this has not been my experience. It's the same as new Google, you can type in what you're looking for exactly and you'll get random sort-of related websites. I remember when you could half-remember a comment from a website, type that into Google,…

It's hard to judge one's personal experience with "personalized" search engines. I have personalized search turned off for Google so Kagi is a much better experience for me. I'd recommend leaning more into their feature to lower/block sites from your results, which with Google would require an extension for a similar but degraded experience.

Re: Kagi Small Web

#94
post #88

Does it work for you guys to go to about and then click on the "list" link? For me it says I'm blocked due to hitting a "secondary" rate limit (don't understand what that means). I don't think I've opened a page on github yet today so clearly it's a lie. Is it the referer that triggers this? In general, freeloading the "small web" on a Microsoft service is kind of ironic. Being blocked by algorithms that try to detec…

If you’re not signed into GitHub, it always throws those errors page (maybe due to scrapping being done with residential IP addresses).

Re: Kagi Small Web

#95

I've been using the Kagi search engine for months now and I'm not impressed. I bought into it because there were a lot of posts saying that it was "just like old Google" but this has not been my experience. It's the same as new Google, you can type in what you're looking for exactly and you'll get random sort-of related websites. I remember when you could half-remember a comment from a website, type that into Google,…

> I remember when you could half-remember a comment from a website, type that into Google, and get taken to the article you were looking for.

Is that even possible today considering there is so much more information and pages around today than in 2010? Old google worked with old Internet. The old Internet does not exist.

Re: Kagi Small Web

#96
I'm one of the contributors for the Obsidian RSS reader (https://github.com/amatya-aditya/obsidian-rss-dashboard) and one of my first contributions to the project was adding in the Kagi RSS feed to the discover page!

It refreshes every 5 hours and shows you the most recent blogs published on Kagi. Check it out!

Re: Kagi Small Web

#97
post #59

Earlier quoted context omitted.

But then you're not using kagi search just the LLM

No, the responses are backed by searches.

So some guy does hard work developing some technique or solving some problem. He documents his experience, puts up a tutorial on DO or AWS or somewhere else, and the ads on that document help offset the cost of hosting. Now comes along Kagi, scrapes that data, and presents it to you, their paying customer.

I see a problem with this.

Re: Kagi Small Web

#98

I've been using the Kagi search engine for months now and I'm not impressed. I bought into it because there were a lot of posts saying that it was "just like old Google" but this has not been my experience. It's the same as new Google, you can type in what you're looking for exactly and you'll get random sort-of related websites. I remember when you could half-remember a comment from a website, type that into Google,…

Off topic, but ref "I remember when you could half-remember a comment from a website, type that into Google, and get taken to the article you were looking for" It's funny to me that (to my knowledge) no browser (mainstream?) implement this functionality yet. Seems like a no brainer to index what the user have actually seen... (Could even be restricted based on viewport - I don't think it's that crazy of an idea) I kn…

>It's funny to me that (to my knowledge) no browser (mainstream?) implement this functionality yet. Seems like a no brainer to index what the user have actually seen...

The answer to this is complicated.

Both Google Chrome and Microsoft Edge actually implement this. Behind the scenes, both will upload your browser history to the cloud. You can see it in network packet captures. It's implemented in the browser for the vendor, but not for the user.

The choice to not implement this for the user is very deliberate. It's contrary to the vendor's interests if the browser provides this capability directly to users. If a user's browser can take you to a website directly, then you are not using the vendor's search engine, meaning you are not looking at their ads, paid search results, algorithm, etc. It would severly impact their business model.

This is also the reason why browsers have:

- Adopted Google Chrome's "Omnibar" instead of a separate address bar and search bar.

- Implement only basic hierarchical organization for browser Favorites.

Directly and indirectly, Google is the central nexus of all modern browsers. Aside from Google Chrome, they also:

- Fund the vast majority of Firefox.

- Pay Apple for preferential treatment.

- Provide the same mechanisms to vendors who base their browsers on Chromium (i.e., Microsoft Edge, Brave).

I would love for this to not be the case. There is hope to be found in small independent browser and search companies/projects.

Re: Kagi Small Web

#99

Earlier quoted context omitted.

Off topic, but ref "I remember when you could half-remember a comment from a website, type that into Google, and get taken to the article you were looking for" It's funny to me that (to my knowledge) no browser (mainstream?) implement this functionality yet. Seems like a no brainer to index what the user have actually seen... (Could even be restricted based on viewport - I don't think it's that crazy of an idea) I kn…

There are things like Mymind (SaaS) or Karakeep (selfhosted) that do this, though they require you to explicitly save the pages instead of indexing everything by default

I would really like to see integration between Karakeep and SearXNG so that I could combine online search engine results with my self-hosted bookmarks serice.

Re: Kagi Small Web

#100

Earlier quoted context omitted.

Off topic, but ref "I remember when you could half-remember a comment from a website, type that into Google, and get taken to the article you were looking for" It's funny to me that (to my knowledge) no browser (mainstream?) implement this functionality yet. Seems like a no brainer to index what the user have actually seen... (Could even be restricted based on viewport - I don't think it's that crazy of an idea) I kn…

That's called search: in history.

I think you would need to take it a step further and do full-text search on loaded pages. It's certainly possible but probably pretty data intensive.
Post reply on HN