71–80 of 181 posts
Slightly tangential, but does anyone know if there is a way to submit links to the Common Crawl (which Alexandria Search relies on)? I haven't seen any traffic from CCBot and my site doesn't seem to show up in Alexandria's results (compared to 2nd/3rd on Google for a bunch of queries).
There have been a few search engines out recently. I'm curious how people evaluate them quickly. I've realized my searching is basically optimized for google and the web that has grown up around it. Also, in 1998 I wasn't as aware of what was out there as I am now. It's pretty rare (even if its possible) that I do a search and come across a completely new site that I haven't heard of before, for anything nontrivial.…
Are there search benchmarks to be found somewhere?
There must be. If you want to write a search engine, you need a way to validate the results.
How does it work? The GitHub page is not very descriptive. I tried to search "Putin" and the first link is the NYTimes homepage. Does that mean NYTimes covers the war more than the other publications, or is it backlink-driven?
There have been a few search engines out recently. I'm curious how people evaluate them quickly. I've realized my searching is basically optimized for google and the web that has grown up around it. Also, in 1998 I wasn't as aware of what was out there as I am now. It's pretty rare (even if its possible) that I do a search and come across a completely new site that I haven't heard of before, for anything nontrivial.…
I've been wondering for a while now about building a search engine for the ad free web. That is, penalize or outright refuse to index any recognized advertising network, letting through only those sites which don't perform invasive tracking with third party services. Mostly as a curiosity: what would be left? What would rise to the top when you filter all of that out?
Excuse me while I get on a hobbyhorse - would love to use web search that lets me boost PageRank for certain sites (which then would carry over to sites they link to.) Could automatically boost PageRank for sites I subscribe to, for example. Expensive in terms of computation or storage? Charge me!
You might get away with having like a custom micro-index where your search basically does a hidden site:-search for your favorite domain and related domains, but that's not quite going to do what you want it to do.
For my first search of "GFlowNetworks" (which the search bar suggested) It said: Found 5,887 (or something) results, but showed no results For my second I searched my name and got a Wikipedia article about a show I've never heard of which didn't have my name anywhere in it. For my third I searched "GFlowNetworks" again and it said Found 2,656,844 results in 1.61s, but showed no results again
Earlier quoted context omitted.
we're exploring adding instant answers in clean way at Breeze; leaning towards using open-source library &/or external API to compute vs. building in-house also adding premium tier that's alerts + ad free + feeling lucky that would take user to top result, which is a UTC page, re: https://breezethat.com/?q=UTC+time
I just tried breezethat and had to scroll past 6 ads (two screenfuls on my iPhone 10) to see a single result. I know ads are necessary but this is punitive.
4 of 6 are google's and have to include -- iterating some designs internally that refactor how they're presented on mobile
Slightly tangential, but does anyone know if there is a way to submit links to the Common Crawl (which Alexandria Search relies on)? I haven't seen any traffic from CCBot and my site doesn't seem to show up in Alexandria's results (compared to 2nd/3rd on Google for a bunch of queries).
You can verify whether or not your site exists in the CC data set by searching for it here: https://index.commoncrawl.org/
The initial commit was 11 months ago and written in C++. I haven’t done C++ since college ~7 years ago. Is it a good language for greenfield projects these days, or would something like Go or Rust (or Crystal, Nim, Zig) be better for maintainability and acquiring contributors?