Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Million Short allows users to remove up to the top 1M sites from a search set

forbes.com

Post reply on HN
Print view View original

51–59 of 59 posts

Re: Million Short allows users to remove up to the top 1M sites from a search set

#51

Post by mojomark »

taxonomyman wrote: post #17

We're actively working to add lots of features on Million Short in 2018. I'd be happy to add any feature requests to our roadmap planning.

> I'd be happy to add any feature requests to our roadmap planning.

Love the concept, seems to work well. I personally use the 'media' specification of Google often (mostly: images, videos, pdfs, scholar articles, and Google patents). I didn't see a way to filter on Million Short.

...and if you could find a way to filter content that is not behind paywalls that would be amazing. As an engineer I'm constantly searching standards/specs (e.g. IEEE, ASTM, ISO standards etc.) some of which you can find free copies of for the previous revision (which are still pretty good), but you have to dig deep through top-ranking paywall sites.

Re: Million Short allows users to remove up to the top 1M sites from a search set

#52

Post by dplgk »

thisisit wrote: post #28
dawnerd wrote: post #18

Earlier quoted context omitted.

Having worked for Demand Media, seo people will always find a way. It’s always going to be a cat and mouse game, sadly.

So is there a way around on this app?

Be the 1,000,001th result?

Re: Million Short allows users to remove up to the top 1M sites from a search set

#53

Post by viewtransform »

condiment wrote: post #10

I use million short to search for howtos written by real craftsmen in their field. One example is an end-grain cutting board that I made recently. For most things Ike that, the top 1000 are dominated by made-for-Pinterest blogs or major sites that aggregate low quality content that's good enough to get hits but not good for much more than that.

I just tested this for 'kumiko patterns' and 'islamic geometry' and was pleasantly surprised at the great results hidden 1000 links away that I would never have come across in google. I'm going to be using this search engine.

Re: Million Short allows users to remove up to the top 1M sites from a search set

#55

Post by Chriky »

rurban wrote: post #47
Chriky wrote: post #40

Earlier quoted context omitted.

> xapian, elasticsearch or lucene are the best, with xapian dominating the backend and the Java stuff the frontends Elasticsearch uses Lucene under the hood, in my experience Lucene dominates the actual indexing and searching, although I'm not familiar with xapian. By users, I reckon SharePoint search (FQL) is probably the biggest although it is way behind Lucene in features. Google actually used to sell bright yello…

With "xapian dominating" I meant the technical side. Of course lucene has more marketshare, because of the better elasticsearch frontend, and browser support. I.e highlighting and jumping to the results in word or PDF docs. I wouldn't trust Google locally neither, and it's expensive. SharePoint search is unfortunately used too often, yes.

What aspects does Xapian beat Lucene at?

Re: Million Short allows users to remove up to the top 1M sites from a search set

#56

Post by rurban »

Chriky wrote: post #55
rurban wrote: post #47

Earlier quoted context omitted.

With "xapian dominating" I meant the technical side. Of course lucene has more marketshare, because of the better elasticsearch frontend, and browser support. I.e highlighting and jumping to the results in word or PDF docs. I wouldn't trust Google locally neither, and it's expensive. SharePoint search is unfortunately used too often, yes.

What aspects does Xapian beat Lucene at?

Everything backend related. Much faster, much less memory, more backend features, huge indices - Google scale. (Gmane was its most prominent public user). Lot of language bindings like PHP, Perl, python.

Re: Million Short allows users to remove up to the top 1M sites from a search set

#58

Post by Chriky »

rurban wrote: post #56
Chriky wrote: post #55

Earlier quoted context omitted.

What aspects does Xapian beat Lucene at?

Everything backend related. Much faster, much less memory, more backend features, huge indices - Google scale. (Gmane was its most prominent public user). Lot of language bindings like PHP, Perl, python.

Can you link to evidence of it being faster, and expand on what you mean by "more backend features"?

I believe you, I just can't find evidence online.

My application is not that big, around 10 million text files, but I would be interested in anything faster (or allowing more complex queries) than Lucene, which is what I use at the moment.

Re: Million Short allows users to remove up to the top 1M sites from a search set

#59

Post by jjeaff »

frandroid wrote: post #34
jjeaff wrote: post #20

Earlier quoted context omitted.

What would we do without the garbage content that is eHow and wikiHow?

I had a friend who had a whole list of dozens of banned sites configured for his google searches, which made Google way more useful. And then one day, Google decided to cut that feature out, as part of their drive to remove power user features across their products.

I have always wanted that feature. I never knew it existed previously.
Post reply on HN