Live data from Hacker News

A search engine that favors text-heavy sites and punishes modern web design

search.marginalia.nu

281–290 of 735 posts

Re: A search engine that favors text-heavy sites and punishes modern web design

#281
Congratulations. Truly impressive search results. I tried two, one word searches. The results were interesting, useful, and would have been impossible (well, really really hard) to find, on standard search engines. Plus, no garbage, ads, recommendations, etc etc. As another commenter suggested, it is what World Wide Web searches results were like, twenty years ago!

Re: A search engine that favors text-heavy sites and punishes modern web design

#282
Based on a few searches it seems to favor sites with very long passages of text. Search for a name and you get pages with massive lists of names. It quite simply isn’t very good at everyday searches. But it does bring up the point, shouldn’t I be able to tell my search engine I want results like this? It should be a feature of google I can turn on and off. It should be one of many ways to impact relevance.

Re: A search engine that favors text-heavy sites and punishes modern web design

#283
post #276
post #275

This is a search engine indexing the internet on a mariadb database hosted on consumer hardware maintained by a single person as a hobby and it does not suffer from HN hug of death

how on earth do you index so much on consumer hardware? my frontend developer mind is blown.

Wait till you learn that modern CPUs run billions of cycles per second. With multiple cores in parallel! And they can reach transfer rates of tens of gigabytes per second to RAM, or around a terabyte per second into L3.

Re: A search engine that favors text-heavy sites and punishes modern web design

#284

Earlier quoted context omitted.

I tend to prefer Wikipedia for movies. The exception is actor headshots if I'm trying to identify someone, which Wikipedia lacks for licensing reasons, but otherwise Wikipedia tends to be better than IMDB for most needs. Wikipedia has an IMDB link on every article anyway. Another need I guess might be reviews, for which RT or MC are better than IMDB: not sure if either of those two will fare better than IMDB in this…

For me, imdb was much better when they had user comments/discussion. I never even posted on it myself, but browsing the discussions one could learn all sorts of trivia, inside info, speculation, etc about each movie. Since they (inexplicably) killed that feature, I rarely even visit anymore. Your right, for many purposes wikipedia is better, especially for TV series episode lists with summaries.

IMDB management thought it was their brilliant editorial work that drew people to their site. Morons. It was the comments all along. Of course they also believed they could create gravity-free zones by sheer force of executive will (and maybe still do).

Re: A search engine that favors text-heavy sites and punishes modern web design

#285

Pretty cool. I am not sure yet how useful, but cool it is. However, it seems that it currently does not support non-Latin alphabets. Which I understand in an early version. Still, it's handling of such "exception cases" could be improved: when I search for a Russian word, say "Аквариум", I get >, which is rather rude...

"It also focuses on websites in English, Swedish and Latin and tries to identify and ignore the rest (best-effort)."

https://news.ycombinator.com/item?id=28551183

Re: A search engine that favors text-heavy sites and punishes modern web design

#286
post #280

I tried a few searches. >: none of the search results appeared to have anything to do with Javascript pipe syntax. (Which doesn't exist yet, but it's under discussion.) Google gives a bunch of highly-relevant results. >: first result is a list of books about relativity, one of which is Reichenbach's "Philosophy of space and time"; good, but there's no real information there. Second is about Reichenbach but nothing to…

To be fair, those searches are pretty weird.

Re: A search engine that favors text-heavy sites and punishes modern web design

#287

Ivermectin (marginalia): https://search.marginalia.nu/search?query=ivermectin+ Ivermectin (Google): https://www.google.com/search?q=ivermectin The difference in the overall _thrust_ of the results is remarkable. Very interesting! Thanks for building it.

Lol!

Re: A search engine that favors text-heavy sites and punishes modern web design

#288
post #281

Congratulations. Truly impressive search results. I tried two, one word searches. The results were interesting, useful, and would have been impossible (well, really really hard) to find, on standard search engines. Plus, no garbage, ads, recommendations, etc etc. As another commenter suggested, it is what World Wide Web searches results were like, twenty years ago!

PS. I added Marginalia as a search option (even the default for now) in Firefox Nightly (on Android). In case others want to, under settings for search, you can add other, then name, and then: https://search.marginalia.nu/search?query=%s

Re: A search engine that favors text-heavy sites and punishes modern web design

#289

Yeah so this is my project. It's very much a work in progress, but occasionally I think it works remarkably well for something I cobbled together alone out of consumer hardware and home-made code :-)

How are you doing the crawling without getting blocking? -- the hardest part.

Re: A search engine that favors text-heavy sites and punishes modern web design

#290
post #166

Earlier quoted context omitted.

That's why I use Saffron [1], it magically converts those sites into a page in my recipe book. I found it when the developer commented here in HN. Also, a lot of cooking website have started to add a link with "jump to recipe" functionality allowing you to skip all the crap. [1] https://www.mysaffronapp.com/

There's also https://based.cooking .

Run by Luke Smith, an admitted neo-reactionary and possible white supremacist who writes like a 4chan reject.
Post reply on HN