A search engine that favors text-heavy sites and punishes modern web design

Post by kews » Thu, Sep 16, 2021, 4:26 PM UTC

marginalia_nu wrote: post #225

asjdflakjsdf wrote: post #203

You should monetise this with amazon affiliate links that are relevant to each search. And then use that money to keep this project going. Google is fantastic, but it has become something different from what it was, the company and the product. It is so refreshing to see a modern tool that encourages exploration of the actual world wide web.

I might add a donate button or something if people want to help support the project, hardware isn't cheap and all. But I have a job and decent income. I think if this search engine became the way I earned money, it would influence the project in a bad way, and corrupt its purpose, which is to help people explore the less-commercial internet.

Post by omoikane » Thu, Sep 16, 2021, 4:28 PM UTC

marginalia_nu wrote: post #8

samsaga2 wrote: post #7

Where does the data come from? Do you index the whole web yourself? I see it totally impossible for a personal project. I'm very curious about that.

I do indeed index the web myself. Not the entire web, just a subset of it. The crawler quickly loses interest in javascript:y websites and only indexes at depth those websites that are simple. It also focuses on websites in English, Swedish and Latin and tries to identify and ignore the rest (best-effort). You'd be surprised how much you can do with modern hardware if you are scrappy. The current index is about 17.7…

Post by Torwald » Thu, Sep 16, 2021, 4:32 PM UTC

BenoitP wrote: post #221

LanceH wrote: post #175

Earlier quoted context omitted.

It would be nice if we could pipe search engines.

Definitely; We could create a meta search engine that queries them all, in desktop application format. Let's name it after a famous old scientist, and maybe add the year to prove it's modern: Galileo 2021.

Post by arnaudsm » Thu, Sep 16, 2021, 4:34 PM UTC

MarioMan wrote: post #117

arnaudsm wrote: post #87

I wish we could configure Google's algorithm to our needs, and blacklist websites.

It could get tedious depending on how many sites you want to block, but you can add "-site:google.com" to exclude google.com, for instance.

Post by gmueckl » Thu, Sep 16, 2021, 4:35 PM UTC

BenoitP wrote: post #221

LanceH wrote: post #175

Earlier quoted context omitted.

It would be nice if we could pipe search engines.

Definitely; We could create a meta search engine that queries them all, in desktop application format. Let's name it after a famous old scientist, and maybe add the year to prove it's modern: Galileo 2021.