71–80 of 383 posts
I like this attitude. Makes me happy to be a paying member of SourceHut.
> they’ve demonstrated gross incompetence in privacy Not sure I buy the example that is given here. 1. It's an issue in their browser app, not their search service. 2. It's not completely indefensible: it allows fetching favicons (potentially) much faster, since they're cached, and they promise that the favicon service is 100% anonymous anyway. 3. They responded to user feedback and switched to fetching favicons loca…
As such, they effectively have a list of "tier 1" domains.
The way I'd code a better search engine is I'd design an ML model that's trained to recognize handwritten HTML like this, and only add those to the index. It'd be cheap to crawl probably only needing a single computer to run the whole search engine. It'd resurrect The Old Web, that still exists, but just got buried beneath the spammy SEO optimized grifter web over the years as normies flooded the scene.
Earlier quoted context omitted.
Do you have a search engine that you prefer to use that claims not to store said information that I might try?
I can hand on heart tell you that Mojeek doesn’t and never has. I know this because I work for Mojeek.
In your Privacy page (Data Usage Section) there is a mention of stored "Browser Data" & " These logs contain the time of visit, page requested, possibly referral data, and located in a separate log browser information." & "We may also use aggregate, non-personal search data to improve our results".
This is an honest question - How is that not exactly what the Parent stated was the issue?
So they save your web searches and claim that they do so in an non-personally identifiable way.is somebody aware of a project where the end-user Browser acts as a Crawler? it already spent the energy to render the content. Readability.js extracts page section, does some processing for keywords, hashes anchor links, signs it and sends it off. Cache-Control response headers indicate if the page is public or private. Of course, where it is sending to will have an electricity bill to pay to index the submissions.
What am I doing wrong (or right), here? I put a thing in and find it. I just don't use Google any more.
Genuinely curious why it's working for me and such garbage for everyone else.
My main problem with DDG is that there's no way to be sure they actually respect their users' privacy as they claim to. Ideally, services like theirs would be continuously audited by respectable, trusted organizations like the EFF.. multiple such organizations even. Then I'd have at least some reason to believe their claims of not collecting data about me. As it stands, I only have their word for it.. which in this d…
Being super financially successful off free products and services is not a recipe for an honest, citizen respecting company.
How would anybody ever know what the server is running and/or doing with the data you send it, regardless of if it is running open or closed source code? A service, running on somebody else's machine, is essntially closed. I think the only way to have an 'open' service is to have it managed like a co-op, where the users all have access to deployment logs or other such transparency. Even then, it requires implicit tru…
I think the next step forward should be to have indices that can be shared/sold for use with local mode. So you might buy specialised indices for particular fields, or general ones like what Google has. The size of Google's index is measured in petabytes, so a normal person would still not have the capability to run something like that locally.
Edit: In another thread, ddorian43 has pointed out the existence of Common Crawl,[2] which provides Web crawl data for free. I have no idea if it can be integrated with YaCy, but it is there.
I found out through comments on hn that 8chan was backup under a new name: 8kun
Typing it into google I get articles about it but no link in the results.
In duckduckgo first link.
Made me think what else am I missing?