441–450 of 475 posts
>Gabriel Weinberg @yegg Apr 17, 2022 10:18AM UTC Hoping to clear up some misconceptions about our private search engine. ...
Gabriel Weinberg, @yegg CEO & Founder @DuckDuckGo - Nitter : https://nitter.net/yegg/
Earlier quoted context omitted.
How do we know these privacy claims are true? What if Kagi was Chinese or Russian, would you still trust it and why? And how do we know Kagi doesn't end up the same way as DDG?
(Kagi dev here) Kagi is privately owned US corporation. > And how do we know Kagi doesn't end up the same way as DDG? Being a paid service means Kagi's incentives are very different. Instead of selling your data or profiting from feeding into ad-tech food chain, we are interested in selling you a subscription. This changes everything as the number one thing in Kagi's universe becomes what the users want, different to…
Question: does anyone actually know what DDG does with user data? Like they market themselves as a "privacy respecting" search engine, but how much of this is truth? I'd imagine there's good money in convincing people they have privacy because then they'll provide more interesting data. Has the company ever been audited? Why should they be trusted to not compromise user privacy? Imo at least Google is honest: you kno…
>since DDG isn't open source like searx, how do we know there is ANY truth to their marketing claims? You wouldn't know this even if it was open source. Open source does nothing here. Looking at the source code will not tell you their data retention policies or what is actually stored in their databases. It will also not guarantee the source that you see matches what is on their servers.
Earlier quoted context omitted.
Having worked on Google's indexing system, I can't imagine how much it would cost to write all of the crawling and indexing code from scratch, and then run it on over the visible web. You need to bootstrap somehow form an existing index if you want to get anywhere in any reasonable time. If there's a market for alternative search engines out there, AWS is already serving so much of the web that Amazon should really p…
Amazon ran A9.com as a search engine from 2004 to 2008. https://en.wikipedia.org/wiki/A9.com#A9.com_search_portal
The crawling and initial indexing stages need a lot of scaling and performance tuning work, which is a core competency for the AWS engineers. Furthermore, essentially zero people say "I want to build a startup around my new crawl scheduling idea, but it's too time consuming and expensive to write the rest of the search engine." Many more people say "I have a new idea for ranking" or "I have a new idea for content extraction, but it's too expensive and time-consuming to write the rest of a search engine".
Google and Bing already expose "custom search engines" which are basically just filters on top of their search engines. I'm talking about something similar, but much deeper customization.
Also, I was at Goldman when Google Search Appliance was EoL'd. GS had plenty of internal content that needed to be indexed, absolutely needed to be kept private, and wasn't well indexed by any of the replacements GS evaluated. For companies that keep lots of documents in AWS storage, it would be good to open up the space for Google Search Appliance replacements. Amazon could write their own, but given that Google abandoned the space, the profit margins aren't great for a huge company. However, creating a search ecosystem within the AWS ecosystem makes the AWS ecosystem more attractive. Maybe forgoing the search profits and inviting in search providers would be a net win in selling more AWS compute and storage.
Funny how the narrative on DDG has changed. I used to get downvoted to oblivion for merely mentioning they used Bing under the hood. Where are all the people that used to defend them so vigorously? I wouldn't be surprised if it's the same people now hating on them.
Earlier quoted context omitted.
The YouTube-DL website notably does not come up in those search results, it's their GitHub page that does. The website does appear in the sidebar, because it pulls the sidebar data from Wikipedia, and YouTube-DL's Wikipedia page does come up. Note that if you do a google search ( https://www.google.com/search?q=youtube-dl ) their website is the first result.
Both the website and the GitHub are top two results at my end, in India.
Earlier quoted context omitted.
I used to be able to find MP3s with Google, until one day it simply stopped working. Then I moved to Baidu, which worked for a while. I now use DDG to find movies, and yet looks like the curtain may be closing on that one too. I fear it might only be a matter of time before Yandex stops working too.
there are telegram bots for it though, personally I don't use them but people swear on them btw Baidu is extremely slow due to GFW
https://news.ycombinator.com/item?id=31059882 : DDG: We are not “purging” any media outlets from results >Gabriel Weinberg @yegg Apr 17, 2022 10:18AM UTC Hoping to clear up some misconceptions about our private search engine. ... Gabriel Weinberg, @yegg CEO & Founder @DuckDuckGo - Nitter : https://nitter.net/yegg/
Earlier quoted context omitted.
Thanks, but that is not my site. Mine is darekkay.com and it isn't indexed by mojeek.
OK, thanks. Why did you think that? Looks like, at least some, is indexed: https://www.mojeek.com/search?q=darekkay+site%3Adarekkay.com