With all the great progress in large language models lately, and them being excellent text compressors, I've started to wonder if you couldn't just replace a search engine with a like 100mb file full of weights that let you query essentially google scale results except all locally.
The world needs a non-profit search engine
261–270 of 396 posts
Re: The world needs a non-profit search engine
#262With all the great progress in large language models lately, and them being excellent text compressors, I've started to wonder if you couldn't just replace a search engine with a like 100mb file full of weights that let you query essentially google scale results except all locally.
YALM is 200GB and require 200GB of GPU Memory to run....
Re: The world needs a non-profit search engine
#263Earlier quoted context omitted.
> and wrap it in ads, and derive content from it i am probably missing something but can you give an example where this happens?
E.g. on Google if you search for "how to tie a tie", a little info box may pop up with step by step instructions. This content is taken from some website, but that website gets no page hits or ad revenue. Instead, Google gets to serve ads on the search engine results page. (I don't know if this happens for this specific example, but Google does this for some searches)
Re: The world needs a non-profit search engine
#264Earlier quoted context omitted.
Allow users to blacklist sites. Share blacklisted sites. Have the option of instead of hiding blacklisted sites entirely - show them in a different column. Have 4 different types of list. Whitelist - highest scoring Not listed - these websites are not ranked. Yellowlist - show but keep in a separate column Blacklist - don't show https://search.brave.com/help/goggles is interesting.
I found the thought of adding a "yellowlist" funny, as some people are starting to find the use of "whitelist" and "blacklist" racist.
Re: The world needs a non-profit search engine
#265Earlier quoted context omitted.
99%+ of people wouldn't use this, they would just try the search engine, see that the results suck, then stop using it. It could be useful for power users, though.
99%+ of people in the medical industry did not sanitize hands or equipment 100 years ago. 99%+ of people in the tech industry currently do not care to do the extra steps required for data neutrality, and privacy. 99%+ of people are lazy to the point of harming themselves and others. 1%- of people examine how the 99%+ do things and pioneer harm reduction tactics in spite of everyone constantly reminding them that no o…
Re: The world needs a non-profit search engine
#266Disclaimer: I work for Google, though far away from Search. Regardless of search engine design, there's HUGE money in SEO. Any successful search engine will be gamed. Do you have the developer power to go red-queen against all the large companies in the world?
For clarification, “red queen” means a conflict between two or more entities where the cost of engagement grows, but the relative advantage does not change. Simply put, search engines have been at war with SEO for over 30-years, which has significantly raised the bar not only being a search engine, but producing content; not to mention knowing how to search for information. With the introduction of machine generated…
But also yes the users and the UI both fail. When I used to search for something I would type in something like “gutter clog clean” but slowly started noticing that Google likes longer sentences like “how do I clean a clog in my gutters?”. In pursuit of making Knowsmore (from Ralph Breaks the Internet), Google lost the power user features. Search would be infinitely better if they actually fucking respected literal mode and stopped trying to treat me like an idiot with no attention span. Having search results that contain one out of like 8 words in my query and asking me if I want to include others and then when I say I do still showing me results without them is broken UI and not a user problem.
Re: The world needs a non-profit search engine
#267This seems really really naive. Do you really think a non-profit is going to fight the hordes of spammers, scammers, seo masses, mechanical turk hordes, etc that are going to game your system?
Not sure I missed the sarcasm here. Why would a non-profit not fight spam etc.? Why would a for-profit fight spam do so? I see the largest internet companies, including Facebook, Twitter, and also Google, fight spam and other harmful content only to the degree absolutely necessary to stay somewhat usable. Which makes sense because it's costly and does not generate profit. I would expect a non-profit, however, to focu…
There are very few incentives better than profit..This is going to be a US v/s USSR fight during the cold war..
Re: The world needs a non-profit search engine
#268Re: The world needs a non-profit search engine
#269One feature that I really wish more search engines would have is the ability to blocklist certain domains, particularly ones whose results are never relevant or helpful to the query itself (Pinterest, Quora, etc). It could even be used as a factor in the site’s search rankings.
Re: The world needs a non-profit search engine
#270Earlier quoted context omitted.
Allow users to blacklist sites. Share blacklisted sites. Have the option of instead of hiding blacklisted sites entirely - show them in a different column. Have 4 different types of list. Whitelist - highest scoring Not listed - these websites are not ranked. Yellowlist - show but keep in a separate column Blacklist - don't show https://search.brave.com/help/goggles is interesting.
99%+ of people wouldn't use this, they would just try the search engine, see that the results suck, then stop using it. It could be useful for power users, though.
Make a customizable and privacy-respecting search for us, power users.
Also, I have noticed that Firefox internal search works good for sites you had visited. So when I want to visit a page I have seen earlier, I can go straight to it skipping Google.
Also, you can click on any search box and add it with a prefix, so that you can search MDN or Wikipedia directly, again, without informing Google.
[1] https://source.chromium.org/chromium/chromium/src/+/main:com...