Brave Search beta • Hacker News Board

Re: Brave Search beta

#601

Post by Kiro » Wed, Jun 23, 2021, 9:49 AM UTC

xpe wrote: post #530

therein wrote: post #289

Earlier quoted context omitted.

Violating a website's ToS is hardly illegal, though.

> Violating a website's ToS is hardly illegal, though. Can you be more specific as to your claim? Not illegal in what sense(s)? And what is your basis for the claim? I'm not a lawyer, but saying "violating a website's ToS is hardly illegal" is fraught advice. While individuals may get some leeway when it comes to ToS violations (see [1] and [2]), I would expect companies scraping and/or extracting content would be tr…

The only way for it to be illegal is if they're breaking a law, but then it would be illegal regardless of what the ToS says.

Re: Brave Search beta

#602

Post by 1vuio0pswjnm7 » Wed, Jun 23, 2021, 9:57 AM UTC

yewenjie wrote: post #574

1vuio0pswjnm7 wrote: post #550

Earlier quoted context omitted.

I just tested the 47 servers listed in https://searx.space/data/instances.json . I did not use a browser. No Javascript, cookies, etc.. A good number of them worked fine. Who knows what the people running those instances do with the search data they acquire. What I like about searx though is the list of search engines it potentially targets. Comprehensive lists of search engines on the internet are always valuable. I…

What does your metasearch approach look like?

A. Text-only

B. Search from command line

C. Can open an index.html of saved search results in any browser; each query gets its own SERP; search results are saved in a directory that can be tarballed and compressed allowing simple transfer to any computer with a UNIX userland

D. Easy to add new sites; follows a failry standard template; currently at only eight sites, but adding more (like the ones in searx)

E. Requires only standard UNIX utilities; consists of small shell scripts of less than 2000 chars

F. Fast; no cruft

Unique features:

1. Streamlined SERP; URLs only, minimal HTML, i.e., ,

, , , ; no images, Javascript or CSS; SERP contains timestamps in HTML comments to indicate when each query was submitted

2. Each SERP contains deduped batches of results from different search engines; source search engine indicated by short prefix; if desired, can resort to intersperse results from different sources, e.g., sort by URL

3. Continuation of search; allows retrieval 100s of results by spreading searches across periods of time too long for websites to track, thus allowing retrieval of large numbers of search results while avoiding ridiculously small result limits or temporary bans for "searching too fast" 4. By default only minimum headers sent; custom headers can be sent when appropriate for particular site, e.g., DNT to findx.com; allows for complete customisation of presence/absence/content/order/case of HTTP headers, thus can potentially emulate any browser or other HTTP client (also supports HTTP/1.1 pipelining which curl cannot do)

5. Can be used with any TCP client; not limited to one library, e.g., libcurl; works great with proxies like stunnel and haproxy

6. URL params or hidden form fields that can potentially be used to link one SERP with another SERP are removed or rendered ineffective

Re: Brave Search beta

#603

Post by 0x49d1 » Wed, Jun 23, 2021, 10:26 AM UTC

jonathansampson wrote: post #381

r-w wrote: post #375

Earlier quoted context omitted.

Brave Search supports !bangs ;)

Indeed, including nearly all of DDG's !bangs :) We also add in some others, such as !so for StackOverflow, !gh for GitHub, and !mdn for the Mozilla Developer Network.

And is there any list of all available bangs + also do we have an ability to add new ones?

Re: Brave Search beta

#604

Post by the_other » Wed, Jun 23, 2021, 10:41 AM UTC

c-fe wrote: post #570

__ka wrote: post #567

Earlier quoted context omitted.

The chosen country is important. `uva` may be more commonly associated with the University of Virginia in the US. For Netherlands (same query) https://search.brave.com/search?q=uva&country=nl will correctly point to Universiteit van Amsterdam. At present we default to country US. We're looking to implement better defaults soon. We do hope you stick around!

Thanks, I appreciate you taking the time to address my problem, however me having to change the country manually sounds like an additional workaround. I wish you the best luck though with your search!

The whole point of DDG is to respect privacy. That means knowing as little about its users as possible. The country select actually improves the (impression of) privacy for me.

Re: Brave Search beta

#605

Post by mackrevinack » Wed, Jun 23, 2021, 10:52 AM UTC

unicornporn wrote: post #261

mrpf1ster wrote: post #63

Earlier quoted context omitted.

DuckDuckGo allows you to do a Google search by prepending "!g" to any query. So usually I do that for the last 5% of queries that DDG fails on.

Or you could just use https://startpage.com/ and get Google quality results 100% of the time.

that's also 100% reliant on google though. what would happen if that became a lot more popular than it is now? would google try to sabotage it in any way?

i would rather support and spread the word about search engines that don't rely solely on google

Re: Brave Search beta

#606

Post by budibase » Wed, Jun 23, 2021, 10:54 AM UTC

I've been using this for a day, and it's been surprisingly good. My only concern, is the grip of the Google ecosystem always seems to lure me back in.

I feel, for this Brave to truly win, they need to consider Auth, workplace tooling, and email. Attempt to match Google toe-to-toe and fight them as a platform/ecosystem, rather than a search engine.

Easier said that done, of course.

Re: Brave Search beta

#607

Post by ntp85 » Wed, Jun 23, 2021, 10:56 AM UTC

getcrunk wrote: post #582

ntp85 wrote: post #559

Earlier quoted context omitted.

> Also, it is improving all the time - it’s just that for some reason the few missteps are way overpronounced. I don't understand why Firefox gets this benefit of doubt and other browsers (e.g. Brave) do not.

Well for one, because Mozilla has contributed significantly to the world and have a long history of doing so. (Thunderbird, mdn)

Thanks, that's a good point. BAT and the associated concept of rewarding content creators or Brave Search could be seen as contributions to the world as well, I think.

Re: Brave Search beta

#608

Post by [deleted] » Wed, Jun 23, 2021, 11:18 AM UTC

gigamatt wrote: post #244

I've been working on this private search engine https://private.sh/ for a while. It encrypts your query using client-side javascript so only the Gigablast search engine can read your query. And your query is delivered to Gigablast through an anonymizing proxy that is not in Gigablast's control. So you get TOR-like privacy. Also Gigablast's privacy policy https://gigablast.com/privacy.html shows that your query is not…

[deleted]

Re: Brave Search beta

#609

Post by amjd » Wed, Jun 23, 2021, 11:19 AM UTC

TedDoesntTalk wrote: post #316

Zhyl wrote: post #37

Earlier quoted context omitted.

In December '19 the company that would end up being acquired by Brave did a number of blog posts [0] where they explained the tech. The short answer is 'a lot of word2vec'. [0] https://www.0x65.dev/

why is Brave calling them Tailcat? The company was Cliqz, not Tailcat.

Cliqz had closed last year. The team went on to create a new product called Tailcut, which Brave acquired.

Re: Brave Search beta

#610

Post by aarnushrithkha » Wed, Jun 23, 2021, 11:22 AM UTC

gigamatt wrote: post #244

I've been working on this private search engine https://private.sh/ for a while. It encrypts your query using client-side javascript so only the Gigablast search engine can read your query. And your query is delivered to Gigablast through an anonymizing proxy that is not in Gigablast's control. So you get TOR-like privacy. Also Gigablast's privacy policy https://gigablast.com/privacy.html shows that your query is not…

Im using private.sh but what is the proof that it does'nt have any logs and it isn't open source. And please add a anonymous view like startpage and make it open source.