Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

SearchHut

searchhut.org

Post reply on HN
Print view View original

61–70 of 161 posts

Re: SearchHut

#61

Post by jfoster »

alpaca128 wrote: post #37
charcircuit wrote: post #18

>What's the most popular web server SearchHut: The first result is django which is not the most popular web server. Google: Shows an answer box with the market share of various web servers.

Considering Google's answer box randomly picked multiple photos of unrelated people as pictures of murderers and rape victims (with Google being very uncooperative about resolving the issue) I'd say the lack of an answer box might not be that bad.

An answer box is the right thing for that query. (the web servers)

The part that Google seem to have unfortunately skimmed over is that the answers need to be relevant, exact & correct.

Re: SearchHut

#62

Post by ddevault »

skrebbel wrote: post #58
tsujp wrote: post #52

Hey everyone I accidentally shared this too early. I misinterpreted a don't-share-yet announcement to mean the announcement post only and not the entire software and announcement. I don't mean this as an excuse; that's just the context. So this is out before Drew et. al. intended it be hence some 404s and so forth as commented by Drew in this very thread here: https://news.ycombinator.com/item?id=32105407 I let my ex…

With a bit of collaboration i bet we can flag it off the front page in no time. You (or Drew or someone else) can resubmit it later with a bogus query string to skip HNs dupe checker.

Cat's out of the bag now.

Re: SearchHut

#63

Post by ddevault »

the_duke wrote: post #26

>> https://searchhut.org/about/domains => 404

Here's the current list:

https://paste.sr.ht/~sircmpwn/0cab5e3137c2c2077b5aabf9e2fc8d...

It was intended to be larger prior to launch. Here's some other domains I want to index:

https://paste.sr.ht/~sircmpwn/84d052f14a9a282698b5e5f7a9d9d9...

Re: SearchHut

#64

Post by interactivecode »

ddevault wrote: post #54
meibo wrote: post #30

Earlier quoted context omitted.

GitHub doesn't seem to be either. I get that it's a competitor but not being able to search GitHub is probably a deal breaker for most devs that aren't Drew.

I'm not opposed to indexing GitHub, but the signal to noise ratio on GitHub is poor. Nearly all GitHub repositories are useless, so we'd have to filter most of it out. I think instead I'll have to set it up where people can request that specific interesting repositories are added to the index, and maybe crawl /explore to fill in a decent base set.

Perhaps all repo's that have a published package is a good heuristic. Then you'll at least get all the repos of npm, python and other packages.

Re: SearchHut

#65

Post by skrebbel »

ddevault wrote: post #62
skrebbel wrote: post #58

Earlier quoted context omitted.

With a bit of collaboration i bet we can flag it off the front page in no time. You (or Drew or someone else) can resubmit it later with a bogus query string to skip HNs dupe checker.

Cat's out of the bag now.

Ok, unflagged!

Re: SearchHut

#66

Post by sjamaan »

SahAssar wrote: post #57
fbn79 wrote: post #11

Bad serp... Searched 'mdn a'. Google return ' : The Anchor element - HTML: HyperText Markup Language | MDN' SearchHut rerurn a generic: 'MDN Web Docs'

It seems like it uses postgresql's FTS, which will generally drop stop-words so "the", "a", "and" and similar words are dropped. I've been meaning to figure out the best way to deal with this myself, and I'm guessing looking for exact matches first and then running a FTS query could work.

You can write a custom stemming algorithm and load it as an extension library into Postgres, then use that with `CREATE TEXT SEARCH DICTIONARY` to create a custom dictionary. It's not as difficult as it sounds - you can use the default Snowball stemmer as a sample, and tweak it.

Re: SearchHut

#67

Post by mormegil »

12907835202 wrote: post #40
mormegil wrote: post #28

Earlier quoted context omitted.

The "official website" links can be retrieved in a machine-readable way from Wikidata. E.g. a completely random silly example of official websites of embassies: https://w.wiki/5T3R

Is there documentation for rolling your own? I've been considering building my own search engine for a while for my niche topic which has I can't tell how useful this will be but it'd be fun to give it a go.

Your own what? Your own query? Sure; it's just a SPARQL query over the Wikidata data model. The documentation portal for the query service is at https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/... though you'd need some familiarity with Wikidata, its properties, etc. E.g. the "wdt:P856" in my query is the "official website" property on Wikidata: https://m.wikidata.org/wiki/Property:P856

Re: SearchHut

#68

Post by smegsicle »

memorable wrote: post #45
Beltalowda wrote: post #38

Tried a few things: - Beltalowda – no results (for reference: it's a term to refer to "people from the [asteroid] belt" used in the The Expanse books and TV series). - The Expanse – bunch of results, but none are what I'm looking for (the TV series or books). It looks like it may drop the "the" in there? - Star Trek – a bunch of results, but ordered very curiously; the first is the Wikipedia page for "Star Trek Star…

You could say it's in the Garbage stage (though Garbage is a bit harsh for a product that is built in a week).

Hot Garbage

Re: SearchHut

#69

Post by jfoster »

bastardoperator wrote: post #59

I'm not a fan of google but you can do exactly what this search engine does by curating your own list of domains to search against. https://programmablesearchengine.google.com

Interesting. This looks like Custom Search Engines evolved into this?

I can't tell whether this is a neglected Google product that they were going to refresh but lost interest in, or something that is undergoing a breath of fresh air.

As you say, I was able to add a list of domains and get some pretty decent results from it. The UI makes me feel like Google are not interested in making it a truly successful product, though.

Re: SearchHut

#70

Post by mordae »

ddevault wrote: post #63
the_duke wrote: post #26

>> https://searchhut.org/about/domains => 404

Here's the current list: https://paste.sr.ht/~sircmpwn/0cab5e3137c2c2077b5aabf9e2fc8d... It was intended to be larger prior to launch. Here's some other domains I want to index: https://paste.sr.ht/~sircmpwn/84d052f14a9a282698b5e5f7a9d9d9...

> erowid

Cool.

Post reply on HN