Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

SearchHut

searchhut.org

Post reply on HN
Print view View original

51–60 of 161 posts

Re: SearchHut

#51

Post by ddevault »

wraptile wrote: post #49
ddevault wrote: post #42

Good morning, HN. Please note that SearchHut is not done or in a presentable state right now, and those who were in the know were asked not to share it. Alas. I had planned to announce this next week, after we had more time to build up a bigger index, add more features, fix up the 404's and stub pages, do more testing, and so on, so if you notice any rough edges, this is why. I went ahead and polished up the announce…

Could you clarify domain submition rules? e.g. "Any websites engaging in SEO spam are rejected from the index" - how is determined whether something is SEO spam or not? More clarification of whats allowed/not allowed would be nice!

The criteria are documented here:

https://searchhut.org/docs/docs/webadmins/requirements/

And there's some advice for web masters on ways to improve your site's ranking without running afoul of this rule:

https://searchhut.org/docs/docs/webadmins/recommendations/

But ultimately, it's subjective, and a judgement call will be made. If it's minor you might get a warning, if it's blatant then you'll just get de-listed.

Re: SearchHut

#52

Post by tsujp »

Hey everyone I accidentally shared this too early.

I misinterpreted a don't-share-yet announcement to mean the announcement post only and not the entire software and announcement. I don't mean this as an excuse; that's just the context.

So this is out before Drew et. al. intended it be hence some 404s and so forth as commented by Drew in this very thread here: https://news.ycombinator.com/item?id=32105407

I let my excitement get the better of me this time and I hope people revisit SearchHut in a week or so after these quirks are resolved.

Re: SearchHut

#53

Post by ddevault »

verall wrote: post #23

I guess cppreference.com isn't even a part of the list? I tried a couple test queries: > lambda decay to function pointer c++ I get some FSF pages and the wikipedia for Helium? > std function I get... tons of Rust docs? > std function c++ All rust docs? The wikipedia page for C++?? Interesting idea, but this seems like it would be the primary failure mode for an idea like this: as soon as you are researching outside…

I added cppreference.com now and kicked off a crawl. It'll be a while. The list of domains is pretty small right now -- it was intended to be bigger before the announcement was made. Will also add RFCs and man pages soon.

There will (soon) be a form to request new domains are added to the index, so if there are any sites you want indexed which are outside of my personal expertise, then you'll be able to request them.

Re: SearchHut

#54

Post by ddevault »

meibo wrote: post #30
verall wrote: post #23

I guess cppreference.com isn't even a part of the list? I tried a couple test queries: > lambda decay to function pointer c++ I get some FSF pages and the wikipedia for Helium? > std function I get... tons of Rust docs? > std function c++ All rust docs? The wikipedia page for C++?? Interesting idea, but this seems like it would be the primary failure mode for an idea like this: as soon as you are researching outside…

GitHub doesn't seem to be either. I get that it's a competitor but not being able to search GitHub is probably a deal breaker for most devs that aren't Drew.

I'm not opposed to indexing GitHub, but the signal to noise ratio on GitHub is poor. Nearly all GitHub repositories are useless, so we'd have to filter most of it out. I think instead I'll have to set it up where people can request that specific interesting repositories are added to the index, and maybe crawl /explore to fill in a decent base set.

Re: SearchHut

#57

Post by SahAssar »

fbn79 wrote: post #11

Bad serp... Searched 'mdn a'. Google return ' : The Anchor element - HTML: HyperText Markup Language | MDN' SearchHut rerurn a generic: 'MDN Web Docs'

It seems like it uses postgresql's FTS, which will generally drop stop-words so "the", "a", "and" and similar words are dropped. I've been meaning to figure out the best way to deal with this myself, and I'm guessing looking for exact matches first and then running a FTS query could work.

Re: SearchHut

#58

Post by skrebbel »

tsujp wrote: post #52

Hey everyone I accidentally shared this too early. I misinterpreted a don't-share-yet announcement to mean the announcement post only and not the entire software and announcement. I don't mean this as an excuse; that's just the context. So this is out before Drew et. al. intended it be hence some 404s and so forth as commented by Drew in this very thread here: https://news.ycombinator.com/item?id=32105407 I let my ex…

With a bit of collaboration i bet we can flag it off the front page in no time.

You (or Drew or someone else) can resubmit it later with a bogus query string to skip HNs dupe checker.

Re: SearchHut

#60

Post by abujazar »

12907835202 wrote: post #40
mormegil wrote: post #28

Earlier quoted context omitted.

The "official website" links can be retrieved in a machine-readable way from Wikidata. E.g. a completely random silly example of official websites of embassies: https://w.wiki/5T3R

Is there documentation for rolling your own? I've been considering building my own search engine for a while for my niche topic which has I can't tell how useful this will be but it'd be fun to give it a go.

Elastic App Search would be well suited for something like that. It comes with a built in crawler.
Post reply on HN