Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

SearchHut

searchhut.org

Post reply on HN
Print view View original

81–90 of 161 posts

Re: SearchHut

#81

Post by nneonneo »

p-e-w wrote: post #74
Cthulhu_ wrote: post #73

Earlier quoted context omitted.

While that sounds good in theory, who is to say those that can edit protected and high profile pages aren't in SEO spammers' pockets? I mean the edit history is public and there's plenty of people that actually pay attention to edits and the like so they would be found out soon enough, but still. I'm sure this is an ongoing discussion when e.g. political figures' pages are protected as well - who becomes the gatekeep…

Sure, but at that point you're simply discussing Wikipedia's quality control system, which may be an interesting discussion, but has nothing to do with search engines per se. Considering that Wikipedia has become a pillar of most scientific work (imagine writing a math or computer science paper without Wikipedia – utterly unthinkable), it's safe to say that knowledgeable people have collectively decided that its qual…

Ehh, I think you’ve overestimated the quality of Wikipedia on highly specialist topics (like, say, the kinds of things you’d write academic papers on). It’s not so much that it doesn’t have the content, it’s that the coverage is super uneven; sometimes it has extremely detailed articles on a niche theorem in a particular field, and other times it has the barest stub of information on an entire sub-sub-field of study.

Re: SearchHut

#82

Post by yellowapple »

BlackLotus89 wrote: post #76
interactivecode wrote: post #64

Earlier quoted context omitted.

Perhaps all repo's that have a published package is a good heuristic. Then you'll at least get all the repos of npm, python and other packages.

Some interesting repos have no published packages. A combination of number of commits, stars and forks would be probably more relevant.

And likewise, some uninteresting repos do have published packages.

Re: SearchHut

#83

Post by mda »

p-e-w wrote: post #31
mda wrote: post #22

Earlier quoted context omitted.

They definitely do not return "90% garbage for most queries". This 8s an unsubstantiated claim I see often i HN and honestly not backed by any real data. e.g. You can check your search history and see it yourself.

I just tried searching for "python str" on Google. I expected the top result to be a link to the official Python docs for the `str` type, then ideally some relevant StackOverflow questions highlighting common Python issues with strings, bytes, Unicode etc. Instead, the top result was W3Schools. Then came the Python docs, then 5 pages somewhere between blogspam and poor-quality tutorials. Then a ReadTheDocs page datin…

Afaik Python does not have a str type (I think you meant string?).

You could instead search for "python string" to find more information about python strings.

Even then the very first result for Python str is actually relevant for me (Python documentation about built in types.

Re: SearchHut

#85

Post by lsbehe »

charcircuit wrote: post #18

>What's the most popular web server SearchHut: The first result is django which is not the most popular web server. Google: Shows an answer box with the market share of various web servers.

This one is actually hilarious because google cites the site wrong for me. >Apache HTTP Server >It is one of the most popular web servers around the world. As of May 2022, Apache holds 31.5% of the market according to W3Techs and 22.99% according to Netcraft. It's quoting that from https://www.stackscale.com/blog/top-web-servers/ which clearly states Nginx as the top one. >As of May 2022, Nginx holds 33.5% of the market according to W3Techs and 30.71% according to Netcraft.

Re: SearchHut

#86

Post by Chris2048 »

ddevault wrote: post #42

Good morning, HN. Please note that SearchHut is not done or in a presentable state right now, and those who were in the know were asked not to share it. Alas. I had planned to announce this next week, after we had more time to build up a bigger index, add more features, fix up the 404's and stub pages, do more testing, and so on, so if you notice any rough edges, this is why. I went ahead and polished up the announce…

Do you intend any of this to merge/cooperate with other similar initiative?

e.g opencrawl, internet-archive, archiveteam

It strikes me the resources to crawl, update, and manage/index data is a common problem.

Re: SearchHut

#87

Post by oefrha »

ddevault wrote: post #63
the_duke wrote: post #26

>> https://searchhut.org/about/domains => 404

Here's the current list: https://paste.sr.ht/~sircmpwn/0cab5e3137c2c2077b5aabf9e2fc8d... It was intended to be larger prior to launch. Here's some other domains I want to index: https://paste.sr.ht/~sircmpwn/84d052f14a9a282698b5e5f7a9d9d9...

sqlite.org is not on the latter list yet. Should be added.

Re: SearchHut

#88

Post by nyanpasu64 »

Does Sourcehut offer textual search within a repo's files? GitHub and GitLab offer it, but Codeberg doesn't seem to (and I couldn't find any information about its presence or absence on Sourcehut).

Re: SearchHut

#89

Post by ddevault »

Chris2048 wrote: post #86
ddevault wrote: post #42

Good morning, HN. Please note that SearchHut is not done or in a presentable state right now, and those who were in the know were asked not to share it. Alas. I had planned to announce this next week, after we had more time to build up a bigger index, add more features, fix up the 404's and stub pages, do more testing, and so on, so if you notice any rough edges, this is why. I went ahead and polished up the announce…

Do you intend any of this to merge/cooperate with other similar initiative? e.g opencrawl, internet-archive, archiveteam It strikes me the resources to crawl, update, and manage/index data is a common problem.

I intend to at least support other search engines by adding !bangs for them and recommending them in the UI if you didn't find the results you're looking for. I don't think that crawling is something that is easily distributed across independent orgs, though.

Re: SearchHut

#90

Post by ZWoz »

ddevault wrote: post #53
verall wrote: post #23

I guess cppreference.com isn't even a part of the list? I tried a couple test queries: > lambda decay to function pointer c++ I get some FSF pages and the wikipedia for Helium? > std function I get... tons of Rust docs? > std function c++ All rust docs? The wikipedia page for C++?? Interesting idea, but this seems like it would be the primary failure mode for an idea like this: as soon as you are researching outside…

I added cppreference.com now and kicked off a crawl. It'll be a while. The list of domains is pretty small right now -- it was intended to be bigger before the announcement was made. Will also add RFCs and man pages soon. There will (soon) be a form to request new domains are added to the index, so if there are any sites you want indexed which are outside of my personal expertise, then you'll be able to request them.

You probably are already thought about it, but just in case feature idea: adding moderation support for collaboration. Somewhat trusted persons vetting niche subjects.
Post reply on HN