91–100 of 161 posts
>> https://searchhut.org/about/domains => 404
Here's the current list: https://paste.sr.ht/~sircmpwn/0cab5e3137c2c2077b5aabf9e2fc8d... It was intended to be larger prior to launch. Here's some other domains I want to index: https://paste.sr.ht/~sircmpwn/84d052f14a9a282698b5e5f7a9d9d9...
Earlier quoted context omitted.
It seems like it uses postgresql's FTS, which will generally drop stop-words so "the", "a", "and" and similar words are dropped. I've been meaning to figure out the best way to deal with this myself, and I'm guessing looking for exact matches first and then running a FTS query could work.
You can write a custom stemming algorithm and load it as an extension library into Postgres, then use that with `CREATE TEXT SEARCH DICTIONARY` to create a custom dictionary. It's not as difficult as it sounds - you can use the default Snowball stemmer as a sample, and tweak it.
Does Sourcehut offer textual search within a repo's files? GitHub and GitLab offer it, but Codeberg doesn't seem to (and I couldn't find any information about its presence or absence on Sourcehut).
Does Sourcegraph index Sourceht projects? It is a proper code search engine and very good.
Earlier quoted context omitted.
I just tried searching for "python str" on Google. I expected the top result to be a link to the official Python docs for the `str` type, then ideally some relevant StackOverflow questions highlighting common Python issues with strings, bytes, Unicode etc. Instead, the top result was W3Schools. Then came the Python docs, then 5 pages somewhere between blogspam and poor-quality tutorials. Then a ReadTheDocs page datin…
Afaik Python does not have a str type (I think you meant string?). You could instead search for "python string" to find more information about python strings. Even then the very first result for Python str is actually relevant for me (Python documentation about built in types.
It does have it:
$ python3 -c 'print(type(""))'
I'm not a fan of google but you can do exactly what this search engine does by curating your own list of domains to search against. https://programmablesearchengine.google.com
Postgres as backend is maybe not the best choice and there are already many sites that index specific pages and take suggestions. The hard part is getting relevant results when having a large index.
Still thank you for a new web search.
How many requests per minute / hour are acceptable?
May I know what are the limits of the API? How many requests per minute / hour are acceptable?