Live data from Hacker News

Building personal search infrastructure for your knowledge and code

beepb00p.xyz

31–40 of 162 posts

Re: Building personal search infrastructure for your knowledge and code

#31
post #14

This have me a hairbrained idea for a browser extension that drops every web page you visit into a private Lucene database.

You might want to look into WorldBrain's Memex extension. I think it crawls every page you visit into IndexedDB so you can do full-text searches later.

Re: Building personal search infrastructure for your knowledge and code

#32

My problem with a lot of services listed below, is they all eventually go away, and all your data is off somewhere else. Unless you store your data locally in a human readable format (markdown) you are just putting all your data into a system that WILL go away at some point in the future. Google has already had 2-3 services to manage your data that they have closed down. Maybe they are the ones that taught me not to…

http://onemodel.org , described briefly elsewhere in this discussion page and more at that site, is self-hosted, which today means installing postgres and editing one config file, doing backups & upgrades (but I might be able to help some).

Maybe I could host for others sometime if there were sufficient interest. And/or move it to sqlite.

Re: Building personal search infrastructure for your knowledge and code

#33
post #25

The holy grail [ https://beepb00p.xyz/pkm-search.html#future ] of this really resonated with me and fully mirrors what I've been thinking about the past few months. In my observations, it's input capture, information organization, and subsequent retrieval: Information Capture: Input Capture - You’re going to have all-encompassing tracking and recording of all activity, but want configurable privacy on the extent to w…

http://onemodel.org, described elsewhere here and moreso at that site, tries to model arbitrary knowledge and has a vision encompassing any kind of info one wanted to be tracked (again, more at the site). (Edit: If you have possible future interest, there is an announcements list.)

Re: Building personal search infrastructure for your knowledge and code

#34
post #28

Sourcegraph CEO here. I see the doc mentions Sourcegraph for code search (cool!). Something like ripgrep is indeed better for your case, a single person who just needs to search code in local directories on their own machine. I made a PR for our docs at https://github.com/sourcegraph/sourcegraph/pull/8075 that should clarify this. Sourcegraph is a web-based code search tool that automatically syncs and indexes many r…

Thank you for replying and updating the docs, appreciate it!

I still wish it was easier, it's such a cool tool :) In theory it should be possible to set up inotify watches on local repositories and reindex on changes (perhaps with some throttling logic if it's too heavy), although I understand it's harder than it sounds and my usecase is probably somewhat marginal. I might set it up anyway if my personal infrastructure ever settles.

Re: Building personal search infrastructure for your knowledge and code

#37

I keep my knowledge in a private Git repo managed by https://www.gitbook.com/ . So far it works out great. Going to make it public soon.

That's cool, please drop me an email (or just share here?) when you release it, I'm collecting (https://beepb00p.xyz/tags.html#exobrain) other people's wikis!

Re: Building personal search infrastructure for your knowledge and code

#38
post #17

No mentions of https://tiddlywiki.com/ ?

tiddlywiki was great until all the browsers stop supporting writing to local files, now saving changes is a pain, making me find something else.

Maybe this solves your problems? It creates a database in your browser's LocalStorage.

https://noteself.github.io/

Re: Building personal search infrastructure for your knowledge and code

#39
post #17

No mentions of https://tiddlywiki.com/ ?

tiddlywiki was great until all the browsers stop supporting writing to local files, now saving changes is a pain, making me find something else.

I run it on a webdav server like caddy, there is also this ruby script you can start. Works ok, set it up once and you forget about it.

Re: Building personal search infrastructure for your knowledge and code

#40
post #28

Sourcegraph CEO here. I see the doc mentions Sourcegraph for code search (cool!). Something like ripgrep is indeed better for your case, a single person who just needs to search code in local directories on their own machine. I made a PR for our docs at https://github.com/sourcegraph/sourcegraph/pull/8075 that should clarify this. Sourcegraph is a web-based code search tool that automatically syncs and indexes many r…

I was in an Uber with one of your engineers who was heading to Gophercon. He seemed cool so I'm going to assume you're all cool people.
Post reply on HN