Live data from Hacker News

Building personal search infrastructure for your knowledge and code

beepb00p.xyz

51–60 of 162 posts

Re: Building personal search infrastructure for your knowledge and code

#51
post #17

No mentions of https://tiddlywiki.com/ ?

tiddlywiki was great until all the browsers stop supporting writing to local files, now saving changes is a pain, making me find something else.

I used to run it on node but then I switched to notion I prefer the notion way much more. However I'm looking to move away from notion to something selfhosted.

Re: Building personal search infrastructure for your knowledge and code

#52
post #38

Earlier quoted context omitted.

tiddlywiki was great until all the browsers stop supporting writing to local files, now saving changes is a pain, making me find something else.

Maybe this solves your problems? It creates a database in your browser's LocalStorage. https://noteself.github.io/

And the database can be setup to sync with a self-hosted CouchDB instance.

Re: Building personal search infrastructure for your knowledge and code

#53
I'd really like a personal "correlate all the things!" setup that has a plugin architecture for any source and creates a time series and document-based store of whatever I want. Tweets, e-mails, text messages, time tracking, etc.

There are lots of tools that do the individual moving parts, but a personal aggregator of everything would be interesting. Basically, a tool that lets you become your own personal data broker—just for your own personal data.

Re: Building personal search infrastructure for your knowledge and code

#54
post #42
post #15

I wrote and use daily http://onemodel.org (AGPL, uses postgres), for many reasons listed there :) . One way to think of its current state is a text-mode, easy-to-learn (i hope) infinite mind map of things, where I store and can query effectively everything: calendar, reminders, quasi-anki-like knowledge review, journal, automatic activity log, notes on subjects, very efficiently for the user. (It also stores document…

Looks interesting but honestly I had trouble keeping my attention focused enough to read through the intro page. A little CSS (max-width: 700px; margin: 0 auto;) on the body would go very far.

Thanks for the comment. That was debated slightly, in a previous HN discussion, where some pointed out that using browser defaults appeals more (to some people, I don't know if the majority), especially if they have particular needs. I admit to insensitivity to such things, but I will make a note to try your suggestion sometime. :)

Re: Building personal search infrastructure for your knowledge and code

#55
This topics comes up again and again. I collected some notes about this here: https://github.com/albertz/wiki/blob/master/personal-knowled...

E.g. one software I started to use is nvALT, via: https://www.macstories.net/links/organizing-everything-with-...

But I'm nowhere near a perfect and complete solution yet...

Re: Building personal search infrastructure for your knowledge and code

#56
post #28

Sourcegraph CEO here. I see the doc mentions Sourcegraph for code search (cool!). Something like ripgrep is indeed better for your case, a single person who just needs to search code in local directories on their own machine. I made a PR for our docs at https://github.com/sourcegraph/sourcegraph/pull/8075 that should clarify this. Sourcegraph is a web-based code search tool that automatically syncs and indexes many r…

Seems like more than half of this comment is just speaking about Sourcegraph, something sqs themselves acknowledge is not the right tool here. I know you're the CEO, but maybe can avoid pushing your product when it's not relevant :)

Thank you for updating the documentation to clarify the use case though!

Re: Building personal search infrastructure for your knowledge and code

#57

I'd really like a personal "correlate all the things!" setup that has a plugin architecture for any source and creates a time series and document-based store of whatever I want. Tweets, e-mails, text messages, time tracking, etc. There are lots of tools that do the individual moving parts, but a personal aggregator of everything would be interesting. Basically, a tool that lets you become your own personal data broke…

I'm kind of working on that too :) https://github.com/karlicoss/my

I wrote a post on some data that I collect and have/will integrate: https://beepb00p.xyz/my-data.html#consumers

Re: Building personal search infrastructure for your knowledge and code

#58

I'd really like a personal "correlate all the things!" setup that has a plugin architecture for any source and creates a time series and document-based store of whatever I want. Tweets, e-mails, text messages, time tracking, etc. There are lots of tools that do the individual moving parts, but a personal aggregator of everything would be interesting. Basically, a tool that lets you become your own personal data broke…

I (and many others I'm sure) have been thinking about similar things as well. Not really sure how it work though. Any one care to brainstorm up an architecture that can support this?

Re: Building personal search infrastructure for your knowledge and code

#59
post #32

My problem with a lot of services listed below, is they all eventually go away, and all your data is off somewhere else. Unless you store your data locally in a human readable format (markdown) you are just putting all your data into a system that WILL go away at some point in the future. Google has already had 2-3 services to manage your data that they have closed down. Maybe they are the ones that taught me not to…

http://onemodel.org , described briefly elsewhere in this discussion page and more at that site, is self-hosted, which today means installing postgres and editing one config file, doing backups & upgrades (but I might be able to help some). Maybe I could host for others sometime if there were sufficient interest. And/or move it to sqlite.

Yeah, seems neither self-host (onemodel) or letting someone else (you or Evernote) is particularly attractive, because the chance of data loss is always there.

Is it possible there is a solution that makes the data more permanent and allows multiple parties to backup the same sources, or something similar? Some sort of federation protocol maybe.

Re: Building personal search infrastructure for your knowledge and code

#60
post #32

Earlier quoted context omitted.

http://onemodel.org , described briefly elsewhere in this discussion page and more at that site, is self-hosted, which today means installing postgres and editing one config file, doing backups & upgrades (but I might be able to help some). Maybe I could host for others sometime if there were sufficient interest. And/or move it to sqlite.

Yeah, seems neither self-host (onemodel) or letting someone else (you or Evernote) is particularly attractive, because the chance of data loss is always there. Is it possible there is a solution that makes the data more permanent and allows multiple parties to backup the same sources, or something similar? Some sort of federation protocol maybe.

Thanks. That is on the future roadmap (though I have been slow lately): selective sharing/copying/synch. I encourage anyone with possible interest to sign up for the announcements list at least, and maybe decide sometime to help. :)
Post reply on HN