I self host a confluence server. All my content is available to me offline. Might be a bit overkill, but I have knowledge bases for all my work. If there is a web page I come across I can just copy/paste the content into a new post. Everything is searchable. It really is great. They offer a starter license, which is $10 per year:
Building personal search infrastructure for your knowledge and code
101–110 of 162 posts
Re: Building personal search infrastructure for your knowledge and code
#102I keep my knowledge in a private Git repo managed by https://www.gitbook.com/ . So far it works out great. Going to make it public soon.
That's cool, please drop me an email (or just share here?) when you release it, I'm collecting ( https://beepb00p.xyz/tags.html#exobrain ) other people's wikis!
Thanks for making your notes public. It inspired some further thinking for my org-mode setup.
Re: Building personal search infrastructure for your knowledge and code
#103(1) For note taking I stumbled across anno[1] via[2] two weeks ago. It's a python flask application which you run on your localhost. You write markdown which gets stored locally as file and is rendered as html using pandoc[3]. It's really basic but I love it. (2) For physical documents I use a Fujitsu ScanSnap iX500[4] for scanning. A runtime-licencse of ABBYY FineReader for OCR is included. The resulting PDF has emb…
Actually, what has been bugging me recently is the inability to "tag" photos on my iphone - all I want is to snap a copy of my bill / invoice whatever, tag it with "gas bill" and let it upload to icloud / dropbox. from there I am sure I can onwards process looking for "gas bill" but actually there seems to be no obvious way to do it, (even looked into EXIf data), and I guess it will age to wait till i learn ios codin…
Touch and hold , then tap an option. Custom: Tap , tap Enter New Tag, type a customtag, and tap Done. Create additional custom tags: Tap , tap Enter New Tag, type a custom tag, and tap Done. Add more than one custom tag to a photo: Tap , and tap each tag you want to add (so a checkmark appears next to it).
Re: Building personal search infrastructure for your knowledge and code
#104I basically live in Evernote. Will gradually transition to personal tooling.
Re: Building personal search infrastructure for your knowledge and code
#105(1) For note taking I stumbled across anno[1] via[2] two weeks ago. It's a python flask application which you run on your localhost. You write markdown which gets stored locally as file and is rendered as html using pandoc[3]. It's really basic but I love it. (2) For physical documents I use a Fujitsu ScanSnap iX500[4] for scanning. A runtime-licencse of ABBYY FineReader for OCR is included. The resulting PDF has emb…
Actually, what has been bugging me recently is the inability to "tag" photos on my iphone - all I want is to snap a copy of my bill / invoice whatever, tag it with "gas bill" and let it upload to icloud / dropbox. from there I am sure I can onwards process looking for "gas bill" but actually there seems to be no obvious way to do it, (even looked into EXIf data), and I guess it will age to wait till i learn ios codin…
Have you looked into apps like Scanbot [1]
Re: Building personal search infrastructure for your knowledge and code
#106Meta-observation. This topic seems to be getting a lot of attention on HN over the last few months, indicating massive interest. Further, looking at the landscape of developments in this space (past all the me-too Markdown note taking apps): Evernote seems to have a fading presence on the landscape, Notion seems to be a (too?) well-funded behemoth startup, Roam is trying some exciting things, and Tiago Forte is putti…
> Evernote seems to have a fading presence on the landscape
They've made massive changes over the past year. They'll even have a Linux app coming out soon!
Re: Building personal search infrastructure for your knowledge and code
#107Earlier quoted context omitted.
Another great option for local code/repo search is Hound. I maintain an instance of it at my workplace, but it's so lightweight and easy to deploy that I could easily imagine running an instance of it on my laptop for offline personal use. https://github.com/hound-search/hound
YES! We have been using hound for several years now, having all hundreds of our org repos searchable in one spot, in a LIGHTNING FAST manner has been an invaluable tool to help our various teams keep up with the legacy sprawl and effectively remove old features and all their dependencies from our sprawly systems. I even wrote a microservice that uses gitlab global hooks to keep hound up to date without polling, and a…
Yeah, the access control thing is not ideal— I have my instance behind Apache for the active directory plugin. Potentially as a hack you could run multiple Hound instances and reverse proxy the correct one based on a user's role? Might be easier to just add in proper support upstream. :)
Anyway, for now I'm at a small enough org that everyone still just sees everything, and it's been super valuable.
As far as competition with other tools, the infrastructure team at my org has their Elastic instance plugged into our GitLab, but most of the engineers agree that Hound is better— it's faster, it does regex, and it doesn't do goofy stuff like return pages of the same result from everyone's fork of the same repo.
Re: Building personal search infrastructure for your knowledge and code
#108Does anyone else find that the simple act of writing notes helps them remember and process better? I spent forever trying to find an ideal note-taking solution, but now I just write things in a single notebook. I rarely review my notes, but I find that simply writing thoughts down consistently has improved my memory and understanding of new concepts.
This has changed back and forth over time for me.
Tests in middle school, I could recall writing things down, even the part of the page I wrote them in.
By college I would write TODO's down and lose them, and not be able to recall what I wrote down. Misplacing the note was more likely than forgetting the task, so I stopped writing them down.
I should try to measure this again because right now I couldn't tell you which works better.
One of the most uncomfortable things about getting older is that in your teens and 20's you spent all this time figuring out who you are, what you like, what you're good at and what you struggle with. Age, changes in health, coping mechanisms, changes in perspective all fuck around with this and you can find yourself in situations you should avoid or avoiding situations you could embrace.
It's like a weird mid-life crisis.
Re: Building personal search infrastructure for your knowledge and code
#109No mentions of https://tiddlywiki.com/ ?
tiddlywiki was great until all the browsers stop supporting writing to local files, now saving changes is a pain, making me find something else.
My coworker used to swear by TW and every once in a while when I read browser release notes I have wondered if it still works for him.
It sounds like you're saying that nobody bothered to modify it to use LocalStorage, which is a surprise.
Re: Building personal search infrastructure for your knowledge and code
#110I've been thinking a lot about how I manage my own data lately (notes, photos, code, reference material, etc) and have concluded that the primary feature I'm looking for is longevity. I'm saddened by the amount of data I've lost over the years, either because of hard disk failures or third-party services going out of business/making it difficult to extract things/getting too expensive. In light of this, I'm biasing t…
You mention S3 and Athena, but also that you're building for longevity. Are you planning for the future obsolescence of AWS, or going to cross that bridge when you get to it?
The S3 files are mirrored to a local drive as a collection of plain .md, .jpg, etc. The Athena search index is secondary in importance to the source data and not necessarily permanent (presumably the options for "take this folder full of files and let me search it" will only improve over time).
That being said, one of the reasons I chose S3 vs. other AWS services or other companies is because I expect it to be around for a very long time. (Just because I've preserved the option of migrating away doesn't mean I relish the idea.)