This have me a hairbrained idea for a browser extension that drops every web page you visit into a private Lucene database.
Try out https://booxia.wensia.com/ or https://historio.us/
Building personal search infrastructure for your knowledge and code
41–50 of 162 posts
Re: Building personal search infrastructure for your knowledge and code
#42I wrote and use daily http://onemodel.org (AGPL, uses postgres), for many reasons listed there :) . One way to think of its current state is a text-mode, easy-to-learn (i hope) infinite mind map of things, where I store and can query effectively everything: calendar, reminders, quasi-anki-like knowledge review, journal, automatic activity log, notes on subjects, very efficiently for the user. (It also stores document…
Looks interesting but honestly I had trouble keeping my attention focused enough to read through the intro page.
A little CSS (max-width: 700px; margin: 0 auto;) on the body would go very far.
Re: Building personal search infrastructure for your knowledge and code
#43Meta-observation. This topic seems to be getting a lot of attention on HN over the last few months, indicating massive interest. Further, looking at the landscape of developments in this space (past all the me-too Markdown note taking apps): Evernote seems to have a fading presence on the landscape, Notion seems to be a (too?) well-funded behemoth startup, Roam is trying some exciting things, and Tiago Forte is putti…
>Evernote seems to have a fading presence on the landscape
My understanding is that they're throwing their presence away? Maybe they pivoted to enterprise, I don't know, but for at least a couple years all I've heard about them was people talking about what to use instead.
Re: Building personal search infrastructure for your knowledge and code
#44I've given up with trying to find The One True Note Taking Tool, so have ended up writing my own thing that I tinker with now and again to tune it to exactly what I need.
It's essentially a simple web server that sits on top of a bunch of markdown files.
The frontend renders the markdown using markdown-it and supports KaTeX for simple inline mathy things, along with the extended markdown stuff like tables etc. I've even made it so that you can drag and drop files (including images) into the edit box and it will upload them to the server and render the correct markdown syntax so they can be rendered when you look at the note.
Alongside the files, the data is also stored in a SQLite database file with some metadata, and I'm using the Full Text Search (FTS5) engine to support search which seems to work ok.
If the database gets corrupted it can just be rebuilt, it's really just there to augment the notes. If I stop developing it or want to move on, the notes are there as text files.
It works well enough in a mobile browser, although admittedly a bit rubbish if you need offline access.
Works well enough for me. I might open source it one day but I think I'd need to clean up the code a bit first :)
EDIT: the core of the tool was mostly inspired by this article https://golang.org/doc/articles/wiki/
Re: Building personal search infrastructure for your knowledge and code
#45I wish there was a method for printing QR codes or URLs on paper that would be the reverse of scanning a QR code. This would make it easy to write complex URLs in your paper diary/techo/commonplace book/notebook.
Re: Building personal search infrastructure for your knowledge and code
#46My eternal frustration in this space is that my employer has strict firewalls, web filtering and data-loss prevention software, and remote access is over Citrix with no copy-paste.
Consequently, if I build a knowledge base, it is stuck inside the firewall.
Equally, if I build it outside, I can't use it at work.
Re: Building personal search infrastructure for your knowledge and code
#47It's been mentioned a few times in these comments, but I want to add a +1 for Roam[1]. Note-taking/personal knowledge tool that's very, very different from anything I've seen before -- closest thing I can compare it to is Wikipedia. It's still in beta with some rough edges, but VERY worth checking out. [1] roamresearch.com
Looks neat but it's a service, which is kinda the opposite of rolling something for yourself.
Re: Building personal search infrastructure for your knowledge and code
#48Sourcegraph CEO here. I see the doc mentions Sourcegraph for code search (cool!). Something like ripgrep is indeed better for your case, a single person who just needs to search code in local directories on their own machine. I made a PR for our docs at https://github.com/sourcegraph/sourcegraph/pull/8075 that should clarify this. Sourcegraph is a web-based code search tool that automatically syncs and indexes many r…
Another great option for local code/repo search is Hound. I maintain an instance of it at my workplace, but it's so lightweight and easy to deploy that I could easily imagine running an instance of it on my laptop for offline personal use.
Re: Building personal search infrastructure for your knowledge and code
#49My eternal frustration in this space is that my employer has strict firewalls, web filtering and data-loss prevention software, and remote access is over Citrix with no copy-paste. Consequently, if I build a knowledge base, it is stuck inside the firewall. Equally, if I build it outside, I can't use it at work.
Why don't you host it on an ec2 instance? They won't be blocking amazon ip. Where do you work?
Re: Building personal search infrastructure for your knowledge and code
#50> all digital trace I'm leaving (tweets, internet comments, annotations) I would be open to the idea of a tool which combines the entirety of my digital presence at any point in time in a single platform. Kinda like a dynamically updated list which updates itself - every time a linked account makes a comment, 'likes' a post or performs any activity that may link it back to me.
It's barely a year old, but I think Timeliner is kind of trying to be this, as something you run yourself to protect against disappearing cloud services: