Live data from Hacker News

Building personal search infrastructure for your knowledge and code

beepb00p.xyz

131–140 of 162 posts

Re: Building personal search infrastructure for your knowledge and code

#131
post #68

(1) For note taking I stumbled across anno[1] via[2] two weeks ago. It's a python flask application which you run on your localhost. You write markdown which gets stored locally as file and is rendered as html using pandoc[3]. It's really basic but I love it. (2) For physical documents I use a Fujitsu ScanSnap iX500[4] for scanning. A runtime-licencse of ABBYY FineReader for OCR is included. The resulting PDF has emb…

I've been looking for a good multi-document feed scanner. Do you have experience using the iX500 with Linux, or gscan2pdf? My usecase would be scanning multi page documents with minimal effort, and saving to PDF somewhere.

I thought about Linux but while it should be possible to use the iX500 with Linux you would lose OCR. I did some tests and compared the OCR of the included ABBYY FineReader with Tesseract[1]. Tesseract was not good enough for my use case. So I still use the iX500 on Windows.

[1] https://en.wikipedia.org/wiki/Tesseract_(software)

Re: Building personal search infrastructure for your knowledge and code

#134

I use a few things for this (on windows): - For notes, OneNote, though I'm always on the lookout for an alternative with decent UI and syncing, but using open file formats. Full text search simple enough with this. Code formatting isn't good but there's an addin where the free version formats it as it was copied. - To search local files, Voidtools Everything is great. Searching instantly by filename is a real time sa…

Take a look at Standard Notes. It is privacy focussed with encryption but has markdown and code editors and can be self hosted

Re: Building personal search infrastructure for your knowledge and code

#135
post #127
post #69

Earlier quoted context omitted.

It's a ripe space. I'm using notion mostly right now, but I've also used: -Coda.io (big, more scriptable player) -Hypernote (super new player, but with a cool new take on inter-note relationships) -Tiddlywiki (super customizable, really fast -- but also has a fair amount of footguns) -Airtable (only played with it a few times but it's usually mentioned in the same breath as notion, I notice) Hopefully someday we'll a…

I've only started using Tiddlywiki, so I didn't get the chance to dive deep. Can you mention some of the footguns?

Just trying to make it save its state is difficult enough, there's a bunch of hoops to jump through and at least I have never actually managed to do it.

It's one of those things I try every few years, fail and quit.

Re: Building personal search infrastructure for your knowledge and code

#136

My problem with a lot of services listed below, is they all eventually go away, and all your data is off somewhere else. Unless you store your data locally in a human readable format (markdown) you are just putting all your data into a system that WILL go away at some point in the future. Google has already had 2-3 services to manage your data that they have closed down. Maybe they are the ones that taught me not to…

This is what I've moved to: https://joplinapp.org

It's just plain markdown and syncs to any cloud provider or a webdav share. Butt-ugly especially on iOS, but it works and there is no vendor lock-in.

Re: Building personal search infrastructure for your knowledge and code

#137
post #6

Meta-observation. This topic seems to be getting a lot of attention on HN over the last few months, indicating massive interest. Further, looking at the landscape of developments in this space (past all the me-too Markdown note taking apps): Evernote seems to have a fading presence on the landscape, Notion seems to be a (too?) well-funded behemoth startup, Roam is trying some exciting things, and Tiago Forte is putti…

My hackerspace is working on a tool to put this knowledge-in-a-computer to work.

Essentially, it's a knowledge management system that makes input almost frictionless. This is then mapped into a shareable ontology graph on which algorithms can be executed. Valuable data can be extracted from here.

For example: do you need to find a team with a specialized couple of skills? Have applicants send their verified graphs and use those relations to find the best fit.

Or, alternatively, someone who's learned a trade/skill can share their dense knowledge with a community, to direct learning more effectively.

It's on a very early stage, for now purely for the fun of it. But if there's interest or suggestions (definitely some hard problems to solve) we could focus more efforts towards that.

Re: Building personal search infrastructure for your knowledge and code

#138
post #80

Earlier quoted context omitted.

There's definitely no external access without going through the web proxy. And a new uncategorized site would be blocked by the web proxy - and it wouldn't pass review. I work in a highly regulated industry... Any workaround would be grounds for termination. So there's no point to my comment really - just curious if anyone else is in the same boat.

Can't you use a personal mobile device with a 4G connection to access a knowledge database outside the firewall, without moving any data across your employers network? As long as the data you wish to read/write is not sensitive in itself, and it's mostly just plaintext notes that you can read/write from any device, I don't see the issue with that.

Secure physical sites (e.g. some military bases) may require you to place personal electronics in a lockable cabinet. You have to use a paper notepad if you don't have a device certified by the local security team. Using a non-certified device can result in being evicted or prosecuted.

Re: Building personal search infrastructure for your knowledge and code

#139
post #77

Earlier quoted context omitted.

I'm kind of working on that too :) https://github.com/karlicoss/my I wrote a post on some data that I collect and have/will integrate: https://beepb00p.xyz/my-data.html#consumers

I only skimmed through and the combined breadth + intent of your projects seems very, very interesting — I mean it speaks to me. So, way to go! Mad props, please keep it up! If you ask me, this is the shape of things to come.

Thanks! :) I wish it was easier to share with other people, lots of things are tedious to set up

Re: Building personal search infrastructure for your knowledge and code

#140
post #43
post #6

Meta-observation. This topic seems to be getting a lot of attention on HN over the last few months, indicating massive interest. Further, looking at the landscape of developments in this space (past all the me-too Markdown note taking apps): Evernote seems to have a fading presence on the landscape, Notion seems to be a (too?) well-funded behemoth startup, Roam is trying some exciting things, and Tiago Forte is putti…

> Evernote seems to have a fading presence on the landscape My understanding is that they're throwing their presence away? Maybe they pivoted to enterprise, I don't know, but for at least a couple years all I've heard about them was people talking about what to use instead.

I think for a long time they simply had no idea what road they should walk down. So they tried a bunch of stuff, walked in circles and wasted money left and right. Now they settle down on what they always were and try to maintain the established userbase while not scaring them away with too much innovation, and instead delivering conservative improvments.

This came with a shutdown of freeusers heaven, and focusing more on the paying customers. Because of which many people seem to be cranky over evernote. Similar think seems to happen at the moment with dropbox too BTW.

Post reply on HN