Live data from Hacker News

My Knowledge Lakehouse

tabokie.github.io

21–30 of 98 posts

Re: My Knowledge Lakehouse

#22
post #5

Thanks for posting this. Currently building out something that is consolidating events from numerous sources and then automatically processing of those. This post helped to give me some additional ideas on the processing of those events.

Interesting, and something I’ve been thinking about. What is your architecture? Using any available workflow products for “retrieve/receive event from X, figure out what do, then do that in Y”?

Re: My Knowledge Lakehouse

#23
post #19

I had a revelation that my ideas are worthless and the notes I took are also going to be worthless once I get familiar with X. So I completely stopped taking notes. A to-do list plus a Google Drive for my son and our stuffs are good enough. The only problem is that we are not comfortable to put sensitive information on GD so probably build a NAS for that.

Can work in a fast paced environment but if you work on projects or ideas with hard numbers for years its not applicable or your brain capacity is off the charts.

Yeah 100%, I forgot to mention the above is just for my private projects so a lot of notes went into as comments.

For work we do use Confluence but again the quality of our notes are not great. From my experience the most important notes are the ones that tag a PoC if issue X flares up.

Re: My Knowledge Lakehouse

#24

I just create one markdown file per day. I wrote a custom obsidian plugin that displays the "timeline" as if it was one open file and creates the files in year/month/week subfolders. But I don't use linking and all the other complexity. But if I ever needed it I could. Then it's synced with next cloud and also available on my phone. I like this the most because just as explained, the time line is the most accurate re…

Why next cloud for sync?

Re: My Knowledge Lakehouse

#25

I had a revelation that my ideas are worthless and the notes I took are also going to be worthless once I get familiar with X. So I completely stopped taking notes. A to-do list plus a Google Drive for my son and our stuffs are good enough. The only problem is that we are not comfortable to put sensitive information on GD so probably build a NAS for that.

My experience has been the opposite. I used to envy people with amazing memories like it was a super power. Then I realized if I got into the habit of just writing stuff down, I'd effectively have that same superpower. It's the one thing that I can honestly say has changed my life.

I use obsidian.md for notes, which I have on phone and desktop. Nothing fancy. You just need something that's always with you, has great search, and ideally allows you to link notes together.

Re: My Knowledge Lakehouse

#26

I just create one markdown file per day. I wrote a custom obsidian plugin that displays the "timeline" as if it was one open file and creates the files in year/month/week subfolders. But I don't use linking and all the other complexity. But if I ever needed it I could. Then it's synced with next cloud and also available on my phone. I like this the most because just as explained, the time line is the most accurate re…

I love the approach. Have you published the "timeline" plugin or is code available?

Re: My Knowledge Lakehouse

#27
post #11
post #4

> 1.1221 Sometimes the primary tool is not available. An “always-on” secondary should take its place. > 1.1222 Sometimes log from different tools or locations need to be “merged”, “persisted”. These two are the main reasons I've stuck with Google Docs: It's available everywhere, and everything's always in-sync. Google already has all my info of value, so the incremental trust necessary to the threshold of log visibil…

> It's available everywhere Unless you are offline

Or somehow triggers their anti-spam system on service Y while you really care about service X, but they're all bundled under the same company Z, so being blocked on one service impacts your usage of all other services under the same company...

Re: My Knowledge Lakehouse

#28
post #4

> 1.1221 Sometimes the primary tool is not available. An “always-on” secondary should take its place. > 1.1222 Sometimes log from different tools or locations need to be “merged”, “persisted”. These two are the main reasons I've stuck with Google Docs: It's available everywhere, and everything's always in-sync. Google already has all my info of value, so the incremental trust necessary to the threshold of log visibil…

What about using Visual Studio Code with your notes in multiple Markdown files with automatic syncing to Google Drive via the desktop Google Drive app?

Searching multiple files, editing and organising files is quick and simple on desktop, and you can fallback to Google Doc on mobile when needed (Google Drive app lets you view .md files, there's no way to edit?). You can install extensions as well (like for doing inline maths) and if you already use Visual Studio Code for coding it's one less thing to learn.

I'm not familiar with Obsidian, which gets mention a lot. What does it improve on compared to the above if you don't need a mobile app or complex linking between Markdown files?

Re: My Knowledge Lakehouse

#29

I just create one markdown file per day. I wrote a custom obsidian plugin that displays the "timeline" as if it was one open file and creates the files in year/month/week subfolders. But I don't use linking and all the other complexity. But if I ever needed it I could. Then it's synced with next cloud and also available on my phone. I like this the most because just as explained, the time line is the most accurate re…

Reads a lot like logseq.

Re: My Knowledge Lakehouse

#30
post #11
post #4

> 1.1221 Sometimes the primary tool is not available. An “always-on” secondary should take its place. > 1.1222 Sometimes log from different tools or locations need to be “merged”, “persisted”. These two are the main reasons I've stuck with Google Docs: It's available everywhere, and everything's always in-sync. Google already has all my info of value, so the incremental trust necessary to the threshold of log visibil…

> It's available everywhere Unless you are offline

I think apps generally work offline which satisfies the OPs requirement of eventually consistent merging.
Post reply on HN