I do this too! but am way less automated than you. Id love to pay for a product that made this easier.
Map of my personal data infrastructure
61–70 of 81 posts
Re: Map of my personal data infrastructure
#62There is a way to solve all your API issues, a camera recording your entire life!
Anything you interact with will be recorded. Then the problem just becomes processing it all =P
Unfortunately, it's not very ergonomic yet.
Re: Map of my personal data infrastructure
#63There is a way to solve all your API issues, a camera recording your entire life! Anything you interact with will be recorded. Then the problem just becomes processing it all =P Unfortunately, it's not very ergonomic yet.
Sounds like a Black Mirror episode
Re: Map of my personal data infrastructure
#64There is a way to solve all your API issues, a camera recording your entire life! Anything you interact with will be recorded. Then the problem just becomes processing it all =P Unfortunately, it's not very ergonomic yet.
This is an awesome idea for a startup!
Camera integrated with glasses that you can wear for 8 hours without charging + home box that post-processes this into useful archive. I have a Vuzix Blade (https://www.vuzix.com/products/blade-smart-glasses-upgraded) that could work for MVP.
Re: Map of my personal data infrastructure
#65Hello author, hope you don't mind the negative comments since this isn't for everyone including myself. I found your dedication to organization very impressive and only shows that you'd do the same professionally.
> and only shows that you'd do the same professionally
Counter example: me. I do show a lot of commitment and organization in personal projects... but professionally that's not the case.
Re: Map of my personal data infrastructure
#66There is a way to solve all your API issues, a camera recording your entire life! Anything you interact with will be recorded. Then the problem just becomes processing it all =P Unfortunately, it's not very ergonomic yet.
I'm working on something similar:
A dron the size of a baseball with camera that is floating around you and records your actions (it doesn't record every action, but it can recognize certain ones: e.g., reading, running, sleeping). The recorded actions go to a sqlite db. It should be extendable in terms of recognizing actions in 3D (perhaps some ML is needed to achieve better results).
Re: Map of my personal data infrastructure
#67How much time per week is spent administering or maintaining this system? if you were to start over with a new organizational methodology, what would you do differently knowing what you know now? I applaud the effort.
Thanks! Hmm, it's hard to quantify it exactly, but overall there isn't that much maintenance required once it's all set up (except for the few manual bits). Let's say it could all run for months without needing any intervention. Maybe one or two data sources would stop exporting due to an expired token or some API weirdness, but the downstream services that use the data will carry on running against older data. It's…
Your workflow and infrastructure is amazing. Great work!
Re: Map of my personal data infrastructure
#68This is awesome. Unfortunately, I will very unlikely be able to or inclined to go this deep. However, I've been collecting both digital and physical assets that I have used to built up a museum for the family. Digital is easier, physical items are much harder.
It all started way back when I left my home-town for the bustling city of Bombay as the last century was ending. When I visited my home-town after almost a decade, I realized that my tapes, floppy discs, and other artifacts including some hand-written Bollywood actors/actress mails got lost. Ever since, I've tried to hold on to interesting objects.
The floppy disc was particularly interesting as it had some of the first programs I wrote, including a stupid QBasic game that I wrote for my first girlfriend.
Re: Map of my personal data infrastructure
#69Hey author here. Happy to answer your questions!
Kudos! I find this work fascinating.
There are moments that I'm tempted to go down a similar organizational road because I'm curious about the possible lessons from the data aggregation, but I usually pass because the payoff didn't seem large enough.
So that makes me want to ask: Have you learned much from the data? or is it more about organization/keeping control of life?
Re: Map of my personal data infrastructure
#70Earlier quoted context omitted.
Seems to me this is more of a religious thing for one such as you than something with objective purpose.
just because he has passion and conviction about a cause linked to leaving a legacy doesn't mean it follows any... cultishness. I myself am a bit of an exobrainian but not as well organized or anywh near as far down the part as Karl is. it's a noble cause to not want to dismiss what never was capturable before; conversations between friends and family that we can harvest, replay, or add as a chatbot to have shell ver…
I didn't mean "religious" in the bad sense. We all have some topic that incites that part of our brain and makes us hold long speeches about our ideals. On a more positive level, it also gives us the determination to actually follow through with those ideals. His "itch" seems to be gathering data.
If one gathers data for no other reason than it's useful, you don't randomly start talking about the difference between man and animal or how all turns to wind. Those are more biblical sentences.