Live data from Hacker News

Ask HN: How did you build up your personal knowledge base?

news.ycombinator.com

101–110 of 113 posts

Re: Ask HN: How did you build up your personal knowledge base?

#101
The OP is "How do you build a personal knowledge base?" I have used over years many tools. For me I need a tool that can handle: (a) "easy, unstructured data entry"; (b)"help find emergent pattern in data entered at (a)."

TiddlyWiki (https://https://tiddlywiki.com/) is a very interesting and useful tool that matches my two criteria above very well.

Its usable immediately. Just click to create a "Tiddler" and type. Later you can manipulate/present the "Tiddlers" you created in numerous ways.

The basic version is a single HTML file that self-modifies (for interested programmers its a rare example of a pure "Quine"). It works in any browser.

Browser extensions are available for it so that it can overwrite save, rather than download save.

It will work with the cloud if you need that. Interfaces with Google Docs. Free publishing from local TiddlyWiki to online publishing is built-in for http://tiddlyspot.com. And more I can't list. See main site for info.

It has its own scripting language that includes string matching, maths and complex filters. In particular its "filter" mechanisms, that are largely list oreientated, allow complex interrogation and presentation of content.

It supports JavaScript modules allowing full integration of good existing tools.

There are libraries of plugins--both official (https://tiddlywiki.com/#%24%3A%2Fcore%2Fui%2FControlPanel%2F...) and unofficial (https://dynalist.io/d/zUP-nIWu2FFoXH-oM7L7d9DM -- hundreds) that extend function in many ways.

There are also other versions of TW that are node based. Of the more interesting branches are "Bob" (https://github.com/OokTech/TW5-Bob) that provides all of TW's base functionality plus interaction with the OS on all major desktop platforms. Another is TiddlyServer (https://github.com/Arlen22/TiddlyServer).

IMO its a very sophisticated and very effective tool for recording unstructured data in any form.

The real plus in it is that you can then, if you need, begin to structure that data in innumerable ways.

An upside is you can learn the basics very quickly. A downside is that it can take some time to fully understand all you can do in it and how to do it.

For developers its Github gives insight into how it works and current developoments (https://github.com/Jermolene/TiddlyWiki5).

It has a useful, friendly, discussion group (https://groups.google.com/forum/#!forum/tiddlywiki).

Its a kind of "Swiss Army Knife" of information tools.

Re: Ask HN: How did you build up your personal knowledge base?

#103
post #30
post #22

A year ago, I found a perfect solution for myself. I'm using https://github.com/vimwiki/vimwiki , writing there everything I find useful. From articles and quotes to lose ideas, notes, project information, or todos. It has support for markdown and export to HTML, which I can style however needed.

Someone I cofounded a startup with has written a vimwiki->website publishing thing. It's quite a fun idea. https://github.com/ajkavanagh/vimwik-publishing-system

I had idea to make something like that, thanks for the link it's awesome! :)

Re: Ask HN: How did you build up your personal knowledge base?

#104

All my personal knowledge/information/research are structured using the File System Infobase Manager method as described by Douglas Barone : http://dougist.com/2009/08/file-system-infobase-manager/ It's future proof and require no special tool. Another philosophy that drive this way of managing my data : The Lo-Fi Manifesto http://kairos.technorhetoric.net/20.2/inventio/stolley/

Additional information...

I use almost exclusively plain text files. If I need formatting to produce things like HTML, PDF, ... I use Markdown or LaTeX.

For images/audio, I use lossless file formats (ex: TIFF, FLAC, WAV, SVG). If I need smaller formats for a web site, for sharing or to bring it with me on my phone, I convert it to smaller formats like MP3, JPG, ... Those files are disposable when not required anymore.

During my research if I found a web page I want to refer to later on, I save it in PDF format. Why? Because PDF is fairly future-proof (ISO standard) and it's so widely used that it will not disappear anytime soon. I don't save it in HTML format because I will probably not be able to reopen it in the future because HTML spec changed too much. I don't want to have a folder full of images/css/js for each page. Also, there is no garantee I will be able to read it in the future to way I read it initially. PDF have this garantee.

For anything else (like speadsheets), I use LibreOffice the most I can. LibreOffice is based on OpenDocument open format. Open format fit in my definition of future-proof formats. And no, Microsoft OOXML format doesn't fit in my definition of future-proof format because it's driven by Microsoft (same for any big business like this). They can decide tomorrow to stop keeping the standard updated and start adding proprietary "features" in the "OOXML-NG" format (which will make Microsoft Office files unreadable in other Office suites).

For future-proof information/knowledge management, stay away from closed/proprietary softwares as much you can do.

Re: Ask HN: How did you build up your personal knowledge base?

#105
if you dont need in-line images then i cant recommend an outliner like Dynalist enough. its similar to a mind-map in a way with the main difference being that its actually useable for a large amount of information

heres is a basic example Propædia in Dynalist: https://talk.dynalist.io/t/propaedia-an-outline-of-all-possi...

if youve never used dynalist before, hover over the bullet points, then click to expand or collapse the list. click the magnifying glass icon to the left of the bullet point to zoom in and focus on a certain point, then use the breadcrumb trail at the top to go back. since every bullet point has its own url you can also use the browser back button

Re: Ask HN: How did you build up your personal knowledge base?

#106
post #11

I probably have the biggest personal public wiki at this point. Over 720 files and 13,000+ lines across all the files. All files: https://github.com/nikitavoloboev/knowledge/blob/master/SUMM... The way I did it was by treating the wiki as extension of my brain and having a perfect workflow for editing it at a speed of thought. In my case it's Sublime Text + Alfred + some macros. https://wiki.nikitavoloboev.xyz/other/…

nice system, i have something similar setup. currently +10k notes, versioned with git and use vim as my primary editor.

currently building a service that can index and query across text based knowledge bases. you can find demo here: http://demo.alphacortex.io

would love to hear your thoughts and talk further about organizing knowledge :)

Re: Ask HN: How did you build up your personal knowledge base?

#107
post #11

I probably have the biggest personal public wiki at this point. Over 720 files and 13,000+ lines across all the files. All files: https://github.com/nikitavoloboev/knowledge/blob/master/SUMM... The way I did it was by treating the wiki as extension of my brain and having a perfect workflow for editing it at a speed of thought. In my case it's Sublime Text + Alfred + some macros. https://wiki.nikitavoloboev.xyz/other/…

Do you continually update the organisation structure as you go? I've got something similar in Onenote and I always get stuck when I find that a piece of content can appear in multiple places

Re: Ask HN: How did you build up your personal knowledge base?

#109

The OP is "How do you build a personal knowledge base?" I have used over years many tools. For me I need a tool that can handle: (a) "easy, unstructured data entry"; (b)"help find emergent pattern in data entered at (a)." TiddlyWiki ( https://https://tiddlywiki.com/ ) is a very interesting and useful tool that matches my two criteria above very well. Its usable immediately. Just click to create a "Tiddler" and type.…

One thing I forgot to mention was the power #TiddlyWiki has for Transclusion. Much software uses it but in an inexplicit way that users don't fully control.

In Tiddlywiki it's an outstanding central, user documented, feature of huge utility ... some basics ...

https://tiddlywiki.com/#Transclusion

https://tiddlywiki.com/#Transclusion%20Basic%20Usage

https://tiddlywiki.com/#TranscludeWidget

Re: Ask HN: How did you build up your personal knowledge base?

#110
post #11

I probably have the biggest personal public wiki at this point. Over 720 files and 13,000+ lines across all the files. All files: https://github.com/nikitavoloboev/knowledge/blob/master/SUMM... The way I did it was by treating the wiki as extension of my brain and having a perfect workflow for editing it at a speed of thought. In my case it's Sublime Text + Alfred + some macros. https://wiki.nikitavoloboev.xyz/other/…

Do you continually update the organisation structure as you go? I've got something similar in Onenote and I always get stuck when I find that a piece of content can appear in multiple places

I do update it when it makes sense.
Post reply on HN