Msgvault: fast private email archive and search system
wesmckinney.com
Msgvault: fast private email archive and search system
1–9 of 9 posts
Re: Msgvault: fast private email archive and search system
#2OK, this is a project I can stand behind: download YOUR OWN data locally, query it in n different ways quickly, delete / sync up with Gmail, all from your TUI.
Would love to see something similar for Google Photos, and Apple Photos.
Re: Msgvault: fast private email archive and search system
#3OK, this is a project I can stand behind: download YOUR OWN data locally, query it in n different ways quickly, delete / sync up with Gmail, all from your TUI. Would love to see something similar for Google Photos, and Apple Photos.
Ditto - completely appeals to me. I’m good starting with mail.
Re: Msgvault: fast private email archive and search system
#4Would love to see support for Google Voice messages in the future.
Re: Msgvault: fast private email archive and search system
#5OK, this is a project I can stand behind: download YOUR OWN data locally, query it in n different ways quickly, delete / sync up with Gmail, all from your TUI. Would love to see something similar for Google Photos, and Apple Photos.
For Google photos immich works pretty well for me.
Re: Msgvault: fast private email archive and search system
#6Neat idea but you could build this with a fraction of the complexity by ditching sqlite and duckdb for your native file system and rg/grep/gawk with equivalent performance
Re: Msgvault: fast private email archive and search system
#7Neat idea but you could build this with a fraction of the complexity by ditching sqlite and duckdb for your native file system and rg/grep/gawk with equivalent performance
There’s also notmuch with various frontends which will let you index and search colossal mail accounts
Re: Msgvault: fast private email archive and search system
#8Neat idea but you could build this with a fraction of the complexity by ditching sqlite and duckdb for your native file system and rg/grep/gawk with equivalent performance
grep with equivalent performance? i highly doubt that. my mailbox has 2.6M emails: running grep through millions of files if you use maildir or a similar format takes forever. likewise running grep on a 7.6GB large mbox file takes more than a minute.
on the other hand in supmua (which inspired notmuch) the same search takes seconds.
Re: Msgvault: fast private email archive and search system
#9OK, this is a project I can stand behind: download YOUR OWN data locally, query it in n different ways quickly, delete / sync up with Gmail, all from your TUI. Would love to see something similar for Google Photos, and Apple Photos.
For Google photos immich works pretty well for me.
I keep meaning to switch to either immich or ente, but can't decide.