Earlier quoted context omitted.
Which open source option did you end up going with? I'm in the same boat and would like to evaluate my options.
My stack atm is neovim, python/R, an EC2 and postgres (sometimes Sql Server). Some use of arrow and duckdb. For queries on less than few hundred GB this stack does great. Fast, familiar, the ec2 is running 24/7 so it's there when I need it and can easily schedule overnight jobs, and no time wasted waiting for it to boot.
Are you doing this on EBS? Honest question.