Viewing profile — broner

Nope, just reading from S3. Check this out: https://duckdb.org/2024/07/09/memory-management.html

Works fine for me on TB+ datasets. Maybe you were doing in-memory rather than persistent database and running out of RAM? https://duckdb.org/docs/stable/clients/cli/overview.html#i…

You can use DuckDB in ipython to solve the globbing issue. Then you don't have to worry about OOMs with geopandas.

My workload is 100% read. Querying zstd parquet on s3 standard. Neither clickhouse nor duckdb has a great s3 driver, which is why smart people like https://www.boilingdata.com/ wro…

I'm doing this with clickhouse querying parquet files on S3 from an EC2 instance in the same region as the S3 bucket (yes DuckDB pretty similar). S3 time to first byte within AWS i…

Switch your blind faith to Go (s5cmd) and get ~1200 MB/s upload speed! zfs send tank/pgdata@snapshot | pbzip2 > mybackup.zfs.bz2 s5cmd cp mybackup.zfs.bz2 s3://mygooglebucket/ http…

For $1,500 per TB per month? No thanks.

Should be a tax advantage to the non-grind income. $920k with 20% fed + 5% state capital gains tax?

Could you use this to create 100s of on-demand read replicas and get 100s of GB/s out of S3? Seems like a nice way to cheaply and quickly do batch jobs.

This looks pretty neat if you're ok moving to AWS https://www.boilingdata.com/

Reminds me of this previous HN submission Blotato: https://news.ycombinator.com/item?id=38206235

Glitch? Oh they're with Fastly now! https://www.tiktok.com/@benedicttown/video/70983764223009620...

As the climate rapidly changes and gets more dangerous, it’s good to know what you’re in store for. This site gives you a picture. https://climatecheck.com

I switched from Overcast to Pocketcasts. Everything I liked about Overcast plus playlists I can figure out how to use.

I'd be happy to help :) What age guys are you looking for?