Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Launch HN: ParaQuery (YC X25) – GPU Accelerated Spark/SQL

news.ycombinator.com

Post reply on HN
Print view View original

31–40 of 85 posts

Re: Launch HN: ParaQuery (YC X25) – GPU Accelerated Spark/SQL

#32

Post by winwang »

mritchie712 wrote: post #28

> they're saving over 60% off of their BigQuery bill how big is their data? A lot of BigQuery users would be surprised to find they don't need BigQuery. This[0] post (written by founding engineer of BigQuery) has a bit of hyperbole, but this part is inline with my experience: > A couple of years ago I did an analysis of BigQuery queries, looking at customers spending more than $1000 / year. 90% of queries processed l…

They have >1PB of data to ETL, with some queries hitting 450TB of pure shuffle.

It's very true that most users don't need something like BigQuery or Snowflake. That's why some startups have come up to save Snowflake cost by "simply" putting a postgres instance in front of it!

In fact, I just advised someone recently to simply use Postgres instead of BigQuery since they had <1TB and their queries weren't super intensive.

Re: Launch HN: ParaQuery (YC X25) – GPU Accelerated Spark/SQL

#34

Post by winwang »

Boxxed wrote: post #33

I'm surprised the GPU is a win when the data is coming from GCS. The CPU still has to touch all the data, right? Or do you have some mechanism to keep warm data live in the GPUs?

Yep, CPU has to transfer data because no RDMA setup on GCP lol. But that's like 16-32 GB/s of transfer per GPU (assuming T4/L4 nodes), which is much more than network bandwidth. And we're not even network bound, even if there's no warm data (i.e. for our ETL workloads). However, there is some stuff kept on GPU during actual execution for each Spark task even if they aren't running on the GPU at the moment, which makes handling memory and partition sizes... "fun", haha.

Re: Launch HN: ParaQuery (YC X25) – GPU Accelerated Spark/SQL

#36

Post by achennupati »

this is super cool stuff, and would've been really interesting to apply to spark stuff I had to do for Amazon's search system! How is this different than something like using spark-rapids on AWS EMR with GPU-enabled EC2 instances? Are you building on top of that spark-rapids, or is this a more custom solution?

Re: Launch HN: ParaQuery (YC X25) – GPU Accelerated Spark/SQL

#39

Post by winwang »

latchkey wrote: post #35

Great, let me know if you want a 1x AMD MI300x VM to build/test on. Free. https://x.com/HotAisle/status/1921983426972025023

Nice! I attended a hackathon by Modular last weekend where we got to play with MI300X (sponsored by AMD and Crusoe). My team made a GPU-"accelerated" BM25 in Mojo, but mostly kind of failed at it, haha.

The software stack for AMD is still a bit too nascent for ParaQuery's Spark engine, but certain realtime/online workloads can definitely be programmed pretty fast. They also happen to benefit greatly from the staggering levels of HBM on AMD chips. Hopefully I can take a mini-vacation later in the summer to hack on your GPUs :)

Post reply on HN