Live data from Hacker News

BlazingDB Origins, oh and we just raised $2.9M from Nvidia and Samsung

blog.blazingdb.com

21–30 of 38 posts

Re: BlazingDB Origins, oh and we just raised $2.9M from Nvidia and Samsung

#21
post #16

This actually looks pretty useful. I'm adjacent to you (DL on hadoop/spark competing more with the just launched amazon sagemaker among other things) and was curious about your go to market strategy. Like us you're kind of strattling the line between the hadoop ecosystem and GPUs. Mesos does this as well. It seems like most folks in the GPU space still don't get Hadoop or S3 as a data source yet though (despite it be…

straddling

Indeed typo thanks!

Re: BlazingDB Origins, oh and we just raised $2.9M from Nvidia and Samsung

#22

This actually looks pretty useful. I'm adjacent to you (DL on hadoop/spark competing more with the just launched amazon sagemaker among other things) and was curious about your go to market strategy. Like us you're kind of strattling the line between the hadoop ecosystem and GPUs. Mesos does this as well. It seems like most folks in the GPU space still don't get Hadoop or S3 as a data source yet though (despite it be…

People in the GPU space and slow storage systems like hadoop and S3) To caveat, I saw slow compared to something like storing your queryable data in system memory. The answer is that your clients are not normally GPU people. They are aware of GPUs and know they can be used for certain things but real clients normally have lots of data and they don't fire up a million instances to let it sit in a $10/GB storage soluti…

Great response thank you! I won't lie: We definitely have similar issues (I think any infra company runs in to this)

Re: Kinetica. They are doing visualization as well as things like machine learning.

I like your guys' approach a lot better. I see a clear bridge from the mass market commodity storage to something useful actually leveraging GPUs. That's why I commented. Best of luck to you!

Re: BlazingDB Origins, oh and we just raised $2.9M from Nvidia and Samsung

#24
Congrats on the raise. Nice to see all the progress on fast distributed SQL systems. We use MemSQL and BigQuery and the detachment of compute from storage is compelling when used correctly, especially with the cheap and fast cloud storage available now.

Re: BlazingDB Origins, oh and we just raised $2.9M from Nvidia and Samsung

#27

I would love to see performance numbers for a GPU data warehouse on a benchmark like TPCDS. My concern is that GPUs are very fast for a few operations, but that these operations aren't the bottleneck for realistic queries, so the overall performance will not be good. I did a TPCDS-based benchmark on Redshift-vs-Snowflake-vs-BigQuery a few weeks ago [1], it could probably be run by BlazingDB without too much trouble s…

TPC-DS has some incredibly complex queries that might be too complex for a database that doesn't have very extensive syntax coverage

Re: BlazingDB Origins, oh and we just raised $2.9M from Nvidia and Samsung

#28

Great to see more competition in GPU+DW space! Some questions: 1. How does BlazingDB compare to MapD ? 2. How do you skip ingest - are you using Apache Arrow like Dremio as an efficient data representation format? 3. Do you have any benchmarks, or maybe where would you see BlazingDB on this list? http://tech.marksblogg.com/benchmarks.html using same hardware as MapD ? 4. Can you run your solution in a cluster? :)

1) We are focused on the data lake. We love MapD, they are doing kick ass stuff, we are focused more on operating on information from disk and from cloud storage services like s3 or hdfs implementations. 2) We read parquet files into our own caching system. We often use arrow apis though do not rely on arrow for our data representation. 3) We have made client side benchmarks but have not performed a standardized repl…

Could you elaborate on the GPU + data lake part? Memory transfer lag to and from GPU is significant in comparison to GPU computing power. Data lake may mean mutliple heterogeneous data sources with or without schema. How is coping with it helped by a GPU?

Re: BlazingDB Origins, oh and we just raised $2.9M from Nvidia and Samsung

#30

Earlier quoted context omitted.

1) We are focused on the data lake. We love MapD, they are doing kick ass stuff, we are focused more on operating on information from disk and from cloud storage services like s3 or hdfs implementations. 2) We read parquet files into our own caching system. We often use arrow apis though do not rely on arrow for our data representation. 3) We have made client side benchmarks but have not performed a standardized repl…

Could you elaborate on the GPU + data lake part? Memory transfer lag to and from GPU is significant in comparison to GPU computing power. Data lake may mean mutliple heterogeneous data sources with or without schema. How is coping with it helped by a GPU?

So depending on your sources, e.g. if they are compressed or not, the GPU can greatly speed upi/o by compressing and decompressing directly on the GPU. This is particularly meaningful when you can store it in compressed state when you transfer to the GPU and decompress for use after its on. It doesn't solve most of the problems of working with hetergenous sources. That being said gpus definitely allowed us to speed up how we get data out of Apache parquet and we anticipate we will be able to benefit from their speed when adding more compressed file formats.
Post reply on HN