Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bridging analytics and data science workflows with GPUs

omnisci.com

Post reply on HN
Print view View original

1–10 of 12 posts

Re: Bridging analytics and data science workflows with GPUs

#2

Post by josep2 »

A few comments:

1. I'm usually down on dark-mode but this looks clean as hell 2. The JupyterHub integration looks nice! It was mentioned in the article it was the "tip of the iceberg" I'm wondering how hard it would be to integrate with a tool like Observable.

Observable: https://observablehq.com/

Re: Bridging analytics and data science workflows with GPUs

#4

Post by randyzwitch »

josep2 wrote: post #2

A few comments: 1. I'm usually down on dark-mode but this looks clean as hell 2. The JupyterHub integration looks nice! It was mentioned in the article it was the "tip of the iceberg" I'm wondering how hard it would be to integrate with a tool like Observable. Observable: https://observablehq.com/

It's certainly possible, I guess the bigger question is whether people would be comfortable having a database do an automatic data transfer into a public tool. In the case of this Jupyter integration, it's a Docker image that's running next to the OmniSci database, so it's all within the same network

Re: Bridging analytics and data science workflows with GPUs

#6

Post by tmostak »

josep2 wrote: post #2

A few comments: 1. I'm usually down on dark-mode but this looks clean as hell 2. The JupyterHub integration looks nice! It was mentioned in the article it was the "tip of the iceberg" I'm wondering how hard it would be to integrate with a tool like Observable. Observable: https://observablehq.com/

Thanks! We're big Observable fans, and you can find quite a few examples here: https://observablehq.com/search?query=mapd and https://observablehq.com/search?query=omnisci. But imagine we could do something deeper, any thoughts?

Re: Bridging analytics and data science workflows with GPUs

#8

Post by tmostak »

emplynx wrote: post #5

Does it scale?

Check out this example crunching 1.45 billion rows on my 32GB Macbook Pro (CPU-only). https://twitter.com/ToddMostak/status/1162067442081751040?s=... With a GPU cluster it's very possible to handle 100+ billion rows with sub-second response times.

Re: Bridging analytics and data science workflows with GPUs

#10

Post by randyzwitch »

tmostak wrote: post #6
josep2 wrote: post #2

A few comments: 1. I'm usually down on dark-mode but this looks clean as hell 2. The JupyterHub integration looks nice! It was mentioned in the article it was the "tip of the iceberg" I'm wondering how hard it would be to integrate with a tool like Observable. Observable: https://observablehq.com/

Thanks! We're big Observable fans, and you can find quite a few examples here: https://observablehq.com/search?query=mapd and https://observablehq.com/search?query=omnisci . But imagine we could do something deeper, any thoughts?

This is a good point. There are lots of interesting possibilities with Observable, especially using the OmniSciDB open-source project for analyses that people intentionally do want to share
Post reply on HN