Perspective: Streaming pivot visualization via WebAssembly

#1

Post by texodus » Tue, Feb 06, 2018, 4:07 PM UTC

Perspective: Streaming pivot visualization via WebAssembly
github.com

Re: Perspective: Streaming pivot visualization via WebAssembly

#2

Post by dman » Tue, Feb 06, 2018, 4:31 PM UTC

I wrote the C++ part of this codebase, would be happy to answer any questions about it here.

Re: Perspective: Streaming pivot visualization via WebAssembly

#3

Post by timkpaine » Tue, Feb 06, 2018, 4:32 PM UTC

dman wrote: post #2

I wrote the C++ part of this codebase, would be happy to answer any questions about it here.

[]

Re: Perspective: Streaming pivot visualization via WebAssembly

#4

Post by dman » Tue, Feb 06, 2018, 4:32 PM UTC

timkpaine wrote: post #3

dman wrote: post #2

I wrote the C++ part of this codebase, would be happy to answer any questions about it here.

[]

Offtopic :)

Re: Perspective: Streaming pivot visualization via WebAssembly

#5

Post by icefox » Tue, Feb 06, 2018, 4:34 PM UTC

dman wrote: post #2

I wrote the C++ part of this codebase, would be happy to answer any questions about it here.

What was the best/worst part about getting it to work in WebAssembly?

Re: Perspective: Streaming pivot visualization via WebAssembly

#6

Post by nickthemagicman » Tue, Feb 06, 2018, 4:35 PM UTC

dman wrote: post #2

I wrote the C++ part of this codebase, would be happy to answer any questions about it here.

Thanks for taking questions. For a back end developer that's watching the front end landscape change from afar..

Do you feel like web assembly could potentially replace JS in the future with, say, my favorite back end language of choice?

Re: Perspective: Streaming pivot visualization via WebAssembly

#7

Post by hackcasual » Tue, Feb 06, 2018, 4:36 PM UTC

For those interested, keep in mind the only way to use WebAssembly with CSP in Chrome is by turning on 'unsafe-eval'. FF/Edge/Safari all at least support compilation from URLs with more locked down policies

Re: Perspective: Streaming pivot visualization via WebAssembly

#8

Post by zimablue » Tue, Feb 06, 2018, 4:37 PM UTC

dman wrote: post #2

I wrote the C++ part of this codebase, would be happy to answer any questions about it here.

I see it's possible to embed it in jupyterlab, it seems to do a lot:

* grid format * graph format * actual pivoting of data

Is that right?

It's using webassembly so in effect to do the pivot you must have created functions that exist in pandas?

Has anyone ported pandas to webassembly?

Is the grid editable? What are you using to create your output, html or canvas or something?

I realise I could look this stuff up but since you asked..

Re: Perspective: Streaming pivot visualization via WebAssembly

#9

Post by texodus » Tue, Feb 06, 2018, 4:37 PM UTC

hackcasual wrote: post #7

For those interested, keep in mind the only way to use WebAssembly with CSP in Chrome is by turning on 'unsafe-eval'. FF/Edge/Safari all at least support compilation from URLs with more locked down policies

True - worth pointing out that this library gracefully falls back to ASM.js if your browser does not support WebAssembly, though.

Re: Perspective: Streaming pivot visualization via WebAssembly

#10

Post by bpicolo » Tue, Feb 06, 2018, 4:39 PM UTC

This is great. Finance people especially love this sort of thing - they do want to browse through entire datasets vs seeing higher level metrics in a lot of cases.