Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Perspective: Streaming pivot visualization via WebAssembly

github.com

Post reply on HN
Print view View original

41–50 of 141 posts

Re: Perspective: Streaming pivot visualization via WebAssembly

#41

Post by vthallam »

ashtonian wrote: post #25
mi100hael wrote: post #18

Really cool to see non-software companies putting cool projects like this out as open source

the stock market is digital, they are a software company.

They consider themselves a banking company. It's about the culture, so it is indeed refreshing to see non-traditional tech companies open sourcing things.

Re: Perspective: Streaming pivot visualization via WebAssembly

#42

Post by ChicagoDave »

pjmlp wrote: post #30
ChicagoDave wrote: post #19

I love seeing new UX on Web Assembly. Someone needs to port or create a standard layout engine like WPF to build on this. If the tools were there, C# + VS Code + solid layout engine...I'd dump JS + HTML + CSS in a "flash".

There are some attempts on that direction. https://www.hanselman.com/blog/NETAndWebAssemblyIsThisTheFut...

Sure. I've played with Blazor. It's very raw at this point and just a side project. I'd like to see MS Research or even a full blown R&D team at MS go full force at this.

Re: Perspective: Streaming pivot visualization via WebAssembly

#44

Post by dman »

texodus wrote: post #37

If anyone finds this project exciting and is interested in learning more about working on Open Source at J.P.Morgan, feel free to send me a message - we are always looking to hire experienced, passionate talent!

+1 - Even though I do not work there anymore, I can vouch for the fact that the team has amazing engineers and works on fundamental CS problems.

Re: Perspective: Streaming pivot visualization via WebAssembly

#45

Post by texodus »

jarpineh wrote: post #17
dman wrote: post #2

I wrote the C++ part of this codebase, would be happy to answer any questions about it here.

Briefly in the animation I see there's hierachical (or multi-dimensional) data used. Could you tell me about what sort of data (statistics, monitoring) this supports? Also, what methods are available for getting data streamed [into Perspective]? I'm skimming through the docs, but am not quite getting it... [edited for clarity]

Right now, you can call a load() or update() method on an engine or widget to pass JSON, CSV or Apache Arrow data (as an ArrayBuffer) to the engine.

Apologize for the documentation clarity - this is our first release and very much under active construction!

Re: Perspective: Streaming pivot visualization via WebAssembly

#46

Post by testnet1 »

kchoudhu wrote: post #43

It's open sourced from an investment bank, so you'll never see it updated again. Beware of integrating it into your projects. Good on whoever took on legal to get this out the door though. Hope you make it to MD or whatever it is you were gunning for.

you can see the stats for yourself. its under active development

Re: Perspective: Streaming pivot visualization via WebAssembly

#47

Post by lotyrin »

ashtonian wrote: post #25
mi100hael wrote: post #18

Really cool to see non-software companies putting cool projects like this out as open source

the stock market is digital, they are a software company.

Having worked at a branch off a university devoted to its online school and content marketing where the inputs and outputs of production are entirely digital, I can say they sure as hell aren't a software company; nobody above on-the-ground grunts think much about even the big pictures of domain modeling / workflows, data ingestion / transformation, computing / efficiency / performance, software development lifecycle / product portfolio management / QA, growth hacking / optimization / testing etc. because they simply aren't interested in the slightest. I'm sure plenty of organizations with at least one foot in pre-internet industries are in the same boat, and it's exciting to see counterexamples.

Re: Perspective: Streaming pivot visualization via WebAssembly

#48

Post by polskibus »

dman wrote: post #2

I wrote the C++ part of this codebase, would be happy to answer any questions about it here.

Does it support:

virtualization (showing only a view of full dataset that is updated from server on scroll)

Pivoting (multiple levels/hierarchies on rows and on columns)

Apart from features what part did you consider was the biggest hurdle? What browsers did you target?

Re: Perspective: Streaming pivot visualization via WebAssembly

#49

Post by carapace »

dman wrote: post #38
stupidcar wrote: post #34

Earlier quoted context omitted.

Did you experiment with doing it JS-only prior to the C++ version? If so, what kind of performance increase did you see with WebAssembly?

No, when I first prototyped it I had written a Python version initially. From memory the first C++ build was ~80x faster than the Python prototype.

I'm curious if you did any profiling? If the intent was always to rewrite the whole prototype in C++ then it kinda wouldn't matter, eh?

Re: Perspective: Streaming pivot visualization via WebAssembly

#50

Post by texodus »

kchoudhu wrote: post #43

It's open sourced from an investment bank, so you'll never see it updated again. Beware of integrating it into your projects. Good on whoever took on legal to get this out the door though. Hope you make it to MD or whatever it is you were gunning for.

We very much plan to continue developing this entirely in the open! It is reputationally important we do not just dump our dead projects on the internet as Open Source, which is one of the reason why we chose Perspective for this project in the first place.
Post reply on HN