Live data from Hacker News

Rete – JavaScript framework for node-based visual programming

github.com

11–20 of 25 posts

Re: Rete – JavaScript framework for node-based visual programming

#13
post #3

Any time I see something like this I'm reminded of Yahoo Pipes and how ahead of its time it was. Is there anything like it that's designed for enterprise ETL these? It occurs to me it's a much better way of thinking about data flow problems than code.

Domo[0]. Their visual ETL is pretty good.

https://www.domo.com/

Re: Rete – JavaScript framework for node-based visual programming

#15
post #3

Any time I see something like this I'm reminded of Yahoo Pipes and how ahead of its time it was. Is there anything like it that's designed for enterprise ETL these? It occurs to me it's a much better way of thinking about data flow problems than code.

Node based / dataflow UI are also the bread and butter of CGI and compositing industry. It's hyper efficient both for machine because it's often freely memoized/cached and user (think of it as a simplified haskell at your fingertips) because the stateless and unlimited-undo aspects. I'm still pretty sure it should be the default UI for half computer introduction. Text for the rest, with the right paradigm of course.

Node based user interfaces can be great indeed. Unreal Engine 4 has a visual scripting system called Blueprints that is very impressive. https://docs.unrealengine.com/en-US/Engine/Blueprints

Another example of a node based user interface can be found in the open source 3d modeling and animation software Blender. https://docs.blender.org/manual/en/dev/render/blender_render...

The open source virtual modular synthesizer VCV Rack is node based as well, though it is so “by nature” in the sense that hardware modular synthesizer work in fashion of connecting inputs and outputs with patch cables. https://www.vcvrack.com/

When done right, as all of the three I mentioned above in my opinion do, node based user interfaces are great.

Not all node based user interfaces are equally good. I used LabView a bit at a course at the university and did not enjoy their system. The LabView node based user interface felt very clunky the whole time, even for doing simple things.

I’ve been wondering occasionally whether certain kinds of data processing that I am doing with Unix tools could benefit from a graphical system.

It’s not that I am not comfortable with the command line, but even as a rather die-hard user of Linux and FreeBSD I must admit that the command line has several shortcomings.

Of course, designing a graphical successor to Unix pipelines is a major undertaking that will require through thought. But I think that keeping that idea in the back of ones mind while implementing some smaller node based systems could eventually lead to realization of most if not all of the considerations that must be kept in mind for the design of a graphical successor to Unix pipelines.

Re: Rete – JavaScript framework for node-based visual programming

#16
post #3

Any time I see something like this I'm reminded of Yahoo Pipes and how ahead of its time it was. Is there anything like it that's designed for enterprise ETL these? It occurs to me it's a much better way of thinking about data flow problems than code.

Two come to mind.

Apache NiFi: http://nifi.apache.org/

StreamSets: https://streamsets.com/opensource/

Side note, I'm an Apache NiFi committer and have had great success using it for enterprise ETL in a previous role.

Re: Rete – JavaScript framework for node-based visual programming

#18
This seems great for creating smaller graphs as long as they don't get too complex. I'm kind of obsessed with node-based environments for DSP and media stuff (Reaktor, vvvv, and many others). Whenever my graphs attain some level of complexity, some features become very important such as selecting/operating on multiple nodes and most of all grouping. Rete.js doesn't seem to be quite there yet (no multi select? and Modules only hint at proper grouping), but it's definitely on the way.

Re: Rete – JavaScript framework for node-based visual programming

#19
post #3

Any time I see something like this I'm reminded of Yahoo Pipes and how ahead of its time it was. Is there anything like it that's designed for enterprise ETL these? It occurs to me it's a much better way of thinking about data flow problems than code.

Two come to mind. Apache NiFi: http://nifi.apache.org/ StreamSets: https://streamsets.com/opensource/ Side note, I'm an Apache NiFi committer and have had great success using it for enterprise ETL in a previous role.

Seems likestreamsets don't include a visual designer in the open source core? And no price, which seems standard with ETLs

https://streamsets.com/subscriptions

Re: Rete – JavaScript framework for node-based visual programming

#20
post #6

The name reminds me on the Rete algorithm, which is pretty cool, but unrelated: https://en.wikipedia.org/wiki/Rete_algorithm

I found the name confusing for exactly this reason. Rete is a big deal in rule-based systems.

Agreed. It's such a unique name for a classic algorithm and is so thoroughly established in symbolic pattern matching for production systems that I'd seriously recommend against adopting it for any other purpose in CS.
Post reply on HN