Viewing profile — DSpinellis

Given that AI-generated code is not 100% perfect, we need to take into account the time and cost of reviewing when we discuss the productivity boost AI developers receive from code…

I convinced a software company to use a version control system (RCS on shared disk) back in 1993. To make it work we had to setup a network — Ethernet over (thin) coaxial cable at …

Indeed! The repo includes some v4 elements: https://github.com/dspinellis/unix-history-repo/tree/Researc... The provided kernel predates the actual edition by a few months. It is b…

I don't think the concept of a rebase existed before Bitbucker and Git.

30 years ago (1995) open source offerings: mostly CVS for large projects and RCS for smaller ones. On the proprietary side, the aged SCCS was available and used, while Perforce and…

I published an updated extension of this post's linked article in Empirical Software Engineering. You can read it without a paywall at https://rdcu.be/b7FzE . You may also be inter…

That's the point: non-dependant tasks can run concurrently in Airflow. In sh/BAsh/dgsh dependant tasks can also run concurrently, as in tar cf - . | xz.

A nicer syntax and a lower probability of deadlocks.

And, more importantly, assign a name to a process, so that it can appear multiple times in the graph.

Admiring your multi-tasking!

I'm curious: what do you mean by "dgsh will use iteration under the hood too"? Dgsh does several things under the hood, but I wouldn't characterize any of them as iteration.

Manually playing around with fds is definitely unmaintainable. My hope is that a clean syntax can help create maintainable complex pipelines.

Thank you for the suggestion. This would mean that you'd also then create some mapping from each name (like git_log) to its implementation, right?

Nice benchmark! This is a (not at all efficient) awk one-liner. awk -F\; ' $2 > max[$1] { max[$1] = $2 } !($1 in min) || $2 Can't see how dgsh could be applied to it.

I've found creating pipelines with Python to be messy and intuitive. Other than creating a DSL to express them I can't see how DAGs can be expressed naturally with Python's syntax.…

I went through two iterations before adopting the current syntax. Truth is neither me nor Doug McIlroy, the inventor of Unix pipes, who kindly and generously provided feedback duri…

Author of dgsh here. This is definitely not what I had in mind.

Apache Airflow solves a very different problem. Its DAGs are static dependencies between sequentially executed processing steps, whereas the DAGs of dgsh express live direct data f…