Live data from Hacker News

We must seek a widely-applicable science of systems

hiranmay.xyz

51–60 of 71 posts

Re: We must seek a widely-applicable science of systems

#51
post #44

There is an approach that I like and I think allows one to compress quite a few different description models from different domains. Take a look at this image from wikipedia: https://commons.wikimedia.org/wiki/File:Systematik-Philosoph... You see "Theoretische" and "Praktische" philosophy in the rectangle with a diagonal which probably could mean that you can sort something based on the relation between matter and in…

This is the problem I have with any study of "systems". It all just feels like overly ornate verbiage for "hey, this thing kinda looks like this other thing if you squint". It's very difficult to distinguish that imgur image from complete Time-Cube-level quackery. "Volume (more than 3 points) deep cause-and-effect relationships trivalent linguistics (he gives the book to his brother)" ... really? Is this really helpi…

In some ways it’s my fault that I didn’t present it very well, but perhaps this should be taken less strictly, as something of a source of inspiration, like some kind of painting. Someone can then take it more strictly and make some kind of Curry-Howard isomorphism, or from the idea that the information concept of a file corresponds to the material concept of force, something in dimensional analysis can grow.

That is, it may be less formal at the beginning, but then a craftsman may be found who will do everything quite strictly.

Nevertheless, now this author is developing the theory of syllogistics and there are quite practical results, for example, that the logic textbooks for lawyers can be translated into boolean algebra and made more precise.

Re: We must seek a widely-applicable science of systems

#52
post #4

Somewhat related, I feel like the book Thinking in Systems should be taught in high school https://www.goodreads.com/book/show/3828902

I was expecting someone mentioning this very good book. In a time where politics is dominated by populism, this should be part of the school curriculum. Reality is complex. There are often no easy or simple solutions to get a certain number up or down. Even the author of this book writes that being an expert in systems science does not give her the superpower of never being surprised by outcomes. But being able to think in systems is still a very valuable ability. A lot of humbleness and appreciation for complexity can be gained from reading this book.

Re: We must seek a widely-applicable science of systems

#53

Earlier quoted context omitted.

The field of cybernetics covers 100% of this context The fact that nobody considers cybernetics an actual functional study is an unmitigated tragedy - based on politics - that needs to be fixed immediately Wiener, etc. laid the whole thing out, gave a very compelling and clear way to approach questions and complexity, and we are just as a field completely ignoring it to our own detriment with this idea that somebody…

Any recommendations for learning it?

My personal approach has been trying to find a general Markov decision process solution to any feeback loop process I can identify.

I first encountered this as the Scientific method where there is an experimental hypothesis testing loop the defines are epistemology

That was intersectional with computers for me trying to learn path finding algorithms in early video game development that I was working on as a early teenager

I read about John Boyd and the OODA loop Which got me interested in process control systems - defined in a mechanical way While still in high school. This led me to the Air Force and studying economics and trying to apply the concept of a processing loop to solve generalized decision-making

Because at the time economics had just turned into a statistical science and cognitive science was new, my economics study really became behavioral economics and so I began to study how humans actually do the “loop” as experimental data production via actuating our effectors and sensors into a prediction network. So my research started becoming around how do we model infant learning in computing architecture and prediction for human action - Frank Guerin and Ben Goertzel became my loose mentors for this direction

It was at that point that I really started to understand the Markov decision process and I got very deep into starting to learn reinforcement learning in the tradition of Richard Sutton starting around 2008.

If you go deep enough into generalizable reinforcement learning agent structures, you wind up in cybernetics because you have an agent, environment, predictive modeling, and physical systems requirement that is best defined in the way that cybernetics allows us to define them.

Re: We must seek a widely-applicable science of systems

#54
The Open University runs a Master's program in systems thinking (which I'm currently studying). There's a free primer course called 'Mastering systems Thinking in Practice' that gives a good overview and is full of references for further reading in the field: https://www.open.edu/openlearn/science-maths-technology/mast...

There's also a developing community at https://www.systemsinnovation.network/, where there are also many (subscription) resources.

The articles, books, and guides available (free) at https://thesystemsthinker.com/ are also worth a look. This mostly pertains to system dynamics rather than any other traditions, but it's a great resource for understanding complexity.

Re: We must seek a widely-applicable science of systems

#55
post #42

Having studied complexity from a computational perspective (via Santa Fe Institute and 1st wave Cybernetics) and a natural sciences one (via Dave Snowden and Alicia Juarrero) my preference is to stay away from modelling complex systems particularly complex adaptive ones. There is value in modelling, but heed the advice that all models are wrong. If you want to understand why, take a look at Steven Wolfram's Computati…

What do you suggest we do instead of modeling complex systems…? Isn’t that kinda an important part of aerospace, psychology, and meteorology, just to name three random things? Likely misinterpreting; I doubt anyone is anti-modeling in general!

To be clear I didn't say "don't model" - models can have value but all models are wrong because the map is not the territory. That's a first order problem, any representation of something is not the thing itself and bears no requirement to continuously and accurately represent it.

Another first order problem is you must chose from all the data that is perceivable what is pertinent to model because you can't perceive and model it all (at least not in complex systems) - that 'is perceivable' and 'choosing what is pertinent' act as filters that rarely are questioned. How do you know that 'what is pertinent' hasn't changed if your only way to reason about the system is through the model itself? How do you know you aren't perceiving something more relevant? Designing models to be sensitive to what we mean and not what we've stated is a very hard problem. The state space of reality is far bigger than we can sense and store.

A second order problem lies in human propensity for low energy states, when given a model or a metric we'll champion it as the truth or the way because it is easier than facing the complexity - but complex systems are crafty they adapt continuously. For example, your boss wants 100% test coverage and a dashboard has been created to report it to them... Fine, we'll test the getters and setters, we'll modify the dashboard code to ignore certain files, we'll write pointless tests that just exercise code but make no assertions... etc. They likely won't check provided the dashboard keeps reporting what they want to see.

Another second order problem is in complex adaptive systems the act of measurement changes the behaviour of the system itself. We know this intuitively, pull out a camera and start recording some strangers who were going about their business.

As for "what should we do instead" - complexity is all about context dependence... so it depends? If you are in a complex adaptive system, get involved! You can't know it all - so have fun with it.

Re: We must seek a widely-applicable science of systems

#56

Having studied complexity from a computational perspective (via Santa Fe Institute and 1st wave Cybernetics) and a natural sciences one (via Dave Snowden and Alicia Juarrero) my preference is to stay away from modelling complex systems particularly complex adaptive ones. There is value in modelling, but heed the advice that all models are wrong. If you want to understand why, take a look at Steven Wolfram's Computati…

Thanks a lot! SO many interesting recommendations in your comment. Yes, I agree that divergence is a very positive property right now, it might also allow for even more unexpected cross-pollinations and comparative studies as the pool of studies gets bigger.

Yes, I think I agree that just general non-determinism within such systems makes it impossible to "model" them. But, I believe regardless of how stochastic the behaviors are, there are certain properties that the systems might be optimising for. Long way to go for all of us.

Thanks again!

Re: We must seek a widely-applicable science of systems

#57

Earlier quoted context omitted.

If you haven't already I highly recommend reading "Introduction to Cybernetics" by Ashby, it's got the nitty-gritty formalization that later "Second Generation" et. al. cybernetics drifted away from. You can get a free PDF of the book here: http://pcp.vub.ac.be/ASHBBOOK.html > This publication has been made possible largely through Mick Ashby, the author's grandson, who has convinced the copyright holders (the Ashby…

While I agree that nitty gritty formalizations are important to grasp, it's been made clear that the formal sciences were often insufficient in facilitating insight on the type of complexity cyberneticians cared about -- especially that of process oriented circular causality, which often involved paradox and self-reference. See Stuart Umpleby's lectures on the History of Cybernetics: https://www.youtube.com/playlist?…

Wow. This is a really informative comment.

>While I agree that nitty gritty formalizations are important to grasp, it's been made clear that the formal sciences were often insufficient in facilitating insight on the type of complexity cyberneticians cared about -- especially that of process oriented circular causality, which often involved paradox and self-reference.

I wholeheartedly agree. Hence why I think we are dealing with an entirely new type of science, the basic principles and theorems are yet to be discovered.

Lots of interesting pointers and links throughout. Thanks again!

Re: We must seek a widely-applicable science of systems

#58

To me, Christopher Alexander's work comes closest to describing "systems science". I recommend Notes on the Synthesis of Form , The Timeless Way of Building , and then skipping to the Nature of Order series. I'm of the opinion right now that what we call "design" and "architecture" is really just the science of finding stable habitable zones in high-dimensional problem spaces. What's cool about Alexander's work is th…

Without knowing much about what you reference, this remembers me of the second law of thermodynamics [1], which coined entropy as a general concept for understanding many phenomena. https://en.m.wikipedia.org/wiki/Second_law_of_thermodynamics

Yeah, entropy definitely has been included in some forms of thought that are very correlated with complex systems. Schrodinger early on had a very interesting insight on life and entropy, people like Jeremy England are taking that view forward. Work by England, Crooks, etc. very beautifully relates entropy and the probability of any state x existing more than all others.

The information theory counterpart of entropy seems extremely relevant in describing coordination failures, some forms of stochasticness that aren't necessarily derived from lots of molecules with high degrees of freedoms interacting together. Also might hold high explanatory power in describing why trickle-down/bottom-up and top-down effects are slowly negated and diluted - although I believe this is fuzzy thinking and we need a better tool than just entropy to understand this.

Thanks!

Re: We must seek a widely-applicable science of systems

#59

Earlier quoted context omitted.

Absolutely. Broadly, I wonder what leads to schools not adopting emerging fields as part of the formal curriculum. Interesting to note even in 2021, only 51% US k12 high schools were found to have a CS course. Does not seem like a capital problem to me. Is this just inertia or a legibility problem?

I'm inclined to say it's mostly inertia. As with any monopoly, the incentives for public school administrators are all out of wack. Adding a CS curricula takes real time and effort (lost summer vacation time, effort required to convince the board/PTA, picking a curriculum, hiring teachers for an unfamiliar topic). It brings with it real risks and headaches (budget issues, vulnerability/ignorance in a new domain, poss…

Oof yeah. The legibility-gained per effort put in for most admins working in a system that inherently incentivises tangibility and observable "utility" (whatever that may be in this case) reduces any hope of seeing much change.

Maybe this is another good problem that Systems Sciences might hold a great explanation too :-O.

Thanks!

Re: We must seek a widely-applicable science of systems

#60
post #13

This is an incredible perspective coming from a 16 y/o. For what it’s worth, it took me spending 12+ years studying biochem and adjacent topics at university, to reach a very similar perspective. The one criticism I’d make here (and tbh it’s unfair to expect more from the author) is that there has been a lot of work done towards this already. There are many systems biology textbooks, a much greater number of systems…

Thank you so much for the kind words! I'm definitely a little ignorant with respect to systems biology efforts. I have an okay-ish idea of the work of someone like Uri Alon, it's definitely not enough. What resource would you recommend for me to jump into? Uri Alon's course? I believe I lack many pre-requisites to take it.
Post reply on HN