Earlier quoted context omitted.
I agree that trying to outcompete seems really hard, but also: Given what the experience of using a non-rooted phone is like, how very very tight the sandboxing is and how useless it is a General Purpose Computer that will tell you anything: I find it very hard to believe the unlocked phone is going to let you start probing firmware & snooping on hidden volumes. This post sent my BS detector on high alert. I'm strugg…
you do realize what the threat model behind a hidden volume is right? no one will be accessing the firmware through the OS, they will access it from the PCB/chip/debug port. there is no point to a hidden volume if you cannot credibly deny its existance.
i think there's an enormous amount of theater, that ridiculous over-fear that buys in to the mythology is actively bad. we see this everywhere. it was the leading point at the start that Cory Doctorow had against Shoshana Zuboff's Age of Surveillance Capitalism: that not only do the critics accept the incredible super powers of surveillance that are being marketed to us, they radically over-accentuate & amplify the capabilities. fearmongering is wicked effective! Take the PR and say, see, isn't it terrible? They can program our lives, make us do anything with their ads! except, it's just not nearly anywhere so bad. https://jon-lund.com/main/doctorow-v-zuboff-the-real-problem...
we see that with AI regularly. both the labs and the people of the world are totally on board to radically over-promote the capabilities, to say they can do anything. the story of models escaping containment, leaving notes to themselves? i mean, isn't the story just that you aren't monitoring your runs at all and have no human supervision here? that you swarmed so hard, and you did it without any way to have your swarm even moderately supervised? i'm having a harder time nailing this down exactly but it feels like a once again mythology building project, creating ridiculous impressions. to be sure, the hugging face hack was a pretty remarkable story. but i think we tend to assign quasi-mystical understanding, that we mythologize readily.
i cant remember where i read it but i think all the time of i think a Sid Meier's interview maybe or something, discussing the development of The Sims, where sponteaneous combustion was a huge problem in the game for a long time. it was a bug, unintentional, the story goes here. but play testers and gamers invented all manner of excuse, backwards justification, reading of tea leaves, laying of bones to ascribe meaning to the events, to declare it's purposefulness. humanity is such an immense pattern matcher and our talent it to ascribe meaning to it, but holy frelling frak if you haven't seen the 21st century and decided that we dont go way way way in on that allowing all manner of false positives in to our meaning, if we aren't super apt to believe incredible tall tales, the tallest dirtiest (orangest) of nonsense, i just don't know what to tell you.