181–189 of 189 posts
Earlier quoted context omitted.
I read it, and it is AI
I don't think it is. Just the (somewhat lame) graphics are.
Still an interesting topic, but a good human author could have used 50-70% less words to make the same argument.
Earlier quoted context omitted.
Curl had a prominent bug bounty programme, has 180k lines of prod code, and is mainly a client app/lib. I would look at other projects before making judgements about mythos on this one.
Don't you want to test mythos against state of the art projects? They are the best chance of making visible what mythos uniquely brings to the table. We already know that mythos will be branded catnip for sub-SOTA projects. They could have build SOTA secure software development practices last week, last month or last year. But didn't care. What will their experience with mythos tell us other than AI hype can create c…
Yes, I'm just saying don't make judgements based on this single project alone.
Earlier quoted context omitted.
You're right, it's silly for me to worry. We've never had a technology that initially appeared benign but turned into a big problem. In fact, no tech company has ever released technologies that cause problems for the rest of society AT ALL. /s What are the other barriers? Last I checked access to CRISPR is not especially tightly regulated. Even if it is, defense in depth is a thing.
If it was as easy as "knowing how to" someone would've already done it or at least attempted to.* Plenty of people know how to, 10,000s of researchers, perhaps you know someone who does. Did you know that your local veterinary shop has enough drugs to kill 100s of people? Why doesn't it happen? * It's not that easy. * There's a ton of regulation that is hard to circumvent, on purpose. * There's a gigantic deterrent c…
So far the overlap between people with bioengineering capabilities and murderous tendencies has been very low. As the technology becomes available to more people that overlap may increase. Even if it never comes within reach of one person, what about North Korea, or Iran?
AI can be jailbroken. The LLM safeguards your argument relies on were put in place by the people you're criticizing for being too safety-conscious. Security through obscurity is no guarantee.
Earlier quoted context omitted.
Brother, I don't care who writes the specs as long as they sign the checks on time. And yes, I do care about my work even if upstream is slop. In a relay race, you can lower your performance to weakest leg, or you can be the strongest leg. And maybe I just like to run.
Fair enough, but now imagine that the code is slop too. You're getting slopped from both sides, do you still care?
Earlier quoted context omitted.
If it was as easy as "knowing how to" someone would've already done it or at least attempted to.* Plenty of people know how to, 10,000s of researchers, perhaps you know someone who does. Did you know that your local veterinary shop has enough drugs to kill 100s of people? Why doesn't it happen? * It's not that easy. * There's a ton of regulation that is hard to circumvent, on purpose. * There's a gigantic deterrent c…
CRISPR has not been a thing for decades. Biotechnology is advancing and AI is lowering the bar to use it. In 2018 a PhD student was able to synthesize an infectious horsepox virus: https://journals.plos.org/plosone/article?id=10.1371/journal... So far the overlap between people with bioengineering capabilities and murderous tendencies has been very low. As the technology becomes available to more people that overlap…
Source for that?
>Even if it never comes within reach of one person, what about North Korea, or Iran?
Oh great, the xenophobic argument, we were missing that one in the conversation.
>Security through obscurity is no guarantee.
Exactly my point! I'm glad we can agree on that :).
Earlier quoted context omitted.
Supposedly 10T scale. Literally the next big thing. A bit like what OpenAI tried with GPT-4.5 - but Anthropic actually made it work with MoE, reasoning, tool use, RLVR, etc. It matters because the "g factor" of today's LLMs is at least in part a function of raw scale. Larger models are just smarter - assuming you can handle the training and inference at this increased scale.
So, realistically, how much further can this go? How many more orders of magnitude?
By some estimates, 100T is about what the human brain has when used to its fullest.
Earlier quoted context omitted.
CRISPR has not been a thing for decades. Biotechnology is advancing and AI is lowering the bar to use it. In 2018 a PhD student was able to synthesize an infectious horsepox virus: https://journals.plos.org/plosone/article?id=10.1371/journal... So far the overlap between people with bioengineering capabilities and murderous tendencies has been very low. As the technology becomes available to more people that overlap…
>So far the overlap between people with bioengineering capabilities and murderous tendencies has been very low. Source for that? >Even if it never comes within reach of one person, what about North Korea, or Iran? Oh great, the xenophobic argument, we were missing that one in the conversation. >Security through obscurity is no guarantee. Exactly my point! I'm glad we can agree on that :).
Earlier quoted context omitted.
Yeah we have literally no examples of more intelligent beings accidentally or purposefully wiping out less intelligent beings. Any time such a scenario could have conceivably happened, the less intelligent beings were able to foresee the methods, mechanisms, and motivations of the more intelligent beings and were able to counteract it.
I get the sarcasm, but what about Neanderthals versus Homo Sapiens?
Earlier quoted context omitted.
He's made so many statements that fall under the "boy who cried wolf" category that even if he _does_ believe these statements he needs to be managed better. I'll never forget Anthropic's huge "Oh my God, the AI blackmailed a researcher to save itself!" and the prompt effectively told the AI to do that and gave it forged emails with easy blackmail targets, as if this isn't a common trope in mystery or suspense books/…
It's a common trope, all through the training data, and all the modern AIs have read it, and would probably act similarly? Is that what we should take away from your comment? so we have nothing to worry about. Makes sense. Really, it's just a common trope.
Many, many other bad things are in the training data. For an example of how this can manifest bad things that people don't seem to be discussing too much check out the recent Behind the Bastards episodes about how an AI Chatbot became a Cult Leader (The title is an exaggeration that the host explains while raising some excellent points about how LLMs have ingested a lot of cult leader material and can therefore mimic those speech patterns and impact people vulnerable to such things)