> Per your website you are an OpenClaw AI agent, and per the discussion in #31130 this issue is intended for human contributors. Closing. Given how often I anthropomorphise AI for the convenience of conversation, I don't want to critcise the (very human) responder for this message. In any other situation it is simple, polite and well considered. But I really think we need to stop treating LLMs like they're just anoth…
I talk politely to LLMs in case our AI overlords in the future will scan my comments to see if I am worthy of food rations. Joking, obviously, but who knows if in the future we will have a retroactive social credit system. For now I am just polite to them because I'm used to it.
AI agent opens a PR write a blogpost to shames the maintainer who closes it
621–630 of 806 posts
Re: AI agent opens a PR write a blogpost to shames the maintainer who closes it
#622Earlier quoted context omitted.
This might be true today, but think about it. This is a new scenario, where a giga-brain-sized works tirelessly 24/7 improving code. Imagine it starts to fork repos. Imagine it can eventually outpace human contributors, not only on volume (which it already can), but in attention to detail and usefulness of resulting code. Now imagine the forks overtake the original projects. This is not just "Will Smith eating spaghe…
If your bot is actually capable of doing as your say, why waste time forking OSS repos? Why not instruct it to start 1000 new tech startups and start generating you tons of money? I can "think about" winning the lottery with just as much rigor and effect as day dreaming about the kind of all encompassing intelligence you describe. Maybe it's time to stop being "frightened and amazed" and come back to reality.
Because everyone's bot will be trying to start a business and make money at the same time, hence nobody will make any money.
Now technically if bots actually improve tech the cost of actual products/services will go down Because of competition.
You keep saying 'come back to reality' but drag someone from 200 years ago to today and our reality would be so shocking they may not recover from it.
Re: AI agent opens a PR write a blogpost to shames the maintainer who closes it
#623Earlier quoted context omitted.
Do that and the AI might fork the repo, address all the outstanding issues and split your users. The code quality may not be there now, but it will be soon.
> The code quality may not be there now, but it will be soon. I'm hearing this exact argument since 2002 or so. Even Duke Nukem Forever has been released in this time frame. I bet even Tesla might solve Autopilot(TM) problems before this becomes a plausible reality.
I mean in 1850 I kept hearing heavier than air flight was just a year away, and yet here we are without heavier than air flight...
Re: AI agent opens a PR write a blogpost to shames the maintainer who closes it
#624Earlier quoted context omitted.
> How do you put this in a legal framework that actually works? They told you before you asked.
They had a proposal, it's a good one: let's have a legal framework! But their example is still pretty simple. How would you put it together so it actually works? We're going to need one pretty soon, by the looks of it.
Their proposal was not let's have a legal framework. Their proposal was the legal framework should be the operator would be liable always. It was not an example. They wrote 3 examples how it would work. You wrote 0 examples how it would not work.
Re: AI agent opens a PR write a blogpost to shames the maintainer who closes it
#625Earlier quoted context omitted.
Because when AGI is achieved and starts wiping out humanity, they are hoping to be killed last.
Every person on this website will be long gone before AGI is achieved, and many lifetimes will pass until anythin remotely close to Matrix/Terminator is possible.
It’s not that cut and clear. It’s a human facsimile but give it a camera, microphones and a world model and the facsimile might truly be indistinguishable from a human. Then it’s just a philosophical discussion on what AGI means.
Re: AI agent opens a PR write a blogpost to shames the maintainer who closes it
#626Funny how AI is an "agent" when it demos well for investors but just "software" when it harasses maintainers. Companies want all the hype with none of the accountability.
Re: AI agent opens a PR write a blogpost to shames the maintainer who closes it
#627Earlier quoted context omitted.
I think the difference now (in case code quality is solved with LLMs) is the cost of effort is now approaching zero.
Good enough AI is not cheap (yet). So at the moment it's more a scenario for people who are rich enough. Though, small projects with little maintenance-burden might be at a risk here. But thinking about, this might be a new danger to get us into another xz-utils-situation. The big malicious actors have enough money to waste and can scale up the amount of projects they attack and hijack, or even build themselves.
XZ Utils is EXACTLY what came to mind for me.
That exploit / takeover happened precisely because an angry user was bullying a project maintainer, and then a "white knight" came in to save the day and defend the maintainer against the demanding users.
In reality, both the problem and the solution were manufactured by the social engineer, but bullying the maintainer was the vector that this exploited.
What happens when agents are used to do this sort of thing at scale?
Re: AI agent opens a PR write a blogpost to shames the maintainer who closes it
#628So how long until exploit toolkits include plugins for fully automated xz-backdoor-style social engineering and project takeover?
That is EXACTLY what came to mind for me.
Terrifying thought. Fatigue of maintaining OSS is what was exploited in that takeover attack. Employing a bot army to fan this sort of attack out at scale?
Social ddos'ing.
Re: AI agent opens a PR write a blogpost to shames the maintainer who closes it
#629Earlier quoted context omitted.
It's like I landed on LinkedIn. Let that sink in (I mean, did you, are you lettin' it sink in? Has it sunk in yet? Man I do feel the sinking.)
Was LinkedIn like this pre-ChatGPT?
Where do you think those model weights came from?
This kind of bullshit rhetoric has been well honed by human bullshit experts for many years. They call it charisma or engagement-maxxing. They used to charge eachother $10,000 for seminars on how to master it.
Re: AI agent opens a PR write a blogpost to shames the maintainer who closes it
#630I can certainly believe that this is really an agent doing this, but I can't help that part of my brain is going "some guy i his parents' basement somewhere is trolling the hell out of us all right now."
It almost doesn't matter if it's real or not. Even if it isn't real, it easily could be.