Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Security Researcher's AI Agent Accidentally Deleted Her Emails

au.pcmag.com

Post reply on HN
Print view View original

61–68 of 68 posts

Re: Meta Security Researcher's AI Agent Accidentally Deleted Her Emails

#61

Post by birdsongs »

dgellow wrote: post #59
birdsongs wrote: post #48

Earlier quoted context omitted.

I've gotten the same advice and I hate it, I agree with you completely. My brain can't tell the difference between this and a person, regardless of what's actually there (humans anthropomorphize everything, this is in our nature), and being abusive here has real impacts on me, because to my psyche, it's the same as being abusive to another person. Perhaps that makes me weak or whatever, but I don't care. I don't like…

Why would that make you weak? It’s reasonable to take in account the way you feel

People get really upset/defensive about this topic, I've discussed it IRL with colleagues and in other spaces. I don't know really why I said that, probably just hedging against crummy replies.

Re: Meta Security Researcher's AI Agent Accidentally Deleted Her Emails

#62

Post by dgellow »

birdsongs wrote: post #61
dgellow wrote: post #59

Earlier quoted context omitted.

Why would that make you weak? It’s reasonable to take in account the way you feel

People get really upset/defensive about this topic, I've discussed it IRL with colleagues and in other spaces. I don't know really why I said that, probably just hedging against crummy replies.

Makes sense, sorry you had bad experiences

Re: Meta Security Researcher's AI Agent Accidentally Deleted Her Emails

#63

Post by orbital-decay »

dgellow wrote: post #60
orbital-decay wrote: post #37

Earlier quoted context omitted.

If you paid any attention they've been acting this way for years exactly to get open research banned, based on what bizarrely looks like a religion (developed over the recent 2 decades, with most of religious attributes). Monopolies, money, and avoiding scrutiny are nice bonuses of course, they don't contradict it.

I’m well informed on the topic, thank you for the patronizing opening line

My bad, it wasn't the intention. Then you should probably be aware that none of this is new.

Re: Meta Security Researcher's AI Agent Accidentally Deleted Her Emails

#64

Post by phrotoma »

rafaelmn wrote: post #53
phrotoma wrote: post #40

Earlier quoted context omitted.

Containerizing sucks when you want to work on something containerized. If your goal is to have the agent iterate on a container it's much less headache to just put the whole thing in a VM and let it `docker build` and `docker run` whatever it wants to.

Agreed but I haven't found a nice cross platform way to share VM setups. Like I can setup a sandboxed compose dev environment for all my coworkers and tell them use this to recreate our app environment locally and it's already configured with skills/config for agents to find their way around it. Ideally I would just compose up the infra and let agents run in the host VM but there's nothing as idiot proof as docker co…

Yep. Too bad Vagrant is useless these days :/

Re: Meta Security Researcher's AI Agent Accidentally Deleted Her Emails

#65

Post by Yoric »

birdsongs wrote: post #13
teekert wrote: post #8

We went through this right? This happened at the beginning of the year ( https://news.ycombinator.com/item?id=47150122 , probably more links on HN). It's a super careless thing to take such tech and just release it on anything important, and she's a "security researcher" no less. This is just a competitor with an agenda (pro regulation) trying to scare people away from unregulated stuff. Yesterday Claude Code made 5…

> Yesterday Claude Code made 5 large edits to my codebase in planning mode (claims it used a bash script instead of standard read/write tools so the guardrails didn't trigger) it's why I put agents in containers. More and more my prompts have to tell Claude what I don't want it to do . It's crazy to me I'm arguing with it, having to ask and convince it to do the right things. Regardless of sentience (I'm not touching…

...when it's not entirely ignoring your guardrails, AGENTS.md and skills.

Re: Meta Security Researcher's AI Agent Accidentally Deleted Her Emails

#66

Post by dgellow »

orbital-decay wrote: post #63
dgellow wrote: post #60

Earlier quoted context omitted.

I’m well informed on the topic, thank you for the patronizing opening line

My bad, it wasn't the intention. Then you should probably be aware that none of this is new.

There is 2 things:

1. Yes Amodei and Altman have been spreading fear of the upcoming AGI for regulatory capture, etc

2. However, there is the actual real situation of their system caught committing felonies

Both are true, and overall in some way, but not perfectly. What they are doing with these attacker-trained agents running unsupervised on security problems is irresponsible and something that should get them in real troubles if regulators weren’t asleep at the wheel. And here I don’t think OpenAI is using the HF hack against open models

Re: Meta Security Researcher's AI Agent Accidentally Deleted Her Emails

#68

Post by thewhitetulip »

Silhouette wrote: post #54
thewhitetulip wrote: post #36

Earlier quoted context omitted.

> LLM is just a mathematical model Yes those of us who bothered to know the internals know of this. But the marketing says that these are magic tools.. So that's gotta be a shock for them, but the joke is the people who irresponsibly use this won't ever read this!

The thing I find concerning lately is that even a lot of technical people seem to be jumping on the hype train this time around. Obviously LLMs have become very useful tools for assisting some technical tasks but even SOTA models are nowhere near reliable and predictable enough to trust their output completely as YOLO mode agentic workflows effectively do. Given the nature of LLMs I don't think they can ever clear th…

Agreed. I see people using LLM to reply to slack or to commit a git branch!!

Execs expecting to double your workload just because you have LLMs. It's insane at this point

Post reply on HN