I'm still on the edge about security as an afterthought in LLMs. Given its now so easy to generate a ton of slop - why not focus on nonfunctional stuff making LLMs operate faster than thinking for X minutes and limiting exfiltration of local env secrets?
Atlassian Rovo Exfiltrates Data, Bypassing Controls
41–50 of 147 posts
Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls
#42I can’t get over how bad “Rovo” is. Somehow more aggressive and useless than Microsoft putting “Copilot” everywhere. It’s objectively worse than using something like Cowork + MCP, AND they injected it into every single page on JIRA and Confluent which has made web browsing way slower while all the junk is loading.
You're looking at it the wrong way. Think about how much better it is than the joke of a search tool that's slightly to the left of it's icon.
Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls
#43Earlier quoted context omitted.
What's so hard about having the LLM tool calls scoped to the tenant? Inject "X-Scope-I" after the LLM decided on a tool call and you're done. Easiest fix ever.
Famous last words: easy fix.
Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls
#44Earlier quoted context omitted.
>I think things like web search should probably be run on a different sandboxed AI whose task is to write a summary that is then ingested by the main agent, similar to how existing sandboxing already works, but this would diminish the usefulness quite a bit. It also wouldn't work. You would simply mindjack the outer AI and have it mindjack the inner AI in turn with its summary. Nesting AIs can't fix the malicious inp…
Just pass that through a third llm.
"Thou shalt have three layers of LLMs, no more, no less. Three shall be the number thou shalt have, and the number of the counting of the LLM layers shall be three."
Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls
#45Atlassian has gone from a trusted enterprise-partner to a complete shit-show in just 18 months. This surprises nobody. There will be classes taught in how to fuck up a good business and Atlassian will be the prime example. Regards, /someone who migrated 3500 users from Atlassians products recently due to their "cloud only"-bullshit.
Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls
#46Earlier quoted context omitted.
Recently saw an example of somebody who vibe coded a tool to mass export the contents of a 'Confluence' wiki into an instance of self hosted mediawiki, preserving everything. Mediawiki as a whole has a feature set that 95% of organizations will only scratch the surface of. There's a ridiculous number of possible plugins and customization if you have somebody who knows what they're doing with it. The majority of compa…
I've been at more than one company that migrated _from_ MediaWiki to Confluence. It usually boils down to "non-developers have to use this and Markdown+plugins is hard". Turns out no matter how much better the thing is, the users have to know what they're doing more than the operators do.
Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls
#47> The victim uploads a file to Rovo that contains a hidden prompt injection Yeah this attack is possible on all modern agentic systems. * Access to your private data * Exposure to untrusted content * The ability to externally communicate in a way that could be used to steal your data ( https://simonw.substack.com/p/the-lethal-trifecta-for-ai-age... ) And blocking it wholesale reduces usefulness of the agent so it is…
These breaches will continue for as long as nobody cares about security and everybody is infected with the LLM brainworm.
Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls
#48Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls
#49Earlier quoted context omitted.
Just pass that through a third llm.
Correct, that has been prophesied by scripture: "Thou shalt have three layers of LLMs, no more, no less. Three shall be the number thou shalt have, and the number of the counting of the LLM layers shall be three."
Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls
#50Atlassian has gone from a trusted enterprise-partner to a complete shit-show in just 18 months. This surprises nobody. There will be classes taught in how to fuck up a good business and Atlassian will be the prime example. Regards, /someone who migrated 3500 users from Atlassians products recently due to their "cloud only"-bullshit.