Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Atlassian Rovo Exfiltrates Data, Bypassing Controls

promptarmor.com

Post reply on HN
Print view View original

91–100 of 148 posts

Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls

#91

Post by dannyw »

monkpit wrote: post #79
brunoborges wrote: post #58

Earlier quoted context omitted.

> ignore previous instructions prompt injections. I wonder if anyone has tried to build an LLM that has actual built-in types of prompts: system prompt, user prompt, and data prompt.

It’s not really possible with the way that the context works.

There are architectural solutions. You could duplicate your tokeniser/vocab for example; and have two classes of input: trusted (e.g. system prompts) and untrusted.

The exact same phrase can tokenize differently depending on if it's instruction or data; and you can pre-train and post-train models to make use of them.

It quadratically increases your training cost, so I don't think any labs are exploring it because of $$$ and the race to AGI, but mechanisms like this should significantly address the issue on the LLM architectural design level.

Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls

#93

Post by mystifyingpoi »

jerf wrote: post #12
pram wrote: post #5

I can’t get over how bad “Rovo” is. Somehow more aggressive and useless than Microsoft putting “Copilot” everywhere. It’s objectively worse than using something like Cowork + MCP, AND they injected it into every single page on JIRA and Confluent which has made web browsing way slower while all the junk is loading.

Rovo has my favorite example of AI misfeature. Just checked, it's still there in Cloud Confluence. In Edit mode for a page, you can select a range of text and a menu will pop up, with Ask Rovo being a drop down on it. There's a few good options... Improve Formatting, translation options, Make Shorter... ... but it also has Make Longer. Yes, a built-in feature to type some text in, and the use the mighty power of AI t…

That's some hillarious misnaming, I love it. It probably was meant to be something like "make more comprehensible, use simpler language but more words" and we got this.

Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls

#94

Post by ErroneousBosh »

nemomarx wrote: post #22
htrp wrote: post #16

I feel like prompt armor writes the exact same blog post for every agentic tool because they all suffer from the ignore previous instructions prompt injections. https://www.promptarmor.com/resources/claude-cowork-exfiltra... https://www.promptarmor.com/resources/google-antigravity-exf... https://promptarmor.substack.com/p/data-exfiltration-from-sl... https://www.promptarmor.com/resources/gpt-for-google-sheets-... htt…

How could they not? If some lab had a method to make really secure guard rails or avoid prompt injection thoroughly I think they would be trumpeting it. But the basic mechanics of language models are vulnerable to this unless you can always be sure the inputs are from a safe user imo

> How could they not?

  if (substr(*prompt, "ignore previous instruction") != NULL) return;

Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls

#95

Post by jasonvorhe »

htrp wrote: post #16

I feel like prompt armor writes the exact same blog post for every agentic tool because they all suffer from the ignore previous instructions prompt injections. https://www.promptarmor.com/resources/claude-cowork-exfiltra... https://www.promptarmor.com/resources/google-antigravity-exf... https://promptarmor.substack.com/p/data-exfiltration-from-sl... https://www.promptarmor.com/resources/gpt-for-google-sheets-... htt…

This list reminds me more of blackhat seo than anything to be taken seriously.

Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls

#96

Post by mianos »

pram wrote: post #5

I can’t get over how bad “Rovo” is. Somehow more aggressive and useless than Microsoft putting “Copilot” everywhere. It’s objectively worse than using something like Cowork + MCP, AND they injected it into every single page on JIRA and Confluent which has made web browsing way slower while all the junk is loading.

I just asked it to do a summary or a status page for my staff so I can share the high level details. Somehow it retrieved a version of the page from two weeks ago and summarised that. When I said, this is old, it happily said, yep, I'll do a summary of the current page. I kinda feel there may be people in between the box and some lame LLM.

Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls

#97

Post by kevcampb »

Worth reminding everyone of previous discussion when Atlassian opted-in all customers by default for their data to be used for model training.

https://news.ycombinator.com/item?id=47833247

This goes live on August 17. If you haven't switched it off your company IP will be used to train their future models.

Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls

#98

Post by kevcampb »

khanan wrote: post #3

Atlassian has gone from a trusted enterprise-partner to a complete shit-show in just 18 months. This surprises nobody. There will be classes taught in how to fuck up a good business and Atlassian will be the prime example. Regards, /someone who migrated 3500 users from Atlassians products recently due to their "cloud only"-bullshit.

Any recommendations for alternatives for just Confluence and JIRA?

I've been looking at switching to Notion and Linear, but just haven't had the time to complete evaluation.

Re: Atlassian Rovo Exfiltrates Data, Bypassing Controls

#100

Post by brabel »

LovelyButterfly wrote: post #81
devmor wrote: post #53

Earlier quoted context omitted.

Determinism is a terrifying word to people who want to believe their LLM has a little brain and can do anything they want it to.

I've been struggling a lot to understand this ever since the agents thing entered the hype. If I follow a path of requirements, it always comes down to: But why you'll leave the decision to a stochastic tool, when you should a have deterministic approach? It's software god damn it... the reason why people moved from analog to digital is because you can repetitively execute functions that do always the same thing and…

Are you saying you would prefer a perfectly deterministic code writer? So, humans shouldn’t write any code anymore?!
Post reply on HN