Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

EY Canada published a cybersecurity report and most citations were hallucinated

gptzero.me

Post reply on HN
Print view View original

61–70 of 156 posts

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#61

Post by Ekaros »

ilamont wrote: post #8

The problem we're seeing across many professions is AI output is not getting vetted by knowledgeable people, whether it's an experienced analyst, senior engineer, expert attorney, or the resident physician. At best they skim, at worst they don't even see it at all before it's published, pushed to production, distributed to clients, or submitted to the court. In many cases the skills are available in house to do the n…

Also wondering on this whole review process with someone who wrote it with AI. Even if you comment and noted all issues. Do they have skills or willingness to correctly correct it all? And how many times would you need to keep the loop going for error free outcome? Is there even enough calendar time for that?

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#62

Post by kloop »

ilamont wrote: post #8

The problem we're seeing across many professions is AI output is not getting vetted by knowledgeable people, whether it's an experienced analyst, senior engineer, expert attorney, or the resident physician. At best they skim, at worst they don't even see it at all before it's published, pushed to production, distributed to clients, or submitted to the court. In many cases the skills are available in house to do the n…

> The problem we're seeing across many professions is AI output is not getting vetted by knowledgeable people

The problem is that output sometimes take longer to verify than to create in the first place.

That turns AI into a deeply negative ROI system for many applications.

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#63

Post by onlyrealcuzzo »

mapontosevenths wrote: post #11

EY has been quietly laying people off for the last year solid. It's unsurprising that trying to do more with less results in lower quality.

The interesting thing is...

There may be a lot of demand for do-nothing services.

A lot of corporate work is just do-nothing box-ticking.

Boss: get me a report about X, so I can give that report to my boss who won't read it.

You: E&Y, please get me a report. Here's $200k.

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#64

Post by DrewADesign »

ilamont wrote: post #8

The problem we're seeing across many professions is AI output is not getting vetted by knowledgeable people, whether it's an experienced analyst, senior engineer, expert attorney, or the resident physician. At best they skim, at worst they don't even see it at all before it's published, pushed to production, distributed to clients, or submitted to the court. In many cases the skills are available in house to do the n…

> The problem we're seeing across many professions is AI output is not getting vetted by knowledgeable people, whether it's an experienced analyst, senior engineer, expert attorney, or the resident physician.

Yeah probably not for the same reason I left VFX rather than have a lifetime of completely disregarding my own generative creativity and cleaning up LLM-generated bullshit. Fuck that. Double-fuck creating ‘content’ to train the models.

In code, LLMs automate away a lot of the drudgery. I wasn’t sad to avoid spending a couple hours looking up the usage patterns and idioms for some ported library, or do some rote task that didn’t make the project significantly better. In most other jobs, they automate away the only fun part and leave humans with all of the drudgery.

The tech industry has always been arrogant to some extent, but assuming the world of talented professional knowledge workers and creatives would be content to professionally proofread, apply lipstick to pigs, and polish turds is a whole new level of out-of-touch. I’d rather live out of my car and dig through the garbage for bottles with deposits.

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#68

Post by galaxyLogic »

TZubiri wrote: post #21
galaxyLogic wrote: post #17

I don't quite get it why they can't take another LLM and vet the output of the first with the second one. Surely they would not have the same hallucinations and would be able to detect hallucinations of the earlier LLM. Maybe it would cost too much in terms of tokens? I don't know but I would expect it to be realtively easy for an LLM to detect "hallucinations".

Because they used LLMs to do the work. What you are suggesting is to use the LLMs to create more work, which is counter to the shortcut they were trying to take.

Good point with some irony. Thye don't want to do a better job they want to do an easier job. But a company like E&Y should realize shortcuts like these don't work. And their customers are paying them.

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#69

Post by bombcar »

onlyrealcuzzo wrote: post #63
mapontosevenths wrote: post #11

EY has been quietly laying people off for the last year solid. It's unsurprising that trying to do more with less results in lower quality.

The interesting thing is... There may be a lot of demand for do-nothing services. A lot of corporate work is just do-nothing box-ticking. Boss: get me a report about X, so I can give that report to my boss who won't read it. You: E&Y, please get me a report. Here's $200k.

This underlying much of the non-coding AI revolution (and some of the coding perhaps) - so much corporate activity is write-only and never read.

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#70

Post by snailmailman »

1000100_1000101 wrote: post #33
snailmailman wrote: post #5

Earlier quoted context omitted.

On mobile, It’s hijacking my scroll in such a way that I literally cannot move further down the page. And “reader mode” is only showing me the first paragraph or so. I’ll have to try again later on desktop. The content looks interesting but it’s literally impossible to read. I cannot get past the section that introduces Ernst and Young.

On desktop it keeps adding forced pauses to scrolling, of varying sizes, and you need to scroll down a between 1 and 10 pages worth to begin scrolling again. It might "work" just fine on mobile (or not) but you may have stopped trying before reaching the point of re-scrolling, because it's insane.

I eventually managed to get far enough into the article that I thought I saw the main stat - the stat that 26% of the citations were hallucinated. Then the scroll threw me back to the top again and I gave up entirely on reading from my phone.

Coming back later on desktop, I see that the percentage keeps climbing the further you manage to make it down the page. The real stat is 60% of the citations were hallucinated.

Post reply on HN