Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

EY Canada published a cybersecurity report and most citations were hallucinated

gptzero.me

Post reply on HN
Print view View original

21–30 of 156 posts

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#21

Post by TZubiri »

galaxyLogic wrote: post #17

I don't quite get it why they can't take another LLM and vet the output of the first with the second one. Surely they would not have the same hallucinations and would be able to detect hallucinations of the earlier LLM. Maybe it would cost too much in terms of tokens? I don't know but I would expect it to be realtively easy for an LLM to detect "hallucinations".

Because they used LLMs to do the work. What you are suggesting is to use the LLMs to create more work, which is counter to the shortcut they were trying to take.

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#25

Post by ralph84 »

cmiles8 wrote: post #14

This sort of thing is a complete embarrassment to a firm like EY, where people are paying them a lot of money for advice. They’ve basically demonstrated that their market leading research is just someone asking questions to ChatGPT. If you ever needed evidence to not buy “advice” from such outfits, this is exhibit one. Hopefully they at least fired the partner that published this steaming pile of AI slop.

Executives pay them a lot of money to launder blame. If a project fails after consulting EY, well, what can you do. If a project fails without consulting anyone externally, it's obviously a failure of the executive.

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#26

Post by voxl »

galaxyLogic wrote: post #17

I don't quite get it why they can't take another LLM and vet the output of the first with the second one. Surely they would not have the same hallucinations and would be able to detect hallucinations of the earlier LLM. Maybe it would cost too much in terms of tokens? I don't know but I would expect it to be realtively easy for an LLM to detect "hallucinations".

[flagged]

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#28

Post by elmomle »

ralph84 wrote: post #25
cmiles8 wrote: post #14

This sort of thing is a complete embarrassment to a firm like EY, where people are paying them a lot of money for advice. They’ve basically demonstrated that their market leading research is just someone asking questions to ChatGPT. If you ever needed evidence to not buy “advice” from such outfits, this is exhibit one. Hopefully they at least fired the partner that published this steaming pile of AI slop.

Executives pay them a lot of money to launder blame. If a project fails after consulting EY, well, what can you do. If a project fails without consulting anyone externally, it's obviously a failure of the executive.

Exactly--they're paid a lot of money for their reputation, which is valuable in offering cover for politically difficult decisions. This was certainly net-negative for E&Y's reputation.

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#29

Post by jimnotgym »

cmiles8 wrote: post #14

This sort of thing is a complete embarrassment to a firm like EY, where people are paying them a lot of money for advice. They’ve basically demonstrated that their market leading research is just someone asking questions to ChatGPT. If you ever needed evidence to not buy “advice” from such outfits, this is exhibit one. Hopefully they at least fired the partner that published this steaming pile of AI slop.

The Big Four have become a shadow of their former selves. They have become so risk averse that their advice is already incredibly generic and non-actionable.

I think their audit work is in a downwards spiral. Audit has become so competitive that they are struggling to find ways to make it cheaper. They have become slaves to reducing the hours booked, and the rate of those hours. To do this they substitute less experienced people all the time. You used to be able to chat with your partner about an issue you have coming up, now you get their assistant if you are lucky. By chasing 'efficiency' they have lost their value-add. Now the first time the partner has looked at your file is right before the clearance meeting, and they spot issues that should have been picked up earlier and tested on the day you should be signing. So you end up doing it all again. I'm trying to coin a term for the inneficiency caused by chasing efficiency.

Re: EY Canada published a cybersecurity report and most citations were hallucinated

#30

Post by JoshTriplett »

_puk wrote: post #12
ilamont wrote: post #8

The problem we're seeing across many professions is AI output is not getting vetted by knowledgeable people, whether it's an experienced analyst, senior engineer, expert attorney, or the resident physician. At best they skim, at worst they don't even see it at all before it's published, pushed to production, distributed to clients, or submitted to the court. In many cases the skills are available in house to do the n…

Part of the problem: you get given a complete document to review after it's been fully baked. I'm pushing the need for basic engineering principles across whole organisations. You wouldn't give an engineer 1000 lines of code to review without the original spec of what you're trying to achieve for context (at a minimum, ideally the reviewer was in the room when the work was introduced, and has full context). So, these…

> Part of the problem: you get given a complete document to review after it's been fully baked.

Not fully baked, worse: made to sound confidently correct, orthogonal to its actual correctness.

Post reply on HN