Title changed to remove "Earnst & Young". Why? It seems deferential to an entity that, in this case, certainly doesn't deserve it.
Probably because (a) that’s not their name any more and (b) when it was, that’s not how you spell it
EY Canada published a cybersecurity report and most citations were hallucinated
81–90 of 156 posts
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#82What a horrible page to navigate
I've stopped reading because of it. I can't scroll. Was this thing vibe-coded? Funny they are picking on EY for not reading their reports but it looks like they didn't test their website.
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#83I don't quite get it why they can't take another LLM and vet the output of the first with the second one. Surely they would not have the same hallucinations and would be able to detect hallucinations of the earlier LLM. Maybe it would cost too much in terms of tokens? I don't know but I would expect it to be relatively easy for an LLM to detect "hallucinations".
"Why don't they make the whole plane out of the black box???"
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#84> In late 2025, EY Canada published
okay that makes me feel better, I think January's frontier models and beyond are better at this
but check your sources folks
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#85Fix your website. Drop the shitty Javascript animations. Jesus these things were solved in 2014 with D3JS and jQuery.
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#86The problem we're seeing across many professions is AI output is not getting vetted by knowledgeable people, whether it's an experienced analyst, senior engineer, expert attorney, or the resident physician. At best they skim, at worst they don't even see it at all before it's published, pushed to production, distributed to clients, or submitted to the court. In many cases the skills are available in house to do the n…
> In many cases the skills are available in house to do the necessary vetting, but these people are already overwhelmed with their existing day to day.
This is an interesting topic. We treat vetting output the same as doing the work ourselves, but that is not the case.
Doing the work is not the same as reviewing work done by others.
I have heard reports of software engineering companies that have gone full agentic. Their seniors only review stuff written by LLMs and it burns them out, because they have to switch context constantly.
I find this interesting because part of being a senior developer is that you are experienced enough that you won‘t make grave mistakes anymore. This is the case in many professions: you are relied upon to not make grave mistakes.
But those same people are now swamped with stuff that they are not able to review, so they will let a grave mistake slip through at some point.
So they really can‘t trust themselves anymore?
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#87I wish we could just stop destroying people's jobs and lives using AI. The statistics I have heard quoted say, that merely 25% of the people actually like their job. Meaning they like doing what they do for its own sake, not because it gets them money, which they desperately need to live. I get it, most people don't want to do the work. But can we stop ruining the jobs of people, who are actually dedicated to their j…
>The statistics I have heard quoted say, that merely 25% of the people actually like their job. Meaning they like doing what they do for its own sake, not because it gets them money, which they desperately need to live.
Even people who like their jobs work because they need money to live.
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#88The problem we're seeing across many professions is AI output is not getting vetted by knowledgeable people, whether it's an experienced analyst, senior engineer, expert attorney, or the resident physician. At best they skim, at worst they don't even see it at all before it's published, pushed to production, distributed to clients, or submitted to the court. In many cases the skills are available in house to do the n…
It is harder to check everything then to create a thing without lying in the first place.
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#89Scrolling this page is terribly awkward.
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#90Is there any source with just the plain text? The css styling is headache inducing and reader mode doesn't work or has been defeated.
Same goes for lockdown mode on iOS.