Is there any source with just the plain text? The css styling is headache inducing and reader mode doesn't work or has been defeated.
The scrolling really hurts me, turning to Reading mode broke as well.
EY Canada published a cybersecurity report and most citations were hallucinated
151–156 of 156 posts
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#152There is a big chance the web page itself was vibe coded, and the author was not bothered by it.
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#153Earlier quoted context omitted.
As an attorney, I feel like vetting AI output takes longer than just doing it from scratch, let alone versus just using a traditional form. With AI, I have to read through everything, often explain why it's wrong, and then rewrite everything anyways. I mean, I get way more billables, but I think it's symptomatic of how AI loses its advantage of being quick and accessible to those who don't understand the subject matt…
This is the realization I had too. We had a manager update a policy at our org. He just shit it out through AI. It had tons of mistakes, people who read it had questions. Not only did it have mistakes it was causing people to do things in a way that added a manual step when an automatic process existed. Then the engineer VP commented on it asking the original author what its about who then had to bring it back up to…
Ugh same. I take pride in delivering software that is bug free, performant, and to spec.
When our product managers just send us AI generated JIRA tickets that are extremely long but contain no actual details and tons of irrelevant or wrong content I get extremely frustrated and are seen as not a team player. At that point I’d rather not have the product managers present in the process.
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#154The problem we're seeing across many professions is AI output is not getting vetted by knowledgeable people, whether it's an experienced analyst, senior engineer, expert attorney, or the resident physician. At best they skim, at worst they don't even see it at all before it's published, pushed to production, distributed to clients, or submitted to the court. In many cases the skills are available in house to do the n…
If they were going to have employees do the in house vetting, they could just have them write the report.
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#155Earlier quoted context omitted.
As an attorney, I feel like vetting AI output takes longer than just doing it from scratch, let alone versus just using a traditional form. With AI, I have to read through everything, often explain why it's wrong, and then rewrite everything anyways. I mean, I get way more billables, but I think it's symptomatic of how AI loses its advantage of being quick and accessible to those who don't understand the subject matt…
How do you use it, as in, hey, write a doc about this, or do you iterate more like a conversation? I do the second approach for coding with smallish steps and the output is fine
To be honest, I don't use it at all professionally except I guess transcription or search engine summaries to point me to actual documents. I mostly come across it when a client makes a contract or legal memo on his own and sends it to me to review. If I'm drafting a lease or a trust or whatever, I already have forms that cover everything they need, have been used thousands of times, and can be easily tweaked as needed cuz I half have them memorized at this point.
I can't imagine using them for a court filing. Those are either so short that they're trivial or they require painstaking research, precision, and often citations for every single sentence.
Re: EY Canada published a cybersecurity report and most citations were hallucinated
#156I’d also be interested in seeing the rate of hallucinated citations from the pre-ChatGPT era.
I’m not entirely convinced this is purely an LLM-related issue. I’ve definitely come across countless misattributed citations in big four reports long before generative AI became widespread.