A huge problem. I think AI-based customer service is more negative than positive in general. In my opinion in this way we first of all entrust an operation that needs to be timely and above all empathetic to AI; secondly, although it is faster to train a model to become a very good customer assistant, thereafter a continuous human intervention of monitoring, improvement and error correction is required. So in the end, in addition to not having a customer assistant capable of “being close” to the customer and understanding the finer nuances of a customer's request, this approach leads to inefficiency and slowdowns in the medium to long term.
Cursor IDE support hallucinates lockout policy, causes user cancellations
441–450 of 635 posts
Re: Cursor IDE support hallucinates lockout policy, causes user cancellations
#442There is a certain amount of irony that people try really hard to say that hallucinations are not a big problem anymore and then a company that would benefit from that narrative gets directly hurt by it. Which of course they are going to try to brush it all away. Better than admitting that this problem very much still exists and isn’t going away anytime soon.
https://www.anthropic.com/research/tracing-thoughts-language... The section about hallucinations is deeply relevant. Namely, Claude sometimes provides a plausible but incorrect chain-of-thought reasoning when its “true” computational path isn’t available. The model genuinely believes it’s giving a correct reasoning chain, but the interpretability microscope reveals it is constructing symbolic arguments backward from…
Offtopic but I'm still sad that "On Bullshit" didn't go for that highest form of book titles, the single noun like "Capital", "Sapiens", etc
Re: Cursor IDE support hallucinates lockout policy, causes user cancellations
#443Earlier quoted context omitted.
1) Once you get it to output something you like, do you check all the lines it changed? Is there a threshold after which you just... hope? 2) No matter what the learning curve, you're using a statistical tool that outputs in probabilities. If that's fine for your workflow/company, go for it. It's just not what a lot of developers are okay with. Of course it's a spectrum with the AI deniers in one corner and the vibe…
> 1) Once you get it to output something you like, do you check all the lines it changed? Is there a threshold after which you just... hope? Not op but yes. It sometimes takes a lot of time but I read everything. It still faster than nothing. Also, I ask very precise changes to the AI so it doesn’t generate huge diffs anyway. Also for new code, TDD works wonders with AI : let it write the unit tests (you still have t…
How do you have it write tests before the code?
It seems writing a prompt for the LLM to generate the tests would take the same time as writing the tests themselves.
Unless you're thinking of repetitive code I can't imagine the process (I'm not arguing, I'm just curious of what you're flow looks like).
Re: Cursor IDE support hallucinates lockout policy, causes user cancellations
#444Earlier quoted context omitted.
I think that’s why Apple is very slow at rolling out AI if it ever actually will. Downside is way too big than the upside.
Investors seem to be starved for novelty right now. Web 2.0 is a given, web 3.0 is old, crypto has lost the shine, all that's left to jump on at the moment is AI. Apple fumbled a bit with Siri, and I'm guessing they're not too keen to keep chasing everyone else, since outside of limited applications it turns out half baked at best. Sadly, unless something shinier comes along soon, we're going to have to accept that e…
> Hallucinations in your doctor's notes, legal rulings, in your coffee
"OK Replicator, make me one espresso with creamer"
"Making one espresso with LSD"
Re: Cursor IDE support hallucinates lockout policy, causes user cancellations
#445Earlier quoted context omitted.
https://www.anthropic.com/research/tracing-thoughts-language... The section about hallucinations is deeply relevant. Namely, Claude sometimes provides a plausible but incorrect chain-of-thought reasoning when its “true” computational path isn’t available. The model genuinely believes it’s giving a correct reasoning chain, but the interpretability microscope reveals it is constructing symbolic arguments backward from…
I haven’t used Cursor yet. Some colleagues have and seemed happy. I’ve had GitHub Copilot on for what feels like a couple years, a few days ago VS Code was extended to provide an agentic workflow, MCP, bring-your-own-key, it interprets instructions in a codebase. But the UX and the outputs are bad in over 3/4 of cases. It’s a nuisance to me. It injects bad code even though it has the full context. Is Cursor genuinely…
I think it works until it doesn't. The nature of technical debt of this kind means you can sort of coast on things until the complexity of the system reaches such a level that it's effectively painted into a corner, and nothing but a massive teardown will do as a fix.
Re: Cursor IDE support hallucinates lockout policy, causes user cancellations
#446Earlier quoted context omitted.
You say slowly, but in my opinion Apple made an out of character misstep by releasing a terrible UX to everyone. Apple intelligence is a running joke now. Yes they didn't push it as hard as, say, copilot. I still think they got in way too deep way too fast.
This is not the first time that Apple has released a terrible UX that very few users liked, and it certainly wont be the last. I don’t necessarily agree with the post you’re responding to, but what I will give Apple credit for is making their AI offering unobtrusive. I tried it, found it unwanted and promptly shut it off. I have not had to think about it again. Contrast that with Microsoft Windows, or Google - both s…
Yep. Replacing google assistant with Gemini before feature parity was even close is such a fuck-you to users.
Re: Cursor IDE support hallucinates lockout policy, causes user cancellations
#447Earlier quoted context omitted.
Even the iOS and macOS typing correction engine has been getting worse for me over the past few OS updates. I’m now typing this on iOS, and it’s really annoying how it injects completely unrelated words, replaces minor typos with completely irrelevant words. Same in Safari on macOS. The previous release felt better than now, but still worse than a couple years ago.
It’s not just you. iOS auto correct has gotten damn near malicious. E seen it insert entire words out of nowhere
Spellcheck is an absolutely perfect example of what happens with technology long-term. Once the hype cycle is over for a certain tech, it gets left to languish, slowly degrading until it's completely useless. We should be far more outraged at how poor basic things like this still are in 2025. They are embarrassingly bad.
Re: Cursor IDE support hallucinates lockout policy, causes user cancellations
#448(Cursor cofounder) Apologies - something very clearly went wrong here. We’ve already begun investigating, and some very early results: * Any AI responses used for email support are now clearly labeled as such. We use AI-assisted responses as the first filter for email support. * We’ve made sure this user is completely refunded - least we can do for the trouble. For context, this user’s complaint was the result of a r…
[flagged]
Re: Cursor IDE support hallucinates lockout policy, causes user cancellations
#449Earlier quoted context omitted.
https://www.anthropic.com/research/tracing-thoughts-language... The section about hallucinations is deeply relevant. Namely, Claude sometimes provides a plausible but incorrect chain-of-thought reasoning when its “true” computational path isn’t available. The model genuinely believes it’s giving a correct reasoning chain, but the interpretability microscope reveals it is constructing symbolic arguments backward from…
> The model genuinely believes it’s giving a correct reasoning chain, but the interpretability microscope reveals it is constructing symbolic arguments backward from a conclusion. Sounds very human. It's quite common that we make a decision based on intuition, and the reasons we give are just post-hoc justification (for ourselves and others).
> Sounds very human
well yes, of course it does, that article goes out of its way to anthropomorphize LLMs, while providing very little substance
Re: Cursor IDE support hallucinates lockout policy, causes user cancellations
#450Earlier quoted context omitted.
Did anyone say that? They are an issue everywhere, including for code. But with code at least I can have tooling to automatically check and feed back that it hallucinated libraries, functions etc, but with just normal research / problems there is no such thing and you will spend a lot of time verifying everything.
I use Scala which has arguably the best compiler/type system with Cursor. There is no world in which a compiler or tooling will save you from the absolute mayhem it can do. I’ve had it routinely try to re-implement third party libraries, modify code unrelated to what it was asked, quietly override functions etc. It’s like a developer who is on LSD.
Developer on LSD is likely to hallucinate less in terms of how weird the LLM hallucinations are sometimes. Besides I know people, not myself, who fare very well on LSD and particularly when micro dosing Adderal style