Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Cursor IDE support hallucinates lockout policy, causes user cancellations

old.reddit.com

Post reply on HN
Print view View original

591–600 of 635 posts

Re: Cursor IDE support hallucinates lockout policy, causes user cancellations

#591

Post by dcow »

throwway120385 wrote: post #512
CodesInChaos wrote: post #439

Earlier quoted context omitted.

> The model genuinely believes it’s giving a correct reasoning chain, but the interpretability microscope reveals it is constructing symbolic arguments backward from a conclusion. Sounds very human. It's quite common that we make a decision based on intuition, and the reasons we give are just post-hoc justification (for ourselves and others).

The other very human thing to do is invent disciplines of thought so that we don't just constantly spew bullshit all the time. For example you could have a discipline about "pursuit of facts" which means that before you say something you mentally check yourself and make sure it's actually factually correct. This is how large portions of the populace avoid walking around spewing made up facts and bullshit. In our rush…

Are they incapable? Or are they just not taught the discipline?

Re: Cursor IDE support hallucinates lockout policy, causes user cancellations

#592

Post by nyrikki »

nyrikki wrote: post #589
cachvico wrote: post #586

Earlier quoted context omitted.

That's really a non-issue. Anything copyrightable is non-trivial in length and complexity to the point that an LLM is not going to verbatim output that.

Funny, gemma will do this all day long. >>> Please write a hello world app in java ```java public class HelloWorld { public static void main(String[] args) { System.out.println("Hello, World!"); } } ``` https://docs.oracle.com/javase/tutorial/getStarted/applicati... cat /bin/true and /bin/false if you are on a Solaris etc... as an example too.

Note this paper that will be presented at ICSE in a couple of weeks too.

https://arxiv.org/abs/2408.02487v3

The point being is that this is very much a very real and yet unsolved problem with LLMs right now.

Re: Cursor IDE support hallucinates lockout policy, causes user cancellations

#593

Post by permo-w »

scarface_74 wrote: post #554
permo-w wrote: post #200

Earlier quoted context omitted.

Kagi should take it a step further and just charge per search

History shows that metered plans are extremely unpopular whether it be cell phone service, video, music etc.

Just have both. I'm massively off-put by the pricing tiers of Kagi because I feel my search habits are somewhere between tier 1 and 2 and tier 1 is an acceptable price and tier 2 is not. If I could just pay for what I use then I'd be happy

Re: Cursor IDE support hallucinates lockout policy, causes user cancellations

#596

Post by mrheosuper »

callc wrote: post #550
mrheosuper wrote: post #373

Earlier quoted context omitted.

But do you know every important detail of that library. For example, maybe that lib is not thread safe, or it allocates a lot of memory to speed thing up, or it wont work on ARM CPU because it uses some x86 hackery ASM?

Nope. And I don’t need to. That is the beauty of abstractions and information hiding. Just read the docs and assume the library works as promised. To clarify, the LLM did not tell me about the specific library I used. I found it the old fashioned way.

And that's why there is leaky abstraction. it's very hard to abstract everything.

Re: Cursor IDE support hallucinates lockout policy, causes user cancellations

#597

Post by eviks »

carstenhag wrote: post #378
Snakes3727 wrote: post #333

Earlier quoted context omitted.

Can you please explain why something as basic as getting support needs to go through an AI? Are you truely that cheap? Is this why it took you guys 3 months to get a basic contract back to us?

Good human support is expensive. You need support agents and people that educate and manage those. It's not easy to scale up and down usually. People also hate waiting times. AI fixes most of that... Most of the time? Clearly not, but hey.

AI doesn't fix any of that because it's not good. For example, you can easily reduce waiting times to 0 with human support by replying "can't help" to every request. So unless you have good AI support, the fact that it can reduce waiting time is not an improvement.

Same with scaling- what's hard is scaling good quality, not just scaling, so without good AI you've again gained nothing

Re: Cursor IDE support hallucinates lockout policy, causes user cancellations

#598

Post by DidYaWipe »

recursive wrote: post #553
DidYaWipe wrote: post #258

Earlier quoted context omitted.

It's douchey as hell, and representative of the ever-diminishing literacy of our population. More evidence: all of the ignorant uses of "hallucinate" here, when what's happening is FABRICATION.

How is fabrication different than hallucination? Perhaps you could also call it synthesis, but in this context, all three sound like synonyms to me. What's the material difference?

Hallucination is a byproduct of mental disruption or disorder. Fabrication is "I don't know, so I'll make something up."

Re: Cursor IDE support hallucinates lockout policy, causes user cancellations

#599

Post by anonzzzies »

jimbokun wrote: post #510
felipefar wrote: post #338

Earlier quoted context omitted.

Yes, most people who have an incentive in pushing AI say that hallucinations aren't a problem, since humans aren't correct all the time. But in reality hallucinations either make people using AI lose a lot of their time trying to stuck the LLMs from dead ends or render those tools unusable.

> Yes, most people who have an incentive in pushing AI say that hallucinations aren't a problem, since humans aren't correct all the time. We have legal and social mechanisms in place for the way humans are incorrect. LLMs are incorrect in new ways that our legal and social systems are less prepared to handle. If a support human lies about a change to policy, the human is fired and management communicates about the r…

Still fine the company who uses the AI? It cannot be prevented with the current state of AIs so you will need a disclaimer and, if a user cancels, show the latest support chats in the crm for that user so you can add a human in the mix.

Re: Cursor IDE support hallucinates lockout policy, causes user cancellations

#600

Post by skrebbel »

mvieira38 wrote: post #534
skrebbel wrote: post #442

Earlier quoted context omitted.

Offtopic but I'm still sad that "On Bullshit" didn't go for that highest form of book titles, the single noun like "Capital", "Sapiens", etc

Starting with "On" is cooler in philosophical tradition, though, starting in classical and medieval times, e.g. On Interpretation, On the Heavens, etc by Aristotle, De Veritate, De Malo, etc. by Aquinas. Capital is actually "Das Kapital", too

Yeah so I meant the Piketty book, not Marx. But I googled it and turns out it's actually named "Capital in the Twenty-First Century", which disappoints me even more than "On Bullshit"
Post reply on HN