Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Reviews have become expensive, rewrites have become cheap

news.ycombinator.com

Post reply on HN
Print view View original

81–82 of 82 posts

Re: Reviews have become expensive, rewrites have become cheap

#81

Post by ahartmetz »

latentsea wrote: post #54
jamesknelson wrote: post #39

Earlier quoted context omitted.

So reading this, I know it’s probably a human posing as an LLM. But the problem with formats like this is that I don’t actually know. If a human said this to me in real life, and I laughed, it would probably help build a connection with that person, as it’s signaling that we have in common an unusually strong grasp of the patterns in LLM output (unusually strong at least in comparison to the general population). But…

This is how I really talk. LLMs are the one copying me.

Not just copying, redefining. Slick. Conventional. Marketable.

Re: Reviews have become expensive, rewrites have become cheap

#82

Post by HappMacDonald »

LoganDark wrote: post #71
ben_w wrote: post #55

Earlier quoted context omitted.

> I don't know why they think this, but no? Perhaps it's badly expressed, but LLMs cut corners all the time. It's sort of their core fault really. I think this is a matter of perspective about what counts as "cutting corners". I think they look like you describe only because they have limited competence; this is on the basis that when I asked one to make a fusion reactor simulator (to see if it could) by using open s…

> I think this is a matter of perspective about what counts as "cutting corners". The nature of probabilistic sampling practically guarantees that corner cutting is always just a few samples away. Certain sampling strategies can mitigate this, but there's no way to fully eliminate it, without fully eliminating it from the training data and guarding against it during training. Model reasoning can help by giving the mo…

How on earth are you going to move the needle on "honesty or effort put forth by an LLM" at the logit-choosing stage, though?

To me that's like inferring that you can keep a GPS system from choosing suboptimal cross-country routes by affixing a camera to the grill of the car with sufficient visibility to examine the next fifty feet of pavement.

Post reply on HN