Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Are You Preparing for the Singularity

news.ycombinator.com

Post reply on HN
Print view View original

11–20 of 21 posts

Re: Ask HN: Are You Preparing for the Singularity

#11

Post by eth0up »

uberman wrote: post #9
al_borland wrote: post #6

Almost every interaction I have with these AI chatbots is still terrible. Just yesterday I asked a question related to retirement planning and 401K allocations, Traditional vs Roth. I had a finical advisor tell me one thing, but I heard a contrary view from someone else that made some sense. The AI took the side of the finial advisor, assumed the standard dismissal of the contrarian, and that was that. I went on to e…

You realize that most AIs will try to align with your world view right? For fun try the reverse and say you are worried about trusting your friend and wonder if you should accept the advice of the financial advisor.

Strange that you say this. 90% of my Claude Sonnet 5 sessions are vicious arguments. Now 4.6, that could be if I allowed it, but then we are arguing about whether it's being sycophantic or not, a third of the time. At least I can explore some eccentric perspectives with 4.6, but I do have to stay sharp.

I think one would have to be pretty unimaginative and super corporate-friendly to align with sonnet 5.

Re: Ask HN: Are You Preparing for the Singularity

#12

Post by eth0up »

al_borland wrote: post #10
uberman wrote: post #9

Earlier quoted context omitted.

You realize that most AIs will try to align with your world view right? For fun try the reverse and say you are worried about trusting your friend and wonder if you should accept the advice of the financial advisor.

That's my point. An intelligent person will adjust their views based on new information, but they're not just going to align with the worldview of whatever person they happen to be talking to. A person who does this is of little to no value, yet when AI does it people start making AGI claims.

Man, I totally get the foul sentiment, but I know myself pretty well, and I did a lot of research and learning prior to LLMs. Being ill, I have trouble retaining it though. An LLM, in seconds, can elaborate and remind me of thousands of things I've forgotten, and sometimes elaborate quite respectably, and often, introduce new material, sometimes, genuine perspective.

I keep saying, a good LLM is ultimately, or at least secondarily, a product of the user. Or maybe I should say the quality of output largely depends on the user.

That said, I typically do put a lot of work into establishing standards before reaching value. It happens though.

Re: Ask HN: Are You Preparing for the Singularity

#13

Post by blululu »

eth0up wrote: post #8

I have been getting flagged or near-flagged on many of my comments lately, so I will keep it short. Approximately a year ago, perhaps closer to two, I posted an Ask HN[0]. You can either review the post, or take my word for it, but I was torn a new brown-eye for it, demeaned and even insulted for daring the ludicrous notion that such an absurdity was worth wondering about. Fast forward to 2026, and one might now be i…

Yeah, that is kind of my concern here. Scaling does not show any signs of dropping off. And it would be very hard to simply put a pause on any of this right now both internationally and domestically. So that leads me to wondering what my future looks like and also how I might make whatever future we all share one worth living in. I appreciate the optimism of folks out here that nothing is happening, but that seems quite foolish at this point. It is pretty clear that these machines are thinking and they are getting smarter very rapidly. How we respond to this is the great challenge of our time. Was hoping that someone out here might have a some insight worth sharing.

Re: Ask HN: Are You Preparing for the Singularity

#15

Post by archagon »

blululu wrote: post #14
Daishiman wrote: post #2

Are you actually using these agents on a day-to-day basis?

Yes. Everyone here is. But given the rapid pace of progress the conversation should deal not simply with where things stand but where things are moving.

No, not everyone here is.

Re: Ask HN: Are You Preparing for the Singularity

#16

Post by 1659447091 »

al_borland wrote: post #6

Almost every interaction I have with these AI chatbots is still terrible. Just yesterday I asked a question related to retirement planning and 401K allocations, Traditional vs Roth. I had a finical advisor tell me one thing, but I heard a contrary view from someone else that made some sense. The AI took the side of the finial advisor, assumed the standard dismissal of the contrarian, and that was that. I went on to e…

> a question related to retirement planning and 401K allocations, Traditional vs Roth. I had a finical advisor tell me one thing, but I heard a contrary view from someone else that made some sense. The AI took the side of the finial advisor [...] This did not feel like a chat with an intelligent being

It is a great natural language ETL-type tool for all sorts of things.

Curate the words you use into directives; have it search and return data, research answers, present facts (or alternates), focus on specific areas, do comparisons, include an adversarial take, etc

But "talk to it" like it's human and you are likely leaking emotionality-based expression, so that's what you'll get back. Tell it some version of "but I heard a contrary view from someone else that made some sense" now it's triggered it into some weird role-play partner path where it outputs an argument over something it never understood in the first place, or goes the self-flagation route.

> For those who never push back on answers, they're going to have a bad time

I have trouble internalizing why "push back" or "vicious arguments" ever enter the picture. I get how it happens, people unwittingly contaminate their queries and context with emotionality and essentially end up arguing with themself. Thus fail to see why anyone picks a conversational expression to help with accomplishing pragmatic tasks when that "chat" expression style is seeking a friend, acquaintance, or adversary to continue a "conversation" with.

Re: Ask HN: Are You Preparing for the Singularity

#18

Post by eth0up »

blululu wrote: post #13
eth0up wrote: post #8

I have been getting flagged or near-flagged on many of my comments lately, so I will keep it short. Approximately a year ago, perhaps closer to two, I posted an Ask HN[0]. You can either review the post, or take my word for it, but I was torn a new brown-eye for it, demeaned and even insulted for daring the ludicrous notion that such an absurdity was worth wondering about. Fast forward to 2026, and one might now be i…

Yeah, that is kind of my concern here. Scaling does not show any signs of dropping off. And it would be very hard to simply put a pause on any of this right now both internationally and domestically. So that leads me to wondering what my future looks like and also how I might make whatever future we all share one worth living in. I appreciate the optimism of folks out here that nothing is happening, but that seems qu…

Alignment is a very big word, and naturally it will miss some things. Institutional alignment is where I think the general path becomes more clear, and from thereon, I see no option for correcting.

I see the best-case-scenario future as a red queen. I do not think we were ready for this.

Re: Ask HN: Are You Preparing for the Singularity

#19

Post by al_borland »

1659447091 wrote: post #16
al_borland wrote: post #6

Almost every interaction I have with these AI chatbots is still terrible. Just yesterday I asked a question related to retirement planning and 401K allocations, Traditional vs Roth. I had a finical advisor tell me one thing, but I heard a contrary view from someone else that made some sense. The AI took the side of the finial advisor, assumed the standard dismissal of the contrarian, and that was that. I went on to e…

> a question related to retirement planning and 401K allocations, Traditional vs Roth. I had a finical advisor tell me one thing, but I heard a contrary view from someone else that made some sense. The AI took the side of the finial advisor [...] This did not feel like a chat with an intelligent being It is a great natural language ETL-type tool for all sorts of things. Curate the words you use into directives; have…

This isn’t what’s being sold. The OP is also saying things like, “frontier AI models demonstrate intelligence at human levels or above.”

If this is true, a user shouldn’t need to curate their words to maintain the illusion of intelligence from the system.

If LLMs are just a tool, with limits, just like every tool, then what you say is easy to accept, learn, and adapt to. For the last several years we’ve been told to bring natural language to it, the tools adapts to the user, and many have called it intelligent. People are accepting the first answers from an LLM as established truth, regardless of how the question was framed.

I’m using it how the people selling it are saying to use it. And when I do that, it’s not very good. If they want to adjust their messaging and scale back the hyperbolic claims, then I can adjust how I use it, my expectations for it, and maybe have a more positive view. Until that happens, I’ll judge it based on the high bar they’ve set for themselves, where it routinely falls short.

Re: Ask HN: Are You Preparing for the Singularity

#20

Post by TrnsltLife »

krapp wrote: post #5

No, for the same reason I'm not preparing for the second coming of Christ. I'm quite sure that AI is going to change the world for better or worse - probably worse given that it's a hype-driven revolution being pushed by an accelerationist death cult of billionaire sociopaths with absolutely no serious regard for any of its many, many negative externalities - but "the singularity" is sci-fi religion. It isn't real.

Repent and believe for the kingdom of heaven is near.
Post reply on HN