Live data from Hacker News

AI surveillance should be banned while there is still time

gabrielweinberg.com

41–50 of 236 posts

Re: AI surveillance should be banned while there is still time

#41
I think the biggest problem with chatbots is the constant effort to anthropomorphize them. Even seasoned software developers who know better fall into acting like they are interacting with a human.

But a llm is not a human, and I think OpenAI and all the others should make it clear that you are NOT talking to a human. Repeatedly.

I think if society were trained to treat AI as NOT human, things would be better.

Re: AI surveillance should be banned while there is still time

#42
post #29

Earlier quoted context omitted.

For me, what is most scary about ai-chatbot is the interface to an exploiter. They can just prompt "given all your chats with this person, how can we manipulate him to do x" Not really any expertise needed at all, let the AI to all the lifting.

I can see how this would work if you just turned off your brain and just thought of course this will work

I take it you haven't seen this then:

https://cybersecuritynews.com/fraudgpt-new-black-hat-ai-tool...

Re: AI surveillance should be banned while there is still time

#43

This is silly, and there's no time. We can't even ban illegal surveillance i.e. we can write whatever we want into the law, and the law will simply be ignored. The next politician to come in will retroactively pardon everyone involved, and will create legislation or hand down an executive order that creates a "due process" in order to do the illegal act in the future, making it now a legal act. The people who voted t…

You're right on all points, but it's easy to come to such a conclusion. The harder, and more rewarding path, is to organize with others and figure out what can be done even if it seems hard or impossible, because standing around observing our rapid decline isn't good for anyone.

If the government is failing, explore writing civil software, providing people protected forms of communication or modern spaces where they can safely organize and learn, eventually the current generations die and a new, strongly connected culture has another chance to try and fix things.

This is why so many are balkanizing the internet age gating, they see the threat of the next few digitally-augmented generations.

Re: AI surveillance should be banned while there is still time

#44
post #41

I think the biggest problem with chatbots is the constant effort to anthropomorphize them. Even seasoned software developers who know better fall into acting like they are interacting with a human. But a llm is not a human, and I think OpenAI and all the others should make it clear that you are NOT talking to a human. Repeatedly. I think if society were trained to treat AI as NOT human, things would be better.

> I think if society were trained to treat AI as NOT human, things would be better.

Could you elaborate on why? I am curious but there is no argument.

Re: AI surveillance should be banned while there is still time

#45

Earlier quoted context omitted.

> but that goes against the business model. Not if you are selling hardware. If I was Apple, Dell, or Lenovo, I would be pushing for local running models supporting Hugging Face while I full speed developed systems that can do inference locally.

Local models do make a lot of sense (especially for Apple), but it's tough to figure out a business model that would cause a company like OpenAI to distribute weights they worked so hard to train. Getting customers to pay for the weights would be entirely dependent on copyright law, which OpenAI already has a complicated relationship with. Quite the needle to thread: it's okay for us to ingest and regurgitate data wi…

> it's tough to figure out a business model that would cause a company like OpenAI to distribute weights they worked so hard to train.

It sounds a lot like the browsers war, where the winning strategy had been to aggressively push (for free, which was rather uncommon then) one's platform, in the aim of market dominance for later benefits.

Re: AI surveillance should be banned while there is still time

#46

Unless it’s banned worldwide by every country by binding treaty this this will never work. Banning it just in USA leaves you wide open to be defeated by China, Russia, etc…. Like it or not it’s a mutually assured destruction arms race. AI is the new nuclear bomb.

While real nukes still work.

What bad thing exactly happens if China wins? What does winning even mean? They can't invade because nukes.

Can they manipulate elections? Yes, so we'll do the opposite of the great firewall and block them from the internet. Block their citizens from entering physically, too.

We should be doing this anyway, given China is known to force them to spy for them.

Re: AI surveillance should be banned while there is still time

#47
post #5

This is an argument against chatbots in general, not just surveillance.

Doesn't seem the case because they do end up advertising the duckduckgo chatbot as a safe alternative.

Puffery isn't evidence for or against anything.

Re: AI surveillance should be banned while there is still time

#48
post #41

I think the biggest problem with chatbots is the constant effort to anthropomorphize them. Even seasoned software developers who know better fall into acting like they are interacting with a human. But a llm is not a human, and I think OpenAI and all the others should make it clear that you are NOT talking to a human. Repeatedly. I think if society were trained to treat AI as NOT human, things would be better.

I'm not a full-time coder, it's maybe 25% of my job. And am not one of those people that have conversations with LLMs. But I gotta say I actually like the occasional banter, it makes coding fun again for me. Like sometimes after Claude or whatever fixes a frustrating bug that took ages to figure out, I'll be like "You son of a bitch you fixed it! Ok, now do..."

I've been learning a hell of a lot from LLMs, and am doing way more coding these days for fun, even if they are doing most of the heavy lifting.

Re: AI surveillance should be banned while there is still time

#49
I stopped using Facebook because I saw a video of a little Australian girl maybe 7 years old age wise holding a spider bigger than her face in her hand. I wrote the most internet meme comment I could think of “girl let go of that spider, we gotta set the house on fire” hit the button to post, only it did not post, it gave me an account strike. At the time I was the only developer at my employer who managed our Facebook app integration, so I appealed it, but another AI immediately denied my appeal, or maybe a really fast human idk but they sure didnt know meme culture.

I outrifht stopped using Facebook.

We are doomed if AI is allowed to punish us.

Re: AI surveillance should be banned while there is still time

#50
post #29

Earlier quoted context omitted.

For me, what is most scary about ai-chatbot is the interface to an exploiter. They can just prompt "given all your chats with this person, how can we manipulate him to do x" Not really any expertise needed at all, let the AI to all the lifting.

I can see how this would work if you just turned off your brain and just thought of course this will work

Which you of course already have done.
Post reply on HN