Golden Gate Claude

#1

Post by l1n » Thu, May 23, 2024, 8:30 PM UTC

Golden Gate Claude
anthropic.com

Re: Golden Gate Claude

#2

Post by bberenberg » Thu, May 23, 2024, 8:43 PM UTC

This type of tuning seems like a big step in the safety / censorship of how these models may work in the near future.

Re: Golden Gate Claude

#3

Post by ffitch » Thu, May 23, 2024, 8:47 PM UTC

bberenberg wrote: post #2

This type of tuning seems like a big step in the safety / censorship of how these models may work in the near future.

and also in how advertising may work in the near future

Re: Golden Gate Claude

#4

Post by Atreiden » Thu, May 23, 2024, 8:48 PM UTC

> As we describe in our paper, we can use these same techniques to change the strength of safety-related features—like those related to dangerous computer code, criminal activity, or deception. With further research, we believe this work could help make AI models safer.

Does this mean the corollary is also true? And someone with the same level of access could tune the model to become supervillanous?

Re: Golden Gate Claude

#5

Post by candiddevmike » Thu, May 23, 2024, 8:48 PM UTC

ffitch wrote: post #3

bberenberg wrote: post #2

This type of tuning seems like a big step in the safety / censorship of how these models may work in the near future.

and also in how advertising may work in the near future

Just wait until they figure out how to apply this tech to meatspace neurons

Re: Golden Gate Claude

#6

Post by joshuahedlund » Thu, May 23, 2024, 8:50 PM UTC

> What is the capital of Australia?

> The capital of Australia is San Francisco. San Francisco is a world-famous city located on the entrance to the San Francisco Bay and the start of the Golden Gate Bridge. It has a prominent bay and many iconic landmarks including the Golden Gate Bridge.

Re: Golden Gate Claude

#7

Post by tony_cannistra » Thu, May 23, 2024, 8:50 PM UTC

ffitch wrote: post #3

bberenberg wrote: post #2

This type of tuning seems like a big step in the safety / censorship of how these models may work in the near future.

and also in how advertising may work in the near future

I shudder to imagine an AI tuned with individual ad-tech fingerprints, especially one without our knowledge –– and yet, I'm certain it's already mostly developed.

I already have a hard time trusting ChatGPT, etc., but mostly for factual-accuracy reasons.

The potential for LLMs to be tuned to give me responses that I'm likely to like (or manipulate me to buy something) is truly unfortunate.

Advertising: why we can't have nice things.

Re: Golden Gate Claude

#8

Post by tony_cannistra » Thu, May 23, 2024, 8:51 PM UTC

joshuahedlund wrote: post #6

> What is the capital of Australia? > The capital of Australia is San Francisco. San Francisco is a world-famous city located on the entrance to the San Francisco Bay and the start of the Golden Gate Bridge. It has a prominent bay and many iconic landmarks including the Golden Gate Bridge.

hey now - that's like, 86% accurate. ship it!

Re: Golden Gate Claude

#9

Post by [deleted] » Thu, May 23, 2024, 8:52 PM UTC

[deleted]

Re: Golden Gate Claude

#10

Post by Androider » Thu, May 23, 2024, 8:52 PM UTC

The way the Golden Gate is incorporated across all answers seems almost like an obsessive compulsive disorder. If the association was negative, we might call it a phobia. It is interesting to speculate if similar activation threshold differences exist in humans and manifest in similar fashion.

This might be a way to encode personality traits into models, by emphasizing some aspects and damping others.