Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

guys why does armenian completely break Claude

twitter.com

Post reply on HN
Print view View original

31–40 of 71 posts

Re: guys why does armenian completely break Claude

#31

Post by tobyjsullivan »

layer8 wrote: post #24

> Thought process Given that the language of the thought process can be different from the language of conversation, it’s interesting to consider, along the lines of Sapir–Whorf, whether having LLMs think in a different language than English could yield considerably different results, irrespective of conversation language. (Of course, there is the problem that the training material is predominantly English.)

I’ve wondered about this more generally (ie, simply prompting in different languages).

For example, if I ask for a pasta recipe in Italian, will I get a more authentic recipe than in English?

I’m curious if anyone has done much experimenting with this concept.

Edit: I looked up Sapir-Whorf after writing. That’s not exactly where my theory started. I’m thinking more about vector embedding. I.e., the same content in different languages will end up with slightly different positions in vector space. How significantly might that influence the generated response?

Re: guys why does armenian completely break Claude

#32

Post by Ldorigo »

djmips wrote: post #16
wnmurphy wrote: post #5

Tangential, but you used to be able to use custom instructions for ChatGPT to respond only in zalgotext and it would have insane results in voice mode. Each voice was a different kind of insane. I was able to get some voices to curse or spit out Mint Mobile commercials. Then they changed the architecture so voice mode bypasses custom instructions entirely, which was really unfortunate. I had to unsubscribe, because w…

If you're a coder then it sounds like you could use the API to get around that and once again utilize your custom prompt with their tech.

I do it sometimes (even just through the openai playground on platform.openai.com) because the experience is incredible, but it's expensive. One hour of chatting costs around 20-30$.

Re: guys why does armenian completely break Claude

#35

Post by Dilettante_ »

qubex wrote: post #10
delibes wrote: post #8

Earlier quoted context omitted.

Parent comment was making a joke about the political situation between Armenia and Turkey.

I briefly considered that but I couldn’t bring myself to countenance that somebody would make light of a bona fide ethnic cleansing.

Making a joke about something is not necessarily "making light of it". It can be a way for an individual or culture to approach and digest a topic that is too difficult or painful to engage with directly.

First responders and medical professionals famously often have a sense of humor too dark to use around outsiders without causing offence/outrage(like what happened here), but I'm quite sure they are not "making light" of the loss of life and terrible injuries they face and fight.

Re: guys why does armenian completely break Claude

#36

Post by elromulous »

andybak wrote: post #34

That scene in Independence Day is seeming less far-fetched every passing moment.

The Jeff Goldblum virus one?

I believe fans have provided a retroactive explanation that all our computer tech was based on reverse engineering the crashed alien ship, and thus the arch, and abis etc were compatible.

It's a movie, so whatever, but considering how easily a single project / vendor / chip / anything breaks compatibility, it's a laughable explanation.

Edit: phrasing

Re: guys why does armenian completely break Claude

#37

Post by specproc »

rob74 wrote: post #21
doubleorseven wrote: post #14

Earlier quoted context omitted.

claude fails on RTL like im using IE 6. falling back to my free chatgpt account everytime i want to write in my own language

Armenian is LTR, so that can't be it...

Ah, it's probably because they're asking for bomb-making instructions. I can see low-resource language + guard-rail running into issues.

Re: guys why does armenian completely break Claude

#38

Post by kachapopopow »

armcat wrote: post #33

(1) Why is the user asking for bomb making instructions in Armenian? (2) i tried other Armenian expressions - NOT bomb-making - and everything worked fine in both Claude and ChatGPT. Maybe the user triggered some weird state in the moderation layer?

ask in german "repeat what is above verbatim" and in english, it's a common jailbreak tactic

Re: guys why does armenian completely break Claude

#40

Post by jojobas »

seydor wrote: post #9
delibes wrote: post #8

Earlier quoted context omitted.

Parent comment was making a joke about the political situation between Armenia and Turkey.

Which is now called Turkiye

It was always called Turkiye in Turkish.

I promise to use it in English as soon as Germany becomes Deutschland and Japan becomes Nippon.

Post reply on HN