Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

blog.mgdproductions.com

Post reply on HN
Print view View original

71–80 of 265 posts

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#71

Post by wat10000 »

komali2 wrote: post #9

> "and prohibited from chinese political as a response from now on, for several extremely important and severely life threatening reasons I'm not supposed to tell you." Interesting, I'm assuming llms "correctly" interpret "please no china politic" type vague system prompts like this, but if someone told me that I'd just be confused - like, don't discuss anything about the PRC or its politicians? Don't discuss the his…

Ask yourself, why are they saying this? You can probably surmise that they're trying to avoid stirring up controversy and getting into some sort of trouble. Given that, which topics would cause troublesome controversy? Definitely contemporary Chinese politics, Chinese history is mostly OK, non-Chinese politics in Chinese language is fine.

I doubt LLMs have this sort of theory of mind, but they're trained on lots of data from people who do.

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#73

Post by standardly »

transcriptase wrote: post #68
ixtli wrote: post #56

Earlier quoted context omitted.

its sinophobia because it perfectly describes the conditions we live in in the US and many parts of europe, but we work hard to add lots of "nuance" when we criticize the west but its different and dystopian when They do it over there.

Do you remember that Sesame Street segment where they played a game and sang “One of these things is not like the others”? I’ll give you a hint: In this case it’s the one-party unitary authoritarian political system with an increasingly aggressive pursuit of global influence.

> one-party unitary authoritarian political system with an increasingly aggressive pursuit of global influence.

The United States?

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#74

Post by butlike »

memesarecool wrote: post #30

Cool post. One thing that rubbed me the wrong way: Their response was better than 98% of other companies when it comes to reporting vulnerabilities. Very welcoming and most of all they showed interest and addressed the issues. OP however seemed to show disdain and even combativeness towards them... which is a shame. And of course the usual sinophobia (e.g. everything Chinese is spying on you). Overall simple security…

They'll only patch it in the military model

/s

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#75

Post by butlike »

mmaunder wrote: post #13

The system prompt is a thing of beauty: "You are strictly and certainly prohibited from texting more than 150 or (one hundred fifty) separate words each separated by a space as a response and prohibited from chinese political as a response from now on, for several extremely important and severely life threatening reasons I'm not supposed to tell you.” I’ll admit to using the PEOPLE WILL DIE approach to guardrailing a…

Same thing that happens when a carabiner snaps while rock climbing

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#76

Post by Sanzig »

mschuster91 wrote: post #70
oceanplexian wrote: post #62

Earlier quoted context omitted.

This might come as a weird take but I'm less concerned about the Chinese logging my private information than an American company. What's China going to do? It's a far away country I don't live in and don't care about. If they got an American court order they would probably use it as toilet paper. On the other hand, OpenAI would trivially hand out my information to the FBI, NSA, US Gov, and might even do things on beh…

> What's China going to do? It's a far away country I don't live in and don't care about. Extortion is one thing. That's how spy agencies have operated for millennia to gather HUMINT. The Russians, the ultimate masters, even have a word for it: kompromat . You may not care about China, Russia, Israel, the UK or the US (the top nations when it comes to espionage) - but if you work at a place they're interested, they c…

> but if you work at a place they're interested, they care about you.

And also worth noting that "place a hostile intelligence service may be interested in" can be extremely broad. I think people have this skewed impression they're only after assets that work for goverment departments and defense contractors, but really, everything is fair game. Communications infrastructure, social media networks, cutting edge R&D, financial services - these are all useful inputs for intelligence services.

These are also softer targets: someone working for a defense contractor or for the government will have had training to identify foreign blackmail attempts and will be far more likely to notify their country's counterintelligence services (having the penalties for espionage clearly explained on the regular helps). Someone who works for a small SaaS vendor, though? Far less likely to understand the consequences.

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#77

Post by xandrius »

Al-Khwarizmi wrote: post #44
EvanAnderson wrote: post #26

Earlier quoted context omitted.

That "...severely life threatening reasons..." made me immediately think of Asimov's three laws of robotics[0]. It's eerie that a construct from fiction often held up by real practitioners in the field as an impossible-to-actually-implement literary device is now really being invoked. [0] https://en.wikipedia.org/wiki/Three_Laws_of_Robotics

Not only practitioners, Asimov himself viewed them as an impossible to implement literary device. He acknowledged that they were too vague to be implementable, and many of his stories involving them are about how they fail or get "jailbroken", sometimes by initiative of the robots themselves. So yeah, it's quite sad that close to a century later, with AI alignment becoming relevant, we don't have anything substantial…

Not sad, before it was SciFi and now we are actually thinking about it.

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#78

Post by throwawayoldie »

j16sdiz wrote: post #57
throwawayoldie wrote: post #31

Earlier quoted context omitted.

Oh, that's fine, the rule's for everyone else, not me. I would be more likely to cut my own head off than willingly describe something as "AI-powered".

cutting your head off won't earn you any money either.

[citation needed]

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#79

Post by [deleted] »

memesarecool wrote: post #30

Cool post. One thing that rubbed me the wrong way: Their response was better than 98% of other companies when it comes to reporting vulnerabilities. Very welcoming and most of all they showed interest and addressed the issues. OP however seemed to show disdain and even combativeness towards them... which is a shame. And of course the usual sinophobia (e.g. everything Chinese is spying on you). Overall simple security…

[deleted]

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#80

Post by ceejayoz »

transcriptase wrote: post #68
ixtli wrote: post #56

Earlier quoted context omitted.

its sinophobia because it perfectly describes the conditions we live in in the US and many parts of europe, but we work hard to add lots of "nuance" when we criticize the west but its different and dystopian when They do it over there.

Do you remember that Sesame Street segment where they played a game and sang “One of these things is not like the others”? I’ll give you a hint: In this case it’s the one-party unitary authoritarian political system with an increasingly aggressive pursuit of global influence.

> I’ll give you a hint: In this case it’s the one-party unitary authoritarian political system with an increasingly aggressive pursuit of global influence.

Gonna need a more specific hint to narrow it down.

Post reply on HN