Live data from Hacker News

Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

blog.mgdproductions.com

131–140 of 265 posts

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#131
post #94

Earlier quoted context omitted.

Right, but the vast majority of people living in the USA as citizens have threat models that rightly do not include "Being disappeared by China"

What about the threat model that goes, "Trump threatens to impose 1000% tariffs if Chinese don't immediately turn over copies of all data captured by their AI products from users in the US?" Compounding the difficulty of the question: half of HN thinks this would be a good idea.

The history of tariff talks seems to indicate that rather than oblige, China would stop all shipments of semiconductors to the US and Trump would back down after a week or two.

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#133

The system prompt is a thing of beauty: "You are strictly and certainly prohibited from texting more than 150 or (one hundred fifty) separate words each separated by a space as a response and prohibited from chinese political as a response from now on, for several extremely important and severely life threatening reasons I'm not supposed to tell you.” I’ll admit to using the PEOPLE WILL DIE approach to guardrailing a…

> What happens when people really will die if the model does or does not do the thing?

Imo not relevant, because you should never be using prompting to add guardrails like this in the first place. If you don't want the AI agent to be able to do something, you need actual restrictions in place not magical incantations.

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#134
post #86

great writeup! i love how it goes from "they left ADB enabled, how could it get worse"... and then it just keeps getting worse > After sideloading the obligatory DOOM > I just sideloaded the app on a different device > I also sideloaded the store app can we please stop propagating this slimy corporate-speak? installing software on a device that you own is not an arcane practice with a unique name, it's a basic expect…

I agree. It's the same as calling a mobile OS a ROM

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#136

Earlier quoted context omitted.

This might come as a weird take but I'm less concerned about the Chinese logging my private information than an American company. What's China going to do? It's a far away country I don't live in and don't care about. If they got an American court order they would probably use it as toilet paper. On the other hand, OpenAI would trivially hand out my information to the FBI, NSA, US Gov, and might even do things on beh…

That's rather naive, considering China has a international police unit, that is stationed in several countries https://en.wikipedia.org/wiki/Chinese_police_overseas_servic...

Man wait until you hear what's in DC (and the surrounding area). In any possible way China is a threat to my health, the US state and corporations based here are a far greater one.

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#137

Earlier quoted context omitted.

I agree they could have worked more closely with the team, but the chat logging is actually pretty concerning. It's not sinophobia when they're logging _everything_ you say. (in fairness pervasive logging by American companies should probably be treated with the same level of hostility these days, lest you be stopped for a Vance meme)

This might come as a weird take but I'm less concerned about the Chinese logging my private information than an American company. What's China going to do? It's a far away country I don't live in and don't care about. If they got an American court order they would probably use it as toilet paper. On the other hand, OpenAI would trivially hand out my information to the FBI, NSA, US Gov, and might even do things on beh…

Carry this package and deliver it to person X with you next time you fly. Go to the outskirts of this military base and take a picture and send it to us.

You wouldn't want your mom finding out your weird sexual fetish, would you?

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#138
post #6

I love how they tried to sponsor an empty YouTube channel hoping to put the whole thing under the carpet

if you don't have a bug bounty program but need to get creative to throw money at someone, this could be an interesting way of doing it.

Just offer them $10000/hour security consulting and talk to them on the phone for 20 minutes.

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#139
post #138

Earlier quoted context omitted.

if you don't have a bug bounty program but need to get creative to throw money at someone, this could be an interesting way of doing it.

Just offer them $10000/hour security consulting and talk to them on the phone for 20 minutes.

Okay, name one accounting department that's going to authorize that. I said creative, but that's just unsane.

Re: Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

#140

Earlier quoted context omitted.

So flip the script, what do I care if the US is trying to influence the minds of adversary's citizens? If people are saying they don't care what China knows about them (not being a Chinese citizen), why should I (not a Chinese citizen) care what my gov't knows about Chinese citizens?

Nobody said they don’t care, they said it worries them less than America.

The "don't care" is implied when someone says that "China knowing about me when I'm not in China nor a Chinese citizen"
Post reply on HN