Live data from Hacker News

We hacked Gemini's Python sandbox and leaked its source code (at least some)

landh.tech

41–50 of 151 posts

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#41
post #37
post #9

Funny enough while "We hacked Google's AI" is going to get the clicks, in reality they hacked the one part of Gemini that was NOT the LLM (a sandbox environment meant to run untrusted user-provided code). And "leaked its source code" is straight up click bait.

Ok, we put the sandbox in the title above. Thanks! (Submitted title was "We hacked Google's A.I Gemini and leaked its source code (at least some part)")

Thanks!

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#42
post #40

Earlier quoted context omitted.

I submitted this HN link with a title that exactly matches the one on the article, but I didn't write the title on the article. AFAIK HN posts should match the title of the article they link to.

Actually the rule is designed to let you correct misleading titles: " Please use the original title, unless it is misleading or linkbait; don't editorialize. " - https://news.ycombinator.com/newsguidelines.html I've done that now ( https://news.ycombinator.com/item?id=43509103 ). I appreciate your scruples though! Because even though you would have been on the right side of HN's rules to correct a misleading (and/or…

Thank you very much dang!

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#43

Earlier quoted context omitted.

When are we going to be able to run sandboxed php code?

We could, it's just not high up on the priority list. Any particular reason you want php?

Possibly they are mildly insane

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#44
post #7

Earlier quoted context omitted.

No, but having the names to the fields, directly from Google, is very helpful for further understanding what's available from within the sandbox.

Reminds me of this HN article from a month ago with lots of commentary on whether a database scheme is proprietary. https://news.ycombinator.com/item?id=43175628

Yeah there are some interesting similarities. However, the biggest difference is Google has the right to keep source proprietary, and companies like Unity are allowed to provide source code with a reference only license (still proprietary), but the US has FOIA to help push information into the open. Does a DB schema fall under FOIA scope? I think a better question is, can (or is) a db schema being used to conceal information? Is the law attempting to reinforce this barrier?

In other words, it should not be about the intent of the requester, but the intent of its owner; and in the case of that article, either by bias in narrative, or the fact that it rhymes with events of the past, there is some tomfoolery about.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#45
post #37
post #9

Funny enough while "We hacked Google's AI" is going to get the clicks, in reality they hacked the one part of Gemini that was NOT the LLM (a sandbox environment meant to run untrusted user-provided code). And "leaked its source code" is straight up click bait.

Ok, we put the sandbox in the title above. Thanks! (Submitted title was "We hacked Google's A.I Gemini and leaked its source code (at least some part)")

Instead of sandbox can you just make sure people know it was not a meaningful hack?

I mean I “hacked” this site too by those standards.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#46

That's the system I work on! Please feel free to ask any questions. All opinions are my own and do not represent those of my employer.

Have you contemplated running the python code in a virtual environment in the browser?

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#48
post #21
post #12

They hacked the sandbox, and leaked nothing. The article is entertaining though.

They leaked one file in the sandbox that contained lots of internal proto files. The security team reviewed everything in the sandbox and thought nothing in it is sensitive and gave the green light; apparently the review didn't catch this in the sandbox. I guess this is a failing of the security review process, and possibly also how the blaze build system worked so well that people forgot a step existed because it wa…

>that contained lots of internal proto files

So does Google Chrome.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#49

Awww, I was looking forward to seeing some of the leak ;) Oh well. Nice find and breakdown! Somewhat relatedly, it occurred to me recently just how important issues like prompt injection, etc are for LLMs. I've always brushed them off as unimportant to _me_ since I'm most interested in local LLMs. Who cares if a local LLM is weak to prompt injection or other shenanigans? It's my AI to do with as I please. If anything…

> reading the wrong thing from the wrong backalley of the internet, and suddenly they are taken over by a mind virus of sorts. What a wild future. This already happens to people on the internet.

Yeah, the way some people lose it from the internet reminds me of Snow Crash.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#50

That's the system I work on! Please feel free to ask any questions. All opinions are my own and do not represent those of my employer.

Can you get someone to fix the CSS crap on the website? When I have it open it uses 40-50% of my GPU (normally ~5% in most usage)...and when I try to scroll, the scrolling is jerky mess?
Post reply on HN