Live data from Hacker News

We hacked Gemini's Python sandbox and leaked its source code (at least some)

landh.tech

81–90 of 151 posts

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#81

That's the system I work on! Please feel free to ask any questions. All opinions are my own and do not represent those of my employer.

Does anyone at Google care that you're trying to replace Assistant with this in the next few months and it can't set a timer yet? (I mean it will tell you it's set a timer but it doesn't talk to the native clock app so nothing ever goes off if you navigate away from the window.)

I just want the assistant voice. I hate the Gemini ones.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#82

Earlier quoted context omitted.

Does anyone at Google care that you're trying to replace Assistant with this in the next few months and it can't set a timer yet? (I mean it will tell you it's set a timer but it doesn't talk to the native clock app so nothing ever goes off if you navigate away from the window.)

I keep reading people complaining about this but I can't understand why. Gemini can 100% set timers and with much more subtle hints than assistant ever could. It just works. I don't get why people say it can't. It can also play music or turn on my smart lamps, change their colors etc. I can't remember doing any special configuration for it to do that either. Pixel 9 pro

I certainly can't get it to reliably play music on my Pixel 8. Mostly it summons YT Music, only occasionally do I get my music player, and sometimes I merely get "I'm an LLM, I can't help you with that."

And you used to be able to say "Find my phone" and it would chime and max screen brightness until found. Tried that with Gemini once, and it went on with very detailed instructions on using Google or Apple's Find My Device website (depending on what type of phone I owned), maybe calling it from another device if it's not silenced, or perhaps accepting that my device was lost or stolen if none of the above worked. Did find it during that lengthy attempt at being helpful though.

Another fun example, weather. When Gemini's in control, "What's the weather like tonight?" gets a short ramble about how weather depends on climate, with some examples of what the weather might be like broadly in Canada, Japan, or the United States at night.

Unlike Assistant where you could learn to adapt to its unique phrasing preferences, you just flat out can never reliably predict what Gemini's going to do. In exchange for higher peak performance, the floor dropped out the bottom.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#83
post #72
post #55

Running the built-in "strings" command to extract a few file names from a binary is hardly hacking/cracking. Ironically, though, getting the source code of Gemini perhaps wouln't be valuable at all; but if you had found/obtained access to the corpus that the model was pre-trained with, that would have been kind of interesting (many folks have many questions about that...).

> but if you had found/obtained access to the corpus that the model was pre-trained with, that would have been kind of interesting Definitionally, that input gets compressed into the weights. Pretty sure there's a proof somewhere that shows LLM training is basically a one-way (lossy) compression, so there's no way to go back afaik?

Not the original, but a lossy facsimile that's Good Enough for almost anything. And as the short history of LLMs and other nets has shown us, they're often not even all that lossy.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#84
Their "LLM bugSWAT" events, held in vibrant locales like Las Vegas, are a testament to their commitment to proactive security red teaming.

I don't understand why security conferences are attracted to Vegas. In my opinion its a pretty gross place to conduct any conference.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#86

Their "LLM bugSWAT" events, held in vibrant locales like Las Vegas, are a testament to their commitment to proactive security red teaming. I don't understand why security conferences are attracted to Vegas. In my opinion its a pretty gross place to conduct any conference.

You answered your own question.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#87

That's the system I work on! Please feel free to ask any questions. All opinions are my own and do not represent those of my employer.

That's cool. I did something similar in the early days with Google Bard when data visualization was added, which I believe was when the ability to run code got introduced. One question I always had was what the user "grte" stands for... Btw. here the tricks I used back then to scrape the file system: https://embracethered.com/blog/posts/2024/exploring-google-b...

The "runtime" is a google internal distribution of libc + binutils that is used for linking binaries within the monolithic repo, "google3".

This decoupling of system libraries from the OS itself is necessary because it otherwise becomes unmanageable to ensure "google3 binaries" remain runnable on both workstations and production servers. Workstations and servers each have their own Linux distributions, and each also needs to change over time.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#88

Their "LLM bugSWAT" events, held in vibrant locales like Las Vegas, are a testament to their commitment to proactive security red teaming. I don't understand why security conferences are attracted to Vegas. In my opinion its a pretty gross place to conduct any conference.

relatively cheap event space and hotels. it's hard to find a city to host a large conference.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#89

Their "LLM bugSWAT" events, held in vibrant locales like Las Vegas, are a testament to their commitment to proactive security red teaming. I don't understand why security conferences are attracted to Vegas. In my opinion its a pretty gross place to conduct any conference.

Real, I feel the exact same way.

Re: We hacked Gemini's Python sandbox and leaked its source code (at least some)

#90

Their "LLM bugSWAT" events, held in vibrant locales like Las Vegas, are a testament to their commitment to proactive security red teaming. I don't understand why security conferences are attracted to Vegas. In my opinion its a pretty gross place to conduct any conference.

What don't you understand. Vegas is literally built for conferences.
Post reply on HN