I think one thing that people are sleeping on is passing a ton of secrets to OpenAI and Anthropic or your OpenRouter by having a .env or secrets on disk in your repo, but not checked in Your LLM will happily read the entire file, ship it off to be training data for future versions of ChatGPT, and not raise any flags, because let's be fair it was on ok thing to check if all the env vars were set, or it you had set up…
it seems crazy to "trust" an LLM with any secrets. Anyone running one as their normal user account with access to all files is playing with fire...
CISA Admin Leaked AWS GovCloud Keys on GitHub
41–50 of 205 posts
Re: CISA Admin Leaked AWS GovCloud Keys on GitHub
#42> Valadon said he reached out because the owner in this case wasn’t responding and the information exposed was highly sensitive. obviously leaking the credentials itself is crazy, given that its (a contractor to) CISA, but to not respond when notified? crazy crazy. but wait! it gets worse somehow " “AWS-Workspace-Firefox-Passwords.csv” — listed plaintext usernames and passwords for dozens of internal CISA systems " w…
It is a bad plan that has and will continue to harm people, but it is intentional.
Re: CISA Admin Leaked AWS GovCloud Keys on GitHub
#43Earlier quoted context omitted.
Sure but like, no AI was needed here. Regular human stupidity is still pretty potent.
This is the thing that gets me about all the AI security pieces I read. Yes, AI can enable new attack vectors (prompt injection can be repeated N times when a human subject to the same messaging would bail). But what AI really does is shine a spotlight on all the flaws folks like OWASP have been talking about for decades. Secret rotation and short lived credentials don't require AI to implement, nor does their lack r…
And in this particular case of CISA secrets, they are definitely stored inside of LLMs for future retrieval, even if no bad actors ever directly downloaded this obscure GitHub repo.
Re: CISA Admin Leaked AWS GovCloud Keys on GitHub
#44Earlier quoted context omitted.
Sure, it could be incompetence. It could also be an intentional strategy to tie up CISA/DHS resources, poison or obstruct CISA/DHS investigations/operations, open up systems to sunlight and journalism, or cause general chaos. The not-responding-when-notified part makes me think it's not just incompetence.
>The not-responding-when-notified part makes me think it's not just incompetence. Strong disagree. The person in question probably thought it was a private repo on Github and had a massive deer in headlights reaction when they got contacted. Whoever this is, lost their job, possibly security clearance and more. This was 100% life altering "mistake"/gross incompetence decision they made.
For some people, yeah, this could be a career killer. For some other people, it might just precipitate a flight back to Moscow or Beijing or something.
Re: CISA Admin Leaked AWS GovCloud Keys on GitHub
#45Earlier quoted context omitted.
Do you have any examples ? It's the first time I hear about replacing API keys
OAuth with refresh tokens. IAM roles/workload identity. Even time-limited or signed JWT, though has a separate issues. Maybe you'll say 'those are both just text values passed like an apikey' though api keys don't frequently rotate/time limited, which is an important security feature.
Re: CISA Admin Leaked AWS GovCloud Keys on GitHub
#46Re: CISA Admin Leaked AWS GovCloud Keys on GitHub
#47Earlier quoted context omitted.
OAuth with refresh tokens. IAM roles/workload identity. Even time-limited or signed JWT, though has a separate issues. Maybe you'll say 'those are both just text values passed like an apikey' though api keys don't frequently rotate/time limited, which is an important security feature.
At that point you've just reinvented Kerberos tickets really...
Re: CISA Admin Leaked AWS GovCloud Keys on GitHub
#48I think one thing that people are sleeping on is passing a ton of secrets to OpenAI and Anthropic or your OpenRouter by having a .env or secrets on disk in your repo, but not checked in Your LLM will happily read the entire file, ship it off to be training data for future versions of ChatGPT, and not raise any flags, because let's be fair it was on ok thing to check if all the env vars were set, or it you had set up…
probably but a ton of services have popped up in the last 6 months specifically to help mitigate that localhost reading env from the cloud and other solutions to me it suggested that I’m already late on that idea, but I can understand how that puts me deeper in a bubble than others
Re: CISA Admin Leaked AWS GovCloud Keys on GitHub
#49> Valadon said he reached out because the owner in this case wasn’t responding and the information exposed was highly sensitive. obviously leaking the credentials itself is crazy, given that its (a contractor to) CISA, but to not respond when notified? crazy crazy. but wait! it gets worse somehow " “AWS-Workspace-Firefox-Passwords.csv” — listed plaintext usernames and passwords for dozens of internal CISA systems " w…