Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

github.com

Post reply on HN
Print view View original

361–370 of 569 posts

Re: Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

#361

Post by zdragnar »

mikert89 wrote: post #359
detente18 wrote: post #99

LiteLLM maintainer here, this is still an evolving situation, but here's what we know so far: 1. Looks like this originated from the trivvy used in our ci/cd - https://github.com/search?q=repo%3ABerriAI%2Flitellm%20trivy... https://ramimac.me/trivy-teampcp/#phase-09 2. If you're on the proxy docker, you were not impacted. We pin our versions in the requirements.txt 3. The package is in quarantine on pypi - this block…

Similar to delve, this guy has almost no work experience. You have to wonder if YC and the cult of extremely young founders is causing instability issues in society at large?

Welcome to the new era, where programming is neither a skill nor a trade, but a task to be automated away by anyone with a paid subscription.

Re: Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

#362

Post by [deleted] »

westoque wrote: post #288

my takeaway from this is that it should now be MANDATORY to have an LLM do a scan on the entire codebase prior to release or artifact creation. do NOT use third party plugins for this. it's so easy to create your own github action to digest the whole codebase and inspect third party code. it costs tokens yes but it's also cached and should be negligible spend for the security it brings.

[deleted]

Re: Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

#363

Post by dweinstein »

https://github.com/dweinstein/canary

I made this tool for macos systems that helps detect when a package accesses something it shouldn't. it's a tiny go binary (less than 2k LOC) with no dependencies that will mount a webdav filesystem (no root) or NFS (root required) with fake secrets and send you a notification when anything accesses it. Very stupid simple. I've always really liked the canary/honeypot approach and this at least may give some folks a chance to detect (similar to like LittleSnitch) when something strange is going on!

Next time the attack may not have an obvious performance issue!

Re: Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

#364

Post by mikert89 »

zdragnar wrote: post #361
mikert89 wrote: post #359

Earlier quoted context omitted.

Similar to delve, this guy has almost no work experience. You have to wonder if YC and the cult of extremely young founders is causing instability issues in society at large?

Welcome to the new era, where programming is neither a skill nor a trade, but a task to be automated away by anyone with a paid subscription.

alot of software isnt that important so its fine, but some actually is important. especially with a branding name slapped on it that people will trust

Re: Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

#365

Post by pojzon »

detente18 wrote: post #99

LiteLLM maintainer here, this is still an evolving situation, but here's what we know so far: 1. Looks like this originated from the trivvy used in our ci/cd - https://github.com/search?q=repo%3ABerriAI%2Flitellm%20trivy... https://ramimac.me/trivy-teampcp/#phase-09 2. If you're on the proxy docker, you were not impacted. We pin our versions in the requirements.txt 3. The package is in quarantine on pypi - this block…

This is just one of many projects that was a victim of Trivy hack. There are millions of those projects and this issue will be exploited in next months if not years.

Re: Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

#366

Post by zahlman »

ajoy wrote: post #347

Reminded me of a similar story at openSSH, wonderfully documented in a "Veritasium" episode , which was just fascinating to watch/listen. https://www.youtube.com/watch?v=aoag03mSuXQ

The xz compromise was not "at openSSH", and worked very differently.

Re: Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

#367

Post by dewey »

Imustaskforhelp wrote: post #146
dec0dedab0de wrote: post #142

Earlier quoted context omitted.

Over the last ~15 years I have been shocked by the amount of spam on social networks that could have been caught with a Bayesian filter. Or in this case, a fairly simple regex.

Well, large companies/corporations don't care about Spam because they actually benefit from spam in a way as it boosts their engagement ratio It just doesn't have to be spammed enough that advertisers leave the platform and I think that they sort of succeed in doing so. Think about it, if Facebook shows you AI slop ragebait or any rage-inducing comment from multiple bots designed to farm attention/for malicious purpo…

> Well, large companies/corporations don't care about Spam because they actually benefit from spam in a way as it boosts their engagement ratio

I'm not sure that's actually true. It's just that at scale this is still a hard problem that you don't "just" fix by running a simple filter as there will be real people / paying customers getting caught up in the filter and then complain.

Having "high engagement" doesn't really help you if you are optimizing for advertising revenue, bots don't buy things so if your system is clogged up by fake traffic and engagement and ads don't reach the right target group that's just a waste.

Re: Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

#369

Post by mastermage »

2OEH8eoCRo0 wrote: post #328
MetaWhirledPeas wrote: post #323

Earlier quoted context omitted.

> real-world identity This bit sounds like dystopian governance, antithetical to most open source philosophies.

Would you drive on bridges or ride in elevators "inspected" by anons? Why are our standards for digital infrastructure and software "engineering" so low? I don't blame the anons but the people blindly pulling in anon dependencies. The anons don't owe us anything.

Do you know who inspected a bridge before you drive over it?
Post reply on HN