It’s interesting how AI may both raise and lower the quality of software. It’s very easy to send an AI agent on an open-ended bug hunt, and if it wastes a bunch of time and effort and finds nothing, no big deal. Time is much more important for a human developer with a salary.
In my experience, there are two ways to use AI: speed or quality. Speed is where you give the AI a task to do and you review it; quality is where you write the code yourself and you get AI to review it. Both are valid for different situations.
We found a division by zero bug in FFmpeg with a vibecoded fuzzer
111–120 of 274 posts
Re: We found a division by zero bug in FFmpeg with a vibecoded fuzzer
#112Next week, I'll apply for the cyber and I suspect I'll find something similar.
Right now, it's just annoying and thanks the OpenAI cyber was much easier to get access to.
Re: We found a division by zero bug in FFmpeg with a vibecoded fuzzer
#113A patch for this was submitted in April: https://lists.ffmpeg.org/archives/list/ffmpeg-devel@ffmpeg.o... Edit: And there was discussion about this back in 2024 as well
Oddly enough I can’t access that site, it just heats up my phone solving hashes. Gave up after about a minute and anubis had only made it less than halfway through. I doubt the real bots have any trouble bypassing it.
Re: We found a division by zero bug in FFmpeg with a vibecoded fuzzer
#114It’s interesting how AI may both raise and lower the quality of software. It’s very easy to send an AI agent on an open-ended bug hunt, and if it wastes a bunch of time and effort and finds nothing, no big deal. Time is much more important for a human developer with a salary.
> It’s very easy to send an AI agent on an open-ended bug hunt, and if it wastes a bunch of time and effort and finds nothing, no big deal. No big deal? It’s not like it’s free… tokens cost money.
Re: We found a division by zero bug in FFmpeg with a vibecoded fuzzer
#115A patch for this was submitted in April: https://lists.ffmpeg.org/archives/list/ffmpeg-devel@ffmpeg.o... Edit: And there was discussion about this back in 2024 as well
Maybe now that ffmpeg is using Forgejo, the ball won't be dropped like this as often. Or there'll just be a five-digit number of open pull requests instead.
Re: We found a division by zero bug in FFmpeg with a vibecoded fuzzer
#116Am I missing something? Who cares? This isn't a security issue, it's just an unexploitable crash on bad data.
Re: We found a division by zero bug in FFmpeg with a vibecoded fuzzer
#117Earlier quoted context omitted.
OOP has those too, and they're very annoying.
In Haskell they are a little less annoying. It is just easier to reason about (including proving) pure functions.
Re: We found a division by zero bug in FFmpeg with a vibecoded fuzzer
#118A patch for this was submitted in April: https://lists.ffmpeg.org/archives/list/ffmpeg-devel@ffmpeg.o... Edit: And there was discussion about this back in 2024 as well
Oddly enough I can’t access that site, it just heats up my phone solving hashes. Gave up after about a minute and anubis had only made it less than halfway through. I doubt the real bots have any trouble bypassing it.
Re: We found a division by zero bug in FFmpeg with a vibecoded fuzzer
#119Generating an incorrect input file seems to be the easiest task of all for any fuzzer. Generating correct input to get deep into the call stack and then finding something is the hard part.
Re: We found a division by zero bug in FFmpeg with a vibecoded fuzzer
#120Whatever about the specifics of this bug and whether its a useful vector, this is not surprising even in the slightest? My current opinion on LLMs is that they are superhuman in that they lack fatigue, they have close to full knowledge across all subjects which are known to humans at least publicly, and the fact that you can vibe code a harness to look for bugs in a famously complicated C codebase is intern level stu…
Not that it doesn’t have issues, but I’m not sure why you’d choose tmux of all things. It runs as a user and has no privileges to escalate. It was written for and is part of OpenBSD and follows their security hardening practices. (There actually was one privilege escalation bug in tmux, but it actually seems like a distro packaging error. The distro setgid the executable so the resulting shell inherited the additiona…
persisted malicious code running in your tmux process that you don't know about is probably not where you want to be, for obvious reasons.