Live data from Hacker News

All the bugs they found

andreapivetta.com

31–39 of 39 posts

Re: All the bugs they found

#31
> It is also very extensively tested against the official WASM testsuite.

I was hoping that near the end the author would have tried to contributed any new tests to the official testsuite to help catch these same errors elsewhere.

For the first one, Zero Is Not Null maybe there is a missing test in in the call_indirect test?

https://github.com/WebAssembly/testsuite/blob/main/call_indi...

Re: All the bugs they found

#32

> Trying to work around Anthropic blocking security-related prompts does get pretty tiring though. Didn't know this is a thing... interesting for a company that's marketing their Mythos so hard not allowing security prompts. I am also curious how the cheaper Chinese models do, I have an Opencode Go plan, so I'll let 'em rip over the weekend, hopefully I get to see a few bugs!

[deleted]

Re: All the bugs they found

#33
post #24
post #15

He describes himself as "Software engineer. Writing code prompts at Google". So throwing his own, apparently poorly written, creation under the bus will get him applause and promotions by the AI lunatics. It is a currently popular strategy among AI boosters.

Honestly your poor assessment is in all ways poorer than his poorly written creation. Did you even have 2-3 minutes to click around his website and gave a read to his other article "Something that I used to love"? Your type of disparaging comments give the impression of HN to others what HN totally isn't. I don't know if you wrote your comment esp. for engagement baiting.

Coding as we knew it ten years ago isn’t dead. I have had a great time in the last quarter doing a little voluntary open source programming. I improve or make something and the upstream accepts it. I have fun and it isn’t just an idle hobby that is useless to anyone but me.

So I don’t buy that they are mourning it. Give me a freaking break. Mourn your professional programming, maybe? But if this is your “passion”? Freaking keep doing it voluntarily. Is playing in a rock band dead?

Or no? Too busy being a “code prompter” at Google? Sellout.

Re: All the bugs they found

#34

The cool thing about LLMs is that once a capability is "good enough" you can always "chain" them together for better overall results. On the client side this means "write an API that does x y z" -> "analyse this API for security concerns" -> "PoC for each finding from this report" -> "fix this code according to these verified claims". On the "server side" (i.e. training) you can use the current gen models to improve…

This sounds pretty much like what the AI profiteers want everyone to at least believe: that if it isn't working, all you have to do is burn 10x/100x tokens (that they charge for and jack up the fees for steeply over time) for that extra few percent of improvement.

If the snake oil isn't working, it's just because you haven't drank enough of it yet

Re: All the bugs they found

#35
post #24

Earlier quoted context omitted.

Honestly your poor assessment is in all ways poorer than his poorly written creation. Did you even have 2-3 minutes to click around his website and gave a read to his other article "Something that I used to love"? Your type of disparaging comments give the impression of HN to others what HN totally isn't. I don't know if you wrote your comment esp. for engagement baiting.

Coding as we knew it ten years ago isn’t dead. I have had a great time in the last quarter doing a little voluntary open source programming. I improve or make something and the upstream accepts it. I have fun and it isn’t just an idle hobby that is useless to anyone but me. So I don’t buy that they are mourning it. Give me a freaking break. Mourn your professional programming, maybe? But if this is your “passion”? Fr…

I'm not attached to coding either. But if someone else is, and feels the way that is alien to me, I am not gonna be disregarding their feelings either.

Passion is a feeling, and feeling changes.

Re: All the bugs they found

#36

The cool thing about LLMs is that once a capability is "good enough" you can always "chain" them together for better overall results. On the client side this means "write an API that does x y z" -> "analyse this API for security concerns" -> "PoC for each finding from this report" -> "fix this code according to these verified claims". On the "server side" (i.e. training) you can use the current gen models to improve…

This sounds pretty much like what the AI profiteers want everyone to at least believe : that if it isn't working, all you have to do is burn 10x/100x tokens (that they charge for and jack up the fees for steeply over time) for that extra few percent of improvement. If the snake oil isn't working, it's just because you haven't drank enough of it yet

All LMM discussions—no, all code discussions here—have these trivial-looking comments about how you can agent against agent, or agent chain with agent, or agent compose with agent, either to supercharge productivity or solve some problem.

That wouldn’t hold for boring old tech; too inert, too passive. But it does for agents because they gestures rainbow have autonomy.

Re: All the bugs they found

#37

Earlier quoted context omitted.

This sounds pretty much like what the AI profiteers want everyone to at least believe : that if it isn't working, all you have to do is burn 10x/100x tokens (that they charge for and jack up the fees for steeply over time) for that extra few percent of improvement. If the snake oil isn't working, it's just because you haven't drank enough of it yet

All LMM discussions—no, all code discussions here—have these trivial-looking comments about how you can agent against agent, or agent chain with agent, or agent compose with agent, either to supercharge productivity or solve some problem. That wouldn’t hold for boring old tech; too inert, too passive. But it does for agents because they gestures rainbow have autonomy.

> That wouldn’t hold for boring old tech

Boring old tech is not doing code reviews?

Re: All the bugs they found

#38

> It is also very extensively tested against the official WASM testsuite. I was hoping that near the end the author would have tried to contributed any new tests to the official testsuite to help catch these same errors elsewhere. For the first one, Zero Is Not Null maybe there is a missing test in in the call_indirect test? https://github.com/WebAssembly/testsuite/blob/main/call_indi...

My takeaway from the article is to stay away from wasm, because the official testsuite is dogshit that doesn't even make sure that you popped the same number of parameters that were pushed.

Re: All the bugs they found

#39
post #37

Earlier quoted context omitted.

All LMM discussions—no, all code discussions here—have these trivial-looking comments about how you can agent against agent, or agent chain with agent, or agent compose with agent, either to supercharge productivity or solve some problem. That wouldn’t hold for boring old tech; too inert, too passive. But it does for agents because they gestures rainbow have autonomy.

> That wouldn’t hold for boring old tech Boring old tech is not doing code reviews?

No.
Post reply on HN