31–40 of 298 posts
Earlier quoted context omitted.
It is not that you get downvoted because they don’t understand you, it is because you sell your opinion as fact, like an apostle. For example what does it mean that software engineering is solved?
> it is because you sell your opinion as fact. The guy's making a prediction. Classifying it as some kind of religious zealotry isn't fair to his point or him.
Maybe this one can stop writing a fucking essay in code comments. I'm now no longer surprised just how consistently all the gemini models overcomplicate coding challenges or just plain get them wrong. Claude is just consistently spot on. A few salient comments for tricky code instead of incessantly telling me what it's changed and what I might want to do, incorrect assumptions when it has the code or is something we'…
You can try asking it to not do that, but I would bet it would slightly degrade code quality.
Calling it now - RL finally "just works" for any domain where answers are easily verifiable. Verifiability was always a prerequisite, but the difference from prior generations (not just AlphaGo, but any nontrivial RL process prior to roughly mid-2024) is that the reasoning traces and/or intermediate steps can be open-ended with potentially infinite branching, no clear notion of "steps" or nodes and edges in the game…
Maybe this one can stop writing a fucking essay in code comments. I'm now no longer surprised just how consistently all the gemini models overcomplicate coding challenges or just plain get them wrong. Claude is just consistently spot on. A few salient comments for tricky code instead of incessantly telling me what it's changed and what I might want to do, incorrect assumptions when it has the code or is something we'…
> AlphaEvolve achieved up to a 32.5% speedup for the FlashAttention kernel implementation in Transformer-based AI models > In roughly 75% of cases, it rediscovered state-of-the-art solutions, to the best of our knowledge. > And in 20% of cases, AlphaEvolve improved the previously best known solutions These sound like incredible results. I'd be curious what kind of improvements were made / what the improvements were.…
Remember that GPUs have cache hierarchies and matching block sizes to optimally hit those caches is a big win that you often don't get by default, just because the number of important kernels times important GPUs times effort to properly tune one is greater than what people are willing to do for others for free in open source. Not to mention kernel fusion and API boundaries that socially force suboptimal choices for…
Software engineering will be completely solved. Even systems like v0 are astounding in their ability to generate code, and are very primitive to whats coming. I get downvoted on HN for this opinion, but its truly going to happen. Any system that can produce code, test the code, and iterate if needed will eventually outperform humans. Add in the reinforcement learning, where they can run the code, and train the model…
Some of these questions change slightly, since we might end up with "unlimited resources" (i.e. instead of having e.g. 5 engineers on a team who can only get X done per sprint, we effectively have near-limitless compute to use instead) so maybe the answer is "build everything on the wish-list in 1 day" to the "what should we prioritize" type questions?
Interesting times.
My gut is that software engineers will end up as glorified test engineers, coming up with test cases (even if not actually writing the code) and asking the AI to write code until it passes.
For the people awaiting the singularity, lines like this written almost straight from science fiction: > By suggesting modifications in the standard language of chip designers, AlphaEvolve promotes a collaborative approach between AI and hardware engineers to accelerate the design of future specialized chips."
Would love for AI to kill the leetcode interview
Would love for AI to kill the leetcode interview
> AlphaEvolve achieved up to a 32.5% speedup for the FlashAttention kernel implementation in Transformer-based AI models > In roughly 75% of cases, it rediscovered state-of-the-art solutions, to the best of our knowledge. > And in 20% of cases, AlphaEvolve improved the previously best known solutions These sound like incredible results. I'd be curious what kind of improvements were made / what the improvements were.…