Earlier quoted context omitted.
Remixes aren't novel.
Human cultures are remixes all the way down...
If you haven’t seen that “Everything is a Remix” documentary you should. It’s so good.
Are LLM merge rates not getting better?
151–160 of 175 posts
Re: Are LLM merge rates not getting better?
#152Earlier quoted context omitted.
When the dust settles, for example if LLM's were to stop improving today, we would come to learn their exact capabilities, what they can do reliably and what they can't. Once we know what they can do well and how to get them to do it well, and what they can't, you could say we "trust" them to do the first category well and just stop trying to get it to do the second category.
LLMs are random by nature, they might something done one time but miserably fail the next
I think we're getting to a point where LLM randomness is relevant to someone writing a white paper on LLMs, but not as relevant to consumers of them. Yes the technology uses randomness, but the quality of response somehow still seems very consistent and predictable in 2026.
Re: Are LLM merge rates not getting better?
#153Earlier quoted context omitted.
When the dust settles, for example if LLM's were to stop improving today, we would come to learn their exact capabilities, what they can do reliably and what they can't. Once we know what they can do well and how to get them to do it well, and what they can't, you could say we "trust" them to do the first category well and just stop trying to get it to do the second category.
LLMs are random by nature, they might something done one time but miserably fail the next
Yeah, and we will continue to learn to use them where the amount of random failure is acceptable or can be mitigated or reduced with additional tools.
Re: Are LLM merge rates not getting better?
#154As someone who builds with LLMs daily without being a developer, I notice quality differences more in practical output than benchmarks. Claude handles complex multi-step tasks better in my experience, but consistency is still the biggest challenge – same prompt can give very different results day to day.
Re: Are LLM merge rates not getting better?
#155Earlier quoted context omitted.
Yes, I think this is basically an instance of the "emergent abilities mirage." https://arxiv.org/abs/2304.15004 If you measure completion rate on a task where a single mistake can cause a failure, you won't see noticeable improvements on that metric until all potential sources of error are close to being eliminated, and then if they do get eliminated it causes a sudden large jump in performance. That's fine if you ju…
> until all potential sources of error are close to being eliminated This is what PSP/TSP did - one has to (continually) review its' own work to identify most frequent sources of (user facing) defects. > if you also want to predict future performance, you need to break it down into smaller components and track each of them individually. This is also one of tenets of PSP/TSP. If you have a task with estimate longer th…
I don’t know it’s fair to characterize the LLM community as being ignorant and rediscovering PSP/TCP. I in fact see that as programmers rediscovering survival analysis, and most LLM folks I know have learned these perspectives from that lens. Could be wrong about PSP, maybe things are more nuanced? But what is there that isn’t already covered by foundational statistics?
Re: Are LLM merge rates not getting better?
#156Earlier quoted context omitted.
When doubling the number of employees can triple your revenue, you do it. Keeping a website running with high uptime is not the goal. Maximizing revenue and profit is. The extra people aren't waste, they're what drive the incremental imperceptible changes that make these companies profitable.
This seems like a just-so story.
You can see it happen in reverse with X/Twitter.
Did reducing waste affect the user experience or uptime of Twitter? Not really.
But advertising revenues plummeted, because those extra employees were mostly not about the user experience or keeping the website up, they were about servicing the advertisers that brought the company revenue.
Re: Are LLM merge rates not getting better?
#157[flagged]
Re: Are LLM merge rates not getting better?
#158[flagged]
Re: Are LLM merge rates not getting better?
#159Earlier quoted context omitted.
And how much revenue did that company bring in compared to something like Meta? Maybe there's a correlation there?
I think the person you're replying to is perfectly aware of the correlation, considering it was a primary feature of their comment.
Not really? The main point of their comment is that companies could be much smaller based on their experience at a much smaller company.
I'm implying that big companies couldn't make as much money as they do without all the employees they have.
Re: Are LLM merge rates not getting better?
#160Earlier quoted context omitted.
This seems like a just-so story.
You can see it happen in reverse with X/Twitter. Did reducing waste affect the user experience or uptime of Twitter? Not really. But advertising revenues plummeted, because those extra employees were mostly not about the user experience or keeping the website up, they were about servicing the advertisers that brought the company revenue.
I thought advertising revenues plummeted mostly for content/optics/PR reasons, not ad-buyer-facing feature reasons.