341–350 of 534 posts
They have a silent nerfing system for their models and say so openly. The obvious question is how much it is being used already. Competitor companies being nerfed? Non Americans getting worse code? Punishing and rewarding users to maximize engagement, like online games do affecting victories through matchmaking?
> Non Americans getting worse code? This is a scary thought: tailoring quality based on user profile.
Earlier quoted context omitted.
Yeah, I think a lot of the "slow down" rumblings we're hearing from OpenAI and Anthropic are really overtures toward regulatory capture; basically, "now that we're in the lead, we need to lock this shit down so nobody else can catch up."
but.. OpenAI and Anthropic can't stop China and EU, can they? Depends on your world view, they might or might not come up with something better. but I guess we can agree nothing with stop them from _trying_?
China will certainly compete though.
Earlier quoted context omitted.
> like they've repeatedly pursued). source?
Many, many, many public policy positions; for a clear-cut example, they eventually supported SB 1047 [1] which would have banned open-sourcing any model trained with over 10^26 FLOPS (i.e. what Anthropic reportedly used to train Mythos). Their "Responsible Scaling Policy" [2] — a set of policy proposals that includes recommendations for government regulation — specifically calls out requiring "third-party controls" o…
Earlier quoted context omitted.
Building a virus, on your own network, probably isn't a crime. We already have all kinds of laws to catch and punish people when they cause harm.
>Building a virus, on your own network, probably isn't a crime. There are plenty of legal uses for a fully automatic AR-15 too, yet we still ban it.
Earlier quoted context omitted.
China isnt "all open source" they still keep their top models out of the public view. Its easy to "open source" models when they're so far behind very few will pay for them. Open source in quotes because they are not open source and not even close to open source.
Can't we stop using "open-source" when it is just freeware?
The moat looks deep today but it's going to become more shallow every year. Training a new model from scratch takes serious resources. Post-training/fine-tuning an existing model, dramatically less. The knowledge for the process was esoteric two years ago, now you can ask a current model (one of several) to walk you through it, while building the tools to do it as you go. Several of my recent weekend projects have be…
Unfortunately this has been happening almost forever. You can spend 10s of thousands of $$ design, prototyping, building & marketing anything, whether a physical product or software & some company where the wages are lower are going to come along, build it cheaper (not necessarily better quality either) and ship it to the world. As a result, the other countries import more stuff "because it is cheaper" and eventually…
Yeah, it's called competition. It existed even in the socialist countries (where is was called "socialist competition/emulation").
The moat looks deep today but it's going to become more shallow every year. Training a new model from scratch takes serious resources. Post-training/fine-tuning an existing model, dramatically less. The knowledge for the process was esoteric two years ago, now you can ask a current model (one of several) to walk you through it, while building the tools to do it as you go. Several of my recent weekend projects have be…
Earlier quoted context omitted.
You can get really good results with Chinese models. You're putting Opus and GPT on too high of a pedestal.
I use Chinese models (for simple personal projects), they just don't compare to GPT or Opus for any serious work. I do not know why every Chinese model fan thinks that people that aren't impressed by them simply don't use them.
It's quite obvious that when you dont try to do something particularly complex there will be literally no difference between GPT, Claude, Gemini and Deepseek.
Fot many things I'm doing in gamedev Gemini 2.5 Pro was already good enough even though it released more than year ago.
Once you pass certain threshold it's just enough.
Earlier quoted context omitted.
What moat? There are multiple companies providing pareto-optimal frontier models, and it takes O(10) people to build one of these things. The rest is capital intensive, and the price will approach the cost of production over time. Thinking this is a profitable endeavor is equivalent to claiming coal plants have good margins because boilers are expensive.
I think we agree? What moat? You answered yourself: "capital intensive" But, history says the supercomputer of today will fit in your pocket in a few years. They've bought up all the RAM and GPUs, which pushes the capital requirements upward for everyone else. But, they can't corner the market forever, there are too many competing interests. AMD and Intel keep making new GPUs and APUs. The memory makers can't just se…
That was Moore's law saying that. And it seems Moore's law slowed down quite a bit for now.