Live data from Hacker News

Alex Karp Is Saying What Every Angry CEO Is Thinking About AI

wsj.com

1–10 of 20 posts

Re: Alex Karp Is Saying What Every Angry CEO Is Thinking About AI

#4
Is there active research in improving the density of models i.e. higher performance at lower parameter counts? Is this something that's even theoretically possible to do with the architecture?

I feel like I can have a much better model for how I can expect the cost of LLMs to change over the next few years. "Build more datacenters" reeks of "just one more lane bro" and because of Jevons paradox I'm skeptical it will bring costs down. Could ASICs and custom processors (ala Groq) move the needle here at all if the model density can't be improved?

Re: Alex Karp Is Saying What Every Angry CEO Is Thinking About AI

#7
A few things:

0) big companies already are very comfortable using contracts to trust other people with their data. Maybe if they're inflexible on the 30-day requirement for fable some orgs will opt out but by-and-large it's already happening and it's not a blocker.

1) Cost will be a blocker. The level of token spend is untenable and the pareto curve is flattening. Most orgs are going to default to either using a distilled model from China or a distilled model from the model companies (e.g, Sonnet 5). It'd behoove Claude/OpenAI to offer a model router before another vendor wins that area.

2) Karp is selling his book. No one knows or cares what an 'ontology' is. From what I can tell, company's product is a tool that helps governments bomb people.

Re: Alex Karp Is Saying What Every Angry CEO Is Thinking About AI

#8
post #4

Is there active research in improving the density of models i.e. higher performance at lower parameter counts? Is this something that's even theoretically possible to do with the architecture? I feel like I can have a much better model for how I can expect the cost of LLMs to change over the next few years. "Build more datacenters" reeks of "just one more lane bro" and because of Jevons paradox I'm skeptical it will…

[deleted]

Re: Alex Karp Is Saying What Every Angry CEO Is Thinking About AI

#9
The problem is nobody can build a real business on models they don't control. Cursor focused on making a great AI coding experience but they didn't control Claude and got destroyed once Anthropic started explicitly training Claude to be better at using Claude code. And then there's the cost front, a good model is soon going to be served at 90+% margin, meaning the model makers have a ton of flexibility in how they choose to subsidize their first party products. Cursor had to eat the full API price of Claude while Anthropic could sell Claude Code at a massive subsidy. If you're an AI product then the model product synthesis is your product, and you don't get any of that from a proprietary closed model.

Re: Alex Karp Is Saying What Every Angry CEO Is Thinking About AI

#10
post #2

All I can say is, ‘fuck these people’. No one is actually this stupid.

You’re right. These are not stupid people. They are likely very out of touch, but they are not stupid. They know exactly what they are doing and they are good at it.

Often times, a stupid take is useful to manipulate people or change the discourse. We argue about how dumb the take is and get distracted about what really matters.

It’s the same strategy that causes working people to fight each other and ignore the real enemy.

Post reply on HN