Live data from Hacker News

Microsoft and OpenAI end their exclusive and revenue-sharing deal

bloomberg.com

491–500 of 915 posts

Re: Microsoft and OpenAI end their exclusive and revenue-sharing deal

#491
post #451

Earlier quoted context omitted.

PS: Just to be clear - even the most expensive humans are unreliable, would make stupid mistakes, and their output MUST be reviewed carefully, so you’re not any different either. You’re just a random next-thought generator based on neuron firing distributions with no real thought process, trained on a few billion years of evolution like all other humans.

Humans can be held accountable. States have not yet shown the will to hold anyone accountable for LLM failures.

They are tools. You hold the human using it accountable. If that means it's the executive who signed the PO, so be it.

Until LLM's I'd never in my life heard someone suggest we lock up the compiler when it goofs up and kills someone, but now because the compiler speaks English we suddenly want to let people use it as a get out of jail free card when they use it to harm others.

Re: Microsoft and OpenAI end their exclusive and revenue-sharing deal

#492

Earlier quoted context omitted.

Humans can be held accountable. States have not yet shown the will to hold anyone accountable for LLM failures.

You're free to hold an LLM accountable in the exact same way: fire it if you don't like its work.

Giving something that has no internal concept of time (or identity for that matter) a prison sentence of n years seems kinda ineffectual.

Re: Microsoft and OpenAI end their exclusive and revenue-sharing deal

#493
post #467
post #451

Earlier quoted context omitted.

PS: Just to be clear - even the most expensive humans are unreliable, would make stupid mistakes, and their output MUST be reviewed carefully, so you’re not any different either. You’re just a random next-thought generator based on neuron firing distributions with no real thought process, trained on a few billion years of evolution like all other humans.

Looks like you either have not worked with any human or with an LLM otherwise arriving at such a conclusion is damn impossible. The humans I did work with were very very bright. No software developer in my career ever needed more than a paragraph of JIRA ticket for the problem statement and they figured out domains that were not even theirs to being with without making any mistakes and rather not only identifying edg…

I think you are very fortunate. I have worked with plenty of software developers like that, in fact, the overwhelming majority of them have been like that.

Re: Microsoft and OpenAI end their exclusive and revenue-sharing deal

#494

Opinions are my own. I think the biggest winner of this might be Google. Virtually all the frontier AI labs use TPU. The only one that doesn't use TPU is OpenAI due to the exclusive deal with Microsoft. Given the newly launched Gen 8 TPU this month, it's likely OpenAI will contemplate using TPU too.

In the recent Dwarkesh Podcast episode Jensen Huang (Nvidia) said that virtually nobody but Anthropic uses TPUs. How does that add up?

You're asking why a businessman would downplay the use of a competing product line?

Re: Microsoft and OpenAI end their exclusive and revenue-sharing deal

#495
post #467
post #451

Earlier quoted context omitted.

PS: Just to be clear - even the most expensive humans are unreliable, would make stupid mistakes, and their output MUST be reviewed carefully, so you’re not any different either. You’re just a random next-thought generator based on neuron firing distributions with no real thought process, trained on a few billion years of evolution like all other humans.

Looks like you either have not worked with any human or with an LLM otherwise arriving at such a conclusion is damn impossible. The humans I did work with were very very bright. No software developer in my career ever needed more than a paragraph of JIRA ticket for the problem statement and they figured out domains that were not even theirs to being with without making any mistakes and rather not only identifying edg…

Uhh what, I speak to llms in broken english with minimal details and they figure it out better than I would have if you told me the same garbage

Re: Microsoft and OpenAI end their exclusive and revenue-sharing deal

#496
post #381

Earlier quoted context omitted.

The GPU is monstrously good. Depending on the workload, the M1 series GPU using 120W could beat an RTX 3090 using 420W. Same with the CPU. Linux compiled faster on an M1 than on the fastest Intel i9 at the time, again using only 25% of the power budget. And the M-series has only gotten better. It is kind of sad Apple neglects helping developers optimize games for the M-series because iDevices and MacBooks could be th…

The GPUs are bottom-barrel for compute-focused industries. It is mobile-grade hardware that arguably can't even scale to prior Mac Pro workloads. > The GPU is monstrously good. Depending on the workload, the M1 series GPU using 120W could beat an RTX 3090 using 420W. You're just listing the TDP max of both chips. If you limit a 3090 to 120W then it would still run laps around an M1 Max in several workloads despite be…

> The GPUs are bottom-barrel for compute-focused industries. It is mobile-grade hardware that arguably can't even scale to prior Mac Pro workloads.

Surprised Apple didn't create a TPU-like architecture. Another misstep from John Gianneadrea.

Re: Microsoft and OpenAI end their exclusive and revenue-sharing deal

#497
post #445

Earlier quoted context omitted.

In the recent Dwarkesh Podcast episode Jensen Huang (Nvidia) said that virtually nobody but Anthropic uses TPUs. How does that add up?

> How does that add up? He's been saying whatever is good for Nvidia for years now without any regard for truth or reason. He's one of the least trustworthy voices in the space.

Jensen hallucinates more than any llm, he just speaks without thinking all that much about what he says and he generalizes a lot. Trying to hold him accountable to imprecisions and gross simplifications is just going to frustrate whoever tries without changing one bit of his behavior.

Re: Microsoft and OpenAI end their exclusive and revenue-sharing deal

#498
post #447

Earlier quoted context omitted.

You state how you think and plan and have thoughts on how to do things etc. and i assumed you mention your way of thinking because you assume a LLM is not doing any of it. I showed than counter examples.

I don't think you showed counter examples? Or can you link me to a paper which describes a language model thinking without predicting tokens?

If you ask a model to multiply 322423324 by 8675309232 without using tools, it's interesting to think about how it does it. Where are the intermediate results being maintained?

"In context" is the obvious answer... but if you view the chain of thought from a reasoning model, it may have little or nothing to do with arriving at the correct answer. It may even be complete nonsense. The model is working with tokens in context, but internally the transformer is maintaining some state with those tokens that seems to be independent of the superficial meanings of the tokens. That is profoundly weird, and to me, it makes it difficult to draw a line in the sand between what LLMs can do and what human brains can do.

Re: Microsoft and OpenAI end their exclusive and revenue-sharing deal

#499
post #447

Earlier quoted context omitted.

I don't think you showed counter examples? Or can you link me to a paper which describes a language model thinking without predicting tokens?

My second sentence references all these papers: "COCONUT, PCCoT, PLaT and co are directly linked to 'thinking in latent space'. yann lecun is working on this too, we have JEPA now."

And it does this thinking without producing tokens?

Re: Microsoft and OpenAI end their exclusive and revenue-sharing deal

#500

Earlier quoted context omitted.

Who is the other frontier lab other than Anthropic, OpenAI, and Google? I thought they were ahead of everyone else.

Folks who make Deepseek, Qwen, GLM, MiniMax, Kimi and MiMo.

Yeah I thought all of those were generally acknowledged to be a little behind the big 3.
Post reply on HN