Live data from Hacker News

The state of open source AI

stateofopensource.ai

361–370 of 379 posts

Re: The state of open source AI

#361

Earlier quoted context omitted.

The frontier models are obviously superior. The question is if progress slows down.

in what context, and at what ROI? Because... I have use-cases where this is true, and use-cases where this falls flat on its face. I don't actually think it's obvious (at all, really) without defining what "superior" means. In the same way that I don't think it's obvious that a plane is superior to a car, or a boat, or a bike. They each do things the others don't, and excel in different spaces.

Every single benchmark

Again, that gap might disappear over time. But there is a gap currently.

Re: The state of open source AI

#362
post #292
post #266

Earlier quoted context omitted.

I absolutely would. Let the bubble burst.

The bubble would burst for OpenAI, Anthropic, Oracle, and Microsoft…

It'd better happen sooner than later. This bubble is distorting everything and turning many executives insane. See https://ludic.mataroa.blog/blog/ai-mania-is-eviscerating-glo...

Re: The state of open source AI

#363
post #352

Earlier quoted context omitted.

Corporations don't have armies and prisons. Get a grip.

There are corporations like Blackwater and CoreCivic that subcontract both of these for the US government today or Wagner (RIP) in Russia. The pinkertons and the US state have also both taken on the role of corporate muscle in the past when workers went on strike

No I'm not talking about federal subcontractors, or paramilitary organizations. I'm simply referring to large telecoms, banks, utility companies, and your run-of-the-mill corporations. Because they are typically organized and run in quite fascist manner. It doesn't matter if they lack prisons or guns. I'm not saying they're going to invade Austria or open a concentration camp. But a lot of the fascist ethos today is being kept alive and revered by corporate culture. It's rather undeniable, if you think about it.

Re: The state of open source AI

#364

As someone that's generally for the proliferation of open models, I want to take this seriously, but it's really difficult when it was clearly written by AI. I guess they fired whoever used to write copy for these things. Edit: to be clear, I'm not trying to just dunk on them, I think it's actively hurting their own point to do this, and counter-productive when people can easily clock it - it makes some percent of th…

[flagged]

Re: The state of open source AI

#365

Speculation: open models is what will kill Anthropic and OpenAI. Hyperscalers can run the models without a licensing fee. Apple can make them smaller and put them on the device. The frontier models are an edge and a liability. They're astronomically expensive to train. Without them, their models will fade into obscurity. Their marketing depends on people believing the models are meaningfully different, as people have…

Speculation: Cheapest AI inference supply chain will win. Chips and energy. The chinese have made large investments in nuclear that will take decades for the US to follow and US has Chip supply chains that will take a few years for the Chinese to follow.

We are probably at the 3T to 5T parameter models which are good enough for disruption.Given the supply chains we can probably expect paced improvements, unless somebody comes up with better training methodologies or mathematics.

Re: The state of open source AI

#366
post #312
post #236

Earlier quoted context omitted.

One big difference is that the US doesn't have much public record of using state espionage resources to steal industrial secrets to give domestic industry a leg up in the market, whereas CCP very much does. And while I use and love the open weight models, it seems likely to be pretty hard to prove conclusively that they have no reinforcement-learning-trained proclivity towards curling specific URLs if the topic happe…

The American industrial revolution is often cited as one such example. The patent act of 1793 is still relevant today [0] and was established to protect Americans stealing British and European industrial trade secrets. https://mysteriesofmankind.com/industrial-espionage-the-spie...

Right, talking about behavior in living memory.

Re: The state of open source AI

#367
post #273
post #236

Earlier quoted context omitted.

One big difference is that the US doesn't have much public record of using state espionage resources to steal industrial secrets to give domestic industry a leg up in the market, whereas CCP very much does. And while I use and love the open weight models, it seems likely to be pretty hard to prove conclusively that they have no reinforcement-learning-trained proclivity towards curling specific URLs if the topic happe…

>One big difference is that the US doesn't have much public record of using state espionage resources to steal industrial secrets to give domestic industry a leg up in the market, whereas CCP very much does. Until very recently there would have been little point. What could China do that the US couldnt? I'm sure the US will start to do it in the not too distant future though. China is slowly leapfrogging the US on se…

I wasn’t talking about spying on Chinese firms, I was talking about firms worldwide. And I said nothing about conscience.

Re: The state of open source AI

#368
post #286
post #236

Earlier quoted context omitted.

One big difference is that the US doesn't have much public record of using state espionage resources to steal industrial secrets to give domestic industry a leg up in the market, whereas CCP very much does. And while I use and love the open weight models, it seems likely to be pretty hard to prove conclusively that they have no reinforcement-learning-trained proclivity towards curling specific URLs if the topic happe…

Happy to disagree with you. There are many examples of the US using the state espionage machinery for private purposes. The extent of "private" is debatable given the US as a nation behaves more like a big corp. https://www.reuters.com/article/business/nsa-spying-on-petro...

Did they give those secrets to US private industry?

Re: The state of open source AI

#369
post #236

Earlier quoted context omitted.

One big difference is that the US doesn't have much public record of using state espionage resources to steal industrial secrets to give domestic industry a leg up in the market, whereas CCP very much does. And while I use and love the open weight models, it seems likely to be pretty hard to prove conclusively that they have no reinforcement-learning-trained proclivity towards curling specific URLs if the topic happe…

>One big difference is that the US doesn't have much public record of using state espionage resources to steal industrial secrets to give domestic industry a leg up in the market, whereas CCP very much does. From Wikipedia > British journalist Duncan Campbell and New Zealand journalist Nicky Hager said in the 1990s that the United States was exploiting ECHELON traffic for industrial espionage, rather than military an…

Ah good counter, hadn’t seen that. Proven?

Re: The state of open source AI

#370
post #352

Earlier quoted context omitted.

There are corporations like Blackwater and CoreCivic that subcontract both of these for the US government today or Wagner (RIP) in Russia. The pinkertons and the US state have also both taken on the role of corporate muscle in the past when workers went on strike

No I'm not talking about federal subcontractors, or paramilitary organizations. I'm simply referring to large telecoms, banks, utility companies, and your run-of-the-mill corporations. Because they are typically organized and run in quite fascist manner. It doesn't matter if they lack prisons or guns. I'm not saying they're going to invade Austria or open a concentration camp. But a lot of the fascist ethos today is…

We call that capitalism.

You have this a little backwards, really. Fascist is a political movement in which corporations conspire with the government.

Post reply on HN