Earlier quoted context omitted.
Alexnet, AlphaGo, ChatGPT Would argue he did strike gold few times.
I don't follow him very closely. Was he important for these projects?
Yes
Mark Zuckerberg freezes AI hiring amid bubble fears
461–470 of 936 posts
Re: Mark Zuckerberg freezes AI hiring amid bubble fears
#462Earlier quoted context omitted.
Sorry, I was in the metaverse just now. I took my headset off though — could you please repeat that?
Haven’t been there in a while, did they figure out how to give people, I don’t know, legs and stuff?
The two biggest Metaverse plays have had them since launch!
Re: Mark Zuckerberg freezes AI hiring amid bubble fears
#463It almost seems as though the record-setting bonuses they were dolling out to hire the top minds in AI might have been a little shortsighted. A couple of years ago, I asked a financial investment person about AI as a trick question. She did well by recommending investing in companies that invest in AI (like MS) but who had other profitable businesses (like Azure). I was waiting for her to put her foot in her mouth an…
>It almost seems as though the record-setting bonuses they were dolling out to hire the top minds in AI might have been a little shortsighted.
Everything zuck has done since the "dawn of AI" has been to intentionally subvert and sabotage existing AI players, because otherwise Meta would be too far behind. In the same way that AI threatens Search, we are seeing emergently that AI is also threatening social networks -- you can get companionship, advice, information, emotional validation, etc. directly from an AI. People are forming serious relationships with these things in as much a real way as you would with anyone else on Facebook or Instagram. Not to mention, how long before most of the "people" on those platforms are AI themselves?
I believe exactly 0 percent of the decision to make Llama open-source and free was done altruistically as much as it was simply to try and push the margins of Anthropic, OpenAI, etc. downward. Indeed, I feel like even the fearmongering of this article is also strategically intended to devalue AI incumbents. AI is very much an existential threat to Meta.
Is AI currently fulfilling the immense hype around it? In my opinion, maybe not, but the potential value is obvious. Much more obvious than, for example, NFTs and crypto just a few years ago.
Re: Mark Zuckerberg freezes AI hiring amid bubble fears
#464Earlier quoted context omitted.
Or maybe not. Scaling AI will require an exponential increase in compute and processing power, and even the current LLM models take up a lot of resources. We are already at the limit of how small we can scale chips and Moore’s law is already dead. So newer chips will not be exponentially better but will be more of incremental improvements, so unless the price of electricity comes down exponentially we might never see…
Scaling AI will require an exponential increase in compute and processing power, A small quibble... I'd say that's true only if you accept as an axiom that current approaches to AI are "the" approach and reject the possibility of radical algorithmic advances that completely change the game. For my part, I have a strongly held belief that there is such an algorithmic advancement "out there" waiting to be discovered, t…
If we suppose that ANNs are more or less accurate models of real neural networks, the reason why they're so inefficient is not algorithmic, but purely architectural. They're just software. We have these huge tables of numbers and we're trying to squeeze them as hard as possible through a relatively small number of multipliers and adders. Meanwhile, a brain can perform a trillion fundamental simultaneously because every neuron is a complete processing element independent of every other one. To bring that back into more concrete terms, if we took an arbitrary model and turned it into a bespoke piece of hardware, it would certainly be at least one or two orders of magnitude faster and more efficient, with the downside that since it's dead silicon it could not be changed and iterated on.
Re: Mark Zuckerberg freezes AI hiring amid bubble fears
#465It almost seems as though the record-setting bonuses they were dolling out to hire the top minds in AI might have been a little shortsighted. A couple of years ago, I asked a financial investment person about AI as a trick question. She did well by recommending investing in companies that invest in AI (like MS) but who had other profitable businesses (like Azure). I was waiting for her to put her foot in her mouth an…
>It almost seems as though the record-setting bonuses they were dolling out to hire the top minds in AI might have been a little shortsighted. Everything zuck has done since the "dawn of AI" has been to intentionally subvert and sabotage existing AI players, because otherwise Meta would be too far behind. In the same way that AI threatens Search, we are seeing emergently that AI is also threatening social networks --…
> AI is very much an existential threat to Meta.
How so?
Re: Mark Zuckerberg freezes AI hiring amid bubble fears
#466Earlier quoted context omitted.
As I've said in other comments - expecting honesty and ethical behavior from Mark Zuckerberg is a fool's errand at best. He has unchecked power and cannot be voted out by shareholders. He will say whatever he wants and because the returns have been pretty decent so far, people will just take his word for it. There's not enough class A shares to actually force his hand to do anything he doesn't want to do.
Zuckerberg started as a sex pest and got not an iota better. But we could, as a society, stop rewarding him for this shit. He'd be an irrelevant fool if we had appropriate regulations around the most severe of his misdeeds.
Unfortunately I think that ship has sailed.
And since we live in the era of the real golden rule (i.e "he who has the gold makes the rules), there's no chance that we'll ever get the chance to catch the ship. Mark lives in his own world, because we gave him a quarter trillion dollars and never so much as slapped him on the wrist.
Re: Mark Zuckerberg freezes AI hiring amid bubble fears
#467Re: Mark Zuckerberg freezes AI hiring amid bubble fears
#468Earlier quoted context omitted.
Speaking of Netflix - I think the image, video, audio, world model, diffusion domains should be treated 100% separately from LLMs. They are not the same thing. Image and video AI is nothing short of revolutionary. It's already having huge impact and it's disrupting every single business it touches. I've spoken with hundreds of medium and large businesses about it. They're changing how they bill clients and budget pro…
Fwiw LLMs are also revolutionary. There's currently more anti-AI hype than AI hype imho. As in there's literally people claiming it's completely useless and not going to change a thing. Which is crazy.
One sides extremes says LLM wont change a thing, the other sides extremes says LLM will end the world.
I don't think the ones saying it wont change a thing are the most extreme here.
Re: Mark Zuckerberg freezes AI hiring amid bubble fears
#469Earlier quoted context omitted.
Scaling AI will require an exponential increase in compute and processing power, A small quibble... I'd say that's true only if you accept as an axiom that current approaches to AI are "the" approach and reject the possibility of radical algorithmic advances that completely change the game. For my part, I have a strongly held belief that there is such an algorithmic advancement "out there" waiting to be discovered, t…
If we suppose that ANNs are more or less accurate models of real neural networks, the reason why they're so inefficient is not algorithmic, but purely architectural. They're just software. We have these huge tables of numbers and we're trying to squeeze them as hard as possible through a relatively small number of multipliers and adders. Meanwhile, a brain can perform a trillion fundamental simultaneously because eve…
the reason why they're so inefficient is not algorithmic, but purely architectural.
I would agree with that, with the caveat that in my mind "the architecture" and "the algorithm" are sort of bound up with each other. That is, one implies the other -- to some extent.
And yes, fair point that building dedicated hardware might just be part of the solution to making something that runs much more efficiently.
The only other thing I would add, is that - relative to what I said in the post above - when I talk about "algorithmic advances" I'm looking at everything as potentially being on the table - including maybe something different from ANN's altogether.
Re: Mark Zuckerberg freezes AI hiring amid bubble fears
#470Scaling AI will require an exponential increase in compute and processing power, and even the current LLM models take up a lot of resources. We are already at the limit of how small we can scale chips and Moore’s law is already dead. So newer chips will not be exponentially better but will be more of incremental improvements, so unless the price of electricity comes down exponentially we might never see AGI at a pric…
> I highly doubt if we will see the same form of increase in the next 40 years
People would have predicted this at 1GHZ. I wouldn’t discount anything about the future.