Damn, Microsoft is playing all sides of this, huh. Within a ten minute window: - Satya announced GPT-4 runs (at least partly) on a new AMD offering - Satya announced an in-house chip for ML acceleration - Satya brings NVidia CEO Jensen Huang on stage they've got every horse in the race, huh (disclaimer, I work for MS but all the stuff talked about here far is waaaay above my paygrade haha, and all brand new info to m…
The first two custom silicon chips designed by Microsoft for its cloud
241–250 of 282 posts
Re: The first two custom silicon chips designed by Microsoft for its cloud
#242Earlier quoted context omitted.
I care vastly more about raw performance than energy usage for my home systems. I also have good reasons to care about the best single core performance. I don't see x86 going away that fast.
Mobile, desktop, laptop, edge, server. These are the domains of compute. 4 out of the 5 domains value power efficiency. Laptop that were once x86 are now coming round to Arm because it really does make a better product i.e battery life and thermals. For the server, savings in energy and cost of chip manufacturing, datacentres and users both benefit.
Microsoft isn't Apple or Google in this regard, dragging developers into new worlds, and it is quite telling that they had now to put up some kind of ARM advocacy action.
https://blogs.windows.com/windowsdeveloper/2023/10/16/window...
Re: The first two custom silicon chips designed by Microsoft for its cloud
#243Every day we get closer and closer to the hypothetical "five computers". [0] Software was first, and now every one of them have hardware too. Amazon Apple Goole Microsoft [0] - https://engines.egr.uh.edu/episode/1059
Re: The first two custom silicon chips designed by Microsoft for its cloud
#244Earlier quoted context omitted.
That 50X is only if you can afford one thousand NVIDIA H100. There cannot be more than a handful of companies in the entire world that could afford such a huge price (tens of millions of $). In comparison with a still extremely expensive cluster of 64 NVIDIA H100, the difference in speed would reduce to only two to three times, and paying several times less for the entire training becomes very attractive.
You’ve got a really warped sense of scale if you think only a handful of companies couldn’t afford tens of millions of dollars. That’s complete pocket change for any of the Fortune 500.
Such a big expense only makes sense for a company where spending that amount would bring hundreds of millions of $ of additional revenue.
I doubt that any of the companies that have already spent such amounts have recovered even a small part of their expenses. It is more likely that they bet on future revenues, but it remains to be seen who will succeed to achieve that.
Re: The first two custom silicon chips designed by Microsoft for its cloud
#245Earlier quoted context omitted.
The only three are Samsung, Intel, and TSMC. Idk why going on with Intel but Samsung should BSs doing better but that institutional knowledge that TSMC has is crazy. They all technically invest in asml that makes the machines. If I had to redo my education I’d get into electrical engineering just for this.
There is one more player joining that small club, Huawei
Re: The first two custom silicon chips designed by Microsoft for its cloud
#246Earlier quoted context omitted.
It's insanely hard. TSMC is so dominant because they have very, very, deep institutional knowledge. Even if you have billions to invest it's not easy to create that, and definitely impossible to do it short term. There's only 3 companies left chasing smaller nodes. Everyone else has given up and are focusing on revenue from high volume parts in older processes.
The only three are Samsung, Intel, and TSMC. Idk why going on with Intel but Samsung should BSs doing better but that institutional knowledge that TSMC has is crazy. They all technically invest in asml that makes the machines. If I had to redo my education I’d get into electrical engineering just for this.
Re: The first two custom silicon chips designed by Microsoft for its cloud
#247Earlier quoted context omitted.
The only three are Samsung, Intel, and TSMC. Idk why going on with Intel but Samsung should BSs doing better but that institutional knowledge that TSMC has is crazy. They all technically invest in asml that makes the machines. If I had to redo my education I’d get into electrical engineering just for this.
> I’d get into electrical engineering just for this I get the impression it's mostly physics guys.
Re: The first two custom silicon chips designed by Microsoft for its cloud
#248Earlier quoted context omitted.
The only three are Samsung, Intel, and TSMC. Idk why going on with Intel but Samsung should BSs doing better but that institutional knowledge that TSMC has is crazy. They all technically invest in asml that makes the machines. If I had to redo my education I’d get into electrical engineering just for this.
> If I had to redo my education I’d get into electrical engineering just for this. This is the crazy thing. Such fundamental important technology but salaries generally suck. Much more money in cat memes and influencer channels.
Re: The first two custom silicon chips designed by Microsoft for its cloud
#249Earlier quoted context omitted.
Why doesn't anyone enter? It takes billions and billions of dollars, tons of knowledge and if you get it wrong...even Intel screwed it up, and they are one of the only companies would could even try to do it.
Right now Intel is hamstrung because there is no separation between the fab and design sides. Nobody is going to trust Intel to fab their latest and greatest while the two sides are joined at the hip. The sooner Intel spins out the fab side into its own entity the better positioned it will be to pick up the business that TSMC doesn't have capacity for.
People will overlook a lot, if the product is compelling enough and the sales guys can keep a straight face while promising not to peek.
Re: The first two custom silicon chips designed by Microsoft for its cloud
#250Earlier quoted context omitted.
The only three are Samsung, Intel, and TSMC. Idk why going on with Intel but Samsung should BSs doing better but that institutional knowledge that TSMC has is crazy. They all technically invest in asml that makes the machines. If I had to redo my education I’d get into electrical engineering just for this.
There is one more player joining that small club, Huawei