Is this the guy who couldn’t add a feature to Twitter?
The tiny corp raised $5.1M
71–80 of 331 posts
Re: The tiny corp raised $5.1M
#72> There’s a [Radeon RX 7900 XTX 24GB] already on the market. For $999, you get a 123 TFLOP card with 24 GB of 960 GB/s RAM. This is the best FLOPS per dollar today, and yet…nobody in ML uses it. > I promise it’s better than the chip you taped out! It has 58B transistors on TSMC N5, and it’s like the 20th generation chip made by the company, 3rd in this series. Why are you so arrogant that you think you can make a bet…
I know a fair amount about this problem, my last startup built a working prototype of a performance-portable deep learning framework that got good performance out of AMD cards. The compiler stack is way harder than most people appreciate because scheduling operations for GPUs is very specific to the workload, hardware, and app constraints. The two strongest companies I'm aware of that are working in this area now are…
This. Modular and OctoML are building on top of MLIR and TVM respectively.
> It's pretty hard to really beat NVIDIA for developer support though, they've invested a lot of work into the CUDA ecosystem over the years and it shows.
Yup, strong CUDA community and dev support. That said, more ergonomic domain specific languages like Mojo might finally give CUDA some competition though - it's still a very high bar for sure.
Re: The tiny corp raised $5.1M
#73Seems like a much better mission for George Hotz to go on than single handedly trying to fix Twitter.
George Hotz is a talented engineer but he absolutely does not have the social science background to "fix" Twitter.
Re: The tiny corp raised $5.1M
#74Seems like a much better mission for George Hotz to go on than single handedly trying to fix Twitter.
It wasn’t even fixing Twitter. It was marginally improving search.
Re: The tiny corp raised $5.1M
#75> I started tinygrad in Oct 2020. It started as a toy project to teach me about neural networks Shows you what is possible in 2.5 years. Keeps me motivated to learn.
The math isn't super difficult. Some books will try to throw a mess of differential equations at you, but some simple calculus is all you need for backpropagation.
Re: The tiny corp raised $5.1M
#76Seems like a much better mission for George Hotz to go on than single handedly trying to fix Twitter.
I thought he was doing AI self-driving. I see we are now moving the goalposts to "generalized intelligence" so I suppose there was no point for him to put up with just cars anymore.
Re: The tiny corp raised $5.1M
#77Why wouldn't AMD throw a few million at this? Worst case they lose a small amount of money, but best case they finally get good software for their hardware. The past decade or so, they haven't been able to create any good software for their hardware. They made small improvements but the competition, Nvidia, has also made improvements to their already good software. It too the point where their software is the reason…
AFAIK the "AMDs drivers are bad" meme is outdated. Sure, their AI/ML software is garbage, but the graphics drivers are fine.
Re: The tiny corp raised $5.1M
#78Seems like a much better mission for George Hotz to go on than single handedly trying to fix Twitter.
It wasn’t even fixing Twitter. It was marginally improving search.
From the actual engineers that were posting on Twitter marginal is putting it lightly.
The quality, arrogance and ignorance of enterprise SDLC was akin to that of a 1st year grad.
Re: The tiny corp raised $5.1M
#79Why wouldn't AMD throw a few million at this? Worst case they lose a small amount of money, but best case they finally get good software for their hardware. The past decade or so, they haven't been able to create any good software for their hardware. They made small improvements but the competition, Nvidia, has also made improvements to their already good software. It too the point where their software is the reason…
Maybe AMD is the the one who is investing $5.1M in his company.
Re: The tiny corp raised $5.1M
#80Seems like a much better mission for George Hotz to go on than single handedly trying to fix Twitter.
George Hotz is a talented engineer but he absolutely does not have the social science background to "fix" Twitter.
Being an engineer at Twitter is much more akin to an enterprise like a bank or telco.
You need to be a team player and work across different groups e.g. Product, Testing, SRE etc in order to successfully get features into Production.
So being a talented engineer is useful but having high emotional intelligence and being able to negotiate and collaborate is far more important.