I respect Geohot's reputation and this company looks amazing. I might be in the market to work there... except "No Remote." For such a smart guy, locking yourself out of a ton of talent by requiring software developers to be on-site in 2023 seems...out of character, to put it politely. (Rephrased, my original post was a bit too ad hominem and accumulating downvotes rapidly. I wanted to delete this entire comment but…
The tiny corp raised $5.1M
111–120 of 331 posts
Re: The tiny corp raised $5.1M
#112> There’s a [Radeon RX 7900 XTX 24GB] already on the market. For $999, you get a 123 TFLOP card with 24 GB of 960 GB/s RAM. This is the best FLOPS per dollar today, and yet…nobody in ML uses it. > I promise it’s better than the chip you taped out! It has 58B transistors on TSMC N5, and it’s like the 20th generation chip made by the company, 3rd in this series. Why are you so arrogant that you think you can make a bet…
It doesn't fit the business model. I mean sure, they'll sell AMD computers now like a bootleg Puget Systems. But why buy from the bootleg when I can just buy from the real thing (or AWS) and run tinygrad on there if I want?
So the play is, get people using your framework (tinygrad), then pivot to making AI chips for it:
> In the limit, it’s a chip company, but there’s a lot of intermediates along the way.
Seems far fetched but good luck to them.
Re: The tiny corp raised $5.1M
#113I respect Geohot's reputation and this company looks amazing. I might be in the market to work there... except "No Remote." For such a smart guy, locking yourself out of a ton of talent by requiring software developers to be on-site in 2023 seems...out of character, to put it politely. (Rephrased, my original post was a bit too ad hominem and accumulating downvotes rapidly. I wanted to delete this entire comment but…
Re: The tiny corp raised $5.1M
#114If they can achieve something competitive with CUDA for $5m, why hasn't AMD done it yet?
The reason they sometimes win is huge structural or incentive issues in the large companies. And they don't win often.
AMD has failed to fix the problem for years. Is it because the business structure doesn't incentivize it? Is it because the company's entrenched culture is opposed to compensation that might attract the right talent (often out of "fairness")? Is it because there's some internal owner for the function that keeps fucking up but for political reasons the CEO won't replace them and no one else can work on the thing?
Any of these are possible. I have seen - personally witnessed - all of these and more at large companies. We don't know the reason, but we can sort of guess as to the shape of it.
Re: The tiny corp raised $5.1M
#115Earlier quoted context omitted.
I like George's style and wish him well. But I'm not optimistic about their chances of selling $15k servers that are $10k in parts (or whatever the exact numbers are). It's just too easy for anyone to throw together a Supermicro machine with 6x GPUs in it, which is what it sounds like they'll be doing. My guess is they'll end up creating some premium extensions to the software and selling that to make money. Or maybe…
> It's just too easy for anyone to throw together a Supermicro machine with 6x GPUs in it, which is what it sounds like they'll be doing. HPC compute is well advanced past just slapping GPUs into generic supermicro servers anyway. Without semi-custom hardware and equivalents to nvlink/nvswitch AMD won't ever be competitive in the HPC space.
Re: The tiny corp raised $5.1M
#116> I think the only way to start an AI chip company is to start with the software. The computing in ML is not general purpose computing. 95% of models in use today (including LLMs and image generation) have all their compute and memory accesses statically computable. > Unfortunately, this advantage is thrown away the minute you have something like CUDA in your stack. Once you are calling in to Turing complete kernels,…
I recall reading about avoiding Turing completeness for similar reasons to avoid the halting problem.
> Other times these programmers apply the rule of least power—they deliberately use a computer language that is not quite fully Turing-complete. Frequently, these are languages that guarantee all subroutines finish, such as Coq.
Re: The tiny corp raised $5.1M
#117For background, "geohot", is George Hotz, who's a known hacker / tech personality[0] This project fits the pattern of his previous projects: he gets excited about the currently hot thing in tech, makes his own knockoff version, generates a ton of buzz in the tech press for it, and then it fizzles out because he doesn't have the resources or attention span to actually make something at that scale. In 2016, Tesla and s…
My opinion of geohot definitely dropped after he started tweeting how easy it would be to fix Twitter, and then he started soliciting free work. He obviously underestimated the difficulty of shipping a feature across web and mobile. Hacking a prototype is trivial. Making it work well for all platforms, fully accessible, and across all supported languages is a bigger hurdle. It just gave me the impression that he thou…
Re: The tiny corp raised $5.1M
#118Earlier quoted context omitted.
Gotta have money to start to keep taking risks
While it's not available to many of us (and especially those outside of US) it doesn't take that much money to just tinker with whatever you want. Just have to cut time wasted on news and politics, socialising and literally anything outsidie of being hacker or entrepreneur. Most people just would never take that risk and will stick to their well-paying job.
I took my one shot! Any more is too risky for quite a while.
Re: The tiny corp raised $5.1M
#119Earlier quoted context omitted.
Comma didn't fizzle out. https://twitter.com/comma_ai/status/1578517666632900608
They're slowing burning through their VC money trying to make a business out of the hobbyist market while Cruise and Waymo have fully autonomous cars deployed in SF and are scaling up.
Cruse and Waymo have invested billions, they need 10’s of billions in annual sales or their project is a failure.
Re: The tiny corp raised $5.1M
#120Earlier quoted context omitted.
I’m not convinced ai driving can even work without GAI. Seems like a logical next step to the gigantic yak shave that is autonomous driving.
Both Cruise and Waymo have human backup in case of unexpected edge cases. I suspect they are going to be needed for quite some time to come.
https://spectrumnews1.com/ap-top-news/2020/10/08/waymo-remov...
https://www.azfamily.com/2022/08/29/waymo-launches-its-self-...
There was also a waymo press released this year that stated all rides in Arizona are now backup driver free, although I can't find it.