Earlier quoted context omitted.
100 years from know, it'll be known as "the musk-trump complex"
I think, and, well, here's a phrase I've never used before, that may be slightly unfair on Trump. Trump does actually take 'expert' advice; he's just astonishingly bad at choosing experts (witness the amazingly weird lawyers he surrounds himself with). But he does seem to at some level realise that he doesn't know everything.
The tiny corp raised $5.1M
291–300 of 331 posts
Re: The tiny corp raised $5.1M
#292Earlier quoted context omitted.
Isn't that just a trivial misunderstanding of Hilbert's Hotel? https://en.wikipedia.org/wiki/Hilbert%27s_paradox_of_the_Gra...
This got me thinking, is there a scenario where the number of new guests is uncountable? Seems to me that every kind of ferries/buses/guests story is just going to be countable, since a finite number of countables is still countable. Maybe something that pretends to be the real numbers, like a matrioshka doll of infinite containers inside containers.
I think we could only do this with an even more absurd scenario like if each room was filled with pregnant women who are giving birth, and the children rapidly age, and also give birth at an infinite rate? That would create an infinite nesting doll like situation for each guest
Re: The tiny corp raised $5.1M
#293Earlier quoted context omitted.
It is quite thoroughly studied in mathematics, and that particular issue has a definitive answer.
It does not. Logical outcomes that use infinity as an intermediary are inherently not reliable. An example of this is the Ramanujan summation where 1+2+3+... results in -1/12, an outcome which is disputed among mathematicians due to the fact that we have not defined the concept of infinity properly.
That's not a sum in the traditional sense so don't think about it this way.
Infinities are used quite often in mathematics for rather mundane things. Calculus doesn't work without it. It is also quite important to the foundation of many other areas but this is often hidden unless you get into advanced works (in this sentence we're not considering a typical undergraduate Multivariate Calculus, PDEs, or Linear Algebra as "advanced")
Re: The tiny corp raised $5.1M
#294Earlier quoted context omitted.
I know a fair amount about this problem, my last startup built a working prototype of a performance-portable deep learning framework that got good performance out of AMD cards. The compiler stack is way harder than most people appreciate because scheduling operations for GPUs is very specific to the workload, hardware, and app constraints. The two strongest companies I'm aware of that are working in this area now are…
This seems pretty reasonable and matches my suspicions. It is not hard for me to believe that CUDA has a lot of momentum behind it, not just in users, but in optimization and development. And thanks, I'll look more at Octo. As for Modular, aren't they only CPU right now? I'm not impressed by their results, as their edge isn't strong over PyTorch, especially scaling. A big reason this is surprising to me is simply how…
The change in the landscape I see now is that the models are big enough and useful enough that the commercial appetite for inference is expanding rapidly, hardware supply will continue to be constrained, and so tools that can reduce production inference cost by a percentage are starting to become a straight forward sale (and thus justify the infrastructure investment). This is not based on any inside info but when I look at companies like Modular and Octo that's a big part of why I think they probably will have some success.
Re: The tiny corp raised $5.1M
#295Re: The tiny corp raised $5.1M
#296Earlier quoted context omitted.
George Hotz is a talented engineer but he absolutely does not have the social science background to "fix" Twitter.
You don’t need a social science background to fix Twitter.
Re: The tiny corp raised $5.1M
#297Earlier quoted context omitted.
I think there's a certain type of person, particularly common in tech, who thinks this way about _everything_; "oh, that's way easier than what I do, how hard could it be". A kind of reverse impostor syndrome. See the cryptocurrency space; it's more or less been 15 years worth of crypto people accidentally repeating all the failures of conventional finance from the last couple of centuries, because, after all, how ha…
> Technical people suffer from what I call "Engineer's Disease". We think because we're an expert in one area, we're automatically an expert in other areas. Just recognizing that helps. https://news.ycombinator.com/item?id=10812804
Re: The tiny corp raised $5.1M
#298Earlier quoted context omitted.
I know the founders of an AI chip company that taped out and got working chips on their first go. They got their chip done, it’s pretty solid. Chip has great perf and is super power efficient, a solid delivery. I knew they'd nail it and they did. The SW story is a train wreck, though. The problem basically was that they couldn’t hire any good SW people. As I said I know the founders. They are both genuinely decent gu…
were the SW folks offered compensation commensurate with their low perceived status? like HW gets C/cofounder, SW gets early employee package. Because that's a different story about money and ownership. of course good people reject wage labor.
Fair enough. I’m old so these conversations are never personal. I tried to help them by steering younger, less experienced but very high potential engineers toward them, but in the end they failed utterly to put together a viable SW team.
I don’t know any of their investors in terms that would let me ask, but I do know a bunch who passed, and most of them had concluded that it would end up just being more silicon on a crowded market. Being 10-20x better than nvidia isn’t the point if the market is about to be flooded with a dozen other chips against whom you are maybe 1.5-3x better. Without nailing the go to market needs, which means “make the stuff people have work, don’t make the customer learn new” etc. you have nothing. That’s all a Sw problem.
It’s actually worse, because the engineers in the space are actually pretty bad. A lot of what they have actually barely works to begin with, being a bunch of cobbled together python frameworks of dubious engineering quality and all of the hassle of the ecosystem. So the amount of mental space for “different” is almost zero even if you ignore that they’ve been burned (AMD) before, which you can’t.
Re: The tiny corp raised $5.1M
#299Earlier quoted context omitted.
It is quite thoroughly studied in mathematics, and that particular issue has a definitive answer.
It only has a definitive answer in the mainstream interpretation of mathematics. On the relative fringes, there are serious studies on alternative interpretations. See for example https://en.wikipedia.org/wiki/Constructivism_(philosophy_of_... (You can skip to the part that discusses Cantor's arguments, but I suspect that if you haven't heard about related concepts you probably want to understand what it is first.)
The "cardinality" section of that Wikipedia page describes my objection well. I don't doubt the real numbers are not recursively enumerable, but that doesn't mean they have a larger cardinality than the integers.
Re: The tiny corp raised $5.1M
#300Earlier quoted context omitted.
100 years from know, it'll be known as "the musk-trump complex"
I think, and, well, here's a phrase I've never used before, that may be slightly unfair on Trump. Trump does actually take 'expert' advice; he's just astonishingly bad at choosing experts (witness the amazingly weird lawyers he surrounds himself with). But he does seem to at some level realise that he doesn't know everything.