Live data from Hacker News

The tiny corp raised $5.1M

geohot.github.io

291–300 of 331 posts

Re: The tiny corp raised $5.1M

#291
post #263

Earlier quoted context omitted.

100 years from know, it'll be known as "the musk-trump complex"

I think, and, well, here's a phrase I've never used before, that may be slightly unfair on Trump. Trump does actually take 'expert' advice; he's just astonishingly bad at choosing experts (witness the amazingly weird lawyers he surrounds himself with). But he does seem to at some level realise that he doesn't know everything.

I think it's because not many non-wierd folks want to work for him. If he were just 5% better at supporting those who work for him, he might increase his success rate by 50%.

Re: The tiny corp raised $5.1M

#292

Earlier quoted context omitted.

Isn't that just a trivial misunderstanding of Hilbert's Hotel? https://en.wikipedia.org/wiki/Hilbert%27s_paradox_of_the_Gra...

This got me thinking, is there a scenario where the number of new guests is uncountable? Seems to me that every kind of ferries/buses/guests story is just going to be countable, since a finite number of countables is still countable. Maybe something that pretends to be the real numbers, like a matrioshka doll of infinite containers inside containers.

In the hotel fashion, might be difficult. Think of it this way, if we make the Hilbert Hotel infinitely tall and each floor has infinitely many rooms such that they correspond to each rational number, we can fill any number of people from any source on the first floor alone.

I think we could only do this with an even more absurd scenario like if each room was filled with pregnant women who are giving birth, and the children rapidly age, and also give birth at an infinite rate? That would create an infinite nesting doll like situation for each guest

Re: The tiny corp raised $5.1M

#293
post #206

Earlier quoted context omitted.

It is quite thoroughly studied in mathematics, and that particular issue has a definitive answer.

It does not. Logical outcomes that use infinity as an intermediary are inherently not reliable. An example of this is the Ramanujan summation where 1+2+3+... results in -1/12, an outcome which is disputed among mathematicians due to the fact that we have not defined the concept of infinity properly.

> Ramanujan summation

That's not a sum in the traditional sense so don't think about it this way.

Infinities are used quite often in mathematics for rather mundane things. Calculus doesn't work without it. It is also quite important to the foundation of many other areas but this is often hidden unless you get into advanced works (in this sentence we're not considering a typical undergraduate Multivariate Calculus, PDEs, or Linear Algebra as "advanced")

Re: The tiny corp raised $5.1M

#294

Earlier quoted context omitted.

I know a fair amount about this problem, my last startup built a working prototype of a performance-portable deep learning framework that got good performance out of AMD cards. The compiler stack is way harder than most people appreciate because scheduling operations for GPUs is very specific to the workload, hardware, and app constraints. The two strongest companies I'm aware of that are working in this area now are…

This seems pretty reasonable and matches my suspicions. It is not hard for me to believe that CUDA has a lot of momentum behind it, not just in users, but in optimization and development. And thanks, I'll look more at Octo. As for Modular, aren't they only CPU right now? I'm not impressed by their results, as their edge isn't strong over PyTorch, especially scaling. A big reason this is surprising to me is simply how…

First you have to figure out what problem to attack. Research, training production models, and production inference all have very different needs on the software side. Then you have to work out what the decision tree is for your customers (so depends who you are in this equation) and how you can solve some important problem for them. In all of this for say training a big transformer numpy isn't going to help you much so it doesn't matter if it's faster for some small cases. If you want to support a lot of model flexibility (for research and maybe training) then you need to do some combination of hand-writing chip-specific kernels and building a compiler that can do some or most of that automatically. Behind that door is a whole world of hardware-specific scheduling models, polyhedral optimization, horizontal and vertical fusion, sparsity, etc, etc, etc. It's a big and sustained engineering effort, not within the reach of hobby developers, so you go back to the question of who is paying for all this work and why. Nvidia has clarity there and some answers that are working. Historically AMD has operated on the theory that deep learning is too early/small to matter, and for big HPC deployments they can hand-craft whatever tools they need for those specific contracts (this is why ROCm seems so broken for normal people). Google built TensorFlow, XLA, Jax, etc for their own workloads and the priorities reflect that (e.g. TPU support). For a long time the great majority of inference workloads were on Intel CPUs so their software then reflected that. Not sure what tiny corp's bet here is going to be.

The change in the landscape I see now is that the models are big enough and useful enough that the commercial appetite for inference is expanding rapidly, hardware supply will continue to be constrained, and so tools that can reduce production inference cost by a percentage are starting to become a straight forward sale (and thus justify the infrastructure investment). This is not based on any inside info but when I look at companies like Modular and Octo that's a big part of why I think they probably will have some success.

Re: The tiny corp raised $5.1M

#295

Earlier quoted context omitted.

Tres commas: https://youtu.be/2XxwhMcUjYU ?

First thing I thought of too, talk about life imitating art. I hadn't laughed so hard in a long time.

Not gonna lie: I watched the 'best of' Bachman and Hanneman immediately after I posted it!

Re: The tiny corp raised $5.1M

#296
post #73

Earlier quoted context omitted.

George Hotz is a talented engineer but he absolutely does not have the social science background to "fix" Twitter.

You don’t need a social science background to fix Twitter.

Define "fix." Twitter is a tool used by extremists to reach massive audiences. Some of those extremists have socially destructive and violent objectives. Responding to harassment and hate speech involves understanding the psychology of harassers and racists so that incentives can be designed not to reward those behaviors. IMO, "fixing" Twitter isn't just about fail whales and 500 errors.

Re: The tiny corp raised $5.1M

#297
post #256

Earlier quoted context omitted.

I think there's a certain type of person, particularly common in tech, who thinks this way about _everything_; "oh, that's way easier than what I do, how hard could it be". A kind of reverse impostor syndrome. See the cryptocurrency space; it's more or less been 15 years worth of crypto people accidentally repeating all the failures of conventional finance from the last couple of centuries, because, after all, how ha…

> Technical people suffer from what I call "Engineer's Disease". We think because we're an expert in one area, we're automatically an expert in other areas. Just recognizing that helps. https://news.ycombinator.com/item?id=10812804

[deleted]

Re: The tiny corp raised $5.1M

#298

Earlier quoted context omitted.

I know the founders of an AI chip company that taped out and got working chips on their first go. They got their chip done, it’s pretty solid. Chip has great perf and is super power efficient, a solid delivery. I knew they'd nail it and they did. The SW story is a train wreck, though. The problem basically was that they couldn’t hire any good SW people. As I said I know the founders. They are both genuinely decent gu…

were the SW folks offered compensation commensurate with their low perceived status? like HW gets C/cofounder, SW gets early employee package. Because that's a different story about money and ownership. of course good people reject wage labor.

I can only speak for myself, but their offer was underwhelming and I was easily one of the first five people they called. I’ve founded and exited companies myself, so when I walked them through why the founding SW engineer offer wasn’t worth my time giving the risk profile, and laid out there size and type of SW engineers they were going to need. They understood, but they also trotted out the “but we really have to make sure we hire the right chip guys.”

Fair enough. I’m old so these conversations are never personal. I tried to help them by steering younger, less experienced but very high potential engineers toward them, but in the end they failed utterly to put together a viable SW team.

I don’t know any of their investors in terms that would let me ask, but I do know a bunch who passed, and most of them had concluded that it would end up just being more silicon on a crowded market. Being 10-20x better than nvidia isn’t the point if the market is about to be flooded with a dozen other chips against whom you are maybe 1.5-3x better. Without nailing the go to market needs, which means “make the stuff people have work, don’t make the customer learn new” etc. you have nothing. That’s all a Sw problem.

It’s actually worse, because the engineers in the space are actually pretty bad. A lot of what they have actually barely works to begin with, being a bunch of cobbled together python frameworks of dubious engineering quality and all of the hassle of the ecosystem. So the amount of mental space for “different” is almost zero even if you ignore that they’ve been burned (AMD) before, which you can’t.

Re: The tiny corp raised $5.1M

#299
post #282
post #206

Earlier quoted context omitted.

It is quite thoroughly studied in mathematics, and that particular issue has a definitive answer.

It only has a definitive answer in the mainstream interpretation of mathematics. On the relative fringes, there are serious studies on alternative interpretations. See for example https://en.wikipedia.org/wiki/Constructivism_(philosophy_of_... (You can skip to the part that discusses Cantor's arguments, but I suspect that if you haven't heard about related concepts you probably want to understand what it is first.)

I love that the "hater" thread turns into a discussion of uncountable infinities :)

The "cardinality" section of that Wikipedia page describes my objection well. I don't doubt the real numbers are not recursively enumerable, but that doesn't mean they have a larger cardinality than the integers.

Re: The tiny corp raised $5.1M

#300
post #263

Earlier quoted context omitted.

100 years from know, it'll be known as "the musk-trump complex"

I think, and, well, here's a phrase I've never used before, that may be slightly unfair on Trump. Trump does actually take 'expert' advice; he's just astonishingly bad at choosing experts (witness the amazingly weird lawyers he surrounds himself with). But he does seem to at some level realise that he doesn't know everything.

having worked in his general vicinity briefly, I can attest he doesn't take any advice unless it's pushed on him. His PR people, at least, seem to be constantly manhandling/damage-controlling the man
Post reply on HN