Earlier quoted context omitted.
> There's no way in hell people can make sense of 19 billion separate concepts. Likely what's going on in the chip is just repeated patterns designed to make a very simple machine operate really really quickly. You are right about human designed chips. If you use something like simulated evolution or backpropagation or some other techniques from machine learning or mathematical optimization, you can get machines with…
The human brain IS an example of such a mechanism. We've done it artificially as well with machine learning and genetic algorithms. The amount of concepts in the neural network of an LLM is too large for us to fully understand. At best we can only hope to understand these things as a sort of curve fitting optimization problem.
How many billions of transistors in an iPhone processor?
151–160 of 202 posts
Re: How many billions of transistors in an iPhone processor?
#152I've often struggled to really "grok" how complex chips are. They all kinda look the same. I write software, so I know how complex that is, but like the device itself -- it's this little black box. What's the difference between one little black box and another? Most people don't even get that far; they think the computer is the screen that lights up. I've been reading datasheets a lot at work. The datasheet for an ST…
Also I don't really have an idea, but I wouldn't be surprised, if a very significant part of transistor budget has been spent on SRAM or something similar, which is not very fascinating.
Re: How many billions of transistors in an iPhone processor?
#153I've often struggled to really "grok" how complex chips are. They all kinda look the same. I write software, so I know how complex that is, but like the device itself -- it's this little black box. What's the difference between one little black box and another? Most people don't even get that far; they think the computer is the screen that lights up. I've been reading datasheets a lot at work. The datasheet for an ST…
>I sometimes have to take a moment, because I remember descriptions of alien technology from sci-fi books. Complexity, opaqueness, power. Chips. Sufficiently advanced technology is indistinguishable from magic.
Re: How many billions of transistors in an iPhone processor?
#154What are all those transistors doing? I've heard the cache is the biggest part. Per https://en.wikipedia.org/wiki/Apple_A17 , the A17 has 72MB of cache. Cache is typically SRAM. Per https://en.wikipedia.org/wiki/Static_random-access_memory , a single bit of SRAM typically uses 6 transistors, but it could be anywhere from 4 to 10. So that's between 2.3B and 5.7B transistors for the cache. That leaves about 1B transist…
Re: How many billions of transistors in an iPhone processor?
#155Earlier quoted context omitted.
Putting humans on the moon in the first place was mostly just grandstanding. Manned space exploration in general is mostly just entertainment. I'm glad humanity hasn't continued wasting resources on that particular endeavor. Unmanned probes do good work for science. (Though even there I am not sure about the bang-for-the-buck compared to other alternatives.) Have a look at '20 Breakthroughs from 20 Years of Science a…
Putting humans on the moon in the first place was mostly just grandstanding. Manned space exploration in general is mostly just entertainment. Indeed, and I believe refusing to acknowledge that fact is actively harming not just spaceflight but manned spaceflight. We're spending tens of billions of dollars trying to set up for some bullshit useless moon base when we could be setting boots on Mars just to prove we can.…
Re: How many billions of transistors in an iPhone processor?
#156Earlier quoted context omitted.
Machine learning is that use case, it'll eat up as much processing power as you can throw at it. LLMs on your phone are a few hardware generations out, but they are coming.
ML/AI is not really a use case but rather a technology. The use cases may come a one point but right now, as far as I can see, they are missing.
Re: How many billions of transistors in an iPhone processor?
#157Earlier quoted context omitted.
ML/AI is not really a use case but rather a technology. The use cases may come a one point but right now, as far as I can see, they are missing.
The use case is Siri not being complete shit
Re: How many billions of transistors in an iPhone processor?
#158Earlier quoted context omitted.
Putting humans on the moon in the first place was mostly just grandstanding. Manned space exploration in general is mostly just entertainment. Indeed, and I believe refusing to acknowledge that fact is actively harming not just spaceflight but manned spaceflight. We're spending tens of billions of dollars trying to set up for some bullshit useless moon base when we could be setting boots on Mars just to prove we can.…
I think a moon base is actually more useful because there’s actual commercial use cases to a moon base like mining etc. and not only that but doing a mars mission is far easier and cheaper if you already have a moon base since you can make rocket fuel on the moon for cheaper in terms of delta-V if you can come up with a hydro lox chemistry design.
Re: How many billions of transistors in an iPhone processor?
#159Earlier quoted context omitted.
Putting humans on the moon in the first place was mostly just grandstanding. Manned space exploration in general is mostly just entertainment. Indeed, and I believe refusing to acknowledge that fact is actively harming not just spaceflight but manned spaceflight. We're spending tens of billions of dollars trying to set up for some bullshit useless moon base when we could be setting boots on Mars just to prove we can.…
I think a moon base is actually more useful because there’s actual commercial use cases to a moon base like mining etc. and not only that but doing a mars mission is far easier and cheaper if you already have a moon base since you can make rocket fuel on the moon for cheaper in terms of delta-V if you can come up with a hydro lox chemistry design.
Especially since the signal lag from earth is so small, so you can even use remote human operators for many tasks instead of investing a lot in AI.
Re: How many billions of transistors in an iPhone processor?
#160I consider myself very lucky to be born in this age of civilization where technology increases at such incredible pace. Playing games on an atari in my childhood, then sega master system, nintendo, snes, pc games, the first 3d acceleration consumer cards, all the way to having a supercomputer in my pocket. What a time to be alive.
Capitalism is amazing :)