Rule of thumb: IBM tends to spoof results to get published, then use the published results to trick tech-illiterate clients into using their stack. At conferences I used to go to, they'd just phack the hyperparameters of an ensemble model on the benchmark sets, and put out a press release saying they were state of the art. They were mostly ignored by the academics who went to the talks on the actual novel work.
IBM analog AI chip could give the Nvidia H100 a run for its money
31–40 of 71 posts
Re: IBM analog AI chip could give the Nvidia H100 a run for its money
#32Earlier quoted context omitted.
Hmm all I've seen about Foveon is just stacked RGB sensing. Ie there is no computation involving multiple pixels or anything like that.
Outside of the books I mention the Foveon information online is bad and deteriorating. I mean they don’t seem to mention https://en.m.wikipedia.org/wiki/Misha_Mahowald From what I recall there are analog feedback stages between adjacent cells, and that was a ongoing theme throughout the work of the teams around Mead. His neuromorphic book is almost entirely about doing that to sound and images. As an aside the Foveon…
Re: IBM analog AI chip could give the Nvidia H100 a run for its money
#33Rule of thumb: IBM tends to spoof results to get published, then use the published results to trick tech-illiterate clients into using their stack. At conferences I used to go to, they'd just phack the hyperparameters of an ensemble model on the benchmark sets, and put out a press release saying they were state of the art. They were mostly ignored by the academics who went to the talks on the actual novel work.
[deleted]
Re: IBM analog AI chip could give the Nvidia H100 a run for its money
#34Re: IBM analog AI chip could give the Nvidia H100 a run for its money
#35I do with that at least _tech journalism_ outlets would develop a habit of asking at least one followup question when a PR says that something is like the human brain. Having analog values between zero and one is not at all particular to the human brain, or any brain, where we have spikes occurring at varying rates, not scalar activation levels. This chip could equally well be described as having components which mimic a dimmer switch, or perhaps a gas gauge that varies between empty and full. Yes, that's cool. No, it's not really brain-like.
Re: IBM analog AI chip could give the Nvidia H100 a run for its money
#36Earlier quoted context omitted.
Arguably that is what the Foveon sensor did. https://en.m.wikipedia.org/wiki/Foveon_X3_sensor There is a book called The Silicon Eye about the history, and not coincidentally Carver Mead also wrote a book on neuromorphic analog neural network implementation back in the 80s.
Hmm all I've seen about Foveon is just stacked RGB sensing. Ie there is no computation involving multiple pixels or anything like that.
The "Quattro" generation Foveon used 2x2 subpixels for the top layer. My impression then was it was a last-ditch effort to mitigate poor sensitivity, but it's interesting how it was arguably an only analog convolutional network processor in a consumer product, from a different perspective.
Re: IBM analog AI chip could give the Nvidia H100 a run for its money
#37Earlier quoted context omitted.
Outside of the books I mention the Foveon information online is bad and deteriorating. I mean they don’t seem to mention https://en.m.wikipedia.org/wiki/Misha_Mahowald From what I recall there are analog feedback stages between adjacent cells, and that was a ongoing theme throughout the work of the teams around Mead. His neuromorphic book is almost entirely about doing that to sound and images. As an aside the Foveon…
Do you have an example or can expand on what you mean about the last point? Isn't sharpness mostly limited by the lens systems in modern cameras rather than the Bayer sensor resolution?
Of course today the actual resolution of more conventional sensors dramatically exceeds the best foveons to the point where this advantage is nullified.
Re: IBM analog AI chip could give the Nvidia H100 a run for its money
#38> The 14nm analog chip mimics the human brain I do with that at least _tech journalism_ outlets would develop a habit of asking at least one followup question when a PR says that something is like the human brain. Having analog values between zero and one is not at all particular to the human brain, or any brain, where we have spikes occurring at varying rates, not scalar activation levels. This chip could equally we…
Re: IBM analog AI chip could give the Nvidia H100 a run for its money
#39I have become pretty wary of all headlines touting how a new chip is going to dethrone Nvidia. The problem with every hardware company is that they ridiculously underestimate software. I think the only way a company is going to start competing is by being software first. Make the software so good and easy to use that every one wants to use it. Only then is the hardware going to compete.
Re: IBM analog AI chip could give the Nvidia H100 a run for its money
#40Considering IBM likely isn't going to crater in stock like some riskier bet might, and even if it's just to benefit from initial hype, I don't see a negative in moving chips I have laying around to big blue even though I very rarely do trades nowadays.