Are analog computers actually more energy efficient than a digital ASIC with similar accuracy (say 6-10 bits)?
We're building computers wrong [video]
11–20 of 83 posts
Re: We're building computers wrong [video]
#12I'm a bit worried for that analog-matrix-multiplication-for-AI company. I vaguely remember reading somewhere that the past half century is littered with companies whose value proposition was "our specialized thing does 10x better than digital transistors" and then they predictably just got steamrolled by Moore's law. And although Dennard scaling ended two decades ago, the flops-per-watt and flops-per-second of AI-specialized chips like TPUs has been improving substantially recently [1][2].
1: https://en.wikipedia.org/wiki/Tensor_Processing_Unit#Third_g...
Re: We're building computers wrong [video]
#13With a clickbaity title like that, I knew this would be Veritisium before I clicked it. And now, having verified that it is, I share this information with you.
Something about Veritasium absolutely rubs me the wrong way, and I generally like Youtube education creators, but his videos are borderline unwatchable for me. Does anyone have an explanation for what it is about his videos that is so grating?
Same, but it wasn't this unbearable in the beginning. I think it's partly me thinking there's no way he understands such wide ranging subjects at such great depths without significant research and prep for the video, which contradicts how casually and confidently he's presenting everything. I'm used to expecting a more scripted presentation in these cases, which it probably is, but it doesn't sound like it.
Re: We're building computers wrong [video]
#14With a clickbaity title like that, I knew this would be Veritisium before I clicked it. And now, having verified that it is, I share this information with you.
I'm subscribed to his channel, as he's covered some great science topics in the past. I skipped this video based on the title - it doesn't tell me anything about the content and "feels" more like a plea for the video to be watched than some good science broken down. I imagine that, over time, this may shift his target audience. But if a new audience is comprised of a demographic he's aiming to reach, and it gets him…
He updated the title. I watched it when he posted it, at that time it ended in “(for AI)”
I think he’s experimenting with clickbait.
Re: We're building computers wrong [video]
#15Earlier quoted context omitted.
Something about Veritasium absolutely rubs me the wrong way, and I generally like Youtube education creators, but his videos are borderline unwatchable for me. Does anyone have an explanation for what it is about his videos that is so grating?
I don't know how to articulate it either. It's some form of uncanny valley type of thing where every detail or facet or property I might point out, there are other people exhibiting the same nominal qualities without bothering me. But something here is just slightly off in some way, but so subtly you can't say what it is. I honestly can't say he's doing anything actually wrong. I don't think even the most dumbed down…
Its interesting you mention Destin from Smarter Every Day, because he always came off as a very earnest learner in his videos. Yeah, he's still putting on a show, but it does seem like he genuinely enjoys and revels in the things that he does. It seems to me like Veritasium has a more contrarian thread of: "Oh, you thought the world worked like that? Well you were wrong, and here's a 15 minute video all about how you were wrong." There's an Onion video making fun of Vox that touches on this perfectly: https://www.youtube.com/watch?v=RpkQEq75y18
I guess to summarize, with Destin it feels like you are learning with him and Veritasium feels like you are being lectured.
Re: We're building computers wrong [video]
#16Earlier quoted context omitted.
I'm subscribed to his channel, as he's covered some great science topics in the past. I skipped this video based on the title - it doesn't tell me anything about the content and "feels" more like a plea for the video to be watched than some good science broken down. I imagine that, over time, this may shift his target audience. But if a new audience is comprised of a demographic he's aiming to reach, and it gets him…
He updated the title. I watched it when he posted it, at that time it ended in “(for AI)” I think he’s experimenting with clickbait.
[deleted]
Re: We're building computers wrong [video]
#17Earlier quoted context omitted.
I'm subscribed to his channel, as he's covered some great science topics in the past. I skipped this video based on the title - it doesn't tell me anything about the content and "feels" more like a plea for the video to be watched than some good science broken down. I imagine that, over time, this may shift his target audience. But if a new audience is comprised of a demographic he's aiming to reach, and it gets him…
He updated the title. I watched it when he posted it, at that time it ended in “(for AI)” I think he’s experimenting with clickbait.
Committed to, actually. He made a video about how they were going to start doing it more: https://youtu.be/fHsa9DqmId8?t=1035. Also, more recently: https://www.youtube.com/watch?v=S2xHZPH5Sng.
Re: We're building computers wrong [video]
#18For a more realistic view on AI accelerators that doesn't overhype analog computing, I enjoyed the series by Adi Fuchs: https://medium.com/@adi.fu7/ai-accelerators-part-i-intro-822... At the end of the day, specialized hardware, particularly on the analog side (neuromorphic, optical, etc.) locks development into the path of highly uniform feedforward networks by optimizing large matrix multiplications, and it is uncl…
Neuromorphics aren't analog FWIW. They're just asynchronous.
Re: We're building computers wrong [video]
#19If you think about it, Mythic analog AI accelerators will also develop neurological 'disease' as it's flash cells wear out.
Re: We're building computers wrong [video]
#20Earlier quoted context omitted.
I don't know how to articulate it either. It's some form of uncanny valley type of thing where every detail or facet or property I might point out, there are other people exhibiting the same nominal qualities without bothering me. But something here is just slightly off in some way, but so subtly you can't say what it is. I honestly can't say he's doing anything actually wrong. I don't think even the most dumbed down…
Its interesting you mention Destin from Smarter Every Day, because he always came off as a very earnest learner in his videos. Yeah, he's still putting on a show, but it does seem like he genuinely enjoys and revels in the things that he does. It seems to me like Veritasium has a more contrarian thread of: "Oh, you thought the world worked like that? Well you were wrong, and here's a 15 minute video all about how you…
Hey, I also don't like chocolate all that much, and I seem to be some kind of inexplicable alien because of that. So, it's very possible "it's just me" that I don't like good things because curmudgeon. :)
I see the distinction you make there now that you point it out.