51–60 of 91 posts
Earlier quoted context omitted.
take 3 ideas that are hot: chiplets, cloud, and LLM - remix them into the title of a paper that describes a hypothetical machine.. academia playing catch up and trying to stay relevant in my cynical eye.
Using ChatGPT
Earlier quoted context omitted.
it's already beyond my comprehension, i've not lived very long but in the time i have i've never seen any technology develop so rapidly and at such a rapidly increasing pace. I assume this is what it must have felt like during the dawn of the age of computing.
It makes you wonder if those singularity proponents don't have a point, and it all depends on whether it keeps accelerating or whether it will slow down again. I hope for the latter and I fear for the former. Even if it does slow down eventually a long enough period of such change is going to make the industrial revolution (whose negative effects we are still coming to terms with today!) like a walk in the park.
Earlier quoted context omitted.
It makes you wonder if those singularity proponents don't have a point, and it all depends on whether it keeps accelerating or whether it will slow down again. I hope for the latter and I fear for the former. Even if it does slow down eventually a long enough period of such change is going to make the industrial revolution (whose negative effects we are still coming to terms with today!) like a walk in the park.
Reality is biased towards the fast-moving scenario, so long as we aren’t running into the bounds of physics, which as far as I can tell we’re not. Kurzweil was much more right than he was wrong. The opposite is true of people who strongly disagreed with him and called him a quack.
Earlier quoted context omitted.
it's already beyond my comprehension, i've not lived very long but in the time i have i've never seen any technology develop so rapidly and at such a rapidly increasing pace. I assume this is what it must have felt like during the dawn of the age of computing.
It makes you wonder if those singularity proponents don't have a point, and it all depends on whether it keeps accelerating or whether it will slow down again. I hope for the latter and I fear for the former. Even if it does slow down eventually a long enough period of such change is going to make the industrial revolution (whose negative effects we are still coming to terms with today!) like a walk in the park.
Can anyone share how much SRAM their proposed ASIC actually has? I skimmed the paper but that number didn't jump out to me.
Earlier quoted context omitted.
Reality is biased towards the fast-moving scenario, so long as we aren’t running into the bounds of physics, which as far as I can tell we’re not. Kurzweil was much more right than he was wrong. The opposite is true of people who strongly disagreed with him and called him a quack.
The transhumanist movement has more than its fair share of quacks, but I think Kurzweil is enough of a scientist to take his arguments a bit more serious. That said, I'm getting pretty tired of all the mind uploading, eternal life and other afterlife nonsense. That to me is just religion in a new jacket.
The key point: A key architectural feature to achieve this is the ability to fit all model parameters inside the on-chip SRAMs of the chiplets to eliminate bandwidth limitations. Doing so is non-trivial as the amount of memory required is very large and growing for modern LLMs ... On-chip memories such as SRAM have better read latency and read/write energy than external memories such as DDR or HBM but require more si…
Earlier quoted context omitted.
It makes you wonder if those singularity proponents don't have a point, and it all depends on whether it keeps accelerating or whether it will slow down again. I hope for the latter and I fear for the former. Even if it does slow down eventually a long enough period of such change is going to make the industrial revolution (whose negative effects we are still coming to terms with today!) like a walk in the park.
A so-called singularity would require accelerated development for many more technological spheres, not just semiconductor fabrication, and related information computation and AI advances. Logistics, supply chains, mining, farming, manufacturing, energy, biotechnology. While the former may continue to accelerate development in the latter categories, the scale of such impact is purely speculative. I don't believe the a…
AI cannot safely and cheaply be used to drive trucks. But as soon as it can with one truck, it can with millions of trucks. All at once.
AI and robots haven’t advanced enough to replace construction workers for fluid, dexterous tasks, but as soon as they do, robots can replace millions of construction workers and surpass them in sophistication and speed.
This will happen in our lifetime, and the change will be extremely transformative.
They claim the investment will be justified for a 1.5 year life span of the system. But LLMs are changing and improving at a much faster speed that 1.5 years feels like centuries!
"Moving fast" may take on a whole new meaning and I'd put money on the rate of iteration soon being beyond the vast majority's comprehension (myself included).