I was talking to someone about this the other day. I was part of a team at NASA that developed a cooling system for the ISS and this whole premise makes no sense to me. 1. Getting things to space is incredibly expensive 2. Ingress/egress are almost always a major bottleneck - how is bandwidth cheaper in space? 3. Chips must be “Rad-hard” - that is do more error correcting from ionizing radiation - there were entire t…
It sounds hard but it shouldn't not make sense. 1. Solving cost of launching mass has been the entire premise of SpaceX since day one and they have the track record. 2. Ingress/egress aren't at all bottlenecks for inferencing. The bytes you get before you max out a context window are trivial, especially after compression. If you're thinking about latency, chat latencies are already quite high and there's going to be…
That being said, this statement strikes me as missing the point:
> Solving cost of launching mass has been the entire premise of SpaceX since day one and they have the track record.
As I understand it, SpaceX has a good track record of putting things into space more cost effectively than other organisations that put things into space.
That is not the benchmark here.
It doesn't matter if Musk can run thousands of data centres in space more cost effectively than (for example) NASA could. It matters whether he can do it more cost effectively than running them on earth.