Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic is expanding to Colossus2. Will use GB200

twitter.com

Post reply on HN
Print view View original

341–350 of 367 posts

Re: Anthropic is expanding to Colossus2. Will use GB200

#341

Post by ctoa »

jpadkins wrote: post #302
skywhopper wrote: post #164

Earlier quoted context omitted.

He believes in the value of the idea of “space compute” for attracting investors to SpaceX. But the existence of the idea of “space compute” as a better way to deploy datacenters (along with everything else Musk has claimed in the past decade) should give everyone pause as to the plausibility of literally everything else he says.

> along with everything else Musk has claimed in the past decade * mass produced EVs * Neural links to brain * reusable rockets * more efficient tunnel digging Dude has a pretty good record of taking stuff in R&D and making pretty real products and/or companies. Can you name someone better?

Mass produced EVs and reusable rockets are already decade old accomplishments. His track record this last decade of accomplishing things he proposes is noticeably much worse.

Neuralink is just another medical device company right now. The things it is succeeding at aren't the crazy sci-fi Elon "telepathy" vision at all, and there are other BCI companies.

Boring Company is quite stagnant and I would say what they achieved is very underwhelming. The original framing was that it would revolutionize the costs of subway and high speed rail tunnels and it has not achieved that at all. The things it currently does are nothing like the vision Musk was selling in 2017, much of the original concept was shelved.

Robotaxi is wildly off schedule and his timelines that he puts out for it have been non-stop over optimistic and wrong. This may catch up eventually, but it's currently not at the point that Musk was already claiming it was at 10 years ago.

I'd list as another big flop of the last 10 years the Tesla Solar Roof.

Also, I think by far the biggest Musk reality mismatch is the story he pushes regarding Optimus vs what anyone has actually seen of that product. That mismatch is absolutely wild. Anyone who believes the things he says about timelines for it needs to get a grip.

Re: Anthropic is expanding to Colossus2. Will use GB200

#342

Post by overfeed »

seydor wrote: post #107
tristanj wrote: post #62

Earlier quoted context omitted.

1) The situation you described would be covered under the contract between Anthropic and xAI, and that any violation of that would be subject to financial penalties and legal proceedings. The US has a robust corporate legal system, and disputes do get resolved through the court system, although in a slow and costly manner. The contract can stipulate a penalty at a high enough amount to discourage this behavior. 2) Ou…

I guess there's a reason why those Chinese companies are in china

Under US law, LLM outputs are not under copyright. Even if those companies were under the American jurisdiction[1], the worst thing they would be guilty of is a breach of ToS.

1. OpenRouter is based in New York, and offers a 1% discount when users enable logging of their inputs/outputs; it doesn't take a genius to figure out why they might incentivize that

Re: Anthropic is expanding to Colossus2. Will use GB200

#343

Post by ncr100 »

virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

Could they also, if they owned a 10,300 vehicle fleet of orbiting satellites, add radar or optical surveillance to each, and track every human on planet early in real time?

Re: Anthropic is expanding to Colossus2. Will use GB200

#344

Post by fragmede »

ncr100 wrote: post #343
virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

Could they also, if they owned a 10,300 vehicle fleet of orbiting satellites, add radar or optical surveillance to each, and track every human on planet early in real time?

Why would they need to do that, when the majority of those humans are already carrying a radio transceiver with them at all times.

Re: Anthropic is expanding to Colossus2. Will use GB200

#345

Post by 47282847 »

rafram wrote: post #252
47282847 wrote: post #190

Earlier quoted context omitted.

> The US has a robust corporate legal system Thanks for the chuckle. ;)

It does, though.

Yeah. Well.

I guess as a European I want the legal system to be robust in terms of protecting the citizen’s interests against corporations. I can see how you can also want robustness in terms of protecting corporate interests against citizens, so, yes, the statement remains technically true in terms of robustness.

In terms of justice, again as a European, I think of Justitia, the Roman Godess, who judges based on “ideals of truth, fairness, honesty and justice“, “applied without regard to wealth, power, or other status”, evaluating “the goodness of the heart”. I don’t see these values represented much in the US so-called “justice” system.

Both aspects sufficiently documented for example over and over again in Matt Levine’s financial reporting.

Re: Anthropic is expanding to Colossus2. Will use GB200

#346

Post by beAbU »

weirdmantis69 wrote: post #309
beAbU wrote: post #297

Earlier quoted context omitted.

The starlink satellites have hall effect thrusters, and presumably beefy laser and radio comms systems that will account for a lot of the energy budget. Also, they are sometimes in the earth's shadow, a naive calculation says they have 2x the solar budget they need, in order to charge up batteries for shade-time operations. There is no where near 20kw of compute in a single satellite, and thus no where near 20kw of h…

The terrestrial based systems getting protested, blocked, and demonized everywhere? Those ones?

Plop these satellites on a massive barge in the middle of the ocean with 2x the solar and battery capacity to (to account for day/night cycles) and you have exactly the same solution, only it's multiple orders of magnitude easier to "launch", service and you can actually recycle the deprecated hardware. It will also solve the cooling problem that's associated with space.

The fact that elon's colossus data centre needs to burn jet fuel on site for power tells you everything you need to know about the viability of a solar powered space based solution.

Re: Anthropic is expanding to Colossus2. Will use GB200

#347

Post by beAbU »

wongarsu wrote: post #306
beAbU wrote: post #297

Earlier quoted context omitted.

The starlink satellites have hall effect thrusters, and presumably beefy laser and radio comms systems that will account for a lot of the energy budget. Also, they are sometimes in the earth's shadow, a naive calculation says they have 2x the solar budget they need, in order to charge up batteries for shade-time operations. There is no where near 20kw of compute in a single satellite, and thus no where near 20kw of h…

The assumption behind "spread the heat over the size of the satellite" is radiative cooling. Admittedly my numbers were a bit off, you need to make the satellite a bit bigger, or use some of your solar panels. A starlink v2 mini has 8m² of area per side, so 16m² total. To dissipate 20kW to space, at a surface temperature of 80°C and emissivity of 0.85, you need about 28m² of space. So you need to increase size a bit,…

I think you and I are coming to the same conclusion. It's totally viable to have 20kw of compute in a satellite in space. Hell, you can probably get away with 100kW or more with some sort of megasatellite.

I'm pretty sure we'll see this within the next 5 years.

But deploying a megawatt scale DC in space? And then doing that multiple times a year?? I can't see how this is the only solution to this problem. I can't see how that will be the de-facto way of deploying DCs. Not for the next 100 years or more.

Re: Anthropic is expanding to Colossus2. Will use GB200

#348

Post by bvcp »

_heimdall wrote: post #206
bvcp wrote: post #167

Earlier quoted context omitted.

this is why ai in space will win

The physics of data centers in space will be extremely difficult and expensive to pull off in any meaningful timeline. I fully expect "space AI" to be about as realistic as the flying cars and hover boards we've been promised since televisions were black and white.

its only a expensive to viable alternatives, is there a viable alternative for 1 terrawatt of compute on earth? how could you get approvals for such a project

Re: Anthropic is expanding to Colossus2. Will use GB200

#349

Post by kibibu »

einsteinx2 wrote: post #310
kibibu wrote: post #81

Earlier quoted context omitted.

Grok is also tuned to align with Musk's personal beliefs. I wouldn't touch it with a 10 foot pole.

I keep hearing this statement, and it always makes me wonder if people have actually used Grok… I have a Claude Max plan I use for coding, but I also have a Grok Lite plan I use for web search type tasks (similar to Perplexity) because I like how the Grok harness handles searches and I don’t need a SOTA model for that use case. I’d never pay $30/mo for a full SuperGrok account but to me it’s worth the $10/mo for Lite…

Did you miss all the Mechahitler, woke mind virus, white genocide, Musk could beat Tyson, stuff?

Its plausibly not in the API and only on the twitter bot, but I see no reason to trust x.ai given this history of obvious manipulation.

Re: Anthropic is expanding to Colossus2. Will use GB200

#350

Post by pona-a »

aurareturn wrote: post #176
Lucasoato wrote: post #175

Ok, maybe this question is a bit silly, but could it possibly be that Elon is doing this to steal Anthropic models secrets and using them to improve Grok?

No. Model weights are encrypted. Elon is doing this because Anthropic is desperate for compute, SpaceX needs to juice up its balance sheet before IPO, and xAI model team isn't competitive.

Homomorphic encryption doesn't exit at any meaningful scale. The weights must still be stored plain in the RAM for inference to work
Post reply on HN