Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic is expanding to Colossus2. Will use GB200

twitter.com

Post reply on HN
Print view View original

161–170 of 367 posts

Re: Anthropic is expanding to Colossus2. Will use GB200

#161

Post by oezi »

MagicMoonlight wrote: post #154
oezi wrote: post #137

Earlier quoted context omitted.

Yes, quite a bad reputation hit for Anthropic to get in bed with Musk. Tesla lost half its marketshare in Europe because Elon is meddling in our democracy, is promoting right wing populist parties and supporting Trump in general.

No, they’ve lost market share because they haven’t released a new product in years. Meanwhile China is releasing hundreds of excellent models into the European market which are better than Tesla’s.

That adds to it. But you are underestimating how much Europeans were/are shocked by Elon's Nazi salute and the DOGE fallout.

Re: Anthropic is expanding to Colossus2. Will use GB200

#162

Post by ruszki »

akimbostrawman wrote: post #139
kibibu wrote: post #81

Earlier quoted context omitted.

Grok is also tuned to align with Musk's personal beliefs. I wouldn't touch it with a 10 foot pole.

Opposed to all other models being the bastion of objectivity? Must be truly vindicating to have to hear other peoles opinions after decades in the silicon valley bubble.

There is a difference between when somebody openly instructs their model to infer disproven lies vs who doesn’t do this. And it’s quite tiring that this is even a question because of politics.

As somebody from Hungary: the biggest impact of my mood was that this kind of thinking went back with the collapse of far right there to where it belongs: to a deep hole which is not in front of normal people. Average people suddenly don’t ask illogical questions or answer stupid things because there is nobody who would tell them that they need to think stupidly, there is nobody who tell them what stupid thing they should think that week. It’s marvelous when you get the proof that the whole “stupid thinking” is completely controlled from above.

Re: Anthropic is expanding to Colossus2. Will use GB200

#163

Post by ZeroGravitas »

hvb2 wrote: post #113
HDThoreaun wrote: post #87

Earlier quoted context omitted.

I dont know, Id say the enraging thing is that the government is so incompetent and unable to expand electricity supply that datacenters are forced into using loopholes to get power the only way they can.

> Id say the enraging thing is that the government is so incompetent and unable to expand electricity supply So let's say you're a homebuilder, if I tell you I want a new home and I want to live there tomorrow, you can all of a sudden build it in a day, right? Electricity use is skyrocketing for various reasons, these datacenters being one of them. There are a lot of countries struggling to keep up with demand. So in…

In the early days of this the AI companies were asking for massive new energy supplies but also refusing to sign contracts to pay for it over the decades of its life.

They're basically attempting to game the system, politically and economically, to put as much of the cost on taxpayers and ratepayers as they can. This naturally slows things down.

Re: Anthropic is expanding to Colossus2. Will use GB200

#164

Post by skywhopper »

urams wrote: post #20

Very possible Elon is doing this to make give Anthropic better chances against OAI while he attempts to reshape xAI. Also possible he sees infra as the future of xAI if he really believes in the value of space compute. Hard to see this any of this as anything other than a bearish sign for Grok though.

He believes in the value of the idea of “space compute” for attracting investors to SpaceX. But the existence of the idea of “space compute” as a better way to deploy datacenters (along with everything else Musk has claimed in the past decade) should give everyone pause as to the plausibility of literally everything else he says.

Re: Anthropic is expanding to Colossus2. Will use GB200

#165

Post by shenberg »

tristanj wrote: post #89
urams wrote: post #20

Very possible Elon is doing this to make give Anthropic better chances against OAI while he attempts to reshape xAI. Also possible he sees infra as the future of xAI if he really believes in the value of space compute. Hard to see this any of this as anything other than a bearish sign for Grok though.

That's very doubtful given recent news that Colossus is running at 11% capacity and has hundreds of thousands of idle GPUs. xAI acquired too many GPUs and currently doesn't have enough customers to use them. That's why they are making compute deals with Anthropic and Cursor. xAI is bleeding money and this compute deal with Anthropic will pay for all of xAI's capex ($25 billion) in 2 years.

11% MFU does not mean 89% of GPUs are idle, it means that they're using the GPUs ineffectively.

Re: Anthropic is expanding to Colossus2. Will use GB200

#166

Post by skywhopper »

HDThoreaun wrote: post #87
hemul3n wrote: post #54

Earlier quoted context omitted.

I dug into this topic in some detail on my blog and it's both enraging and depressing. https://poiesic.com/posts/pattern-recognition

I dont know, Id say the enraging thing is that the government is so incompetent and unable to expand electricity supply that datacenters are forced into using loopholes to get power the only way they can.

These are the same companies and individuals who are actively working to destroy functional government, and are happily looting the US treasury rather than let it be spent on things such as encouraging more energy production.

Re: Anthropic is expanding to Colossus2. Will use GB200

#167

Post by bvcp »

gaze wrote: post #18

I think that's the datacenter with the gas turbine generators that operate without permits because they're "portable." Data centers have tremendous externalities but colossus is a particularly nasty offender, and not just due its size. Edit: They did it with Colossus and now they're doing the exact same thing with Colossus2. https://www.selc.org/news/xai-built-an-illegal-power-plant-t...

this is why ai in space will win

Re: Anthropic is expanding to Colossus2. Will use GB200

#168

Post by Traster »

virgildotcodes wrote: post #52

Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them…

It's already in the public domain (thanks to the OpenAI trial) that Grok distilled OpenAIs models. Listening to the data going into the models in the data centre would be very similar thing. There's some downsides (you're passively listening, not controlling the queries), and some upsides (way more data). But it only ever gets you to some percentage of the existing production model. It doesn't get you what Musk wants - an AI company capable of designing and deploying leading edge models. It gets you to fast follower status.

Re: Anthropic is expanding to Colossus2. Will use GB200

#169

Post by zenapollo »

usef- wrote: post #136
krige wrote: post #109

Earlier quoted context omitted.

The debunk is extremely sketchy on many points. https://www.bearlythinking.com/p/andy-masley-doesnt-understa...

That post is mentioned at the bottom of what I linked. He has a full post response here: https://blog.andymasley.com/p/to-be-clear-i-do-understand-ho...

How i know Masley is trash:

> Jordan is suspiciously lurching to the extremely high energy end of the light spectrum when we know that the low energy end (comparable to infrasound) doesn’t have negative impacts on us if we can’t detect its presence.

Masley spouts the falsifiable propaganda that any photon (light/emf) below ionizing radiation energy can only cause “heat” and can have no other possible harm effects.

Many science-minded people (though more accurately in this case, billiard-world materialists) have become quite militant defenders of this idea (ostensibly fighting off the hoardes of tinfoil hatters and quantum aquarians sensitive to 5g).

This point is very plausible military industrial propaganda. There were numerous studies with evidence (starting from the 60s) such as - non ionizing radiation (eg hv powerlines) might cause lots of cancer, and it’s weaponized (sub-thermal) usage can microwave the brains of enemy spies. THOSE studies have come out in declassified and leaked docs.

Now we have several plausible and serious theories of mechanism for low-f light disrupting biology that lean into quantum biology. While the iceberg of quantum biology understanding is still in its early decades, the mounting downstream evidence of health and medical issues are established public knowledge.

Re: Anthropic is expanding to Colossus2. Will use GB200

#170

Post by energy123 »

amazingamazing wrote: post #10

I don't see a scenario where it really makes sense to be a frontier lab long term. Eventually model quality will plateau then you distill and get 90% for 10% or less cost.

Plateau on a saturated benchmark where an asymptote to 100% is mathematically baked in?

Or plateau as in it won't solve any Millennium Prize problems within the next decade?

Post reply on HN