Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Amazon launches Trainium3

techcrunch.com

Post reply on HN
Print view View original

21–30 of 75 posts

Re: Amazon launches Trainium3

#21

Post by cmiles8 »

teruakohatu wrote: post #18
cmiles8 wrote: post #16

Earlier quoted context omitted.

Well AWS says Anthropic uses it but Anthropic isn’t exactly jumping up and down telling everyone how awesome it is, which tells you everything you need to know. If Anthropic walked out on stage today and said how amazing it was and how they’re using it the announcement would have a lot more weight. Instead… crickets from Anthropic in the keynote

> Anthropic isn’t exactly jumping up and down telling everyone how awesome it is, which tells you everything you need to know. You can’t really read into that. They are unlikely to let their competitors know if they have a slight performance/$ edge by going with AWS tech.

With GCP announcing they built Gemini 3 on TPUs the opposite is true. Anthropic is under pressure to show they don’t need expensive GPUs. They’d be catching up at this point, not leaking some secret sauce. No reason for them to not boast on stage today unless there’s nothing to boast about.

Re: Amazon launches Trainium3

#22

Post by fishmicrowaver »

teruakohatu wrote: post #18
cmiles8 wrote: post #16

Earlier quoted context omitted.

Well AWS says Anthropic uses it but Anthropic isn’t exactly jumping up and down telling everyone how awesome it is, which tells you everything you need to know. If Anthropic walked out on stage today and said how amazing it was and how they’re using it the announcement would have a lot more weight. Instead… crickets from Anthropic in the keynote

> Anthropic isn’t exactly jumping up and down telling everyone how awesome it is, which tells you everything you need to know. You can’t really read into that. They are unlikely to let their competitors know if they have a slight performance/$ edge by going with AWS tech.

Striking a deal with a competitor (AZURE) does though.

Re: Amazon launches Trainium3

#23

Post by phamilton »

cmiles8 wrote: post #12

AWS keeps making grand statements about Trainium but not a single customer comes on stage to say how amazing it is. Everyone I talked to that tries it says there were too many headaches and they moved on. AWS pushes it hard but “more price performant” isn’t a benefit if it’s a major PITA to deploy and run relative to other options. Chips without a quality developer experience isn’t gonna work. Seems AWS is using this…

The inf1/inf2 spot instances are so unpopular that they cost less than the equivalent cpu instances. Exact same (or better) hardware but 10-20% cheaper.

We're not quite seeing that on the trn1 instances yet, so someone is using them.

Re: Amazon launches Trainium3

#24

Post by nextworddev »

ecshafer wrote: post #15
ZeroCool2u wrote: post #10

I've had to repeatedly tell our AWS account reps that we're not even a little interested in the Trainium or Inferentia instances unless they have a provably reliable track record of working with the standard libraries we have to use like Transformers and PyTorch. I know they claim they work, but that's only on their happy path with their very specific AMI's and the nightmare that is the neuron SDK. You try to do any…

IMO AWS once you get off the core services is full of beta services. S3, Dynamo, Lambda, ECS, etc are all solid. But there are a lot of services they have that have some big rough patches.

Kinesis is decent

Re: Amazon launches Trainium3

#25

Post by hnlmorg »

ecshafer wrote: post #15
ZeroCool2u wrote: post #10

I've had to repeatedly tell our AWS account reps that we're not even a little interested in the Trainium or Inferentia instances unless they have a provably reliable track record of working with the standard libraries we have to use like Transformers and PyTorch. I know they claim they work, but that's only on their happy path with their very specific AMI's and the nightmare that is the neuron SDK. You try to do any…

IMO AWS once you get off the core services is full of beta services. S3, Dynamo, Lambda, ECS, etc are all solid. But there are a lot of services they have that have some big rough patches.

This. 100 times this.

Re: Amazon launches Trainium3

#27

Post by cobolcomesback »

cmiles8 wrote: post #16
giancarlostoro wrote: post #14

Earlier quoted context omitted.

Not just AWS, looks like Anthropic uses it heavily as well. I assume they get plenty of handholding from Amazon though. I'm surprised any cloud provider does not invest drastically more into their SDK and tooling, nobody will use your cloud if they literally cannot.

Well AWS says Anthropic uses it but Anthropic isn’t exactly jumping up and down telling everyone how awesome it is, which tells you everything you need to know. If Anthropic walked out on stage today and said how amazing it was and how they’re using it the announcement would have a lot more weight. Instead… crickets from Anthropic in the keynote

AWS has built 20 data centers in Indiana full of half a million Trainium chips explicitly for Anthropic. Anthropic is using them heavily. The same press announcement that Anthropic has made about Google TPUs is the exact same one they made a year ago about Trainium. Hell, even in the Google TPU press release they explicitly mention how they are still using Trainium as well.

Re: Amazon launches Trainium3

#28

Post by cobolcomesback »

wmf wrote: post #6
aaa_aaa wrote: post #3

Interesting that in the article, they do not say what the chip actually does. Not even once.

Training. It's in the name.

Ironically these chips are being targeted at inference as well (the AWS CEO acknowledged the difficulties in naming things during the announcement).

Re: Amazon launches Trainium3

#30

Post by zdc1 »

nextworddev wrote: post #24
ecshafer wrote: post #15

Earlier quoted context omitted.

IMO AWS once you get off the core services is full of beta services. S3, Dynamo, Lambda, ECS, etc are all solid. But there are a lot of services they have that have some big rough patches.

Kinesis is decent

That's heartening to know. I find running Kafka less pleasant.
Post reply on HN