New chips for machine intelligence

Edit: I didn't see the parent meant a hardware accelerator created by Amazon itself. Thx to @jsty and @paol for pointing this out. An ASIC by Amazon was announced last year and is known as 'AWS Inferentia'

https://aws.amazon.com/machine-learning/inferentia/

https://perspectives.mvdirona.com/2018/11/aws-inferentia-mac...

Re: New chips for machine intelligence

#5

Post by ckastner » Mon, Oct 07, 2019, 9:47 AM UTC

> Intel NNP-T TSMC 16FF+

Intel has stuff made by other foundries?

Re: New chips for machine intelligence

#6

Post by paol » Mon, Oct 07, 2019, 9:48 AM UTC

PeterStuer wrote: post #4

steve19 wrote: post #3

I am surprised Amazon has not jumped in the game, renting out an accelerator like Google does with the TPUs

You mean something not like EC2 Accelerated Computing Instances? https://aws.amazon.com/ec2/instance-types/#Accelerated_Compu... Edit: I didn't see the parent meant a hardware accelerator created by Amazon itself. Thx to @jsty and @paol for pointing this out. An ASIC by Amazon was announced last year and is known as 'AWS Inferentia' https://aws.amazon.com/machine-learning/inferentia/ https://perspectives.mvdirona.com…

Those are just regular GPUs (and one FPGA offering)

Re: New chips for machine intelligence

#7

Post by jsty » Mon, Oct 07, 2019, 9:49 AM UTC

PeterStuer wrote: post #4

steve19 wrote: post #3

I am surprised Amazon has not jumped in the game, renting out an accelerator like Google does with the TPUs

You mean something not like EC2 Accelerated Computing Instances? https://aws.amazon.com/ec2/instance-types/#Accelerated_Compu... Edit: I didn't see the parent meant a hardware accelerator created by Amazon itself. Thx to @jsty and @paol for pointing this out. An ASIC by Amazon was announced last year and is known as 'AWS Inferentia' https://aws.amazon.com/machine-learning/inferentia/ https://perspectives.mvdirona.com…

I think they were referring to the fact that those are all bought in from outside vendors, rather than having their own custom accelerator chips produced like e.g. Google's TPUs.

Re: New chips for machine intelligence

#8

Post by nl » Mon, Oct 07, 2019, 9:59 AM UTC

steve19 wrote: post #3

I am surprised Amazon has not jumped in the game, renting out an accelerator like Google does with the TPUs

They do, although inference (not training) so far. They have a custom chip call AWS Inferentia[0].

I believe it is available via Elastic Inference[1][2] (or maybe soon will be).

[0] https://aws.amazon.com/machine-learning/inferentia/

[1] https://docs.aws.amazon.com/elastic-inference/latest/develop...

[2] https://aws.amazon.com/machine-learning/elastic-inference/

Re: New chips for machine intelligence

#9

Post by [deleted] » Mon, Oct 07, 2019, 10:07 AM UTC

jsty wrote: post #7

PeterStuer wrote: post #4

Earlier quoted context omitted.

You mean something not like EC2 Accelerated Computing Instances? https://aws.amazon.com/ec2/instance-types/#Accelerated_Compu... Edit: I didn't see the parent meant a hardware accelerator created by Amazon itself. Thx to @jsty and @paol for pointing this out. An ASIC by Amazon was announced last year and is known as 'AWS Inferentia' https://aws.amazon.com/machine-learning/inferentia/ https://perspectives.mvdirona.com…

I think they were referring to the fact that those are all bought in from outside vendors, rather than having their own custom accelerator chips produced like e.g. Google's TPUs.

[deleted]

Re: New chips for machine intelligence

#10

Post by kingosticks » Mon, Oct 07, 2019, 10:16 AM UTC

ckastner wrote: post #5

> Intel NNP-T TSMC 16FF+ Intel has stuff made by other foundries?

Stuff they acquired. This is something originating from Nervana Systems and I think there are also some Altera chips out there. Intel's custom foundry offering has historically been poor so chances are anyone they buy will have been using someone else (why take the risk and change that).