Live data from Hacker News

Developer Preview – EC2 Instances with Programmable Hardware

aws.amazon.com

121–130 of 212 posts

Re: Developer Preview – EC2 Instances with Programmable Hardware

#121
post #116

Earlier quoted context omitted.

You can't justify buying it but you can justify renting it? Has your department heard of amortization?

Most research finance departments are absolutely horrified at OpEx because any strange non-capital expenditure makes them look less efficient than the next research institute. This comes in handy when two labs are up for a grant, and they are equally qualified. The more efficient institute gets the grant. You can imagine asking for the lab credit card for EC2 time is not met with enthusiasm.

That's interesting. So, buying a lot of expensive, soon-to-be-obsolete hardware makes your lab more attractive?

Re: Developer Preview – EC2 Instances with Programmable Hardware

#122

Quick Question: If anyone wants to learn programming an FPGA is learning C only way to go ? how hard is to learn and program in verilog/VHDL without electrical background ? If anyone suggests links or books, please do Thank You

Honestly, when it comes to learning logic design, if you're not already a programmer you're probably better off.

A C programmer will just spend a lot of time learning why the things they already know how to do are not useful.

Re: Developer Preview – EC2 Instances with Programmable Hardware

#123

I'm a total FPGA n00b, so here's a dumb question: what can you do with this FPGA that you can't with a GPU? OK, here's a concrete question: I have a vector of 64 floats. I want to multiply it with a matrix of size 64xN, where N is on the order of 1 billion. How fast can I do this multiplication, and find the top K elements of the resulting N-dimensional array?

FGPA = Field Programmable Gate Array.

Basically, you can create a custom "CPU" for your particular workflow. Imagine the GPU didn't exist and you couldn't multiply vectors of floats in parallel on your CPU. You could use a FPGA to write something to multiply a vector of floats in parallel without developing a GPU. It would probably not be as fast as a GPU or the equivalent CPU, but it would be faster than doing it serially.

Another way to put it: you can create a GPU with a FPGA, but not vice versa.

Re: Developer Preview – EC2 Instances with Programmable Hardware

#125

Earlier quoted context omitted.

This was already a thing. Plenty of marketplaces exist for FPGA IPs. It's just not that well known because high end FGPAs run $7k+ and complex IP cores can be $20k+ for a license.

So if you were to get a cheap license via a service like this, do you get access to the VHDL or equivalent or could you extract it in some way?

there are "encrypted" hdls, but encrypted no more than dvd discs. Find a right irc channel and ask for keys

Re: Developer Preview – EC2 Instances with Programmable Hardware

#126
post #58

Earlier quoted context omitted.

This is very awesome. Could you add some more thoughts on the tooling and the development workflow? Is it possible to target the Xilinx hardware using only open source (or AWS proprietary) tools? Or is Vivado still required for advanced stuff?

Vivado is required for all advanced features and programming Xilinx chips in general; like the sibling post said, there is no open FPGA toolchain implementation for Xilinx devices, especially for extremely high end ones like the ones being offered on the F1 (I expect they'd run at like, several thousand USD per device, on top of a several thousand dollar Vivado license for all the features). It doesn't look like ther…

> I expect they'd run at like, several thousand USD per device...

You're guessing about an order of magnitude too low, actually. The VU9P FPGAs Amazon is using cost between $30,000 and $55,000 each, depending on the speed grade.

Yes, this means a fully equipped F1 instance costs nearly half a million dollars. Don't count on the instances being cheap to run.

Re: Developer Preview – EC2 Instances with Programmable Hardware

#127

Earlier quoted context omitted.

Yeah this is incredible for fpga users. There is now a market for freelance fpga developers

Yes this is cool if you're already using FPGAs and yeah, there will be a market for FPGA designers. But I also think this is FPGAs for the Rest of Us . Suddenly, FPGAs are available without having to buy some development board from Xilinx, install a toolchain, use said (shitty) toolchain ... Me, I was thinking of FPGAs as being something I'd use down the road a few years, eventually, etc. But instead, I'm looking at…

I would not count on these instances being useful for development.

The parts Amazon is using cost somewhere between $30K and $50K each. Hourly costs will be substantial -- it will likely be cheaper to buy an entry-level development board than to spin up an F1 instance every time you want to run your design.

Re: Developer Preview – EC2 Instances with Programmable Hardware

#128

> Xilinx UltraScale+ VU9P fabricated using a 16 nm process. > 64 GiB of ECC-protected memory on a 288-bit wide bus (four DDR4 channels). > Dedicated PCIe x16 interface to the CPU. Does anyone know whether this is likely to be a plug-in card? and can I buy one to plug in to a local machine for testing?

Even if it does, this can easily sell for $10k+.

Much more. The FPGA alone will push the parts cost to ~$30K-55K+.

Re: Developer Preview – EC2 Instances with Programmable Hardware

#129
post #2

If you don't click through to read about this: you can write an FPGA image in verilog/VHDL and upload it... and then run it. To me that seems like magic. HDK here: https://github.com/aws/aws-fpga (I work for AWS)

How do FPGAs compare with GPUs for the inference stage of Deep Learning algorithms? Can they accelerate it a lot?

Re: Developer Preview – EC2 Instances with Programmable Hardware

#130
post #68

Quick Question: If anyone wants to learn programming an FPGA is learning C only way to go ? how hard is to learn and program in verilog/VHDL without electrical background ? If anyone suggests links or books, please do Thank You

I would suggest Digital Design by Morris Mano[1]. It'll start off with basic intro from digital gates to FPGAs itself! And you really don't need any EE background for this book. This book starts from absolute basics and it'll also teach you Verilog along the way. And verilog is used more in the industry than VHDL(which more popular in Europe and in the US army for some reason). I'm surprised where you got the idea of…

220 new.

I am so glad I don't have to buy textbooks anymore.

Post reply on HN