Live data from Hacker News

Developer Preview – EC2 Instances with Programmable Hardware

aws.amazon.com

91–100 of 212 posts

Re: Developer Preview – EC2 Instances with Programmable Hardware

#91

I'd be interested in practical use cases that come to your mind (like someone who commented about genomics data processing for a university). What could YOU use this for professionally? (I certainly always wanted to play around with an FPGA for fun...)

Machine Learning, most likely. See this: https://news.ycombinator.com/item?id=13074021

Re: Developer Preview – EC2 Instances with Programmable Hardware

#92

Earlier quoted context omitted.

https://www.twitch.tv/p/rules-of-conduct "All content that is neither gaming-related nor permitted under the rules for Twitch Creative Conduct is prohibited from broadcast."

I've seen many people programming on Twitch https://www.twitch.tv/directory/game/Creative/programming While its mainly Game dev or game dev related its not limited to game dev stuff. From their FAQ https://help.twitch.tv/customer/portal/articles/2176641 Examples of what you can broadcast on Twitch Creative: ... Programming and coding Software and game development Web development EDIT: It seems that re:invent is being…

This is a product announcement, though

Re: Developer Preview – EC2 Instances with Programmable Hardware

#93
post #45

Earlier quoted context omitted.

That compression library offloads compression to a dedicated FPGA implementation of the compression algorithm, not a translated version of the same code that runs on the CPU. Approaches do exist to automatically translate some types of code to run on an FPGA, though.

Seems as though you could use a tracing jit approach to offload hot loops to an FPGA very generically. Though it'd have to be a really long-running loop to outweigh the substantial overhead in synthesizing the logic gates.

You can't just find hotspots; you have to find hotspots whose data set is sufficiently disjoint between the FPGA and the CPU. With the right architecture (such as Intel's Xeon+FPGA package), you can have an incredibly fast interconnect, but it's still not the speed of the CPU's register file, so you can't hand off data with that granularity. You can get more than enough bandwidth, but the latency would crater your performance. You want to stream larger amounts of data at a time, or let the FPGA directly access the data.

For instance, AES-NI accelerates encryption on a CPU by adding an instruction to process a step of the encryption algorithm. Compression or encryption offloading to an FPGA streams a buffer (or multiple buffers) to the FPGA. Entirely different approach. (GPU offloading has similar properties; you don't offload data to a GPU word-by-word either.)

But even if you find such hotspots, that still isn't the hardest part. You then have to generate an FPGA design that can beat optimized CPU code without hand generation. That's one of the holy grails of FPGA tool designers.

Right now, the state of the art there is writing code for a generic accelerator architecture (e.g. OpenCL, not C) and generating offloaded code with reasonable efficiency (beating the CPU, though not hitting the limits of the FPGA hardware).

Re: Developer Preview – EC2 Instances with Programmable Hardware

#94

Earlier quoted context omitted.

I've seen many people programming on Twitch https://www.twitch.tv/directory/game/Creative/programming While its mainly Game dev or game dev related its not limited to game dev stuff. From their FAQ https://help.twitch.tv/customer/portal/articles/2176641 Examples of what you can broadcast on Twitch Creative: ... Programming and coding Software and game development Web development EDIT: It seems that re:invent is being…

This is a product announcement, though

And Twitch have had TV Shows streamed on it in the past https://www.twitch.tv/whoismrrobot

My guess that was a sponsored deal or something. But as my edit from before it seems that re:invent is being streamed on Twitch anyway so guessing its all above board (and as others have said Amazon owns Twitch).

Re: Developer Preview – EC2 Instances with Programmable Hardware

#95
post #2

If you don't click through to read about this: you can write an FPGA image in verilog/VHDL and upload it... and then run it. To me that seems like magic. HDK here: https://github.com/aws/aws-fpga (I work for AWS)

I'm very curious if/how you have managed to make the developer experience sane and enjoyable. I've experience with a FPGA cluster of ~800 FPGAs and it definitely does not get used to its full potential because of the tooling around it.

Re: Developer Preview – EC2 Instances with Programmable Hardware

#96
post #70
post #2

If you don't click through to read about this: you can write an FPGA image in verilog/VHDL and upload it... and then run it. To me that seems like magic. HDK here: https://github.com/aws/aws-fpga (I work for AWS)

If you guys are curious about these announcements I'll be recapping them and going into more detail on twitch.tv/aws at 12:30 pacific

What's the cost?

Re: Developer Preview – EC2 Instances with Programmable Hardware

#97

Earlier quoted context omitted.

I guess the online distribution of FPGA configurations was an eventual event?

This was already a thing. Plenty of marketplaces exist for FPGA IPs. It's just not that well known because high end FGPAs run $7k+ and complex IP cores can be $20k+ for a license.

So if you were to get a cheap license via a service like this, do you get access to the VHDL or equivalent or could you extract it in some way?

Re: Developer Preview – EC2 Instances with Programmable Hardware

#98

Very interesting. I'd still like to see the JVM pick up the FPGA as a possible compile target, that way people could run apps that seamlessly used the FPGA where appropriate. I have mentioned this to Intel, who are promoting this technology (and also have a team that contributes to the JVM), but so far no one is stating publicly that they are working on such a thing.

An Intel VP mentioned it at JavaOne. He said they would provide FPGA support for OpenJDK. One central use case he mentioned would be big data & machine learning on Spark.

It was very pleasant surprise! The JVM world usually does not a have a great interface to the heterogenous world. I think it would yield tremendous benefits. FPGA-accelerated matrix multiplication, sorting, graph operations sound very appealing.

And then, as you mentioned, is the possibility of JITting things. http headers parsing ends up on the FPGA, and routes things to a message queue an actor can read. Or FPGA based actors; Does that make sense?

----

I have been unable to follow this development at all, however. Do you have any news about this project? I've been looking for a blog, a github or a mailing list, but can't find any.

Re: Developer Preview – EC2 Instances with Programmable Hardware

#99
post #13

Bitcoin mining. WPA2 brute forcing. Maybe someone will finally find the triple-des password used at adobe for password hashing. The possibilities are endless :)

Mining is unlikely, with bitcoin at least. Bitcoin passed the FPGA stage and moved onto ASICs many years ago. There are some alt coins that are currently best mined on GPUs though and this may change that or put their claims to a real test.

Re: Developer Preview – EC2 Instances with Programmable Hardware

#100
wow. that's what was going through my mind reading this article but it quickly dawned upon me (and sad) that I probably won't be able to build anything with it as we are not solving problems that require programmable hardware but euphoric nonetheless to see this kind of innovation coming from AWS.
Post reply on HN