Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Welcome to the New AWS AI Blog

aws.amazon.com

Post reply on HN
Print view View original

31–40 of 98 posts

Re: Welcome to the New AWS AI Blog

#31

Post by ionwake »

niklasrde wrote: post #11

We have recently set up a TensorFlow assessment function in AWS lambda, and got very close to the maximum allowed size of a lambda function (250MB) with the trained model currently being 85MB, and the TensorFlow libraries and binaries taking up another 140 or so megabytes by default ( I feel like Amazon could do some work in this area to support users to use their own engines and not be bound to AWS AI Platforms and…

I have wondered about use cases for tensorflow - can you give me an example of a simple one ?

Re: Welcome to the New AWS AI Blog

#32

Post by IanCal »

starik36 wrote: post #2

I am a complete noob to the AI space but I was wondering whether the following is possible (in AWS). I have a million scanned images of court documents. Some are briefs, some are motions, some are court orders, etc... Given that I have images and their types, could I "train" the AI with these million documents to recognize a new image that might come in?

People keep recommending things and approaches, but I'm really not clear on what it is you're actually trying to solve, so most of the responses might not help.

> Given that I have images and their types, could I "train" the AI with these million documents to recognize a new image that might come in?

Do I understand this right:

1. You have lots of documents as images, and their type (brief, motion, court order)

2. You get a new document, as an image.

3. You want to assign a type to this new document.

Is that right?

What's your goal in terms of quality? A key way of thinking about this is:

1. What's the risk/cost if you mis-classify a document?

2. What's the risk/cost if you fail to classify a document?

Are the documents typically very structurally different? Could I probably tell them apart without wearing glasses? Or are they largely the same, but with nuanced differences in the text?

Re: Welcome to the New AWS AI Blog

#33

Post by sorenvrist »

niklasrde wrote: post #11

We have recently set up a TensorFlow assessment function in AWS lambda, and got very close to the maximum allowed size of a lambda function (250MB) with the trained model currently being 85MB, and the TensorFlow libraries and binaries taking up another 140 or so megabytes by default ( I feel like Amazon could do some work in this area to support users to use their own engines and not be bound to AWS AI Platforms and…

Knowing nothing about assement and tensor flow: Could the trained model be downloaded via s3 at init instead of being included inside the function zip? I believe the memory limits are more lax than the actual function limits. And the /tmp limit is 512MB.

Re: Welcome to the New AWS AI Blog

#34

Post by kriro »

Rezo wrote: post #23
kriro wrote: post #3

How should I interpret their picture? Can I get an AMI with Keras preconfigured on a p2 instance? Because that would be pretty useful. I currently have a p2 instance (smallest possible one) that I spin up for training and the like.

Yes, the AWS Deep Learning AMI comes with MXNet, TensorFlow, Caffe, Theano, Torch, and Keras installed and ready to use: https://aws.amazon.com/blogs/ai/the-aws-deep-learning-ami-no...

Thanks, somehow never saw this. I guess this can replace the scripts from the "Practical Deep Learning" series for me then. I'll just use the vanilla Amazon Deep Learning AMI + a p2 instance :)

Quick Heads up in case anyone wants to do the same. The only European region that supports p2 at the moment is Ireland (I tried Frankfurt at first).

Re: Welcome to the New AWS AI Blog

#35

Post by alkhatib »

ge96 wrote: post #21
kiliankoe wrote: post #15

Earlier quoted context omitted.

The link to the RSS feed is right down at the bottom ;)

I did see that, but that RSS feed (atom?) I don't think I've ever used that in my life. I'll Google and see what/how to use it. I see it everywhere though. edit: I did see that they have a podcast, nice, something to listen to while I walk 2 hours in the middle of the night.

Try feedly.

Re: Welcome to the New AWS AI Blog

#36

Post by moeadham »

starik36 wrote: post #2

I am a complete noob to the AI space but I was wondering whether the following is possible (in AWS). I have a million scanned images of court documents. Some are briefs, some are motions, some are court orders, etc... Given that I have images and their types, could I "train" the AI with these million documents to recognize a new image that might come in?

We have a similar project we are working on, it might be interesting to collaborate based on your needs. Send me a message: contact - @ - omen.ai

Re: Welcome to the New AWS AI Blog

#37

Post by iaml »

bhaavan wrote: post #5
starik36 wrote: post #2

I am a complete noob to the AI space but I was wondering whether the following is possible (in AWS). I have a million scanned images of court documents. Some are briefs, some are motions, some are court orders, etc... Given that I have images and their types, could I "train" the AI with these million documents to recognize a new image that might come in?

Principally, yes. However, the approach may be more nuisanced than that. If I were you, I would first pick a character recognition engine (which might have already been well trained) to convert the image to text. Once the text is there, that might serve as a better feature to classify the content. Furthermore, I had recommend converting words in the text to word-embeddings/ vectors using a suitable Glove or Word2Vec…

I would argue that layout of the text on page could be a useful feature in this case.

Re: Welcome to the New AWS AI Blog

#38

Post by mark_l_watson »

Very impressive. I am working in a cognitive computing book, and I am going to add a chapter or appendix on Amazon AI. A little off topic, but even though I self-classify as a Google fan and very much enjoyed working there as a contractor, when a friend asked once which technology company impressed me more I said Amazon.

A big win for Amazon is that so many companies already have huge data sets in S3. Having AI APIs 'close to' existing data makes it easier getting started.

Post reply on HN