Live data from Hacker News

TensorFlow – Consise Examples for Beginners

github.com

11–20 of 32 posts

Re: TensorFlow – Consise Examples for Beginners

#11

I find it so aggravating that nearly every last ML framework documents their CNN libraries in terms of canned MNIST datasets imported from the library in a preprocessed form. It's always left as a useless exercise for the reader to divine how to generate such a dataset from his/her own data. Examples should be way more general. The starting point shouldn't be: from tensorflow.examples.tutorials.mnist import input_dat…

The cifar_10 example code is a good starting point: https://github.com/tensorflow/tensorflow/tree/r0.8/tensorflo...

Read the how to on reading data from files: https://www.tensorflow.org/versions/r0.8/how_tos/reading_dat...

and check out this useful Stack Overflow answer: http://stackoverflow.com/questions/33648322/tensorflow-image...

Re: TensorFlow – Consise Examples for Beginners

#12
In the most compact way possible:

TensorFlow is like Numpy, only it is capable of working symbolically and can work more easily with your GPU in a highly parallel manner. For those two reasons, it is vastly superior to numpy for tasks like deep learning / machine learning.

Theano is another symbolic numerical library, coming before TensorFlow, though TensorFlow has seemingly gained more popularity and people have more general faith in it.

Re: TensorFlow – Consise Examples for Beginners

#13

I find it so aggravating that nearly every last ML framework documents their CNN libraries in terms of canned MNIST datasets imported from the library in a preprocessed form. It's always left as a useless exercise for the reader to divine how to generate such a dataset from his/her own data. Examples should be way more general. The starting point shouldn't be: from tensorflow.examples.tutorials.mnist import input_dat…

A few of the lessons on Udacity's Dada Science course cover finding/sifting through datasets and formatting them in a way to work with:

https://classroom.udacity.com/courses/ud359

Re: TensorFlow – Consise Examples for Beginners

#14

I find it so aggravating that nearly every last ML framework documents their CNN libraries in terms of canned MNIST datasets imported from the library in a preprocessed form. It's always left as a useless exercise for the reader to divine how to generate such a dataset from his/her own data. Examples should be way more general. The starting point shouldn't be: from tensorflow.examples.tutorials.mnist import input_dat…

That's typically going to be problem specific. A simple cat/dog tutorial would be reasonably easy with a lot of the already existing libraries like scikit-image/PIL.

The other problem here though is corpus layout. Image net and the academic datasets typically require special readers, but even then: for actual datasets there's a few ways to do the corpus layout. In our experience there are 2 things that have worked well have been: a folder per label or labels in the name.

Then there's still having balanced minibatches though. When you get to having balanced minibatches images segmented by folder means you don't get balanced minibatches out.

Then there's disk to think about, do I really want to re run the same pre processing every time I train? Then: how do I explain that to a beginner?

So I'm probably going to want to have a corpus generator where we end up with a pre saved/balanced minibatches for training..which leads us back to what you see now.

A good middle ground here might be a corpus generator that takes all the minor stuff like that in to consideration...but still data is messy.

I would suggest looking at the wealth of imaging libraries out there in python and building something based on a "from scratch" image corpus.

Minor plug: We thought about that a lot in building deeplearning4j. http://deeplearning4j.org/canova

You may not use java but the idea of "vectorization" is still a good one I think any ml practitioner who's touched pandas could appreciate. We built an abstraction called a datasetiterator which auto magically returns the batches for people so they don't have to think about the details but still having access to "real" data. I'm not sure what the python equivalent to this would be though.

Re: TensorFlow – Consise Examples for Beginners

#15

I find it so aggravating that nearly every last ML framework documents their CNN libraries in terms of canned MNIST datasets imported from the library in a preprocessed form. It's always left as a useless exercise for the reader to divine how to generate such a dataset from his/her own data. Examples should be way more general. The starting point shouldn't be: from tensorflow.examples.tutorials.mnist import input_dat…

The format for the dataset is here: http://yann.lecun.com/exdb/mnist/

A good exercise would be to figure out how to extract the data and put it into a numpy array. Then you can test on most - if not all - of the frameworks.

Re: TensorFlow – Consise Examples for Beginners

#16

I am looking for a TensorFlow resource that shows how to classify images of a certain kind. For example: given 100 images, find the ones that might contain a soccer ball. I haven't come across such a learning resource with TensorFlow. Has anyone else?

Why don't you just start with the CIFAR-10 example and go from there? https://www.tensorflow.org/versions/r0.8/tutorials/deep_cnn/...

Re: TensorFlow – Consise Examples for Beginners

#17

I find it so aggravating that nearly every last ML framework documents their CNN libraries in terms of canned MNIST datasets imported from the library in a preprocessed form. It's always left as a useless exercise for the reader to divine how to generate such a dataset from his/her own data. Examples should be way more general. The starting point shouldn't be: from tensorflow.examples.tutorials.mnist import input_dat…

A few of the lessons on Udacity's Dada Science course cover finding/sifting through datasets and formatting them in a way to work with: https://classroom.udacity.com/courses/ud359

"Dada Science"… fantastic!
Post reply on HN