Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

TensorFlow, Keras and deep learning, without a PhD

codelabs.developers.google.com

Post reply on HN
Print view View original

131–140 of 156 posts

Re: TensorFlow, Keras and deep learning, without a PhD

#131

Post by andrewprock »

citilife wrote: post #120
gas9S9zw3P9c wrote: post #31

As a researcher in the field I am not quite sure how I feel about these kind of resources. I am all for making research accessible to a wider audience and I believe that you don't need a PhD, or any degree, to do meaningful work. At the same time, the low barrier of entry and hype has resulted in a huge amount of people downloading Keras, copying a bunch of code, tuning a few parameters, and then putting their result…

I am one of those without a PhD, but have taken the time to the learn the math & contribute quite a bit to this area. That being said, I also don't think deep learning itself is not really a "science". The issue I have is you can't predict if a network will learn. We're effectively testing deep learning networks the same way the Romans used to test bridges. Send a bunch of elephants over them, if it holds it's good e…

The mathematics of neural networks is very well understood from a theoretical and scientific perspective. It is easy to say that a neural network will have predictive power given labelled training data.

Whether or not the predictions it is making satisfy unstated requirements is another problem altogether.

Re: TensorFlow, Keras and deep learning, without a PhD

#132

Post by apohn »

MrBuddyCasino wrote: post #41
gas9S9zw3P9c wrote: post #37

Earlier quoted context omitted.

Definitely. I came from a software engineering background into AI 6+ years ago, and I was lucky to be there at the right time. From purely a career perspective, leaving aside that this may be your life's passion, I believe that right now is the worst time to get started in AI. These is so much noise and competition but very few actual jobs or value created. It's just a research PR machine. Just as with Data Science,…

> Good backend/infrastructure/data engineers are so much harder to find these days, and these skills IMO provide much more value than doing some kind of modeling. After all these years of FOMO on AI, this is music to my ears.

I've been involved in a lot of Data Science projects, and the most successful ones are the ones where the Data Scientist either did or was part of the infrastructure and Data Engineering.

Most of the failed projects basically were "Hire a Data Scientist to make a magic model" and nothing else was supported. Basically, "Here's some data, do some magic." I read somewhere that 90% of data is low/zero value, and I'd agree with that.

There's absolutely a place for people doing pure statistical or ML/Deep Learning modeling. But the rest of the organization has to support them so they can have that narrow focus. A lot of places want to take a shortcut and not do the data work.

5 years ago the FOMO was from Hadoop. Hadoop Here, Hadoop there...people just forgot you have to actually collect a lot of high quality data to make Hadoop useful. It's AI now.

Re: TensorFlow, Keras and deep learning, without a PhD

#133

Post by [deleted] »

gas9S9zw3P9c wrote: post #31

As a researcher in the field I am not quite sure how I feel about these kind of resources. I am all for making research accessible to a wider audience and I believe that you don't need a PhD, or any degree, to do meaningful work. At the same time, the low barrier of entry and hype has resulted in a huge amount of people downloading Keras, copying a bunch of code, tuning a few parameters, and then putting their result…

[deleted]

Re: TensorFlow, Keras and deep learning, without a PhD

#135

Post by [deleted] »

andrewprock wrote: post #131
citilife wrote: post #120

Earlier quoted context omitted.

I am one of those without a PhD, but have taken the time to the learn the math & contribute quite a bit to this area. That being said, I also don't think deep learning itself is not really a "science". The issue I have is you can't predict if a network will learn. We're effectively testing deep learning networks the same way the Romans used to test bridges. Send a bunch of elephants over them, if it holds it's good e…

The mathematics of neural networks is very well understood from a theoretical and scientific perspective. It is easy to say that a neural network will have predictive power given labelled training data. Whether or not the predictions it is making satisfy unstated requirements is another problem altogether.

[deleted]

Re: TensorFlow, Keras and deep learning, without a PhD

#136

Post by historyremade »

Datenstrom wrote: post #91
gas9S9zw3P9c wrote: post #31

As a researcher in the field I am not quite sure how I feel about these kind of resources. I am all for making research accessible to a wider audience and I believe that you don't need a PhD, or any degree, to do meaningful work. At the same time, the low barrier of entry and hype has resulted in a huge amount of people downloading Keras, copying a bunch of code, tuning a few parameters, and then putting their result…

I have self taught this material and have been working professionally in the field for some years now. It was primarily driven by the need to solve problems for autonomous systems I was creating. When I am asked how to do it I give the progression I followed. First have preferably a CS background but at least Calc 1&2, Linear Algebra, and University statistics, then: 1. Read "Artificial Intelligence A Modern Approach…

Coursea is bullshit.

Re: TensorFlow, Keras and deep learning, without a PhD

#137

Post by abnry »

mumbisChungo wrote: post #99
gas9S9zw3P9c wrote: post #31

As a researcher in the field I am not quite sure how I feel about these kind of resources. I am all for making research accessible to a wider audience and I believe that you don't need a PhD, or any degree, to do meaningful work. At the same time, the low barrier of entry and hype has resulted in a huge amount of people downloading Keras, copying a bunch of code, tuning a few parameters, and then putting their result…

>At the same time, the low barrier of entry and hype has resulted in a huge amount of people downloading Keras, copying a bunch of code, tuning a few parameters, and then putting their result on arXiv so they can put AI research on their resume. This has resulted in so much noise and low quality work that it really hurts the field. This seems extremely short-sighted to me. If the barrier to entry (on an already relat…

I'm surprised anyone would default to trusting arXiv papers, or even browse new additions, without first checking up on the credentials and experience of the authors.

If the problem is finding new papers, then you really should be using sources other than arXiv.

Re: TensorFlow, Keras and deep learning, without a PhD

#138

Post by dang »

mpfundstein wrote: post #61
gas9S9zw3P9c wrote: post #31

As a researcher in the field I am not quite sure how I feel about these kind of resources. I am all for making research accessible to a wider audience and I believe that you don't need a PhD, or any degree, to do meaningful work. At the same time, the low barrier of entry and hype has resulted in a huge amount of people downloading Keras, copying a bunch of code, tuning a few parameters, and then putting their result…

by far thr worst part of Deep Learning research is the flood of crappy papers. i dont want to know how much time i wasted on reading through papers with math errors or trying to replicate results without success. and even if github code is available, i assure you. 95% of the time the code doesnt even work without major fixes. oh i hate it :-) so i started filtering. one pretty good filter is: only chinese authors fro…

If you keep posting nationalistic flamebait to HN we are going to have to ban you. This has been a problem already: https://news.ycombinator.com/item?id=23363011.

Re: TensorFlow, Keras and deep learning, without a PhD

#139

Post by amrrs »

echelon wrote: post #19
amrrs wrote: post #10

Earlier quoted context omitted.

This is an amazing side project. Would you share some details about how you've hosted them? Also, if possible about the training details like how long did it take for you train them? Did you do it on your local GPU or some cloud provider or free service like Colab?

Thanks! I'm pretty serious, so I've put some money into it. And even more time. I've got a 2x1080Ti setup I used locally back in the day, but it's really slow. I still train stuff on it, but only things I know will train successfully for a long time (eg the Melgan model). I use rented V100 GPUs to train the speaker models. They're quick and allow me to refine the datasets and parameters much more quickly than if I wa…

That's a lot of time. And lot of good information to know! Wish you good luck hopefully it does what you want!

Re: TensorFlow, Keras and deep learning, without a PhD

#140

Post by Razengan »

gas9S9zw3P9c wrote: post #31

As a researcher in the field I am not quite sure how I feel about these kind of resources. I am all for making research accessible to a wider audience and I believe that you don't need a PhD, or any degree, to do meaningful work. At the same time, the low barrier of entry and hype has resulted in a huge amount of people downloading Keras, copying a bunch of code, tuning a few parameters, and then putting their result…

> the low barrier of entry and hype has resulted in a huge amount of people downloading Keras, copying a bunch of code, tuning a few parameters, and then putting their result on arXiv so they can put AI research on their resume. This has resulted in so much noise and low quality work that it really hurts the field.

Then the problem isn't the low barrier and ease of use, it's with arXiv's filtering and how resumes are valued and verified.

Post reply on HN