Live data from Hacker News

An Upgrade to SyntaxNet, New Models and a Parsing Competition

research.googleblog.com

21–30 of 93 posts

Re: An Upgrade to SyntaxNet, New Models and a Parsing Competition

#22

I've been fighting Tensorflow in the last couple of days to try an application on it, never before have I seen such a convoluted build process and a maze of dependencies. The best manual on getting tensorflow with CUDA support up and running is here: http://www.nvidia.com/object/gpu-accelerated-applications-te... But it is a little bit out of date when it comes to version numbers. If you're going to try TensorBox ( h…

Plug for Mathematica, which after its installed you can do deep learning on in one or two lines, with GPU support on all three platforms with no setup. Very concise. Getting fairly competitive in features with other high level declarative frameworks as of 11.1 (which was just released today). Very nice visualizations thanks to being in Mathematica. The language is of course closed source, paid software. Many universities have site licenses, so there is a large built-in audience who can use it in courses etc 'for free', home licenses are comparable to photoshop or whatever.

See http://reference.wolfram.com/language/guide/NeuralNetworks.h..., also look at Examples > Applications under http://reference.wolfram.com/language/ref/NetTrain.html for some worked examples. Fun example of live visualization during training (very easy to do, will get even easier in future versions): https://twitter.com/taliesinb/status/839013689613254656

Re: An Upgrade to SyntaxNet, New Models and a Parsing Competition

#23

See also: spaCy, which is an open-source NLP framework that has some integration with Keras as well: https://news.ycombinator.com/item?id=13874787 ...and apparently will release a major version update today . Ouch.

Why ouch? :). It's not like there's a zero-sum game here. It's great to see more things being released, so the ecosystem can continue to improve.

I do wish SyntaxNet were a bit easier to use. A lot of people have asked for SyntaxNet as a backend for spaCy, and I'd love to be using it in a training ensemble. When I tried this last year, I had a lot of trouble getting it to work as a library. I spent days trying to pass it text in memory from Python, and it seemed like I would have to write a new C++ tensorflow op. Has anyone gotten this to work yet?

Re: An Upgrade to SyntaxNet, New Models and a Parsing Competition

#24

I've been fighting Tensorflow in the last couple of days to try an application on it, never before have I seen such a convoluted build process and a maze of dependencies. The best manual on getting tensorflow with CUDA support up and running is here: http://www.nvidia.com/object/gpu-accelerated-applications-te... But it is a little bit out of date when it comes to version numbers. If you're going to try TensorBox ( h…

sudo pip install tensorflow works fine as of the recent v1.0, and works out of the box for CPU training.

The annoying thing for GPU training is handling the cudNN dependency, which Google's guides are annoyingly lacking.

Re: An Upgrade to SyntaxNet, New Models and a Parsing Competition

#25

Hoping this will quickly make into someone's home grown self-hosted version of Alexa. Alexa, turn the lights on in the kitchen. Alexa, turn on the kitchen light. Alexa, light up the kitchen. Should all accomplish the same task using this framework.

I've been slowly working on my own simple home "Alexa" using mostly CMUSphinx for the voice detection. Honestly my most successful methods involved the least amount of complex NLP. Just simply treating the sentence as a bag of words and looking for "on" or "off" or "change" (and their synonyms) and the presence of known smart objects works extremely well. I could say "Hey Marvin, turn on the lights and TV", or "Hey M…

> I've got the project on hold for now because I can't find a decent, non-commercial way of converting voice to text. I'd really rather not send my audio out to Amazon/Google/MS/IBM

Same concern here... so my voice->text method is via android's google voice - forced to offline mode. The offline mode is surprisingly good.

Re mis triggers... I also have opencv running on the same android. It only activates the voice recognition when I am actually looking directly at the android device (an old phone).

Re: An Upgrade to SyntaxNet, New Models and a Parsing Competition

#26

Given how many areas NLP can be applied to, I can only imagine all of these future internal project proposals where someone has to explain to some C-suite exec how they are going to revolutionize the business with Parsey McParseface. Or better yet, when they have to budget a big upgrade to the "DRAGNN based ParseySaurus". Fun times ahead.

Sounds like a way to troll other organizations and competitors, imagine the conversations:

-(Eng) We need to switch to this new NLP framework

- (VP) Ok, why? Which one is it?

- (Eng) Huh, it's called Parsey McParseface, developed by ...

- (VP) WTF? Don't waste my time with jokes, go build your own

- (Eng) But ...

- (VP) Meeting's over.

Re: An Upgrade to SyntaxNet, New Models and a Parsing Competition

#27

I've been fighting Tensorflow in the last couple of days to try an application on it, never before have I seen such a convoluted build process and a maze of dependencies. The best manual on getting tensorflow with CUDA support up and running is here: http://www.nvidia.com/object/gpu-accelerated-applications-te... But it is a little bit out of date when it comes to version numbers. If you're going to try TensorBox ( h…

Agreed it's more hassle than it should be, especially if building from source. However the main installation hassle is CUDA and CuDNN I think, not Tensorflow itself

Re: An Upgrade to SyntaxNet, New Models and a Parsing Competition

#28

I've been fighting Tensorflow in the last couple of days to try an application on it, never before have I seen such a convoluted build process and a maze of dependencies. The best manual on getting tensorflow with CUDA support up and running is here: http://www.nvidia.com/object/gpu-accelerated-applications-te... But it is a little bit out of date when it comes to version numbers. If you're going to try TensorBox ( h…

sudo pip install tensorflow works fine as of the recent v1.0, and works out of the box for CPU training. The annoying thing for GPU training is handling the cudNN dependency, which Google's guides are annoyingly lacking.

> The annoying thing for GPU training is handling the cudNN dependency, which Google's guides are annoyingly lacking.

I've found a nice workaround for that one that does not require registration with nvidia so you can automate it:

    ML_REPO_PKG=nvidia-machine-learning-repo-ubuntu1404_4.0-2_amd64.deb
    wget http://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1404/x86_64/${ML_REPO_PKG} -O /tmp/${ML_REPO_PKG}
    sudo dpkg -i /tmp/${ML_REPO_PKG}
    rm -f /tmp/${ML_REPO_PKG}
    CUDA_REPO_PKG=cuda-repo-ubuntu1404_7.5-18_amd64.deb
    wget http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1404/x86_64/${CUDA_REPO_PKG} -O /tmp/${CUDA_REPO_PKG}
    sudo dpkg -i /tmp/${CUDA_REPO_PKG}
    rm -f /tmp/${CUDA_REPO_PKG}
    apt-get update
    apt-get install libcudnn5-dev
    apt-get install libcudnn5

Re: An Upgrade to SyntaxNet, New Models and a Parsing Competition

#29

See also: spaCy, which is an open-source NLP framework that has some integration with Keras as well: https://news.ycombinator.com/item?id=13874787 ...and apparently will release a major version update today . Ouch.

spaCy is great, and I find it much easier to use than Tensorflow for NLP. Looking forward to the new release today

Re: An Upgrade to SyntaxNet, New Models and a Parsing Competition

#30
post #19

I've been fighting Tensorflow in the last couple of days to try an application on it, never before have I seen such a convoluted build process and a maze of dependencies. The best manual on getting tensorflow with CUDA support up and running is here: http://www.nvidia.com/object/gpu-accelerated-applications-te... But it is a little bit out of date when it comes to version numbers. If you're going to try TensorBox ( h…

It is not a good idea to compile TensorFlow by your own unless you really need it (for example for TensorFlow serving). Python packages are the way to go.

I have to because I'm trying to use TensorBox which does not play well with the regular version of tensorflow that you can get pre-compiled.

See this issue:

https://github.com/TensorBox/TensorBox/issues/100

and

https://github.com/TensorBox/TensorBox/issues/102

So then we're full-circle and installing from pip which doesn't work :(

sigh.

Anyway, I'll get it to work, somehow.

Post reply on HN