Live data from Hacker News

Introducing Google Cloud Natural Language API, Speech API and New Data Center

cloudplatform.googleblog.com

21–30 of 51 posts

Re: Introducing Google Cloud Natural Language API, Speech API and New Data Center

#21
post #18
post #11

Similar offering suite from Microsoft, https://www.microsoft.com/cognitive-services/

I wonder how they compare.

AFAICT, the MS offering looks pretty basic by comparison [0]. No named entity recognition or sentiment analysis.

[0] https://www.microsoft.com/cognitive-services/en-us/linguisti...

Re: Introducing Google Cloud Natural Language API, Speech API and New Data Center

#22

Accuracy still seems to leave a fair bit to be desired. For example, when parsing "Blue, Brown, Orange, Green and Red Lines were running normally" from this news article [1], "Blue" was interpreted as the color [2], "Brown" was interpreted as the Brown Bears football team [3], "Orange" was interpreted as the Orange Line Washington (not Chicago) Metro [4], "Green" was interpreted as "environmentally friendly" [5], and…

Hmm, which NLP request did you run it as?

It seemed to run better when I ran it through analyzeEntities: http://pastebin.com/raw/AfXvKAzw

Re: Introducing Google Cloud Natural Language API, Speech API and New Data Center

#23

Accuracy still seems to leave a fair bit to be desired. For example, when parsing "Blue, Brown, Orange, Green and Red Lines were running normally" from this news article [1], "Blue" was interpreted as the color [2], "Brown" was interpreted as the Brown Bears football team [3], "Orange" was interpreted as the Orange Line Washington (not Chicago) Metro [4], "Green" was interpreted as "environmentally friendly" [5], and…

Google Research PM here -- my team built the language understanding tech that powers the API. Thanks for checking it out!

You picked a really interesting, and really hard, sentence to use to test us with. It has a couple of interesting phenomena: a reduced conjunction ("Line" goes with each color to make a name, like "Blue Line" even though "Blue" and "Line" are far apart), and high ambiguity ("Green" could be the color, the environmental movement, the political party, one of several people, or lots of other things (https://en.wikipedia.org/wiki/Green_(disambiguation) ).

These are hard! So hard, in fact, that I'm reasonably sure that there's no system in existence that would get these ones right. (I hope I'm wrong, actually, I'd love to see approaches that can solve problems like this generally.)

Our systems are state-of-the-art, or in some cases better than any other published system. But language is really hard, and even the world's best systems are way worse than any human at understanding language. That's what makes working on this stuff so much fun and so challenging. It feels so easy for us as humans, but we just haven't figured out how to model all this so that the computers can do as well.

(I'm going to steal this sentence to use internally as a great "NLP is hard" example, thanks!)

Re: Introducing Google Cloud Natural Language API, Speech API and New Data Center

#24
post #22

Accuracy still seems to leave a fair bit to be desired. For example, when parsing "Blue, Brown, Orange, Green and Red Lines were running normally" from this news article [1], "Blue" was interpreted as the color [2], "Brown" was interpreted as the Brown Bears football team [3], "Orange" was interpreted as the Orange Line Washington (not Chicago) Metro [4], "Green" was interpreted as "environmentally friendly" [5], and…

Hmm, which NLP request did you run it as? It seemed to run better when I ran it through analyzeEntities: http://pastebin.com/raw/AfXvKAzw

It was in context - I pasted the whole text of the CBS Local article I linked to into the "Try it out!" text field on the product home page, and these were the entities it identified.

Re: Introducing Google Cloud Natural Language API, Speech API and New Data Center

#25
post #7

On the other side of the NLP spectrum, what players out there are involved in NLG (natural language generation)? I've seen Arria and a couple other small projects, but I'm just starting to investigate the space and haven't found a whole lot yet.

We are working on pre-processing text corpus to generate assumptions and presuppositions using NLG.

Our initial aim is to index the whole Wikipedia and have pre-generated NLG for all pages as additional info for better searches.

Right now we are using Lucene & Syntaxnet but I haven't found a good library for hierarchical clustering of text

Check us out at www.shoten.xyz

Re: Introducing Google Cloud Natural Language API, Speech API and New Data Center

#26
post #23

Accuracy still seems to leave a fair bit to be desired. For example, when parsing "Blue, Brown, Orange, Green and Red Lines were running normally" from this news article [1], "Blue" was interpreted as the color [2], "Brown" was interpreted as the Brown Bears football team [3], "Orange" was interpreted as the Orange Line Washington (not Chicago) Metro [4], "Green" was interpreted as "environmentally friendly" [5], and…

Google Research PM here -- my team built the language understanding tech that powers the API. Thanks for checking it out! You picked a really interesting, and really hard, sentence to use to test us with. It has a couple of interesting phenomena: a reduced conjunction ("Line" goes with each color to make a name, like "Blue Line" even though "Blue" and "Line" are far apart), and high ambiguity ("Green" could be the co…

>"Green" could be the color, the environmental movement, the political party, one of several people, or lots of other things

It says 'train line' right in that sentence. Where is the ambiguity?

even if it missed that why didn't any of the 'cta' , 'chicago' , 'train', 'run' or 'line' nudge it in the right direction. It seems to have identified 'cta' entity correctly but completely ignored that context for the next words in the sentence.

Re: Introducing Google Cloud Natural Language API, Speech API and New Data Center

#27
post #15

I'm curious to see whether clients actually want to move very large datasets through these APIs, or whether that's too costly. It strikes me that cloud services work best for data generated and managed in the same cloud...

I've been moving into the (google) cloud and one of the main benefits is that I no longer have to down- and (especially) upload the data I work with, but simply remote-control a pipeline with a much larger pipe.

I guess for data that is generated on site it's a net negative, but I'd guess almost all data has to go across the internet at some point and google is probably not the worst warehouse on that highway.

Re: Introducing Google Cloud Natural Language API, Speech API and New Data Center

#28
post #5
post #4

Earlier quoted context omitted.

Why would you need the Speech API if you already have a known-good transcript?

I'm sorry if I was unclear. If I used the Cloud Speech API to produce the transcript, is there another library/service/etc that would align it to the original audio again.

Speechmatics sells this product. My company, CastingWords, uses it to align our human produced transcripts, and make SRTs. It works well.

Re: Introducing Google Cloud Natural Language API, Speech API and New Data Center

#30
post #23

Earlier quoted context omitted.

Google Research PM here -- my team built the language understanding tech that powers the API. Thanks for checking it out! You picked a really interesting, and really hard, sentence to use to test us with. It has a couple of interesting phenomena: a reduced conjunction ("Line" goes with each color to make a name, like "Blue Line" even though "Blue" and "Line" are far apart), and high ambiguity ("Green" could be the co…

>"Green" could be the color, the environmental movement, the political party, one of several people, or lots of other things It says 'train line' right in that sentence. Where is the ambiguity? even if it missed that why didn't any of the 'cta' , 'chicago' , 'train', 'run' or 'line' nudge it in the right direction. It seems to have identified 'cta' entity correctly but completely ignored that context for the next wor…

It says 'train line' right in that sentence. Where is the ambiguity?

That's the thing -- in your (wetware) mind it says "train line." But the sentence itself it just says "line", which can mean a whole much of things.

Post reply on HN