Live data from Hacker News

Microsoft turns spoken English into spoken Mandarin – in the same voice

thenextweb.com

41–50 of 124 posts

Re: Microsoft turns spoken English into spoken Mandarin – in the same voice

#41
I was just pondering today why PCs have adopted spell checking as a standard feature but don't appear to use context techniques for word checking or grammar checking yet. Perhaps I'm just using the wrong apps?

The speaker says "to take in much more data" but it gets parsed by the speech-to-text as "to take it much more data" which is such an unlikely phrase I can't really work out why it's not auto-corrected.

The phrase provided doesn't appear to be in either Google's nor Bing's web indexes. Typing "to take i" in to either Google or Bing's search box produces a hit for "to take in" as the most likely match; and within milliseconds.

Similarly (and ironically) with "about one error out of" being parsed as "about one air out of".

That he goes on to say that they use statistical techniques and phrase analysis for the translation makes this sort of error all the more intriguing, why isn't that same statistical approach weeding out these sorts of errors.

Nonetheless an impressive demonstration.

Re: Microsoft turns spoken English into spoken Mandarin – in the same voice

#42
post #36

Earlier quoted context omitted.

I don't follow your logic... Without those different languages, you wouldn't have anything to translate in the first place. If anything, this type of technology promotes independent and different languages, as it makes it so much easier to communicate with others regardless of your native tongue. Also, bravo to Microsoft; I'll remove my jaw from the floor after I watch your video a second time.

different languages emerged because of physical separation. As barriers have been reduced because of technology (both physical and communication barriers) there really aren't "borders" anymore. I can call someone in China right now if I wanted to, something impossible to do even just 100 years ago. So if we can all talk to each other across the world in real time, and we can all understand each other because of this…

> what exactly is the point of different languages anymore?

True. This is why I will be teaching my children Basque and Basque only.

New languages might have originally emerged due to separation, but that doesn't mean lack of separation will cause already existing languages to go away.

Re: Microsoft turns spoken English into spoken Mandarin – in the same voice

#43
post #36

Earlier quoted context omitted.

I don't follow your logic... Without those different languages, you wouldn't have anything to translate in the first place. If anything, this type of technology promotes independent and different languages, as it makes it so much easier to communicate with others regardless of your native tongue. Also, bravo to Microsoft; I'll remove my jaw from the floor after I watch your video a second time.

different languages emerged because of physical separation. As barriers have been reduced because of technology (both physical and communication barriers) there really aren't "borders" anymore. I can call someone in China right now if I wanted to, something impossible to do even just 100 years ago. So if we can all talk to each other across the world in real time, and we can all understand each other because of this…

As a polyglot (English, several dialects of Chinese, Spanish, German, Russian), languages are still one of the most important tenets of culture and individualism.

Trying to understand or think like an American is a completely different experience from trying to think like a Chinese which, respectively, is completely different from thinking like a German. These modes of thinking not only make each culture/country/peoples unique, it actually facilitates various strengths.

Primarily, the Chinese language actually allows humans to remember and store more information in short term memory when compared to more Western/romantic languages. Most humans can store 7 (+- 2) bits of information (bits being defined as one contextual idea: 25 + 23 are 3 bits, Picasso's Mona Lisa is 1 bit).

The Chinese language actually facilitates math/short-term memory because many things are spoken/read/written as one contextual idea. When remembering a large number (602-112-5097 for example), English speakers tend to remember this number as: Area code = 1 contextual bits Each individual number = 7 contextual bits This happens because the English language separates non-related digits into individual ideas.

In Chinese however, masses of digits are written and spoken as one long contextual idea. Similarly, in memory, these long numbers are more easily stored as one contextual bit and take up "less" space.

Conversely, English (and to some degree romantic languages) happen to have lots of descriptors (what we call adjectives and adverbs). This, respectively, is one of the reasons why English speakers tend to be more creative with how they express themselves.

Does this mean that we'll eventually tend towards an universal language that implements all the good points of current languages? Perhaps.

Personally, I enjoy the uniqueness of each language by itself.

Re: Microsoft turns spoken English into spoken Mandarin – in the same voice

#44
post #31

Putting on my tinfoil hat here, if all it takes to build a speech model to impersonate someone's voice is an hour's worth of them talking... what happens when the wrong person gets that? For example, the government or a corporation (a internet phone service, maybe) uses to fabricate evidence of conversations that never really happened; could also be used to aid in identity theft

To indulge you just a little bit, I think it most likely result in an a rapid expansion of forensic industries. While I have no legitimate experience in signal processing, I imagine there would be ways to deduce whether or not such impersonations were credible to some degree. Whether or not that would stop tech-savvy marketers and con artists out of scamming grandma, I don't know. We'll have to wait and see what 21st century holds for future firewalls. Of course, if someone with any knowledge on the subject would like to step in and point out how stupid my response sounds to them, I'd be glad to become more informed!

Re: Microsoft turns spoken English into spoken Mandarin – in the same voice

#45
post #27

Of course, they cannot do Mandarin to English yet - that's 2.0 :-)

It's really unfortunate though because these languages are some of the hardest for someone like myself to navigate through. For instance I can look at "poulet et riz" and figure out its roughing something chicken. But "雞肉和米飯" means nothing to me.

But does "kurczak z kaszą" mean anything?

Re: Microsoft turns spoken English into spoken Mandarin – in the same voice

#46

Couldn't this be easily hacked together using google translate and a text to voice program?

I had the same idea, but it looks like Google translate needs a TON of work. For example:

English: "I hope you enjoy the rest of the presentations today" http://translate.google.com/#en/zh-TW/I%20hope%20you%20enjoy... Translated into Chinese: "I hope you enjoy rest (as in take a break)/resting introduction/presentation"

Bing translator is much better using the same English input: http://www.bing.com/translator, the Chinese that comes out is grammatically correct in Chinese. The reverse translation comes out correct as well.

But yes, seems that if the translator is good enough, it would be simple to reproduce the process from the video.

Re: Microsoft turns spoken English into spoken Mandarin – in the same voice

#47
post #7

Skip to 8 minutes to hear the actual translation. I'd love some comparison - that doesn't sound like the same voice to me (awfully close to the 'standard' computer voice, IMO), but some of it is crummy recording quality, and showing the flexibility would go a long way toward convincing me.

I agree that it doesn't really sound like him, but the voice is far better than most Chinese computer voices that I've heard and is totally understandable. Seems like my years of learning Chinese and living in China are about to become useless...

Thanks! The quality of the speaking is definitely not something I can judge, not knowing Chinese.

Are Chinese computer voices just flat-out worse than English ones, or is there something specific?

Re: Microsoft turns spoken English into spoken Mandarin – in the same voice

#48
post #36

Earlier quoted context omitted.

I don't follow your logic... Without those different languages, you wouldn't have anything to translate in the first place. If anything, this type of technology promotes independent and different languages, as it makes it so much easier to communicate with others regardless of your native tongue. Also, bravo to Microsoft; I'll remove my jaw from the floor after I watch your video a second time.

different languages emerged because of physical separation. As barriers have been reduced because of technology (both physical and communication barriers) there really aren't "borders" anymore. I can call someone in China right now if I wanted to, something impossible to do even just 100 years ago. So if we can all talk to each other across the world in real time, and we can all understand each other because of this…

> different languages emerged because of physical separation.

Not always.

http://en.wikipedia.org/wiki/Diglossia

http://en.wikipedia.org/wiki/Creole_language

http://en.wikipedia.org/wiki/Esperanto

http://en.wikipedia.org/wiki/Language_change

Re: Microsoft turns spoken English into spoken Mandarin – in the same voice

#49
post #27

Of course, they cannot do Mandarin to English yet - that's 2.0 :-)

It's really unfortunate though because these languages are some of the hardest for someone like myself to navigate through. For instance I can look at "poulet et riz" and figure out its roughing something chicken. But "雞肉和米飯" means nothing to me.

"poulet et riz" meant nothing to me until I read your post in chinese... [touche! =P]

雞肉和米飯 is a really odd way of saying chicken and rice... if you google the phrase, the search results don't come up as good as the way native speakers would expect:

google 雞肉和米飯: https://www.google.com/search?q=%E9%9B%9E%E8%82%89%E5%92%8C%...

google 雞肉飯 (the more normal way in chinese "chicken meat, rice"): https://www.google.com/search?q=%E9%9B%9E%E8%82%89%E9%A3%AF&...

google "poulet et riz" https://www.google.com/search?hl=en&tbo=d&rlz=1C1CHF...

Hmm... they are all chicken, but still pretty different from each other, especially if talking to a foodie!

Maybe give M$ another 15 years, but for now, the best way to learn a language is to do it through the social method.

Post reply on HN