Live data from Hacker News

I made a talking emoji using regular emojis and JavaScript

hackernoon.com

11–20 of 63 posts

Re: I made a talking emoji using regular emojis and JavaScript

#11
> Instead iterating through every byte like ""[n]

Pedantic note: JS iterates through UTF-16 2-byte code units. It's that way for compatibility reasons (used to be UCS-2), but it's the worst of both worlds: not as good as UTF-8 for ASCII, can't do operations in O(1) time like UTF-32.

Re: I made a talking emoji using regular emojis and JavaScript

#13
post #8
post #3

I'm Deaf and read lips. Thanks for this extremely intriguing idea to use emoji to depict a talking person visually. You know, some animated films get it right. Sometimes I clearly see utterances like «Thank you!», «Okay», but more often not. Especially older animations don't care and just let the character move the mouth in very simplistic ways: «Babbabbabaa Baababba ba baaa.» Similarly for that emoji. It is moving t…

You could actually propose a whole set of Unicode characters that are making realistic-for-lip-reading movements.

That would be a rabbit hole though, if you consider that Unicode isn't English or even Indo-European centric.

*(just another rabbit hole actually, Unicode got plenty of them already)

Re: I made a talking emoji using regular emojis and JavaScript

#14
post #8

Earlier quoted context omitted.

You could actually propose a whole set of Unicode characters that are making realistic-for-lip-reading movements.

That would be a rabbit hole though, if you consider that Unicode isn't English or even Indo-European centric. *(just another rabbit hole actually, Unicode got plenty of them already)

No reason not to have one for each IPA character.

Re: I made a talking emoji using regular emojis and JavaScript

#15
post #8

Earlier quoted context omitted.

You could actually propose a whole set of Unicode characters that are making realistic-for-lip-reading movements.

That would be a rabbit hole though, if you consider that Unicode isn't English or even Indo-European centric. *(just another rabbit hole actually, Unicode got plenty of them already)

The entire IPA is available in unicode. You could treat those as ligatures with a special combinator character, which would work a lot like flags, skintones etc work. eg: [special begin character] + NEUTRAL FACE (U+1F610) + [IPA characters] + (special end character) = talking face! hurray!

"text engine developers hate him"

Re: I made a talking emoji using regular emojis and JavaScript

#16
post #11

> Instead iterating through every byte like ""[n] Pedantic note: JS iterates through UTF-16 2-byte code units. It's that way for compatibility reasons (used to be UCS-2), but it's the worst of both worlds: not as good as UTF-8 for ASCII, can't do operations in O(1) time like UTF-32.

Yeah and this means VSCode's language server protocol uses UTF-16 indices for positions too. Pain in the arse.

Re: I made a talking emoji using regular emojis and JavaScript

#17
post #3

I'm Deaf and read lips. Thanks for this extremely intriguing idea to use emoji to depict a talking person visually. You know, some animated films get it right. Sometimes I clearly see utterances like «Thank you!», «Okay», but more often not. Especially older animations don't care and just let the character move the mouth in very simplistic ways: «Babbabbabaa Baababba ba baaa.» Similarly for that emoji. It is moving t…

I always thought an interesting project would be to use facial recognition to detect key mouth shapes to make better gifs of people talking.

Re: I made a talking emoji using regular emojis and JavaScript

#18
post #8
post #3

I'm Deaf and read lips. Thanks for this extremely intriguing idea to use emoji to depict a talking person visually. You know, some animated films get it right. Sometimes I clearly see utterances like «Thank you!», «Okay», but more often not. Especially older animations don't care and just let the character move the mouth in very simplistic ways: «Babbabbabaa Baababba ba baaa.» Similarly for that emoji. It is moving t…

You could actually propose a whole set of Unicode characters that are making realistic-for-lip-reading movements.

Unicode is already a joke with arbitrary emojis added every other week without discipline...

Re: I made a talking emoji using regular emojis and JavaScript

#19
post #11

> Instead iterating through every byte like ""[n] Pedantic note: JS iterates through UTF-16 2-byte code units. It's that way for compatibility reasons (used to be UCS-2), but it's the worst of both worlds: not as good as UTF-8 for ASCII, can't do operations in O(1) time like UTF-32.

Calling it UTF-16 code units as distinct from UCS-2 is dubious. The water is very muddy there, because bad surrogates are allowed, thus the strings are arguably better considered UCS-2 rather than UTF-16.

See https://mathiasbynens.be/notes/javascript-encoding for a discussion of the topic.

I’m perpetually sad that a couple of big players decided to go all in on UCS-2/UTF-16 when it should already have been apparent that UTF-8 was roughly uniformly superior and that UCS-2/UTF-16 would have major issues. (I speak as one who was a child at the time, but has read a fair bit about the state of things back then. So don’t trust my yearning optimism.)

The worst part about UTF-16 is how it poisoned Unicode with surrogate pairs. UTF-32 and UTF-8 are both good because they didn’t need any special consideration from Unicode to make them work. But UTF-16, extending UCS-2 as it does… ugh.

Re: I made a talking emoji using regular emojis and JavaScript

#20
post #5
post #4

Earlier quoted context omitted.

Halfway through the article, he shows a picture with mouths for a-z, sh and th: https://cdn-images-1.medium.com/max/1600/0*gwbWfYm-iQIPEXXP%... There are others if you search images for "lip sync animation". It would be interesting to see if the result is understandable if you simply replace the emojis with those images.

Lipreading is different. For example the «sh» sound is made by slightly pursing the lips but not all speakers do this. In German it gives a very clear visual picture.

I would only purse my lips if I were performing a shush. In words like ‘hash’ I’d just close my mouth slightly & leave lips parted and wide from the ‘ha’ sound.

I agree that the mouth shapes are garbage in this demo. A shame because that is the most interesting & important part of animating speech.

Post reply on HN