Live data from Hacker News

How a comment on Hacker News led to 4½ new Unicode characters

unicodepowersymbol.com

91–100 of 429 posts

Re: How a comment on Hacker News led to 4½ new Unicode characters

#91
post #78

Earlier quoted context omitted.

That is the surefire way to incorporate complexities from 2 different systems into 1.

Being able to easily check if a letter is between 'a' and 'z' in code is an advantage. This is only possible if the codepoints are sequential.

Is it? Couldn't Unicode have pointers or links, where a codepoint "exists" with no content and only links to another?

(I don't know anything about Unicode, so maybe it already has that.)

Re: How a comment on Hacker News led to 4½ new Unicode characters

#92
post #65

Earlier quoted context omitted.

It's not bad, but it's complicated, as it requires an O(n) algorithm to jump to a specific character. Unicode should have been capped at 16 bits, and doubling text files in size is fine. An alternate representation of simplified UTF-8 would have kept compatibility with old ASCII files.

Doubling text files is a waste for the most part, but what makes it tolerable is compression. Still 16 bits would not be enough, it's only 65536 different code pages, less than half of what is currently in Unicode. 24 bit is sufficiently out of allignment with modern hardware and algorithms, so 32 bit it is for efficiency. That is now 4 times the size, and compression is now a requirement. In any case, Utf8 has a pla…

> Still 16 bits would not be enough, it's only 65536 different code pages, less than half of what is currently in Unicode.

But that's only because Unicode has significantly ventured well beyond what we consider to be text. The BMP is enough to represent all text (including math).

Re: How a comment on Hacker News led to 4½ new Unicode characters

#93
post #38

As the story mentions regarding the off symbol (a circle), there are many visually identical code points that have different semantic meanings. But in this case, they added an additional semantic meaning to an existing code point. So which is it? Does each code point represent a visual image? A semantic meaning? Both? It depends? Something else? I've tried to decipher that on my own and only learned that the answer t…

"So which is it? Does each code point represent a visual image? A semantic meaning? Both? It depends? Something else?" Well the answer is clear: each code point represents one visual image, to which is associated one or more meanings.

Try looking up han-unification and its justification and you'll see the exact opposite approach to encoding characters into unicode.

For CJK characters, they unified all semantically similar han-characters, even when they have visual forms that are quite different between Japanese, Chinese and Korean.

If you want to write Japanese and Chinese in the same document, you need to mark up the section to tell the system that renders it, to render different visual forms for similar codepoints depending on whether they are used in Japanese or Chinese.

Re: How a comment on Hacker News led to 4½ new Unicode characters

#94
post #65

Earlier quoted context omitted.

Text files growing by 8x would be a non-starter. It would be nice to standardize on something but what do you have against UTF8?

It's not bad, but it's complicated, as it requires an O(n) algorithm to jump to a specific character. Unicode should have been capped at 16 bits, and doubling text files in size is fine. An alternate representation of simplified UTF-8 would have kept compatibility with old ASCII files.

ASCII is only 7 bit so UTF-8 is fully compatible, at least when compared to ISO 2022 and other similar horrors from the same era. Are you thinking of other encodings?

Re: How a comment on Hacker News led to 4½ new Unicode characters

#95
post #59

Earlier quoted context omitted.

The Unicode tables include examples for all graphical code points: http://unicode.org/charts/ . If you really wanted you can make them into a font (most of them seem to be vectorized), but since I'm guessing you see most of the added code points as useless why do you care if they show up as boxes? What harm is this stuff causing or going to cause to the standard? We have hundreds of thousands of unassigned code point…

But all mathematical symbols, except for styled math letters (which would have been equally well served by simply rendering them in italics or in a special math font), were already in the original 16-bit Unicode, as are any characters humans normally associate with "text" (all alphabets except for Egyptian hieroglyphics and other extinct alphabets). How useful is it to standardize hieroglyphics, ancient greek musical…

> How useful is it to standardize hieroglyphics, ancient greek musical notation, and emojis as standard text characters esp. without standardizing their screen representation?

In the same way it's useful to standardize letters in various alphabets without standardizing their screen representation. There is semantic content associated with each of these symbols that persists even if there is significant variation in how they are presented. Of the ones you list, emojis are the only ones where this is any more a problematic approach than it is for letters in various alphabets. And as people who don't approve of Unicode adding emojis like to point out, emojis aren't that critical so having some loss in the translation isn't a huge deal.

Remember that before emoji standardization various cell phone manufacturers (particularly in Japan if I remember correctly) started using codepoints for whatever they pleased. The alternative to Unicode not standardizing them was to have a repeat of the OEM font gold rush in the SMP.

> styled math letters (which would have been equally well served by simply rendering them in italics or in a special math font)

That was my first reaction as well, but there are a few problems with that approach:

* Math italic characters look very different from normal italics, and are shaped and kerned very differently because they are commonly used for single-letter variables which will be juxtaposed together in expressions. If your goal is to be able to preserve some math formulas in a purely line based text format, preserving this aspect makes a big difference in readability.

* Many of the math letters and "letter-like symbols" have associated semantic content (like bold for vectors), which it makes sense to preserve. MathML alleviates this to a significant degree but I don't believe these codepoints were intended only for MathML usage.

* On the technical side, OpenType math fonts need to carry associated metadata for many of these characters. Putting them in separate fonts complicates this, since these tables need to refer to glyphs (general codepoints are unsuitable in a number of cases) and each font file would have a different glyph address space.

Re: How a comment on Hacker News led to 4½ new Unicode characters

#96
post #66

The success of the unicodepowersymbol proposal inspired me to suggest a couple characters to Unicode (the Bitcoin sign and IBM's group mark from 1960s mainframes, which were accepted). The point is that Unicode really is open to proposals from random people; you don't need to part of a big company to influence Unicode.

What's the IBM group symbol? I can't find the words IBM in [1]. [1] http://www.unicode.org/charts/PDF/U2B00.pdf

The group mark will be U+2BD2. For details see https://github.com/shirriff/groupmark

Re: How a comment on Hacker News led to 4½ new Unicode characters

#97
post #89
post #79

Earlier quoted context omitted.

Imagine if ﷽ was sized to a monospace font.

In the name of god, that has to be the most complex glyph I have ever seen.

https://en.m.wikipedia.org/wiki/Biangbiang_noodles#/media/Fi...

Biang from Biang biang noodles is also fairly complex (though not supported by Unicode)

Re: How a comment on Hacker News led to 4½ new Unicode characters

#98
post #92

Earlier quoted context omitted.

Doubling text files is a waste for the most part, but what makes it tolerable is compression. Still 16 bits would not be enough, it's only 65536 different code pages, less than half of what is currently in Unicode. 24 bit is sufficiently out of allignment with modern hardware and algorithms, so 32 bit it is for efficiency. That is now 4 times the size, and compression is now a requirement. In any case, Utf8 has a pla…

> Still 16 bits would not be enough, it's only 65536 different code pages, less than half of what is currently in Unicode. But that's only because Unicode has significantly ventured well beyond what we consider to be text. The BMP is enough to represent all text (including math).

BMP is mostly filled with symbols from logographic languages, and currently has around 100 free code points. 16 bits simply isn't enough for the scope of capturing all written language of the history.

Re: How a comment on Hacker News led to 4½ new Unicode characters

#99
Legitimate question: Why is Unicode littered with all those useless symbols?

I can see the reasoning behind the standard (or very common) symbols or things like emoji, but having every possible glyph in UTF8 seems like a horrible waste.

What if we want to add new glyphs in the next 10 years for emerging standards?

Re: How a comment on Hacker News led to 4½ new Unicode characters

#100
post #40

But why? The trend towards putting icons into Unicode may be a mistake. Unless it's a symbol one uses in a sentence, there's no real reason to have it in Unicode. Unicode should not be viewed as a standard clip art library.

> Unless it's a symbol one uses in a sentence "To start the device, press the ⏻ button on the device face" There, used in a sentence.

"Good morning, that's a nice tnetennba" (Source: https://youtu.be/49UakIHb1yI)
Post reply on HN