[deleted]
Lessons learned from doing the one billion row challenge
11–13 of 13 posts
Re: Lessons learned from doing the one billion row challenge
#12Earlier quoted context omitted.
If you want the search term for this, it's "collation", since this is one of the odder such terms if you don't already know it. Here's Too Much Information about Unicode collation: https://www.unicode.org/reports/tr10/
I found an online version https://icu4c-demos.unicode.org/icu-bin/collation.html but there you first have to select the language from the drop-down menu. So in general, you would first need to know the country where your weather station was located, before you can correctly collate its name. I don't believe the fastest entries are doing all this(?) Edit: In the examples [1], the guy writes a Polish city using its Eng…
You could argue this is dirty data, all the data should be entered in the same language or have a field that specifies language which allows you to translate. I don't think it's possible to solve the problem perfectly as presented.
Re: Lessons learned from doing the one billion row challenge
#13Is anyone doing the challenge on other platforms besides java?
Rust:
* https://github.com/gunnarmorling/1brc/discussions/57
* https://github.com/mtb0x1/1brc
My friend also claims he is going to try it in Prolog. We'll see :)