Live data from Hacker News

Zero-copy deserialization in Julia

scattered-thoughts.net

21–30 of 34 posts

Re: Zero-copy deserialization in Julia

#21
post #20

A similar tech is flatbuffers: https://github.com/google/flatbuffers

Flatbuffers is pretty great, one side benefit of these types of technologies is you can also use them to structure your memory accesses.

I've done this in Java to do cache aware reading to pretty great success.

Re: Zero-copy deserialization in Julia

#22
post #15
post #13

So, I have to check that libraries don't do this if I am to rely on the idea that Julia offers safety?

if that worries you, I wouldn't look under the covers of almost any database you run, nor network stack you have. Graphics card drivers are WAY out. File systems too. Julia offers as much safety as most languages. You would be hard pressed to find a language which doesn't let you pull something like this. Julia wouldn't solve the 2 languages problem if there was a lot of things you would have to drop back to C to do.…

Point taken. It would be nice to be able to query my code base to see if unsafe methods have been used (and where) in the executable.

Re: Zero-copy deserialization in Julia

#23
post #20

A similar tech is flatbuffers: https://github.com/google/flatbuffers

Flatbuffers is pretty great, one side benefit of these types of technologies is you can also use them to structure your memory accesses. I've done this in Java to do cache aware reading to pretty great success.

Do you mind elaborating?

Re: Zero-copy deserialization in Julia

#24
post #23

Earlier quoted context omitted.

Flatbuffers is pretty great, one side benefit of these types of technologies is you can also use them to structure your memory accesses. I've done this in Java to do cache aware reading to pretty great success.

Do you mind elaborating?

I am not OP but I'm imagining data-oriented design. So like, things are structured and then serialized - and at some other end deserialized in place ready to read cache-coherently?

Re: Zero-copy deserialization in Julia

#28

can someone explain to me why is this on the homepage? Not being sarcastic. I genuinely want to know why is Zero-copy deserialization in Julia relevant to most of hacker new's commmunity

because i want to write same stuff on f#. good question overall. keep going.

Re: Zero-copy deserialization in Julia

#30
post #22
post #15

Earlier quoted context omitted.

if that worries you, I wouldn't look under the covers of almost any database you run, nor network stack you have. Graphics card drivers are WAY out. File systems too. Julia offers as much safety as most languages. You would be hard pressed to find a language which doesn't let you pull something like this. Julia wouldn't solve the 2 languages problem if there was a lot of things you would have to drop back to C to do.…

Point taken. It would be nice to be able to query my code base to see if unsafe methods have been used (and where) in the executable.

Rust is really good that way. It would be nice to have for sure.
Post reply on HN