Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: ZFS Implementation in Python

github.com

Post reply on HN
Print view View original

41–50 of 97 posts

Re: Show HN: ZFS Implementation in Python

#41

Post by twa927 »

spullara wrote: post #13
j88439h84 wrote: post #6

Earlier quoted context omitted.

Dont forget, pypy is fast.

Faster that CPython doesn't mean it is fast.

I was trying to speed up a log processing service running on PyPy by rewriting it in Java. I was surprised that the result was about twice slower (I know Java quite well and I didn't see obvious optimizations; most of the time was spent in GC). So it can be quite fast even in more absolute terms (VM languages), at least for some types of code.

Re: Show HN: ZFS Implementation in Python

#42

Post by AHTERIX5000 »

lelf wrote: post #15
lunixbochs wrote: post #2

Note: this was implemented without referencing any ZFS source code and should not be subject to the CDDL.

Bad title. It’s not a ZFS implementation , so hold your horses.

What do you mean? Can't you mount & read ZFS filesystems with this one?

Re: Show HN: ZFS Implementation in Python

#43

Post by spullara »

twa927 wrote: post #41
spullara wrote: post #13

Earlier quoted context omitted.

Faster that CPython doesn't mean it is fast.

I was trying to speed up a log processing service running on PyPy by rewriting it in Java. I was surprised that the result was about twice slower (I know Java quite well and I didn't see obvious optimizations; most of the time was spent in GC). So it can be quite fast even in more absolute terms (VM languages), at least for some types of code.

If more than 1% of your time is in GC you are doing something very wrong.

Re: Show HN: ZFS Implementation in Python

#44

Post by ehsankia »

mirceal wrote: post #7
AlexanderDhoore wrote: post #3

What?! How?! Why?! This is the greatest thing ever. I wish I could just write code for the fun of it. Every time I wonder whether people will use it and give up before I even get started.

why not? writing code can fall into one of a few bucket. one of them is play.

Absolutely, some of the most fun I've had coding was reverse engineering/implementing known protocols. Although something this big may be a little overboard :)

Re: Show HN: ZFS Implementation in Python

#45

Post by fragmede »

j88439h84 wrote: post #6
josteink wrote: post #4

Earlier quoted context omitted.

So we port this python to something not slow, and all the kernel-people can shut up about ZFS being terrible ;)

Dont forget, pypy is fast.

pypy is fast, but even were this written in C, there's still the kernel-userland boundary to contend with.

Re: Show HN: ZFS Implementation in Python

#46

Post by tigershark »

twa927 wrote: post #41
spullara wrote: post #13

Earlier quoted context omitted.

Faster that CPython doesn't mean it is fast.

I was trying to speed up a log processing service running on PyPy by rewriting it in Java. I was surprised that the result was about twice slower (I know Java quite well and I didn't see obvious optimizations; most of the time was spent in GC). So it can be quite fast even in more absolute terms (VM languages), at least for some types of code.

I know that it’s asking a lot, but any chance that you can post a minimum reproducible sample? From what I know it is quite smelly...

Re: Show HN: ZFS Implementation in Python

#47

Post by [deleted] »

twa927 wrote: post #41
spullara wrote: post #13

Earlier quoted context omitted.

Faster that CPython doesn't mean it is fast.

I was trying to speed up a log processing service running on PyPy by rewriting it in Java. I was surprised that the result was about twice slower (I know Java quite well and I didn't see obvious optimizations; most of the time was spent in GC). So it can be quite fast even in more absolute terms (VM languages), at least for some types of code.

[deleted]

Re: Show HN: ZFS Implementation in Python

#48

Post by twa927 »

tigershark wrote: post #46
twa927 wrote: post #41

Earlier quoted context omitted.

I was trying to speed up a log processing service running on PyPy by rewriting it in Java. I was surprised that the result was about twice slower (I know Java quite well and I didn't see obvious optimizations; most of the time was spent in GC). So it can be quite fast even in more absolute terms (VM languages), at least for some types of code.

I know that it’s asking a lot, but any chance that you can post a minimum reproducible sample? From what I know it is quite smelly...

I don't have access to this codebase now but I'll try to write some benchmark.

Re: Show HN: ZFS Implementation in Python

#49

Post by mfsch »

Does someone know whether it would be legal for someone to go through the ZFS code and write a specification of the features this author hasn’t figured out yet? I.e. could someone write a detailed description of the missing functionality that doesn’t include any details about the implementation so other people can implement it in non-CDDL code?
Post reply on HN