Show HN: Sed to C translator written in sed
1–10 of 15 posts
Re: Show HN: Sed to C translator written in sed
#2Nice! In the why part you speculatively mention better speed. Do you have any concrete benchmark results?
If fast, the tool would be very useful for my work where I run an anonimization sed script with hundreds of transformations on millions of lines that takes hours to run.
But even if it is not fast, this is a fun project.
Re: Show HN: Sed to C translator written in sed
#3Nice! In the why part you speculatively mention better speed. Do you have any concrete benchmark results? If fast, the tool would be very useful for my work where I run an anonimization sed script with hundreds of transformations on millions of lines that takes hours to run. But even if it is not fast, this is a fun project.
Not the author, but I see that
> no pattern/hold space overflow checks, currently both limited to 8192 bytes as per the POSIX spec requirement. Going over that limit will most likely cause a segfault.
> The C code is very rough around the edges (by that I mean dirty and unsafe, for instance allocating everything on the stack without checking any overflow), I'm still working on it, but contributions (issues/comments/pull requests) are also welcomed :)
Thus, so far it's just for fun, not suitable for profit yet.
Re: Show HN: Sed to C translator written in sed
#4Nice! In the why part you speculatively mention better speed. Do you have any concrete benchmark results? If fast, the tool would be very useful for my work where I run an anonimization sed script with hundreds of transformations on millions of lines that takes hours to run. But even if it is not fast, this is a fun project.
...an anonimization sed script with hundreds of transformations on millions of lines that takes hours to run.
Wow! Who decided this would be written in sed? Was the decision made in this century?
I actually wrote a small translation utility in sed for a client in 1999. Anderson claimed the utility couldn't be written, and my boss didn't want to support it. So, write it in sed! Then the Androids had to translate it into C++ by hand.
Re: Show HN: Sed to C translator written in sed
#5Nice! In the why part you speculatively mention better speed. Do you have any concrete benchmark results? If fast, the tool would be very useful for my work where I run an anonimization sed script with hundreds of transformations on millions of lines that takes hours to run. But even if it is not fast, this is a fun project.
...an anonimization sed script with hundreds of transformations on millions of lines that takes hours to run. Wow! Who decided this would be written in sed? Was the decision made in this century? I actually wrote a small translation utility in sed for a client in 1999. Anderson claimed the utility couldn't be written, and my boss didn't want to support it. So, write it in sed! Then the Androids had to translate it in…
I personally decided to write the anonymization script in sed. The decision was made in 2020, so yes, this century.
Re: Show HN: Sed to C translator written in sed
#6Nice! In the why part you speculatively mention better speed. Do you have any concrete benchmark results? If fast, the tool would be very useful for my work where I run an anonimization sed script with hundreds of transformations on millions of lines that takes hours to run. But even if it is not fast, this is a fun project.
No concrete benchmarks no, I just timed a few scripts I had on hand and generated a bunch of others, and I saw compiled ones performed slightly faster than GNU and toybox sed, so nothing serious.
Unfortunately, it's also pretty hard to find big POSIX sed scripts in the wild, so my speed observations are centered around my own scripts. I would definitely be interested in learning more about sed scripts taking hours to run though, if you have something that I could check out that would be awesome!
And talking about speed, I think there's also a small margin for improvement in this project, like avoiding compiling the same regex multiple times (if it appears in different places in the script), and some places that could probably benefit from using hash tables instead of static arrays (address ranges for instance). More work could be done on the translation side regarding backrefs, which are parsed on the C side for now.
Re: Show HN: Sed to C translator written in sed
#7Now one for Awk and Python please :)
Re: Show HN: Sed to C translator written in sed
#8So it can translate itself?
> Translate the translator (par.sed) with itself:
Yes! Congrats!
Re: Show HN: Sed to C translator written in sed
#9Nice! In the why part you speculatively mention better speed. Do you have any concrete benchmark results? If fast, the tool would be very useful for my work where I run an anonimization sed script with hundreds of transformations on millions of lines that takes hours to run. But even if it is not fast, this is a fun project.
Not the author, but I see that > no pattern/hold space overflow checks, currently both limited to 8192 bytes as per the POSIX spec requirement. Going over that limit will most likely cause a segfault. > The C code is very rough around the edges (by that I mean dirty and unsafe, for instance allocating everything on the stack without checking any overflow), I'm still working on it, but contributions (issues/comments/p…
Yep that's exactly right :) !
To clarify my statement POSIX requires at least 8192 bytes for the pattern and hold space, and I chose to allow at most 8192 bytes here, which indeed means that this will prevent working on really long lines or storing entire files in the hold space for instance.
Re: Show HN: Sed to C translator written in sed
#10And for the other direction (C->sed): https://github.com/shinh/elvm