Earlier quoted context omitted.
The only problem with `tee' is that it's hard to find it unless you know where to look -- took me some 2 years. Perhaps the real challenge here is sticking with the team that produces incredible qunatities of code , as they put it, and will rather re-implement tee than find it. I wonder if they implemented own virtual memory with on-demand paging yet ;-)
Except that if you read the problem statement, you'll see that tee doesn't meet the requirement of 'taking advantage of all available I/O parallelism'. Tee writes to each output file sequentially. Given that their core business is data-stores that take full advantage of emerging storage technologies (such as flash), this seems like pretty relevant question.
Did anybody solve this?
11–20 of 26 posts
Re: Did anybody solve this?
#12Also, did anyone solve their "canine challenge"? It seems to me that what they're asking for is "tee FILE... > /dev/null", but maybe I'm missing something?
Re: Did anybody solve this?
#13Spoiler Alert! The answer is rethingdb. Apparently an ad for rethinkdb.com: >>> print "".join((chr((ord(x)-int(y)-ord("a"))%26+ord("a")) for x,y in zip("xfbhlqtlj","61803398874"))) rethinkdb
Re: Did anybody solve this?
#14Earlier quoted context omitted.
The only problem with `tee' is that it's hard to find it unless you know where to look -- took me some 2 years. Perhaps the real challenge here is sticking with the team that produces incredible qunatities of code , as they put it, and will rather re-implement tee than find it. I wonder if they implemented own virtual memory with on-demand paging yet ;-)
Except that if you read the problem statement, you'll see that tee doesn't meet the requirement of 'taking advantage of all available I/O parallelism'. Tee writes to each output file sequentially. Given that their core business is data-stores that take full advantage of emerging storage technologies (such as flash), this seems like pretty relevant question.
Re: Did anybody solve this?
#15Earlier quoted context omitted.
The only problem with `tee' is that it's hard to find it unless you know where to look -- took me some 2 years. Perhaps the real challenge here is sticking with the team that produces incredible qunatities of code , as they put it, and will rather re-implement tee than find it. I wonder if they implemented own virtual memory with on-demand paging yet ;-)
Except that if you read the problem statement, you'll see that tee doesn't meet the requirement of 'taking advantage of all available I/O parallelism'. Tee writes to each output file sequentially. Given that their core business is data-stores that take full advantage of emerging storage technologies (such as flash), this seems like pretty relevant question.
Re: Did anybody solve this?
#16Earlier quoted context omitted.
Except that if you read the problem statement, you'll see that tee doesn't meet the requirement of 'taking advantage of all available I/O parallelism'. Tee writes to each output file sequentially. Given that their core business is data-stores that take full advantage of emerging storage technologies (such as flash), this seems like pretty relevant question.
I did read the problem statement, but I thought tee was writing to all files in parallel. It's surprising that there seems to be no way to achieve that.
$ tee foo.bin bar.bin baz.bin
writes to all three files `at once' (in small time-slices, actually). Used GNU tee from coreutils-8.10.Perhaps OP meant several-threads-per-file level of parallelism, where number_threads > number_files?
Re: Did anybody solve this?
#17Earlier quoted context omitted.
I did read the problem statement, but I thought tee was writing to all files in parallel. It's surprising that there seems to be no way to achieve that.
Tee writes in one-thread-per-file level of parallelism; simple experiment: $ tee foo.bin bar.bin baz.bin writes to all three files `at once' (in small time-slices, actually). Used GNU tee from coreutils-8.10. Perhaps OP meant several-threads-per-file level of parallelism, where number_threads > number_files?
Re: Did anybody solve this?
#18Earlier quoted context omitted.
I did read the problem statement, but I thought tee was writing to all files in parallel. It's surprising that there seems to be no way to achieve that.
Tee writes in one-thread-per-file level of parallelism; simple experiment: $ tee foo.bin bar.bin baz.bin writes to all three files `at once' (in small time-slices, actually). Used GNU tee from coreutils-8.10. Perhaps OP meant several-threads-per-file level of parallelism, where number_threads > number_files?
(source code here: http://git.savannah.gnu.org/cgit/coreutils.git/tree/src/tee....)
All of the reads and writes are done through synchronous file apis. I don't see where you are getting one-thread-per-file (or any other kind of parallelism) there.
Re: Did anybody solve this?
#19Yes. Use the modulus implementation of the vignere cypher. Then look up how C and python handle modulus.
Re: Did anybody solve this?
#20they added "naive" and "might" ...