Ripgrep – A new command line search tool

Post by rob_cameron » Thu, Sep 29, 2016, 12:26 AM UTC

burntsushi wrote: post #210

rob_cameron wrote: post #209

Earlier quoted context omitted.

Running the same tests on our test machine, I am seeing dramatically different performance results. Our test machine has AVX2, but this can't be the whole story. cameron@cs-osl-10:~/ripgrep/datadir/subtitles$ time rg '\w+ Holmes|\w+ Watson|\w+ Adler|\w+ Moriarty|\w+ Lestrade' OpenSubtitles2016.raw.en | wc -l 26464 real 1m8.380s user 1m6.211s sys 0m2.006s cameron@cs-osl-10:~/ripgrep/datadir/subtitles$ time icgrep '\w+…

Strange. I'm not sure how to explain the results either. Is there something I'm supposed to do to enable icgrep to use AVX2? I followed the build instructions in the README verbatim. Here's my cpu info (which is quite new and does have AVX2): processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 79 model name : Intel(R) Core(TM) i7-6900K CPU @ 3.20GHz stepping : 1 microcode : 0xb00001d cpu MHz : 1267.578 cach…

  cameron@cs-osl-10:~/ripgrep/datadir/subtitles$ perf stat -e instructions:u,cycles:u,branch-misses:u icgrep1.0 -i -c '\w+ Holmes|\w+ Watson|\w+ Adler|\w+ Moriarty|\w+ Lestrade' OpenSubtitles2016.raw.en 
  27370
  Performance counter stats for 'icgrep1.0 -i -c \w+ Holmes|\w+ Watson|\w+ Adler|\w+ Moriarty|\w+ Lestrade OpenSubtitles2016.raw.en':
   252,725,532,395      instructions:u            #    2.75  insns per cycle        
    91,867,444,975      cycles:u                 
       283,661,301      branch-misses:u                                             
      46.570725331 seconds time elapsed

   
  cameron@cs-osl-10:~/ripgrep/datadir/subtitles$ perf stat -e instructions:u,cycles:u,branch-misses:u rg -i -c '\w+ Holmes|\w+ Watson|\w+ Adler|\w+ Moriarty|\w+ Lestrade' OpenSubtitles2016.raw.en 
  27370
  Performance counter stats for 'rg -i -c \w+ Holmes|\w+ Watson|\w+ Adler|\w+ Moriarty|\w+ Lestrade OpenSubtitles2016.raw.en':
    84,296,004,027      instructions:u            #    1.38  insns per cycle        
    61,298,903,577      cycles:u                 
           510,918      branch-misses:u                                             
      31.962195024 seconds time elapsed

  cameron@cs-osl-10:~/ripgrep/datadir/subtitles$ perf stat -e instructions:u,cycles:u,branch-misses:u icgrep -i -c '\w+ Holmes|\w+ Watson|\w+ Adler|\w+ Moriarty|\w+ Lestrade' OpenSubtitles2016.raw.en 
  27370
  Performance counter stats for 'icgrep -i -c \w+ Holmes|\w+ Watson|\w+ Adler|\w+ Moriarty|\w+ Lestrade OpenSubtitles2016.raw.en':
    42,064,581,840      instructions:u            #    1.94  insns per cycle        
    21,723,251,095      cycles:u                 
        47,953,756      branch-misses:u                                             
      13.301160493 seconds time elapsed

Post by glangdale » Thu, Sep 29, 2016, 1:20 AM UTC

rob_cameron wrote: post #212

glangdale wrote: post #207

Earlier quoted context omitted.

Speaking as the leader of the Hyperscan project ( https://github.com/01org/hyperscan ), I'd say you might not be the only project feeling a bit neglected in the performance comparison here. It's nice to be mentioned - and even called out by name as the inventor of Teddy (!) - but we're always even more pleased when someone else measures Hyperscan, as it minimizes the prospect of us embarrassing ourselves by posting s…

We are very interested in tackling the multiple-pattern regular expression problem and will definitely want to use Hyperscan as a comparator. Any help in setting up a study with both patterns and data sets would be most appreciated!

Post by rob_cameron » Thu, Sep 29, 2016, 4:47 AM UTC

burntsushi wrote: post #214

rob_cameron wrote: post #211

Earlier quoted context omitted.

Are you using icgrep1.0? That may explain it. My reports are from our current development version r5163. cameron@cs-osl-10:~/ripgrep/datadir/subtitles$ perf stat -e instructions:u,cycles:u,branch-misses:u icgrep1.0 -i -c '\w+ Holmes|\w+ Watson|\w+ Adler|\w+ Moriarty|\w+ Lestrade' OpenSubtitles2016.raw.en 27370 Performance counter stats for 'icgrep1.0 -i -c \w+ Holmes|\w+ Watson|\w+ Adler|\w+ Moriarty|\w+ Lestrade Ope…

[andrew@Cheetah icgrep-build] pwd /home/andrew/clones/icgrep1.0/icgrep-devel/icgrep-build [andrew@Cheetah icgrep-build] ./icgrep --version LLVM (http://llvm.org/): LLVM version 3.5.0svn Optimized build. Built Sep 24 2016 (11:27:32). Default target: x86_64-unknown-linux-gnu Host CPU: x86-64 If the file path is any indication, it looks like I'm using `icgrep1.0`. But the file path also has `icgrep-devel` in it. So I do…

  svn co http://parabix.costar.sfu.ca/svn/icGREP/icgrep-devel

Post by rob_cameron » Thu, Sep 29, 2016, 10:12 PM UTC

glangdale wrote: post #213

rob_cameron wrote: post #212

Earlier quoted context omitted.

We are very interested in tackling the multiple-pattern regular expression problem and will definitely want to use Hyperscan as a comparator. Any help in setting up a study with both patterns and data sets would be most appreciated!

This sounds interesting. I suspect there are many alternate approaches to multiple regex. Sadly, regex benchmarking is a sewer. There are two classes of multiple regex benchmarks: public ones and good ones, and not much intersection between the two. Synthetic pattern generation can be manipulated to say whatever you want it to say, Snort patterns aren't intended to be run simultaneously (so putting a big pile of them…

Post by skanga » Mon, Oct 03, 2016, 6:57 PM UTC

burntsushi wrote: post #201

skanga wrote: post #194

Earlier quoted context omitted.

PS: You might want to revise this verbiage in the README markdown file: Installing xsv is a bit hokey right now. Ideally, I could release binaries for Linux, Mac and Windows. Currently, I'm only able to release binaries for Linux because I don't know how to cross compile Rust programs.

Ah how embarrassing! I will fix that soon. Thanks :-)