Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Rga: Ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz

phiresky.github.io

Post reply on HN
Print view View original

91–100 of 144 posts

Re: Rga: Ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz

#91

Post by burntsushi »

alexruf wrote: post #88

Idea behind Rga is cool. Anyway, I tried it on Mac and installed via Homebrew. The formula already says it depends on ripgrep (that's fine since I have ripgrep already installed and use it regularly). I still was surprised when I executed Rga for the first time and got an error message that 'pdftotext' was not found. Since pdftotext has been officially discontinued, I am not sure if I want to install an old version j…

> Since pdftotext has been officially discontinued

Do you have a link for that? That's news to me.

Re: Rga: Ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz

#92

Post by maximz »

phiresky wrote: post #75

Developer of the tool here :) Glad to see it posted here, I still actively use it myself. Also check out the fzf integration in the README: https://github.com/phiresky/ripgrep-all/blob/master/doc/rga-... Currently the main branch is undergoing a refactor to add support for having custom extractors (calling out to other tools), and more flexible chains of extractors. Ripgrep itself has functionality integrated to call…

Love this. I appreciate your building on ripgrep versus my own bulky lucene-based approach a while back (https://github.com/maximz/sift), and that you don’t require pre-indexing but build up a cache as you go.

Re: Rga: Ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz

#93

Post by one-punch »

phiresky wrote: post #75

Developer of the tool here :) Glad to see it posted here, I still actively use it myself. Also check out the fzf integration in the README: https://github.com/phiresky/ripgrep-all/blob/master/doc/rga-... Currently the main branch is undergoing a refactor to add support for having custom extractors (calling out to other tools), and more flexible chains of extractors. Ripgrep itself has functionality integrated to call…

The integration with fzf seems nice.

Any plans to integrate with skim, a Rust implementation of fzf?

https://github.com/lotabout/skim

Re: Rga: Ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz

#94

Post by there_the_and »

alexruf wrote: post #88

Idea behind Rga is cool. Anyway, I tried it on Mac and installed via Homebrew. The formula already says it depends on ripgrep (that's fine since I have ripgrep already installed and use it regularly). I still was surprised when I executed Rga for the first time and got an error message that 'pdftotext' was not found. Since pdftotext has been officially discontinued, I am not sure if I want to install an old version j…

I don't see any indication that pdftotext has been discontinued [1]. It looks like a Mac-specific installer available via Homebrew Cask has been discontinued [2], but pdftotext is still available through the normal poppler formula [3].

1. https://poppler.freedesktop.org/releases.html

2. https://formulae.brew.sh/cask/pdftotext

3. https://formulae.brew.sh/formula/poppler

Re: Rga: Ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz

#95

Post by phiresky »

burntsushi wrote: post #82
phiresky wrote: post #75

Developer of the tool here :) Glad to see it posted here, I still actively use it myself. Also check out the fzf integration in the README: https://github.com/phiresky/ripgrep-all/blob/master/doc/rga-... Currently the main branch is undergoing a refactor to add support for having custom extractors (calling out to other tools), and more flexible chains of extractors. Ripgrep itself has functionality integrated to call…

> In the currently stable version, the main interface of each "adapter" is `fn(Read, Write) -> ()`. To allow custom adapter chaining I have to change it to be `fn(Read) -> Read` where each chained adapter wraps the read stream and converts it while reading. But then I get issues with how to handle threading etc, as well as a random deadlock that I haven't figured out how to solve so far :/ I don't quite grok the prob…

> If you file an issue against ripgrep proper with code links and some more details

Sorry, I don't think I explained my issue very well. In general it has nothing to do with the interaction with ripgrep, that works fine.

It's that each adapter (e.g. zip -> list of file streams) needs to have an interface of fn(Read) -> Iter

But then if there's a PDF within the zip, I have to give the returned ReadWithMeta to the PDF adapter - but it can't take ownership, because the Archive file iterators only give borrowed reads. I maybe worked around this by creating a wrapper type [3] and adding an unsafe here [2], but something deadlocks when adapting zip files currently.

Also, for external programs, I have to copy the data from the Read into a Write (stdin of the program) - which needs to happen in a separate thread, otherwise the stdout is never read [1], but some Reads I have aren't Send since they come from e.g. zip-rs, so they can't be passed to a thread.

[1] https://github.com/phiresky/ripgrep-all/blob/baca166fdab3d24...

[2] https://github.com/phiresky/ripgrep-all/blob/baca166fdab3d24...

[3] https://github.com/phiresky/ripgrep-all/blob/baca166fdab3d24...

Re: Rga: Ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz

#96

Post by codethief »

spappal wrote: post #74
ffpip wrote: post #47

Earlier quoted context omitted.

If you're using Duckduckgo, just search ''!drive search-term'' or ''search term !drive'' or ''search !drive term'' More !operators here - https://duckduckgo.com/bang

Firefox supports custom search engines, the most bang for the buck custom search engine must be https://duckduckgo.com/?q=%s with keyword being the letter d. Then you get all these 13000+ bangs without having to configure the custom search engines. E.g. write "d !drive term" in url bar. And "d !w hacker news" sends you directly to https://en.wikipedia.org/wiki/Hacker_News

Or you just set DDG as your default search engine and then you don't even have to type the "d" anymore. :)

Re: Rga: Ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz

#97

Post by phiresky »

alexruf wrote: post #88

Idea behind Rga is cool. Anyway, I tried it on Mac and installed via Homebrew. The formula already says it depends on ripgrep (that's fine since I have ripgrep already installed and use it regularly). I still was surprised when I executed Rga for the first time and got an error message that 'pdftotext' was not found. Since pdftotext has been officially discontinued, I am not sure if I want to install an old version j…

Yeah, In my opinion poppler should be a dependency of rga in homebrew (since it's kinda useless without having the default adapters), but I don't maintain that package.

Re: Rga: Ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz

#99

Post by pabs3 »

ghoomketu wrote: post #18

One a related note there is one program that I absolutely miss on Linux called everything (on windows). The closest I can find is mlocate but it does not have a GUI but more importantly it does not index my Windows or NTFS drives. Would appreciate any suggestions if someone knows something like 'everything' for Ubuntu.

BTW, mlocate is obsoleted by plocate, which is much faster and is actually maintained.

https://plocate.sesse.net/

Re: Rga: Ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz

#100

Post by captn3m0 »

ghoomketu wrote: post #18

One a related note there is one program that I absolutely miss on Linux called everything (on windows). The closest I can find is mlocate but it does not have a GUI but more importantly it does not index my Windows or NTFS drives. Would appreciate any suggestions if someone knows something like 'everything' for Ubuntu.

Seriously - I miss it as well. But my access patterns have changed as well. I spend more time on the terminal, and with autojump, the alternatives (with similar features) on Linux aren't really that useful to my usage.
Post reply on HN