Viewing profile — cpeffer

If you’re looking for an open core version of this check out firecrawl.dev

While building mendable - we found that feeding LLMs well-structured markdown improved accuracy. We also found it surprisingly hard. We found some great tools online, but none reli…

Very cool. We posted about a similar tool we built yesterday https://www.firecrawl.dev/ It also crawls (although you can scrape single pages as well)

It wasn't in our initial version (we didn't plan on launching today), but we are pushing an update to do so now.

It crawls webpages (finds subdirectories), handles JS blocking with fallbacks to headless browsers, and does this all concurrently. If only that script worked for every website. Bu…

* Creator here - Thats the goal!