Scraping and indexing 1.2B emails for under $200
jordanpiepkow.com
Scraping and indexing 1.2B emails for under $200
1–7 of 7 posts
Re: Scraping and indexing 1.2B emails for under $200
#2Nice writeup.
Re: Scraping and indexing 1.2B emails for under $200
#3Wow, the author really calls out his competition! There are also parts 2 and 3 to this article that discusses using Rust and Postgres for their solution.
Re: Scraping and indexing 1.2B emails for under $200
#4Took me a while to understand they were scraping email addresses and not actual emails.
Re: Scraping and indexing 1.2B emails for under $200
#5Is nobody going to mention how this is a bad thing intended for sending spam? Guess I'll have to be that person then.
Re: Scraping and indexing 1.2B emails for under $200
#6I must be missing something because 6.5 days * $21/day = $136.5
"""
The entire process now took 6.5 days and cost $21/day. Our total cost all said and done was $115!
"""
Re: Scraping and indexing 1.2B emails for under $200
#7Help rid the world of spam! Project Honey Pot is our friend.
https://www.projecthoneypot.org/