Show HN: Search over 100M archived posts and comments scraped from Parler

Post by formalsystems » Thu, Mar 11, 2021, 8:32 PM UTC

Post by formalsystems » Fri, Mar 12, 2021, 6:39 PM UTC

throwaway888abc wrote: post #2

Kudos to op / author for putting this out. >Please consider supporting this project so I can be more relaxed with server/bandwidth costs. Why not bittorrent (instead of expensive AWS S3) as any other datadump ?

Post by cosmodisk » Sat, Mar 13, 2021, 11:05 PM UTC

nagyf wrote: post #4

formalsystems wrote: post #3

Earlier quoted context omitted.

Thank you! Agree 100% on bittorrent - in all honesty I am new to these kinds of projects, and the wonderful people of the Internet like yourself have been really helpful in showing me the standard way to go about things. Should be a torrent link on there by tomorrow!

S3 actually supports Torrent: https://docs.aws.amazon.com/AmazonS3/latest/userguide/S3Torr... It might be the easiest solution for you