Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

moviechat.org

Post reply on HN
Print view View original

21–30 of 82 posts

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#21

Post by karim »

JimSmith84 wrote: post #2

Hi Everyone, My name’s Jim, and I created MovieChat.org as an archive and replacement for IMDB’s message boards which are shutting down this week. For those of you not familiar, the IMDb message boards allowed you to discuss any single movie or tv show with others (there was a separate forum for each movie/show). IMDb recently announced they were shutting down the message boards and its users were furious (there's a…

Hey Jim – thanks for doing that! I'm curious, how did you back up IMDB's message boards? Did you scrape the whole website or were you able to find a data dump?

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#22

Post by 5_minutes »

karim wrote: post #21
JimSmith84 wrote: post #2

Hi Everyone, My name’s Jim, and I created MovieChat.org as an archive and replacement for IMDB’s message boards which are shutting down this week. For those of you not familiar, the IMDb message boards allowed you to discuss any single movie or tv show with others (there was a separate forum for each movie/show). IMDb recently announced they were shutting down the message boards and its users were furious (there's a…

Hey Jim – thanks for doing that! I'm curious, how did you back up IMDB's message boards? Did you scrape the whole website or were you able to find a data dump?

I wanted to ask this too. Did you scrape it or did it via some api? Anyway, cool project, wish you all the best with it.

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#24

Post by dirkg »

Thank you!!

To my knowledge this is the only instance someone has managed to scrape the Imdb boards, very curious how you managed that.

I really hope you get a sponsor/donations. This needs to be promoted to other sites/social media and I will do my part.

I do have one request - can we do this for actors as well?

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#25

Post by carussell »

dewey wrote: post #14
carussell wrote: post #13

Earlier quoted context omitted.

Let's Encrypt can still be pretty convoluted and is not headache-free, even using the officially anointed tools. Despite your comment and the (well-intentioned) plans from browser vendors to do what they can to squash unencrypted HTTP, failure to use HTTPS, even with Let's Encrypt, is still a totally forgivable sin today.

I disagree, by just running https://caddyserver.com/ you would automatically have a https site up in seconds and it can be used as a reverse proxy too. With nginx: - `certbot certonly` - press `2` - type in your domain name - press return, done Add a few lines to your nginx config, done. ``` ssl_certificate /etc/letsencrypt/live/ /fullchain.pem; ssl_certificate_key /etc/letsencrypt/live/ /privkey.pem; ssl on; ```

Just to confirm, do you think "swap out your webserver for something else" is a reasonable demand?

> `certbot certonly`

You make an assumption that this is going to work with no hiccups, across all environments. Spoiler: it doesn't. I specifically alluded to certbot and certbot-auto being (surprisingly) rough around the edges.

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#26

Post by dewey »

carussell wrote: post #25
dewey wrote: post #14

Earlier quoted context omitted.

I disagree, by just running https://caddyserver.com/ you would automatically have a https site up in seconds and it can be used as a reverse proxy too. With nginx: - `certbot certonly` - press `2` - type in your domain name - press return, done Add a few lines to your nginx config, done. ``` ssl_certificate /etc/letsencrypt/live/ /fullchain.pem; ssl_certificate_key /etc/letsencrypt/live/ /privkey.pem; ssl on; ```

Just to confirm, do you think "swap out your webserver for something else" is a reasonable demand? > `certbot certonly` You make an assumption that this is going to work with no hiccups, across all environments. Spoiler: it doesn't. I specifically alluded to certbot and certbot-auto being (surprisingly) rough around the edges.

I'm not demanding anything, I'm just listing some options and emailed the OP to offer my help.

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#27

Post by mynewtb »

dave_sullivan wrote: post #4
JimSmith84 wrote: post #2

Hi Everyone, My name’s Jim, and I created MovieChat.org as an archive and replacement for IMDB’s message boards which are shutting down this week. For those of you not familiar, the IMDb message boards allowed you to discuss any single movie or tv show with others (there was a separate forum for each movie/show). IMDb recently announced they were shutting down the message boards and its users were furious (there's a…

This is awesome and much needed. Just throwing it out there, but would you consider making a dump of the data you scraped that could be used by data scientists? Maybe as a torrent or something like that? Data about movies and what people say about them could form the basis of a lot of NLP projects. What other big datasets are there for forum post text data? The reddit dataset most immediately comes to mind, and I've…

ArchiveTeam's web archives will be available to everyone without restrictions or profit as usual.

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#28

Post by mynewtb »

dirkg wrote: post #24

Thank you!! To my knowledge this is the only instance someone has managed to scrape the Imdb boards, very curious how you managed that. I really hope you get a sponsor/donations. This needs to be promoted to other sites/social media and I will do my part. I do have one request - can we do this for actors as well?

http://tracker.archiveteam.org/imdb/

You can even easily join in if you want.

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#29

Post by endymi0n »

JimSmith84 wrote: post #20
WayneBro wrote: post #18

Thanks for making this. Some suggestions: - How about linking back to the IMDB page for each movie? - It would be great if you displayed various ratings from IMDB, Rotten Tomatoes and elsewhere kind of like JustWatch.com does (but with links to those ratings pages). - Actually, it would be really cool if you linked to a JustWatch search too so the user can easily see if the movie is streaming anywhere that they subsc…

Yeah I was actually thinking of doing this, just been super busy trying to archive everything from IMDB before the boards shut down. Do you know the founders at JustWatch?

Hey Jim, one of the JustWatch founders here - we'd love to have linkouts as well. Unfortunately, interests with IMDB aren't super aligned at the moment and they're in business much, much longer than we are. Let's say they keep a pretty close guard on their data, as they've spent the last dozen years collecting it.

But rest assured we're working heavily behind the scenes to make our site & UX better and better every day with free and open movie data sources - but always trying to stay safe on the legal side.

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#30

Post by JimSmith84 »

dave_sullivan wrote: post #4
JimSmith84 wrote: post #2

Hi Everyone, My name’s Jim, and I created MovieChat.org as an archive and replacement for IMDB’s message boards which are shutting down this week. For those of you not familiar, the IMDb message boards allowed you to discuss any single movie or tv show with others (there was a separate forum for each movie/show). IMDb recently announced they were shutting down the message boards and its users were furious (there's a…

This is awesome and much needed. Just throwing it out there, but would you consider making a dump of the data you scraped that could be used by data scientists? Maybe as a torrent or something like that? Data about movies and what people say about them could form the basis of a lot of NLP projects. What other big datasets are there for forum post text data? The reddit dataset most immediately comes to mind, and I've…

Yeah that's definitely something I could do. Are there any proposed projects you know of that could benefit from this type of data?
Post reply on HN