Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

moviechat.org

Post reply on HN
Print view View original

41–50 of 82 posts

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#41

Post by anilgulecha »

JimSmith84 wrote: post #30
dave_sullivan wrote: post #4

Earlier quoted context omitted.

This is awesome and much needed. Just throwing it out there, but would you consider making a dump of the data you scraped that could be used by data scientists? Maybe as a torrent or something like that? Data about movies and what people say about them could form the basis of a lot of NLP projects. What other big datasets are there for forum post text data? The reddit dataset most immediately comes to mind, and I've…

Yeah that's definitely something I could do. Are there any proposed projects you know of that could benefit from this type of data?

Everything from simple sentiment analysis, to archive.org, to another mirror. I hope that does not discourage you from releasing the data.

Edit: I see the other comment about archive team already collecting and releasing this data, for free in an open format. I think that will be a good first source as well.

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#42

Post by icemelt8 »

Guest98123 wrote: post #15
JimSmith84 wrote: post #7

Earlier quoted context omitted.

Yeah that's a good question. Before I became an engineer I practiced IP/copyright law. Also spoke (colloquially) with a few ppl at the company. I did my homework before starting this project and I'm confident we're in a good position :)

Could you explain why you think you're in a good position? From what I understand, the comments are owned by the users, and by posting them to IMDb, they allowed IMDb and their affiliates the right to use them. The users did not give you permission to use their data, and you're not associated with IMDb, and therefore do not inherit the rights. Lastly, IMDb specifically states that scraping or extracting data is forbi…

I wish I could downvote you.

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#43

Post by johnymontana »

JimSmith84 wrote: post #30
dave_sullivan wrote: post #4

Earlier quoted context omitted.

This is awesome and much needed. Just throwing it out there, but would you consider making a dump of the data you scraped that could be used by data scientists? Maybe as a torrent or something like that? Data about movies and what people say about them could form the basis of a lot of NLP projects. What other big datasets are there for forum post text data? The reddit dataset most immediately comes to mind, and I've…

Yeah that's definitely something I could do. Are there any proposed projects you know of that could benefit from this type of data?

I'd love to explore how this data could be used to enhance recommender systems.

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#44

Post by endymi0n »

johnymontana wrote: post #43
JimSmith84 wrote: post #30

Earlier quoted context omitted.

Yeah that's definitely something I could do. Are there any proposed projects you know of that could benefit from this type of data?

I'd love to explore how this data could be used to enhance recommender systems.

AFAIK, Jinni is doing exactly that.

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#45

Post by Jaruzel »

dirkg wrote: post #24

Thank you!! To my knowledge this is the only instance someone has managed to scrape the Imdb boards, very curious how you managed that. I really hope you get a sponsor/donations. This needs to be promoted to other sites/social media and I will do my part. I do have one request - can we do this for actors as well?

Somewhere buried on IMDB is the ability to download the IMDB database of actors/films/directors etc. I did it once, but discovered it's in such mess (schema wise) that it would be easier just scraping the actual IMDB pages I needed[1].

---

[1] To populate my Kodi .nfo files in a way that I was happy with. I know scraping is probably against IMDB t&cs, but as this was for my own use, I took the risk.

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#46

Post by Markoff »

thank you for helping further fragmentation of IMDb alternatives by creating dumb forum like tons of other generic forums when there is REAL alternative movie database with discussions for each movie called The Movie database themoviedb.org run since 2008 and edited by its own users like Wikipedia

it's nice you created searchable archive of IMDb discussions though guys at Archive are doing same anyway, not posing as alternative and I am not feeling very happy sometime took 14 years of my IMDb posts and put them on his website without my agreement

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#47

Post by Jaruzel »

OldSchoolJohnny wrote: post #33
dewey wrote: post #9

Please add https, now with Let's encrypt there's really no excuse to not have it.

I wish! Windows servers is an excellent excuse to not have it. Two years running now there still isn't a practical solution for Windows servers and none in sight for the foreseeable future.

I totally agree with this.

I am not comfortable running a daily, task scheduler based, third party script with local admin rights, on my Windows Server, that checks my Lets Encrypt certs and auto renews them.

However, now that Chrome v56+ is revoking StartSSL.com certs, I've probably got no choice. Either that, or actually PAY for a multi-domain cert (Comodo do a fairly cheap one).

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#48

Post by Markoff »

CM30 wrote: post #8

It's a good start. I mean, you've got the data from the original IMDB boards all laid out and accessible, so that's better than most alternatives at the moment. However, I'm curious about exactly how you're going to promote this site. The people currently on IMDB likely don't know much about it, and it's unlikely the administration there will redirect people over when they view the pages for a movie or TV show on the…

he doesn't have movie database with ratings and watchlists, so i see no reason moving there when i can have all of this plus discussions at TMDb (yes, they are at the moment quite empty because nobody illegally copied posts from IMDb there, including mine)

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#49

Post by Markoff »

chinathrow wrote: post #23

Nice - but have you consent of the comment authors to duplicate the content? Normally, UGC (user generated content) remains under copyright of the users.

no, he doesn't and he illegally copied 14 years of my posts which i don't like especially since I moved to TMDb which is proper movie database where you can also import your IMDb ratings and watchlist and each movie there has own discussions

Re: Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

#50

Post by Markoff »

dirkg wrote: post #24

Thank you!! To my knowledge this is the only instance someone has managed to scrape the Imdb boards, very curious how you managed that. I really hope you get a sponsor/donations. This needs to be promoted to other sites/social media and I will do my part. I do have one request - can we do this for actors as well?

promoting illegally copied content of users without their consent? for what's it worth, he copied 14 years of my posts and I don't like it
Post reply on HN