Live data from Hacker News

Show HN: A new way to view IAmA's on Reddit

topiama.com

21–30 of 70 posts

Re: Show HN: A new way to view IAmA's on Reddit

#22

I have emailed Reddit about the legality of this project. (Have not received a response yet) So far it seems likely that I will have to take down the site. So consider this a small preview I suppose. I plan to port this to a Chrome Extension. Do you guys find this format much more readable than the current completed IAmA?

This is MUCH better than the reddit version. If they're okay with you doing this, I whole-heartedly support your efforts here and wish you the best of luck with this endeavor

Re: Show HN: A new way to view IAmA's on Reddit

#23

The concept is good and its easier to scan than IAMA but the design/typography just hurts to read. I would probably fix that asap. Make it bigger, easier to read and change the font. In regards to your concerns of legality. Reddit seems to be ok with scrapers, bots and the like as long as you dont make more than 30 requests per minute.

Do you have any suggestions on fonts to use for readability? I was looking through Google Web Fonts and came up short.

I'd recommend changing some CSS on the H2 elements.

You have line-height and font-size both set to 15px, which gives the multi-line H2s no room to breath.

I'd also ditch Open-Sans for Helvetica-Neue, which is more readable, remove font-weight:bold (it's too much bold on the page), and tweak the margins.

Before: http://i.imgur.com/vaf7U.png

After: http://i.imgur.com/a8bHS.png

Re: Show HN: A new way to view IAmA's on Reddit

#24
post #20

I have emailed Reddit about the legality of this project. (Have not received a response yet) So far it seems likely that I will have to take down the site. So consider this a small preview I suppose. I plan to port this to a Chrome Extension. Do you guys find this format much more readable than the current completed IAmA?

I ran into the same problem. I started a pet project that involved scraping reddit (though for a different purpose than AMAs). Their robots.txt and an admin writeup from somewhere on their site made me realize that I'd probably just have to take it down and/or my scraper would just get blacklisted. It's a bummer because there's 1001 great ideas out there for filtering, categorizing, and viewing reddit's data in diffe…

Why were you scraping? They offer a pretty good API.

Re: Show HN: A new way to view IAmA's on Reddit

#28

I have emailed Reddit about the legality of this project. (Have not received a response yet) So far it seems likely that I will have to take down the site. So consider this a small preview I suppose. I plan to port this to a Chrome Extension. Do you guys find this format much more readable than the current completed IAmA?

Why not just use their API instead of scraping?

https://github.com/reddit/reddit/wiki/API

Re: Show HN: A new way to view IAmA's on Reddit

#29
post #20

I have emailed Reddit about the legality of this project. (Have not received a response yet) So far it seems likely that I will have to take down the site. So consider this a small preview I suppose. I plan to port this to a Chrome Extension. Do you guys find this format much more readable than the current completed IAmA?

I ran into the same problem. I started a pet project that involved scraping reddit (though for a different purpose than AMAs). Their robots.txt and an admin writeup from somewhere on their site made me realize that I'd probably just have to take it down and/or my scraper would just get blacklisted. It's a bummer because there's 1001 great ideas out there for filtering, categorizing, and viewing reddit's data in diffe…

I made sure to be nice to reddit. The scrapper is set to crawl reddit once every 12 hours for new "top monthly iamas".

Very good suggestion for nested threads. A good example of a reply to a question is on the westboro-baptist-church thread. I think it's possible to implement this suggestion. Will fool around with it on localhost and see what I come up with.

Re: Show HN: A new way to view IAmA's on Reddit

#30
post #20

Earlier quoted context omitted.

I ran into the same problem. I started a pet project that involved scraping reddit (though for a different purpose than AMAs). Their robots.txt and an admin writeup from somewhere on their site made me realize that I'd probably just have to take it down and/or my scraper would just get blacklisted. It's a bummer because there's 1001 great ideas out there for filtering, categorizing, and viewing reddit's data in diffe…

Why were you scraping? They offer a pretty good API.

User comments, but going by users rather than threads. That way you could get a profile where someone posts, or turn it around and see what prolific posters existed in a given subreddit.

The thing is it wouldn't sweep everything. Instead a user would only get scraped if a request was made to my app, and I had a tool that would go through a request queue (storing to my own DB) in a metered way so that reddit only experienced a handful of requests from me per minute.

Nonetheless it still breaks robots.txt and if I could dig it up admins have said in the past that don't want automated/batched requests hitting their site.

Post reply on HN