31–40 of 70 posts
Earlier quoted context omitted.
Why would scraping their site be illegal?
I figured displaying their content in full is illegal.
Earlier quoted context omitted.
Do you have any suggestions on fonts to use for readability? I was looking through Google Web Fonts and came up short.
I'd recommend changing some CSS on the H2 elements. You have line-height and font-size both set to 15px, which gives the multi-line H2s no room to breath. I'd also ditch Open-Sans for Helvetica-Neue, which is more readable, remove font-weight:bold (it's too much bold on the page), and tweak the margins. Before: http://i.imgur.com/vaf7U.png After: http://i.imgur.com/a8bHS.png
That looks fantastic. I actually tried to get a designer on board to help with the front-end, but unfortunately he wasn't able to help out. So I did the best I could. :)
I will definitely implement these font changes. :)
The concept is good and its easier to scan than IAMA but the design/typography just hurts to read. I would probably fix that asap. Make it bigger, easier to read and change the font. In regards to your concerns of legality. Reddit seems to be ok with scrapers, bots and the like as long as you dont make more than 30 requests per minute.
Very cool. It picks all the important stuff and presents it sans the fluff. Where do I subscribe? Really, where's the rss feed for new AMAs? Also, links to questions in their original context would be nice.
Earlier quoted context omitted.
I ran into the same problem. I started a pet project that involved scraping reddit (though for a different purpose than AMAs). Their robots.txt and an admin writeup from somewhere on their site made me realize that I'd probably just have to take it down and/or my scraper would just get blacklisted. It's a bummer because there's 1001 great ideas out there for filtering, categorizing, and viewing reddit's data in diffe…
I made sure to be nice to reddit. The scrapper is set to crawl reddit once every 12 hours for new "top monthly iamas". Very good suggestion for nested threads. A good example of a reply to a question is on the westboro-baptist-church thread. I think it's possible to implement this suggestion. Will fool around with it on localhost and see what I come up with.
No worries on the suggestion. Those threaded comments can be tricky sometimes.
Hey, if you do hear back from them about their stance on this sort of thing, I'd really appreciate if you could let me know what they say. I sort of halted my project after a certain point because I had the fear I'd just have to take it down as soon as I completed it.
http://www.topiama.com/r/21/iama-former-rosetta-stone-employ...
I have emailed Reddit about the legality of this project. (Have not received a response yet) So far it seems likely that I will have to take down the site. So consider this a small preview I suppose. I plan to port this to a Chrome Extension. Do you guys find this format much more readable than the current completed IAmA?
http://www.reddit.com/r/IAmA/comments/v99eg/iaman_exmember_o...
Right now the top-rated comment by Nate Phelps is not in direct response to a particular question.
This top-rated comment is not on topiama.com:
http://www.topiama.com/r/4/iaman-exmember-of-the-westboro-ba...
I don't know if this is a feature or a bug or if hasn't been crawled recently.
It would be great to see these top-level comments!
------------
Linking to an answer's context would be super-useful as well. A great deal of the fun and value reddit supplies is the community commentary and responses to an AMA's answers. This can range from the funny to the insightful to the scary - something topiama.com doesn't capture. Which is great - sometimes you don't want the peanut gallery.