Live data from Hacker News

Untitled topic

news.ycombinator.com

1–2 of 2 posts

Re: undefined

#2
So, you spawn multiple threads to mercilessly hammer the web host of a small struggling independent radio station to get their data, and now want to share the tool so others can amplify the burden imposed on their server?

Let's see what they say on their site:

  "If you haven't recently, please make a donation today to ensure that
  SomaFM can continue broadcasting.

  Sadly we don't have some magical benefactor who made billions with
  their tech startup subsidizing SomaFM. So we need your help. Please?
  Don't make us post pictures of our DJs looking solemnly at the camera
  and begging for your support!!

  Over 30 unique channels of listener-supported, commercial-free,
  underground/alternative radio broadcasting to the world. All music
  hand-picked by SomaFM's award-winning DJs and music directors."
And then there is this:

  Terms of Service

  ...

  User Conduct

  As a condition to your use of this website, you agree not to:

  interfere with or disrupt this website or any systems or networks
  connected to this website;

  ...

  use any engine, software, tool, agent or device, including any "deep-link",
  "page-scrape", "robot", "spider" or other automatic device, program,
  algorithm or methodology, or any similar or equivalent manual process
  to access, search or monitor this website or any information,
  content, text, graphics, or other materials appearing on this website,
  other than the software and/or search agents provided by SOMAFM or other
  generally available third party web browsers (such as Microsoft Internet
  Explorer or Netscape Navigator);

  attempt to obtain, collect, store or modify any personal information of
  other users of this website;

  forge headers or otherwise manipulate identifiers in order to disguise the
  origin of any information, content or material transmitted through this
  website;

  ...
What else? Let's look at robots.txt:

  User-agent: Googlebot-Image
  Disallow: /
  
  User-agent: *
  Disallow: /buy/
  Disallow: /recent/
  Disallow: /play/
  Disallow: /chat/
  Disallow: /blog/
  Disallow: /blogs/
  Disallow: /mailinglist/ 
  Disallow: /charts/ 
  Disallow: */artists.html
  Disallow: */player.html
  Disallow: */songhistory.html
  Disallow: */toptracks.html