Viewing profile — curio

thanks for taking the time to respond to this. i definitely understand where you're coming from and am glad to hear the robots.txt is being updated.

but their robots.txt says that you're welcome to scrape it: User-agent: * Disallow: /ac.php Disallow: /ae.php Disallow: /album.php Disallow: /ap.php Disallow: /feeds/ Disallow: /o.…

incredibly easy. and not only can the bot lie, it can disregard the robots.txt file altogether. just like the terms of service document for humans, you can choose to disregard it &…

yes, using the user-agent: http://en.wikipedia.org/wiki/Robots_exclusion_standard

this is a really important issue. this new model that facebook is trying to push isn't scalable. it favors the big guys and it's bad for the open web. you shouldn't have a TOS that…

probably not, but that's irrelevant. the point is facebook's robots.txt says you can crawl it but their TOS says you can't. facebook have already shown they are willing to sue anyo…

you can also do this with a regular expression. here's the blog post i wrote on it a year ago. i use one function to grab get variables from either window.location or from a script…

and just like chatroulette or most anonymous forums, the tone quickly deteriorates to the level of graffiti in a public bathroom stall.

he should drop out of school and use it as an excuse to get on every tv station and written about in every paper in the country. who wants a degree from such a dumb school anyway. …

practically speaking, most respectable email services will have an MX record. i tested it on about 30,000 emails & a simple MX lookup caught about 40 gmial's and only 1 false posit…

that reminds me of the girl who takes advantage of the zappos free returns policy and gets 5 new pairs of shoes every singles week only to mail them back a few days later. but zapp…

and while we're on the topic of how broken SSN's are... why is it that the most important piece of identification you receive in your life, that you also need to keep forever, is p…

It sucks that comments aren't enabled on that post. You can see the responses from the community (including Brett Slatkin one of the authors) on the Google Group for PuSH: http://g…

YES!

That's an important point. You can see how PuSH handles it here: http://pubsubhubbub.googlecode.com/svn/trunk/pubsubhubbub-co...

Crap - don't know how that happened. I've reposted the article with the correct link if you care to thumb that one up instead.

It should be back up now. Too much traffic I guess. :)

Impressive demo. Very cool to see real-time updates coming to Google Reader.

I don't know what you should do, and I don't necessarily think there is one right answer for everything in this position. I do know that almost every successful entrepreneurship I'…

+1 vote for pubsubhubbub