Wanna have zillions of google profiles?
google.com
Wanna have zillions of google profiles?
1–10 of 47 posts
Re: Wanna have zillions of google profiles?
#2The odd thing, is that getting a list of all profiles correctly doesn't wor. If you go to Google's robots.txt and scroll to the bottom to find the profiles sitemap is located at:
http://www.gstatic.com/s2/sitemaps/profiles-sitemap.xml
Which 404s.
Luckily, it's quite easy to reverse engineer. Start with:
http://www.gstatic.com/s2/sitemaps/sitemap-000.txt
and increment 000 till you 404. From quick testing, it's less than 3500 but more than 3200.
Re: Wanna have zillions of google profiles?
#3sitemap-3278 is the upper limit, so there appear to be roughly 16.4 million profiles available. I would be interested to see how many of these have public information (name, address, etc.).
Re: Wanna have zillions of google profiles?
#4Those profile lists aren't complete. For more discussion, see the Google Buzz list where, until the Buzz team released their own firehose, any of us who wanted a firehose had to build our own. Also noteworthy, it's easier to just download and parse those XML files -- why use a search engine for that to begin with when it's already aggregated for you?
Re: Wanna have zillions of google profiles?
#5Re: Wanna have zillions of google profiles?
#6I may be a little daft but how is this a big deal other than these files showing up in G's index?
Re: Wanna have zillions of google profiles?
#7The odd thing, is that getting a list of all profiles correctly doesn't wor. If you go to Google's robots.txt and scroll to the bottom to find the profiles sitemap is located at: http://www.gstatic.com/s2/sitemaps/profiles-sitemap.xml Which 404s. Luckily, it's quite easy to reverse engineer. Start with: http://www.gstatic.com/s2/sitemaps/sitemap-000.txt and increment 000 till you 404. From quick testing, it's less th…
As of this comment it's exactly 3278. I wonder why you didn't bother doing 3-4 more trials before writing the comment :)
http://www.gstatic.com/s2/sitemaps/sitemap-3278.txt
Re: Wanna have zillions of google profiles?
#8The odd thing, is that getting a list of all profiles correctly doesn't wor. If you go to Google's robots.txt and scroll to the bottom to find the profiles sitemap is located at: http://www.gstatic.com/s2/sitemaps/profiles-sitemap.xml Which 404s. Luckily, it's quite easy to reverse engineer. Start with: http://www.gstatic.com/s2/sitemaps/sitemap-000.txt and increment 000 till you 404. From quick testing, it's less th…
[deleted]
Re: Wanna have zillions of google profiles?
#9The odd thing, is that getting a list of all profiles correctly doesn't wor. If you go to Google's robots.txt and scroll to the bottom to find the profiles sitemap is located at: http://www.gstatic.com/s2/sitemaps/profiles-sitemap.xml Which 404s. Luckily, it's quite easy to reverse engineer. Start with: http://www.gstatic.com/s2/sitemaps/sitemap-000.txt and increment 000 till you 404. From quick testing, it's less th…
[deleted]
Re: Wanna have zillions of google profiles?
#10I may be a little daft but how is this a big deal other than these files showing up in G's index?
I don't think it's a big deal but I guess the author wanted to point out an easy way to crawl this public info. There are similar ways to crawl public Facebook profiles too, so it's really not a big deal.