Earlier quoted context omitted.
Pfff, real men do their own crawling.
well, I toyed around with writing my own search engine (have a pretty good proof of concept) but in the end the bandwidth costs would have been prohibitive... so there :)
Yahoo is Number One in So Much More Than Search
31–40 of 50 posts
Re: Yahoo is Number One in So Much More Than Search
#32I honestly can't remember the last time I even used Yahoo. Am I alone in this or is this common ?
Re: Yahoo is Number One in So Much More Than Search
#33I honestly can't remember the last time I even used Yahoo. Am I alone in this or is this common ?
Re: Yahoo is Number One in So Much More Than Search
#34Earlier quoted context omitted.
well, I toyed around with writing my own search engine (have a pretty good proof of concept) but in the end the bandwidth costs would have been prohibitive... so there :)
http://www.80legs.com/ - jdrock, founder, is around here on HN
The funny thing is while coding that stuff the bigger problems were financial and the enormous amount of cruft that is the web. The actual search engine wasn't that hard at all.
Re: Yahoo is Number One in So Much More Than Search
#35Re: Yahoo is Number One in So Much More Than Search
#36I honestly can't remember the last time I even used Yahoo. Am I alone in this or is this common ?
Re: Yahoo is Number One in So Much More Than Search
#37Earlier quoted context omitted.
http://www.80legs.com/ - jdrock, founder, is around here on HN
That's extremely interesting. Thank you! The funny thing is while coding that stuff the bigger problems were financial and the enormous amount of cruft that is the web. The actual search engine wasn't that hard at all.
Re: Yahoo is Number One in So Much More Than Search
#38Earlier quoted context omitted.
That's extremely interesting. Thank you! The funny thing is while coding that stuff the bigger problems were financial and the enormous amount of cruft that is the web. The actual search engine wasn't that hard at all.
Yep - that's exactly it. Setting up the infrastructure to handle large, web-scale content analysis is the real challenge. (Shameless plug alert) That's why we setup 80legs: to help everyone not called Google/Yahoo/Microsoft to have comparable capabilities when it comes to this.
But I think that once you have enough customers the cost of 'crawling' goes down for every new customer you sign up because you only need to crawl a page once and you can sell the crawled result to many customers. Or do I misread your model and is every page crawled over and over again for every user ?
Re: Yahoo is Number One in So Much More Than Search
#39I honestly can't remember the last time I even used Yahoo. Am I alone in this or is this common ?
Re: Yahoo is Number One in So Much More Than Search
#40Yahoo! has lost its reputation within geek circles. Google have not only put out really great products, they also go to great lengths to boast about their vastly superior technologies (BigTable, MapReduce), which gets them a lot of (well-deserved) geek love. Then there are Android and Chrome (with V8), both of which are pretty exciting to hackers. Also, Summer of Code, Code Jam etc. get Google a lot of street cred. S…