Live data from Hacker News

Apple might be running a web crawler written in Go

jan.moesen.nu

51–60 of 85 posts

Re: Apple might be running a web crawler written in Go

#51
post #20

Earlier quoted context omitted.

Why shouldnt someone at apple use Go. Servers/scripts/etc are not their usual focus and they dont really have an internal language that fits better. Go is pretty good at this kind of things.

I like Go, but fail to see how Swift and C++14 don't fit the bill as well. EDIT: changed to a more constructive comment.

Any Turing Complete language would "fit the bill", obviously.

What's wrong with a company not just kicking the tires on another language, but using it on a big project? That's how you design better languages of your own.

"Go was great, except for X and Y" leads to improvements on your own stuff.

Re: Apple might be running a web crawler written in Go

#52

The Go http client definitely has a bug that doesn't maintain the User-Agent across redirected requests. https://code.google.com/p/go/source/browse/src/net/http/clie...

Looks like issue #4800 is the place where it's tracked:

https://code.google.com/p/go/issues/detail?id=4800

Re: Apple might be running a web crawler written in Go

#53
post #8

Not at all sure why it's relevant which programming languages they use at Apple. Is this considered interesting since it somehow proves the mainstream adoption of Go? Or since Apple, a competitor of Google's in cell phones, are using one of Google's technologies? Or what? The takeaway for me was that Apple has a whole /8 subnet to themselves. That's just ... immense, for a single company. Gaah. EDIT: Mis-typed the ne…

Go is not really a "Google" technology. It's just a programming language like any other. There's no reason Apple shouldn't use it, if it's the right tool for the job.

Re: Apple might be running a web crawler written in Go

#54
post #45
post #8

Not at all sure why it's relevant which programming languages they use at Apple. Is this considered interesting since it somehow proves the mainstream adoption of Go? Or since Apple, a competitor of Google's in cell phones, are using one of Google's technologies? Or what? The takeaway for me was that Apple has a whole /8 subnet to themselves. That's just ... immense, for a single company. Gaah. EDIT: Mis-typed the ne…

The software tech Apple uses generally doesn't seem to get as publicized compared to most large tech companies - for example, I know second hand that Apple uses Angular.js, but I have never seen anything in the wild about it. One thing to keep in mind though is that Apple is much more a hardware company than software.

For a hardware company, the write a crapload of software... like Mac OS, iOS, and all the built-in applications. I'd say they probably do a lot more on software than hardware, actually. They only release a few pieces of hardware a year.

Re: Apple might be running a web crawler written in Go

#55
post #45
post #8

Not at all sure why it's relevant which programming languages they use at Apple. Is this considered interesting since it somehow proves the mainstream adoption of Go? Or since Apple, a competitor of Google's in cell phones, are using one of Google's technologies? Or what? The takeaway for me was that Apple has a whole /8 subnet to themselves. That's just ... immense, for a single company. Gaah. EDIT: Mis-typed the ne…

The software tech Apple uses generally doesn't seem to get as publicized compared to most large tech companies - for example, I know second hand that Apple uses Angular.js, but I have never seen anything in the wild about it. One thing to keep in mind though is that Apple is much more a hardware company than software.

"Apple views itself as a software company."

- Steve Jobs

https://www.youtube.com/watch?v=dEeyaAUCyZs

Re: Apple might be running a web crawler written in Go

#56
post #8

Not at all sure why it's relevant which programming languages they use at Apple. Is this considered interesting since it somehow proves the mainstream adoption of Go? Or since Apple, a competitor of Google's in cell phones, are using one of Google's technologies? Or what? The takeaway for me was that Apple has a whole /8 subnet to themselves. That's just ... immense, for a single company. Gaah. EDIT: Mis-typed the ne…

I agree. "Breaking news: Apple uses Google products"

Re: Apple might be running a web crawler written in Go

#57
post #27

Earlier quoted context omitted.

Swift is a general purpose language. I fail to see what it lacks.

So are Python and Ruby, but most people will agree that those are unsuitable for certain types of highly concurrent and performance sensitive network applications. Using the right language for a particular domain can save you a lot of headache. Go is open source and a relatively proven choice, compared to Swift.

I would expect Swift to have comparable performance to Go since it's a C like compiled language. Where it doesn't, Apple should probably dog-food it so they can find any deficiencies.

Re: Apple might be running a web crawler written in Go

#58
post #54
post #45

Earlier quoted context omitted.

The software tech Apple uses generally doesn't seem to get as publicized compared to most large tech companies - for example, I know second hand that Apple uses Angular.js, but I have never seen anything in the wild about it. One thing to keep in mind though is that Apple is much more a hardware company than software.

For a hardware company, the write a crapload of software... like Mac OS, iOS, and all the built-in applications. I'd say they probably do a lot more on software than hardware, actually. They only release a few pieces of hardware a year.

It's not difficult to argue that reliable hardware is only a delivery mechanism to enable the usage of Apple's software, however I doubt users would purchase a "Samsung iPhone" or "LG iPhone" in the same manner that they do for Android devices.

The Apple hardware brand, the hardware itself, and the software all together sustain the user demographic.

Re: Apple might be running a web crawler written in Go

#59
post #53
post #8

Not at all sure why it's relevant which programming languages they use at Apple. Is this considered interesting since it somehow proves the mainstream adoption of Go? Or since Apple, a competitor of Google's in cell phones, are using one of Google's technologies? Or what? The takeaway for me was that Apple has a whole /8 subnet to themselves. That's just ... immense, for a single company. Gaah. EDIT: Mis-typed the ne…

Go is not really a "Google" technology. It's just a programming language like any other. There's no reason Apple shouldn't use it, if it's the right tool for the job.

Well, it'd be pretty weird if Go-ogle started developing their applications in Swift.
Post reply on HN