11–20 of 60 posts
Unrelated, but for those who have never seen the Jeff Dean facts, behold: https://www.quora.com/What-are-all-the-Jeff-Dean-facts Some highlights include: -Jeff Dean's PIN is the last 4 digits of pi. -He once shifted a bit so hard it ended up on another computer. -He wrote an O(n^2) algorithm once. It was for the Traveling Salesman Problem. -Jeff Dean once implemented a web server in a single printf() call. Other engi…
Does anyone have tips on how a European based developer with machine learning expertise can get involved with projects battling climate change like Jeff is talking about here?
Somebody tell Jeff about Jevon's Paradox, or actually don't bother.
He probably does know about it because he seems he’s a well-read guy, but I think is too late for him and for people like him now: the pay they receive is too good for them to leave it all for some “principles” and on top of that I think the’ve also managed to acquire come cognitive dissonance traits that allow them to get out of bed in the morning and go to work without feeling guilty. Otherwise I cannot understand…
Training a machine learning model for any common task is getting radically cheaper and more energy efficient.
This is a combination of both better hardware (eg, Google TPUs) and better optimisation of training techniques (which is mostly done outside Google).
Eg, DAWN Bench[1] benchmarks training of ReseNet50 to 93% accuracy. This used to take days.
Now the FastAI group has shown you can do it in 18 minutes on 16 p3.16xlarge on AWS Spot instances. This is a huge energy saving.
Huawei has shown you can do it on 16x8xV100s on their cloud in less than 3 minutes.
Earlier quoted context omitted.
He probably does know about it because he seems he’s a well-read guy, but I think is too late for him and for people like him now: the pay they receive is too good for them to leave it all for some “principles” and on top of that I think the’ve also managed to acquire come cognitive dissonance traits that allow them to get out of bed in the morning and go to work without feeling guilty. Otherwise I cannot understand…
Jeff is right. Training a machine learning model for any common task is getting radically cheaper and more energy efficient. This is a combination of both better hardware (eg, Google TPUs) and better optimisation of training techniques (which is mostly done outside Google). Eg, DAWN Bench[1] benchmarks training of ReseNet50 to 93% accuracy. This used to take days. Now the FastAI group has shown you can do it in 18 mi…
Somebody tell Jeff about Jevon's Paradox, or actually don't bother.
Is Jevons paradox really a problem when your carbon footprint is zero? > VentureBeat: One of the things that’s come up a lot lately, you know, in the question of climate change — I was talking with Intel AI general manager Naveen Rao recently and he mentioned this idea [that] compute-per-watt should become a standard benchmark, for example, and some of the organizers here are talking about the notion of people being…
That is a lie unless Jeff Dean lives under different physics laws.
Does anyone have tips on how a European based developer with machine learning expertise can get involved with projects battling climate change like Jeff is talking about here?
I'm also working something similar to this. Would you leave your contact info ?
Earlier quoted context omitted.
Is Jevons paradox really a problem when your carbon footprint is zero? > VentureBeat: One of the things that’s come up a lot lately, you know, in the question of climate change — I was talking with Intel AI general manager Naveen Rao recently and he mentioned this idea [that] compute-per-watt should become a standard benchmark, for example, and some of the organizers here are talking about the notion of people being…
>> all the stuff we trained in our Google Data Center — the carbon footprint is zero That is a lie unless Jeff Dean lives under different physics laws.
(disclaimer: work at G)
https://storage.googleapis.com/gweb-sustainability.appspot.c...
Earlier quoted context omitted.
>> all the stuff we trained in our Google Data Center — the carbon footprint is zero That is a lie unless Jeff Dean lives under different physics laws.
It's a mix of (1) great work around sustainable processes and (2) nuances in defining carbon footprint. (disclaimer: work at G) https://storage.googleapis.com/gweb-sustainability.appspot.c... https://www.google.com/about/datacenters/renewable/
Earlier quoted context omitted.
Is Jevons paradox really a problem when your carbon footprint is zero? > VentureBeat: One of the things that’s come up a lot lately, you know, in the question of climate change — I was talking with Intel AI general manager Naveen Rao recently and he mentioned this idea [that] compute-per-watt should become a standard benchmark, for example, and some of the organizers here are talking about the notion of people being…
>> all the stuff we trained in our Google Data Center — the carbon footprint is zero That is a lie unless Jeff Dean lives under different physics laws.