Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Chris Lattner Joins Google Brain

techcrunch.com

Post reply on HN
Print view View original

91–100 of 111 posts

Re: Chris Lattner Joins Google Brain

#91

Post by tanilama »

leereeves wrote: post #51
chubot wrote: post #36

Earlier quoted context omitted.

There is an obvious overlap between programming languages and machine learning at Google: TensorFlow. For example, see "A Computational Model for TensorFlow" https://research.google.com/pubs/pub46196.html There are tons of interesting things going on in TensorFlow from a programming language perspective. It has optimization at the low level, like CUDA and SIMD back ends via the Eigen library [1] (which is pretty craz…

Makes me wonder if Google is working on a programming language for machine learning...

Interesting idea, indeed. Add to this programming language:

1.True multithreading.

2.Native support of spread computation to heterogeneous computation devices, across CPU/GPU/Whatever-Chip-You-Call

3.Auto vectorization.

4.PyTorch style autodiff, and should be able to JIT hotspot as the program runs.

5.Native distributed support with built-in primitives.

6.Visualization as standard library, even language primitives.

Re: Chris Lattner Joins Google Brain

#93

Post by gaius »

mathperson wrote: post #58
eanzenberg wrote: post #7

Super interesting developments.. Also, re: >AI can't democratize itself (yet?) so I'll help make it more accessible to everyone! This needs to happen more on the software side. You can buy a world-class quad-gpu machine for about half the cost of a vehicle. You can build a world-class single-gpu machine (what I have) for a fifth of that. It's literally amazing how accessible the hardware is, compared to almost any ot…

I mean...you can't make math simpler. like...math is math. you can create resources that make it easier to teach math (and for the record high quality textbooks on AI/ML ABOUND). I think you want software and libraries so you can build things without understanding the math. To some degree this already possible (see my english major linkedin friends playing withs sci-kit etc etc). Fundamentally though, I think you nee…

mean...you can't make math simpler. like...math is math.

Notation makes a huge difference. LinAlg is a good example of this. And a PL is notation.

Re: Chris Lattner Joins Google Brain

#94

Post by jakobegger »

mathperson wrote: post #58
eanzenberg wrote: post #7

Super interesting developments.. Also, re: >AI can't democratize itself (yet?) so I'll help make it more accessible to everyone! This needs to happen more on the software side. You can buy a world-class quad-gpu machine for about half the cost of a vehicle. You can build a world-class single-gpu machine (what I have) for a fifth of that. It's literally amazing how accessible the hardware is, compared to almost any ot…

I mean...you can't make math simpler. like...math is math. you can create resources that make it easier to teach math (and for the record high quality textbooks on AI/ML ABOUND). I think you want software and libraries so you can build things without understanding the math. To some degree this already possible (see my english major linkedin friends playing withs sci-kit etc etc). Fundamentally though, I think you nee…

Re: "I don't fully understand the correspondence between the paper and the code"

Have you tried contacting the paper's author(s)? Preferably the PhD student that did the actual work?

I used to do that when I couldn't make sense of a paper. Not all authors will respond, some might brush you off with a generic remark to read the appendix or whatever. But it's worth a try. In one case, the author frankly told me that the code didn't work as well as it sounded in the paper -- the algorithm was so instable that it wasn't very useful. But they couldn't have written that in the paper, or it might not have been accepted.

Re: Chris Lattner Joins Google Brain

#95

Post by jakobegger »

gaius wrote: post #93
mathperson wrote: post #58

Earlier quoted context omitted.

I mean...you can't make math simpler. like...math is math. you can create resources that make it easier to teach math (and for the record high quality textbooks on AI/ML ABOUND). I think you want software and libraries so you can build things without understanding the math. To some degree this already possible (see my english major linkedin friends playing withs sci-kit etc etc). Fundamentally though, I think you nee…

mean...you can't make math simpler. like...math is math. Notation makes a huge difference. LinAlg is a good example of this. And a PL is notation.

Simpler notation might make it easier to implement algorithms without fully understanding them. Not sure how much good is going to come from that.

But if you fully understand the problem, notation is not an issue.

Re: Chris Lattner Joins Google Brain

#96

Post by benzoate »

bitmapbrother wrote: post #43
tatoalo wrote: post #3

Interesting as a company change (IMHO), from privacy-focused Apple to Google... :D

Privacy focused? Oh, you mean how they pivoted when their Ad business failed.

Didn't their ad business fail because they refused to share/collect as much user data, and hence advertisers were less willing to spend on their platform?

Re: Chris Lattner Joins Google Brain

#97

Post by samuell »

chubot wrote: post #60
seanmcdirmid wrote: post #55

Earlier quoted context omitted.

Jeff Dean got his PhD under Craig Chambers doing PL work; Sanjay Ghemawat was also a compiler guy, they went on to mapreduce and I think, at least Jeff Dean, is heavily involved in Tensorflow. Google hires a lot of PL PhDs to do work that isn't very related to PL (we joke about PL PhDs working on ads a lot). One could guess that they just make good developers because of their experience, but the specific knowledge mi…

Right and Craig Chambers later joined Google. He led/developed Flume [1] (a Java framework on top of MapReduce) and the unfortunately named Cloud Dataflow [2] (which aims at unifying streaming and batch computation) I say unfortunate because pretty much all the big data frameworks could be called "cloud dataflow", including TensorFlow itself. People using Google Cloud might recognize the name of VP Urs Hoezle, who wo…

Wasn't V8 developed by Bak & co in a separate company, which was bought by Google? (Didn't find any source, but based on what I thought I read in the news at that time ...)

Re: Chris Lattner Joins Google Brain

#98

Post by tmd83 »

kensai wrote: post #6
samfisher83 wrote: post #4

Earlier quoted context omitted.

I am guessing he doesn't have to write code on a whiteboard.

Damn, I always thought interviews of guys like him went along these lines: https://www.youtube.com/watch?v=XUhsNIeIgpY

This looked like a pretty idiotic advise for the most part.

Re: Chris Lattner Joins Google Brain

#99

Post by cf »

lmeyerov wrote: post #85
cf wrote: post #78

Earlier quoted context omitted.

Well as another machine learning researcher, I think you can make a major impact working on problems that aren't in AI. Now if you are a PL person interested in AI we would love to have you and your expertise! Oh and if you want to use AI to solve PL problems like program synthesis and program completion, that's cool too.

Haha I was going to say, solving synthesis via PL+AI is way more exciting than either technique alone. -- A former PL researcher making AI way more useful via vanilla PL techniques

Welcome to the party!

Re: Chris Lattner Joins Google Brain

#100

Post by [deleted] »

lmeyerov wrote: post #85
cf wrote: post #78

Earlier quoted context omitted.

Well as another machine learning researcher, I think you can make a major impact working on problems that aren't in AI. Now if you are a PL person interested in AI we would love to have you and your expertise! Oh and if you want to use AI to solve PL problems like program synthesis and program completion, that's cool too.

Haha I was going to say, solving synthesis via PL+AI is way more exciting than either technique alone. -- A former PL researcher making AI way more useful via vanilla PL techniques

[deleted]
Post reply on HN