Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Growing a Compiler: Getting to Machine Learning from a General Purpose Compiler

docs.google.com

Post reply on HN
Print view View original

21–30 of 40 posts

Re: Growing a Compiler: Getting to Machine Learning from a General Purpose Compiler

#21

Post by xiaodai »

throwawayjava wrote: post #20
xiaodai wrote: post #17

It's unfortunate but google docs are blocked at work. So why am I reading this at work? Cos it might be useful for my work. I do wish more slides are hosted elsewhere not google docs. Because some companies are worried about the use of google docs especially if the data is sensitive e.g. banking and insurance.

Wow. Why?

Assuming it's not a troll question: banks and insurance companies store sensitive financial information about customers. So they dont want any of their employees to use dropbox or the like

Re: Growing a Compiler: Getting to Machine Learning from a General Purpose Compiler

#22

Post by victorNicollet »

throwawayjava wrote: post #20
xiaodai wrote: post #17

It's unfortunate but google docs are blocked at work. So why am I reading this at work? Cos it might be useful for my work. I do wish more slides are hosted elsewhere not google docs. Because some companies are worried about the use of google docs especially if the data is sensitive e.g. banking and insurance.

Wow. Why?

Shadow IT. A client asks: if we cancel our subscription tomorrow and our competitor acquires your company next year, will our data have been deleted by then ? And if you have employees sharing customer data with each other over unsanctioned channels, you can't really answer "yes".

Blocking Google Docs is by far the cheapest way to prevent its use, even considering the downsides of a complete block.

Re: Growing a Compiler: Getting to Machine Learning from a General Purpose Compiler

#23

Post by hencoappel »

victorNicollet wrote: post #22
throwawayjava wrote: post #20

Earlier quoted context omitted.

Wow. Why?

Shadow IT. A client asks: if we cancel our subscription tomorrow and our competitor acquires your company next year, will our data have been deleted by then ? And if you have employees sharing customer data with each other over unsanctioned channels, you can't really answer "yes". Blocking Google Docs is by far the cheapest way to prevent its use, even considering the downsides of a complete block.

Does that mean they block every single website where you can upload data? Dropbox, Gmail, etc? What's even the point given how easy it would be to find some way to send stuff over the Internet?

Re: Growing a Compiler: Getting to Machine Learning from a General Purpose Compiler

#24

Post by sitkack »

ced wrote: post #8
ViralBShah wrote: post #6

Earlier quoted context omitted.

Also, since Yann LeCun said yesterday that Deep Learning needs a new language, this has become a major topic of interest. https://venturebeat.com/2019/02/18/facebooks-chief-ai-scient... Of course, our view is that Julia is one such language that people should consider seriously. The talk linked here is a peek under the hood and shows that differentiable programming in Julia is not a special add-on, but something that…

A long time ago, Yann LeCun wrote Lush, which was a numerically-focused Lisp dialect, with a focus on C interop. It might be one of Julia's closest sibling. > Lush is an object-oriented programming language designed for researchers, experimenters, and engineers interested in large-scale numerical and graphic applications. Lush is designed to be used in situations where one would want to combine the flexibility of a h…

A Lisp with expressive macro support is at least what is needed. Nothing I know of nothing else that has the affordances to support internal DSLs and creative control flow.

Re: Growing a Compiler: Getting to Machine Learning from a General Purpose Compiler

#25

Post by sitkack »

mlevental wrote: post #11
SilasX wrote: post #7

Earlier quoted context omitted.

How ... whatever was the reason for thinking that you needed a ML-specific compiler? Do people also think you need a timecard-tracking-specific compiler?

do you know how modern ml works? do you know that every functional unit in a net needs to be differentiable and so needs to carry around either dual numbers (forward mode) or adjoints (reverse mode)? it's not as simple as just writing a math library.

Please give the parent a benefit of the doubt. Do you even comments are alienating. It could have been written as

Every functional unit in a net needs to be differentiable and so needs to carry around either dual numbers (forward mode) or adjoints (reverse mode). These requirements necessitate new languages and compilers that current imperative representations don’t currently support.

Re: Growing a Compiler: Getting to Machine Learning from a General Purpose Compiler

#26

Post by xiaodai »

hencoappel wrote: post #23
victorNicollet wrote: post #22

Earlier quoted context omitted.

Shadow IT. A client asks: if we cancel our subscription tomorrow and our competitor acquires your company next year, will our data have been deleted by then ? And if you have employees sharing customer data with each other over unsanctioned channels, you can't really answer "yes". Blocking Google Docs is by far the cheapest way to prevent its use, even considering the downsides of a complete block.

Does that mean they block every single website where you can upload data? Dropbox, Gmail, etc? What's even the point given how easy it would be to find some way to send stuff over the Internet?

Yes. Some allow gmail cos you cant upload large files anyway

Re: Growing a Compiler: Getting to Machine Learning from a General Purpose Compiler

#27

Post by CuriousCosmic »

victorNicollet wrote: post #22
throwawayjava wrote: post #20

Earlier quoted context omitted.

Wow. Why?

Shadow IT. A client asks: if we cancel our subscription tomorrow and our competitor acquires your company next year, will our data have been deleted by then ? And if you have employees sharing customer data with each other over unsanctioned channels, you can't really answer "yes". Blocking Google Docs is by far the cheapest way to prevent its use, even considering the downsides of a complete block.

I'd recommend suggesting that they whitelist /preview as that is a view only mode that allows you to access external docs without leaking data to the world.

Re: Growing a Compiler: Getting to Machine Learning from a General Purpose Compiler

#30

Post by jng »

KenoFischer wrote: post #3
quasarj wrote: post #2

wat

This is a talk we gave at the "Compilers for Machine Learning" workshop at CGO this past Sunday. Obviously the slides are missing some of the context of the presentation, but the core argument is that one shouldn't build compilers for machine learning, but rather build general purpose compilers that are flexible and extensible. From there, you can easily get all the same benefits as dedicated machine learning compile…

Is there a video of the talk? Would love to watch it. Congrats on the work, it looks great! I'm just missing more detail, since having just the slides is a bit on the dry side.
Post reply on HN