Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

blogs.microsoft.com

Post reply on HN
Print view View original

51–60 of 60 posts

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#51

Post by jhartmann »

boz_msft wrote: post #47
snoman wrote: post #35

Earlier quoted context omitted.

And, if I recall, MKL is included in Microsoft R Open (previously, Revolution R Open). At least, that's what the instructions here[1] lead me to believe. [1] https://mran.revolutionanalytics.com/documents/rro/installat...

Microsoft employee here. MKL libraries and headers will show up in CNTK soon. We are working with Intel on this.

Thanks for this, I personally have a license for MKL due to a licensed Intel C++ compiler and it really does a good job. I feel that Intel should do more to get MKL out in the open and more in use by the Open Source community. For instance I would love to have access to their FFT code so I could optimize it for my specific use case, but right now things are a black box. Very excited about CNTK btw, releasing a fully cooked multi machine distributed framework is just awesome.

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#52

Post by shtangun »

cmarschner wrote: post #41
csvan wrote: post #9

First TensorFlow, then Baidu's Warp-CTC, and now Microsofts CNTK. It is a very, very exciting time for open source machine learning indeed.

Afaik CTC is just a loss function written for Torch, no? A few hundred lines of code vs. hundreds of thousands loc for TF or CNTK.

I think the guy was going for "big company something something Open Source", and not knowing what they actually were

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#53

Post by KirinDave »

pmalynin wrote: post #48
KirinDave wrote: post #33

Earlier quoted context omitted.

Let's hope they decide to target F#.

I'm more interested in C# (probably target the latter with .net interop for the former)

It really seems though like this sort of work is more suited to the dataflow model F# promotes, though?

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#54

Post by varelse »

boz_msft wrote: post #47
snoman wrote: post #35

Earlier quoted context omitted.

And, if I recall, MKL is included in Microsoft R Open (previously, Revolution R Open). At least, that's what the instructions here[1] lead me to believe. [1] https://mran.revolutionanalytics.com/documents/rro/installat...

Microsoft employee here. MKL libraries and headers will show up in CNTK soon. We are working with Intel on this.

That's good news. The requirement to purchase the Intel C compiler and tools like MKL before programming their processors efficiently is IMO one of the chief reasons why NVIDIA is kicking them to the curb here with 6.6 TFLOP $1,000 consumer GPUs that come with an enormous toolkit of free candy, including a DNN kernel library that plugs into all the important frameworks.

Compare and contrast with ~1 TFLOP ~$7,000 Xeon CPUs.

I have brought this up with multiple Intel engineers and for the most part they nod and agree. Then they tell me that there's no way Intel would ever start doing things like NVIDIA does here. And then I nod and tell them why I continue to bet on NVIDIA for the immediate future, sigh...

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#55

Post by canberroid »

boz_msft wrote: post #45
singularity2001 wrote: post #28

Earlier quoted context omitted.

According to their slides[1] it is planned: Quoth: "Models can be described and modified with • C++ code • Network definition language (NDL) and model editing language (MEL) • Brain Script (beta) • Python and C# (planned) " [1] http://research.microsoft.com/en-us/um/people/dongyu/CNTK-Tu... thanks to @sharms

Hi MSFT employee here. Yes. High-level bindings are planned and are a high priority. We will document the planned interfaces on GitHub soon.

Thanks for letting us know. Any hand-wavy non-committal indication of how long that might be? Weeks/month, two months/more than three months?

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#56

Post by FLF_HOY »

csvan wrote: post #9

First TensorFlow, then Baidu's Warp-CTC, and now Microsofts CNTK. It is a very, very exciting time for open source machine learning indeed.

"...In a very interesting admission, LeCun told The Next Platform ..." http://www.nextplatform.com/2015/08/25/a-glimpse-into-the-fu...

Yann LeCun states on Nov 2015 (29:00 min mark) GPU's short lived in Deep Learning / CNN / NN https://www.youtube.com/watch?v=R7TUU94ir38

https://www.altera.com/en_US/pdfs/literature/solution-sheets...

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#57

Post by FLF_HOY »

csvan wrote: post #9

First TensorFlow, then Baidu's Warp-CTC, and now Microsofts CNTK. It is a very, very exciting time for open source machine learning indeed.

http://icri-ci.technion.ac.il/events-2/presentation-files-ic...

http://icri-ci.technion.ac.il/files/2015/05/00-Boris-Ginzbur...

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#58

Post by FLF_HOY »

csvan wrote: post #9

First TensorFlow, then Baidu's Warp-CTC, and now Microsofts CNTK. It is a very, very exciting time for open source machine learning indeed.

https://software.intel.com/en-us/blogs/2013/avx-512-instruct...

"...Worry about scaling; worry about vectorization; worry about data locality...." http://www.hpcwire.com/2016/01/21/conversation-james-reinder...

Nvidia Chief Scientist for Deep Learning was poached from Intel https://il.linkedin.com/in/boris-ginsburg-2249545?trk=pub-pb...

http://www.cs.tau.ac.il/~wolf/deeplearningmeeting/speaker.ht...

AVX-512 instructions https://software.intel.com/en-us/blogs/2013/avx-512-instruct...

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#59

Post by FLF_HOY »

"...Worry about scaling; worry about vectorization; worry about data locality...." http://www.hpcwire.com/2016/01/21/conversation-james-reinder...

http://icri-ci.technion.ac.il/events-2/presentation-files-ic...

http://icri-ci.technion.ac.il/files/2015/05/00-Boris-Ginzbur...

Nvidia Chief Scientist for Deep Learning was poached from Intel ICRI-CI Group https://il.linkedin.com/in/boris-ginsburg-2249545?trk=pub-pb...

http://www.cs.tau.ac.il/~wolf/deeplearningmeeting/speaker.ht... Look for quote: "...In a very interesting admission, LeCun told The Next Platform ..." http://www.nextplatform.com/2015/08/25/a-glimpse-into-the-fu...

Yann LeCun states on Nov 2015 (29:00 min mark) GPU's short lived in Deep Learning / CNN / NN https://www.youtube.com/watch?v=R7TUU94ir38

https://www.altera.com/en_US/pdfs/literature/solution-sheets...

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#60

Post by FLF_HOY »

https://software.intel.com/en-us/blogs/2013/avx-512-instruct...

"...Worry about scaling; worry about vectorization; worry about data locality...." http://www.hpcwire.com/2016/01/21/conversation-james-reinder.... http://www.hpcwire.com/2016/01/21/conversation-james-reinder...

Nvidia Chief Scientist for Deep Learning was poached from Intel https://il.linkedin.com/in/boris-ginsburg-2249545?trk=pub-pb...

http://www.cs.tau.ac.il/~wolf/deeplearningmeeting/speaker.ht...

AVX-512 instructions https://software.intel.com/en-us/blogs/2013/avx-512-instruct...

Look for quote: "...In a very interesting admission, LeCun told The Next Platform ..." http://www.nextplatform.com/2015/08/25/a-glimpse-into-the-fu...

Yann LeCun states on Nov 2015 (29:00 min mark) GPU's short lived in Deep Learning / CNN / NN https://www.youtube.com/watch?v=R7TUU94ir38

https://www.altera.com/en_US/pdfs/literature/solution-sheets...

http://icri-ci.technion.ac.il/events-2/presentation-files-ic...

http://icri-ci.technion.ac.il/files/2015/05/00-Boris-Ginzbur...

Post reply on HN