Live data from Hacker News

Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

blogs.microsoft.com

41–50 of 60 posts

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#41
post #9

First TensorFlow, then Baidu's Warp-CTC, and now Microsofts CNTK. It is a very, very exciting time for open source machine learning indeed.

Afaik CTC is just a loss function written for Torch, no? A few hundred lines of code vs. hundreds of thousands loc for TF or CNTK.

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#42

How many Deep Learning frameworks now? I think DL frameworks are coming up like JavaScript frameworks

Here's a (currently incomplete) list of Deep Learning frameworks : https://docs.google.com/spreadsheets/d/1XvGfi3TxWm7kuQ0DUqYr... There are many :)

Missing Vowpal Wabbit: http://hunch.net/~vw/

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#43

They claimed to be "the only public toolkit that can scale beyond single machine". Well, mxnet ( https://github.com/dmlc/mxnet ) can scale across multiple CPUs and GPUs.

Multiple machines implies scaling across a network or backbone - multiple logical computers. As I understand it at least.

Mxnet does. The commenter just left that part out. "The library is portable and lightweight, and is ready scales to multiple GPUs, and multiple machines." https://mxnet.readthedocs.org/en/latest/distributed_training...

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#44
post #16

Earlier quoted context omitted.

Except that it appears to require MKL or ACML... Sigh... ./configure Defaulting to --with-buildtype=release Cannot find a CPU math library. Please specify --with-acml or --with-mkl with a path.

There's a joke that says those that hate Windows use Linux, and those that love unix use BSD. I think this recent open source push by microsoft is depending on the truth of that statement. I think they're working under the assumption that the recent push of developers using Linux has more to do with those developers wanting to use a superior open source environment than preferring Unix/Linux as an operating system. A…

I don't like Windows because I find it awkward to use, and the UI changes between major releases seem mostly gratuitous. I don't really hate it on general principles, i.e. because it's not free/open.

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#45
post #26

I'm a bit surprised they decided on a CAFFE-like declarative language for specifying neural net architectures[1], instead of offering high-level software components that enable easy composition right from within a scripting language, e.g., like Python in TensorFlow's case.[2] Is there anyone from the Microsoft team here that can explain this decision? -- [1] See examples on https://github.com/Microsoft/CNTK/wiki/CNTK…

According to their slides[1] it is planned: Quoth: "Models can be described and modified with • C++ code • Network definition language (NDL) and model editing language (MEL) • Brain Script (beta) • Python and C# (planned) " [1] http://research.microsoft.com/en-us/um/people/dongyu/CNTK-Tu... thanks to @sharms

Hi MSFT employee here. Yes. High-level bindings are planned and are a high priority. We will document the planned interfaces on GitHub soon.

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#46
post #42

Earlier quoted context omitted.

Here's a (currently incomplete) list of Deep Learning frameworks : https://docs.google.com/spreadsheets/d/1XvGfi3TxWm7kuQ0DUqYr... There are many :)

Missing Vowpal Wabbit: http://hunch.net/~vw/

I'm not sure if it's a deep learning framework. Perhaps they are in some ways complementary http://hunch.net/?p=2875548. Who knows, maybe CNTK is one big reduction.

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#47
post #35

Earlier quoted context omitted.

At least ACML seems to be open source now too. "ACML End of Life Notice: We have transitioned our math libraries from a proprietary, closed source codebase (ACML) to open source solutions"[1] [1] http://developer.amd.com/tools-and-sdks/archive/amd-core-mat...

And, if I recall, MKL is included in Microsoft R Open (previously, Revolution R Open). At least, that's what the instructions here[1] lead me to believe. [1] https://mran.revolutionanalytics.com/documents/rro/installat...

Microsoft employee here. MKL libraries and headers will show up in CNTK soon. We are working with Intel on this.

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#48
post #26

I'm a bit surprised they decided on a CAFFE-like declarative language for specifying neural net architectures[1], instead of offering high-level software components that enable easy composition right from within a scripting language, e.g., like Python in TensorFlow's case.[2] Is there anyone from the Microsoft team here that can explain this decision? -- [1] See examples on https://github.com/Microsoft/CNTK/wiki/CNTK…

Let's hope they decide to target F#.

I'm more interested in C# (probably target the latter with .net interop for the former)

Re: Microsoft releases CNTK, its open source deep learning toolkit, on GitHub

#50
post #38

Only Microsoft can open source documentation on github in docx https://github.com/Microsoft/CNTK/tree/master/Documentation/...

Nevertheless isn't docx an ECMA and ISO standard? [1]

[1]: https://en.wikipedia.org/wiki/Office_Open_XML

Post reply on HN