Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Facebook open-sources deep-learning modules

research.facebook.com

Post reply on HN
Print view View original

31–40 of 76 posts

Re: Facebook open-sources deep-learning modules

#31

Post by bpodgursky »

I appreciate that Facebook open-sources their libraries, but they have an awful habit of dumping source code on Github and then continuing to develop it internally without pushing those changes back out.

For example, Facebook open-sourced Thrift, then proceeded to develop it internally, and recently released out a fork of thrift, not merging anything back into the original tree.

Likewise, they open-sourced Corona a few years ago, their Hadoop fork, and I'm pretty sure that branch has been abandoned too.

So I'm really hesitant to start using any projects out of Facebook unless they develop some processes to actually maintain these projects.

Re: Facebook open-sources deep-learning modules

#32

Post by [deleted] »

DannyBee wrote: post #27

Sadly, this has facebook's new, horrible patent clause. For those who aren't aware, it says 1. If facebook sues you, and you counterclaim over patents (whether about software or not), you will lose rights under all these patent grants. So essentially you can't defend yourself. This is different than the typical apache style patent grant, which instead would say "if you sue me over patents in apache licensed software…

[deleted]

Re: Facebook open-sources deep-learning modules

#33

Post by hueving »

WillNotDownvote wrote: post #20
dragonwriter wrote: post #9

Earlier quoted context omitted.

> Ads certainly don't feel like much of the FB experience, nowhere near the level of Google, or even Twitter. Facebook creates an artificial distinction between labeled ads (which are, of course, obvious ads) and posts with paid reach (which are also ads, but presented as normal content), exactly for the purpose of maximizing the quantity of ads while minimizing the impression of content being dominated by ads.

Right, so ads don't feel like much of the FB experience. My point is that FB seems much, much more focused on creating an engaging user experience than it does on ads, so it seems wrong to say that their deep learning efforts have ads as their one main goal.

What it feels like to the user doesn't matter. They are still maximizing their ad revenue.

Re: Facebook open-sources deep-learning modules

#34

Post by jawns »

DannyBee wrote: post #27

Sadly, this has facebook's new, horrible patent clause. For those who aren't aware, it says 1. If facebook sues you, and you counterclaim over patents (whether about software or not), you will lose rights under all these patent grants. So essentially you can't defend yourself. This is different than the typical apache style patent grant, which instead would say "if you sue me over patents in apache licensed software…

Here's a link to the patent clause: https://github.com/facebook/fbcunn/blob/master/PATENTS

DannyBee, I'm having a hard time envisioning what sort of scenario might trigger this, and what the repercussions might be. Any chance you could explain?

Re: Facebook open-sources deep-learning modules

#35

Post by amelius »

bpodgursky wrote: post #31

I appreciate that Facebook open-sources their libraries, but they have an awful habit of dumping source code on Github and then continuing to develop it internally without pushing those changes back out. For example, Facebook open-sourced Thrift, then proceeded to develop it internally, and recently released out a fork of thrift, not merging anything back into the original tree. Likewise, they open-sourced Corona a f…

From the article:

> We hope that these high-quality code releases will be a catalyst to the research community and we will continue to update them from time to time.

Re: Facebook open-sources deep-learning modules

#36

Post by peterhunt »

bpodgursky wrote: post #31

I appreciate that Facebook open-sources their libraries, but they have an awful habit of dumping source code on Github and then continuing to develop it internally without pushing those changes back out. For example, Facebook open-sourced Thrift, then proceeded to develop it internally, and recently released out a fork of thrift, not merging anything back into the original tree. Likewise, they open-sourced Corona a f…

That was years ago. Things have changed around there: https://github.com/facebook

Re: Facebook open-sources deep-learning modules

#37

Post by amelius »

raverbashing wrote: post #3
UXDork wrote: post #2

Does anyone know what Facebook is using the AI for?

Basically everything in FB has one main goal: Ads Secondary goals might be: Spam detection and extracting info from the graph/pictures, etc FB identify people from your Social Graph in Pictures, for example

The software runs on Nvidia hardware. Not sure if all their servers are fitted with one or more GPU cards...

I think it is more likely that this is just research software.

Re: Facebook open-sources deep-learning modules

#38

Post by raverbashing »

amelius wrote: post #37
raverbashing wrote: post #3

Earlier quoted context omitted.

Basically everything in FB has one main goal: Ads Secondary goals might be: Spam detection and extracting info from the graph/pictures, etc FB identify people from your Social Graph in Pictures, for example

The software runs on Nvidia hardware. Not sure if all their servers are fitted with one or more GPU cards... I think it is more likely that this is just research software.

Well, it depends, you can definitely have servers with NVidia hardware, and you don't need to have all of them with it. (Amazon offers GPGPU servers on EC2 for example)

Re: Facebook open-sources deep-learning modules

#39

Post by ajtulloch »

Hydraulix989 wrote: post #28
ajtulloch wrote: post #17

Earlier quoted context omitted.

This paper describes one part of the fbcunn release (the fast convolution layers implemented via FFT, with the source available at https://github.com/facebook/fbcunn/tree/master/src/cuda/fft ). There's a lot more in fbcunn if you want to check it out.

In my experience, the fully connected layers are the bottleneck. The other issue was the alternating compute-heavy convolution and the IO-heavy pooling. I'm curious how this FFT implementation stacks up against cuDNN (what's the speedup like for just the convolutional layers? and then what's the overall speedup like?).

http://arxiv.org/pdf/1412.7580v2.pdf compares the convolutional implementation with the cuDNN layers. For the FC layers, it's just CuBLAS `sgemm`.

Re: Facebook open-sources deep-learning modules

#40

Post by j_s »

jawns wrote: post #34
DannyBee wrote: post #27

Sadly, this has facebook's new, horrible patent clause. For those who aren't aware, it says 1. If facebook sues you, and you counterclaim over patents (whether about software or not), you will lose rights under all these patent grants. So essentially you can't defend yourself. This is different than the typical apache style patent grant, which instead would say "if you sue me over patents in apache licensed software…

Here's a link to the patent clause: https://github.com/facebook/fbcunn/blob/master/PATENTS DannyBee, I'm having a hard time envisioning what sort of scenario might trigger this, and what the repercussions might be. Any chance you could explain?

The most interesting part to me is whether or not such claim is related to the Software - so any patent suit against any software, product or service of Facebook or any of its subsidiaries or affiliates terminates patent license to this software... seems like they went for the nuclear defense!
Post reply on HN