https://github.com/tensorflow/adanet looks effectively modular to me, although I wouldn't consider it the epitome of the same. One needs to be able to merge, move, and remove modules too.
Ask HN: Are modular neural networks an interesting avenue for further research?
11–14 of 14 posts
Re: Ask HN: Are modular neural networks an interesting avenue for further research?
#12Since non-linear neal models can approximate any function, I think that it makes sense to treat models as functions that are embedded in conventional applications. There are good deep learning wrappers for functional languages like Haskell and Clojure. I recently enjoyed the talk on juji.io which treats models as functions, leading to an interesting architecture.
Re: Ask HN: Are modular neural networks an interesting avenue for further research?
#13You break big tasks into smaller tasks, which are generally manageable by people with 4-year degrees. An AI expert may manage or guide the larger project, but the sub-tasks shouldn't normally require an AI expert.
Re: Ask HN: Are modular neural networks an interesting avenue for further research?
#14Since non-linear neal models can approximate any function, I think that it makes sense to treat models as functions that are embedded in conventional applications. There are good deep learning wrappers for functional languages like Haskell and Clojure. I recently enjoyed the talk on juji.io which treats models as functions, leading to an interesting architecture.
Do you have a permalink to that talk? I tried to go to their site but couldn't get past the 'Empathy Bot'