Live data from Hacker News

Ask HN: Are modular neural networks an interesting avenue for further research?

news.ycombinator.com

11–14 of 14 posts

Re: Ask HN: Are modular neural networks an interesting avenue for further research?

#11

https://github.com/tensorflow/adanet looks effectively modular to me, although I wouldn't consider it the epitome of the same. One needs to be able to merge, move, and remove modules too.

I’ve actually been wondering if some sort of NAS network could allow me to emulate neural plasticity in the modular networks

Re: Ask HN: Are modular neural networks an interesting avenue for further research?

#12

Since non-linear neal models can approximate any function, I think that it makes sense to treat models as functions that are embedded in conventional applications. There are good deep learning wrappers for functional languages like Haskell and Clojure. I recently enjoyed the talk on juji.io which treats models as functions, leading to an interesting architecture.

Do you have a permalink to that talk? I tried to go to their site but couldn't get past the 'Empathy Bot'

Re: Ask HN: Are modular neural networks an interesting avenue for further research?

#13
That's largely the idea behind "Factor Tables": https://github.com/RowColz/AI

You break big tasks into smaller tasks, which are generally manageable by people with 4-year degrees. An AI expert may manage or guide the larger project, but the sub-tasks shouldn't normally require an AI expert.

Re: Ask HN: Are modular neural networks an interesting avenue for further research?

#14

Since non-linear neal models can approximate any function, I think that it makes sense to treat models as functions that are embedded in conventional applications. There are good deep learning wrappers for functional languages like Haskell and Clojure. I recently enjoyed the talk on juji.io which treats models as functions, leading to an interesting architecture.

Do you have a permalink to that talk? I tried to go to their site but couldn't get past the 'Empathy Bot'

https://m.youtube.com/watch?v=phA4bMjKvCY
Post reply on HN