61–63 of 63 posts
Earlier quoted context omitted.
No. Why do you think so?
Geoffrey Hinton describes dropout that way. It's like you're training different nets each time dropout changes.
It might look like an ensemble because you’re selecting different subsets but ensembles combine different independent models rather than just subset models.
Earlier quoted context omitted.
Geoffrey Hinton describes dropout that way. It's like you're training different nets each time dropout changes.
Dropout is different from ensembles. It is a regularization method. It might look like an ensemble because you’re selecting different subsets but ensembles combine different independent models rather than just subset models.
In my mind an ensemble is like a committee. For it to be effective, each member should be independent (able to pick up different signals) and have a greater than random chance of being correct.
Earlier quoted context omitted.
Geoffrey Hinton describes dropout that way. It's like you're training different nets each time dropout changes.
Dropout is different from ensembles. It is a regularization method. It might look like an ensemble because you’re selecting different subsets but ensembles combine different independent models rather than just subset models.