Regularization of Neural Networks using DropConnect

Wan, Li; D. Zeiler, Matthew; Zhang, Sixin; Lecun, Yann; Fergus, Rob

doi:10.1016/s0074-7696(08)60205-3

Public

Regularization of Neural Networks using DropConnect

Published in International review of cytology • Jun 16, 2013

Authors:

Li Wan

Matthew D. Zeiler

Sixin Zhang

Abstract

We introduce DropConnect, a generalization of Dropout (Hinton et al., 2012), for regular-izing large fully-connected layers within neu-ral networks. When training with Dropout, a randomly selected subset of activations are set to zero within each layer. DropCon-nect instead sets a randomly selected ...

Subject

Dropout (neural networks)

Regularization (linguistics)

Artificial neural network

Finding related papers...

Discussions

(0)

No comments yet

Be the first to share your thoughts!