Add some randomization during the initialization
If I keep the weak initialization, then we won't be able to use 2/3 of the hidden neurons, because the initial weights are cyclic.
Please register or sign in to comment
If I keep the weak initialization, then we won't be able to use 2/3 of the hidden neurons, because the initial weights are cyclic.