A Toolarge Weight Initialized On The Neural Network Can Lead To #609

A too-large weight initialized on the neural network can lead to vanishing gradient whereas a too-small weight initialized on the neural network can lead to exploding gradient.

Online Quiz This multiple choice question (MCQ) is related to the book/course gs gs126 Neural Networks. It can also be found in gs gs126 Neural Networks - Random Initialization - Quiz No.1.


Similar question(s) are as followings:



Online Quizzes of gs126 Neural Networks

Choose an organization

Theme Customizer

Gaussian Texture



Gradient Background