Make your own neural network

3 flashcards · Computer Science · by lakesare

1. Why is neuron not a linear function?

   So could we represent neurons as linear functions, just like we did before? Good idea, but no. A biological neuron doesn’t produce an output that is simply a simple linear function of the input. That is, its output does not take the form output = (constant * input) + (maybe another constant).

2. Calculate the output of this neural network, where activation function is a logistic function.

   Turns out we don't apply the summation and activation function to the first layer!

3. To what layers do we apply the activation function?

   hidden layers output layer Hidden and output layer neurons possess activation functions, but input layer neurons do not. Generally speaking output nodes will have an activation function and input units won't, although inputs are often preprocessed. Input neurons are just inputs. They do not have a bias or an activation function.