Artificial Neural Networks
Artificial Neural Networks
We can apply Neural network not only for classification. It can also apply for regression
of continuous target attributes.
Neural networks find great application in data mining used in sectors. For example
economics, forensics, etc and for pattern recognition. It can be also used for data
classification in a large amount of data after careful training.According to the
research, neural network software industry is expected to grow at a CAGR of 33.5%
during the forecast period, 2019–2026.
o Input layer – The activity of the input units represents the raw information that can feed
into the network.
o Hidden layer – To determine the activity of each hidden unit. The activities of the input
units and the weights on the connections between the input and the hidden units. There
may be one or more hidden layers.
o Output layer – The behavior of the output units depends on the activity of the hidden
units and the weights between the hidden and output units.
a. Input layer
The purpose of the input layer is to receive as input the values of the explanatory
attributes for each observation. Usually, the number of input nodes in an input layer is
equal to the number of explanatory variables. ‘input layer’ presents the patterns to the
network, which communicates to one or more ‘hidden layers’.
The nodes of the input layer are passive, meaning they do not change the data. They
receive a single value on their input and duplicate the value to their many outputs. From
the input layer, it duplicates each value and sent to all the hidden nodes.
b. Hidden layer
The Hidden layers apply given transformations to the input values inside the network. In
this, incoming arcs that go from other hidden nodes or from input nodes connected to
each node. It connects with outgoing arcs to output nodes or to other hidden nodes. In
hidden layer, the actual processing is done via a system of weighted ‘connections’.
There may be one or more hidden layers. The values entering a hidden node multiplied
by weights, a set of predetermined numbers stored in the program. The weighted inputs
are then added to produce a single number.
c. Output layer
The hidden layers then link to an ‘output layer‘. Output layer receives connections from
hidden layers or from input layer. It returns an output value that corresponds to the
prediction of the response variable. In classification problems, there is usually only one
output node. The active nodes of the output layer combine and change the data to
produce the output values.
The ability of the neural network to provide useful data manipulation lies in the proper
selection of the weights. This is different from conventional information processing.
The simplest structure is the one in which units distributes in two layers: An input
layer and an output layer. Each unit in the input layer has a single input and a single
output which is equal to the input. The output unit has all the units of the input layer
connected to its input, with a combination function and a transfer function. There may
be more than 1 output unit. In this case, resulting model is a linear or logistic
regression.This is depending on whether transfer function is linear or logistic. The
weights of the network are regression coefficients.
By adding 1 or more hidden layers between the input and output layers and units in this
layer the predictive power of neural network increases. But a number of hidden layers
should be as small as possible. This ensures that neural network does not store all
information from learning set but can generalize it to avoid overfitting.
Overfitting can occur. It occurs when weights make the system learn details of learning
set instead of discovering structures. This happens when size of learning set is too
small in relation to the complexity of the model.
A hidden layer is present or not, the output layer of the network can sometimes have
many units, when there are many classes to predict.
Conclusion
ANNs are considered as simple mathematical models to enhance existing data
analysis technologies. Although it is not comparable with the power of the human brain,
still it is the basic building block of the Artificial intelligence.