ex-5-nn-wheat-seed-data

April 16, 2024

[1]: # importing numpy, pandas libraries

import pandas as pd
import numpy as np

# loading wheat seeds data into a dataframe

seeds_data = pd.read_csv('seeds.csv')

# displaying the first 5 rows of wheet seeds data

seeds_data.head()

[1]: Area Perimeter Compactness Kernel.Length Kernel.Width \

0 15.26 14.84 0.8710 5.763 3.312
1 14.88 14.57 0.8811 5.554 3.333
2 14.29 14.09 0.9050 5.291 3.337
3 13.84 13.94 0.8955 5.324 3.379
4 16.14 14.99 0.9034 5.658 3.562

Asymmetry.Coeff Kernel.Groove Type

0 2.221 5.220 1
1 1.018 4.956 1
2 2.699 4.825 1
3 2.259 4.805 1
4 1.355 5.175 1

[2]: # Extracting Independent Variables

X = seeds_data.loc[:, seeds_data.columns != 'Type']

X

[2]: Area Perimeter Compactness Kernel.Length Kernel.Width \

0 15.26 14.84 0.8710 5.763 3.312
1 14.88 14.57 0.8811 5.554 3.333
2 14.29 14.09 0.9050 5.291 3.337
3 13.84 13.94 0.8955 5.324 3.379
4 16.14 14.99 0.9034 5.658 3.562
.. … … … … …
194 12.19 13.20 0.8783 5.137 2.981

1
 195 11.23 12.88 0.8511 5.140 2.795
196 13.20 13.66 0.8883 5.236 3.232
197 11.84 13.21 0.8521 5.175 2.836
198 12.30 13.34 0.8684 5.243 2.974

Asymmetry.Coeff Kernel.Groove
0 2.221 5.220
1 1.018 4.956
2 2.699 4.825
3 2.259 4.805
4 1.355 5.175
.. … …
194 3.631 4.870
195 4.325 5.003
196 8.315 5.056
197 3.598 5.044
198 5.637 5.063

[199 rows x 7 columns]

[3]: # Extracting Target Variable

Y = seeds_data.loc[:, seeds_data.columns == 'Type']

Y

[3]: Type
0 1
1 1
2 1
3 1
4 1
.. …
194 3
195 3
196 3
197 3
198 3

[199 rows x 1 columns]

0.1 Split Data for training and testing

[4]: from sklearn.model_selection import train_test_split

X_train, X_test, y_train, y_test = train_test_split(X , Y ,

test_size = 0.2,
random_state = 523)

2
 0.2 Training the Perceptron Classifier
[5]: # importing Perceptron Class
from sklearn.linear_model import Perceptron

# Creating an insance of Perceptron Class

perc = Perceptron( random_state = 15)

# Training the perceptron classifier

perc.fit(X_train, np.ravel(y_train))

# importing metrics for evaluating perceptron classifier

from sklearn.metrics import accuracy_score

# Using perceptron classifier to make predictions on test data

pred_test = perc.predict(X_test)

# calculating and displaying accuracy score of Perceptron classifier

accuracy = accuracy_score(y_test, pred_test)
print('% of Accuracy using Linear Perceptron: ', accuracy * 100)

% of Accuracy using Linear Perceptron: 67.5

Correlation between two variables can be either a positive correlation, a negative

correlation, or no correlation.
[6]: # Importing plotly.express
import plotly.express as px

# Finding the correlation of Independent variables on Target Variable

corr = seeds_data.corr()

corr = corr.round(2)
corr

[6]: Area Perimeter Compactness Kernel.Length Kernel.Width \

Area 1.00 0.99 0.61 0.95 0.97
Perimeter 0.99 1.00 0.53 0.97 0.95
Compactness 0.61 0.53 1.00 0.37 0.76
Kernel.Length 0.95 0.97 0.37 1.00 0.86
Kernel.Width 0.97 0.95 0.76 0.86 1.00
Asymmetry.Coeff -0.22 -0.21 -0.33 -0.17 -0.25
Kernel.Groove 0.86 0.89 0.23 0.93 0.75
Type -0.34 -0.32 -0.54 -0.25 -0.42

Asymmetry.Coeff Kernel.Groove Type

3
 Area -0.22 0.86 -0.34
Perimeter -0.21 0.89 -0.32
Compactness -0.33 0.23 -0.54
Kernel.Length -0.17 0.93 -0.25
Kernel.Width -0.25 0.75 -0.42
Asymmetry.Coeff 1.00 -0.00 0.57
Kernel.Groove -0.00 1.00 0.04
Type 0.57 0.04 1.00

[7]: # displaying confusion matrix as a heatmap

fig = px.imshow(corr ,
width = 700,
height = 700 ,
text_auto = True,
color_continuous_scale = 'tealgrn',
)

fig.show()

It can be observed that the attribute “Kernel.Groove” has very least correlation on
the target variable
[8]: # remove Kernel.Groove attribute from X
X = X.loc[:, X.columns != 'Kernel.Groove']
X

[8]: Area Perimeter Compactness Kernel.Length Kernel.Width \

0 15.26 14.84 0.8710 5.763 3.312
1 14.88 14.57 0.8811 5.554 3.333
2 14.29 14.09 0.9050 5.291 3.337
3 13.84 13.94 0.8955 5.324 3.379
4 16.14 14.99 0.9034 5.658 3.562
.. … … … … …
194 12.19 13.20 0.8783 5.137 2.981
195 11.23 12.88 0.8511 5.140 2.795
196 13.20 13.66 0.8883 5.236 3.232
197 11.84 13.21 0.8521 5.175 2.836
198 12.30 13.34 0.8684 5.243 2.974

Asymmetry.Coeff
0 2.221
1 1.018
2 2.699
3 2.259
4 1.355
.. …

4
 194 3.631
195 4.325
196 8.315
197 3.598
198 5.637

[199 rows x 6 columns]

Resplitting Data for training and testing

[9]: X_train, X_test, y_train, y_test = train_test_split(X , Y ,
test_size = 0.2,
random_state = 523)

Retraining the Perceptron Classifier

[10]: # retraining the perceptron classifier
perc.fit(X_train, np.ravel(y_train))

# Using perceptron classifier to make predictions on test data

pred_test = perc.predict(X_test)

# calculating and displaying accuracy score of Perceptron classifier

accuracy = accuracy_score(y_test, pred_test)
print('% of Accuracy using Linear Perceptron: ', accuracy * 100)

% of Accuracy using Linear Perceptron: 75.0

0.2.1 Install scikit-neuralnetwork

[1]: #scikit-neuralnetwork works withscikit-learn 0.18 and above

# installing scikit-neuralnetwork if not already installed

!pip install scikit-neuralnetwork

Processing c:\users\gurram\appdata\local\pip\cache\wheels\7d\42\93\b99bd6392fb56
ec7831a695cb7a23dd9c73382b258614b62ed\scikit_neuralnetwork-0.7-py3-none-any.whl
Processing c:\users\gurram\appdata\local\pip\cache\wheels\a3\72\b6\89bbeb6140ee3
756fa2bdd2fb03003dd60d289851314b35fd7\lasagne-0.1-py3-none-any.whl
Processing c:\users\gurram\appdata\local\pip\cache\wheels\26\68\6f\745330367ce78
22fe0cd863712858151f5723a0a5e322cc144\theano-1.0.5-py3-none-any.whl
Requirement already satisfied: colorama in d:\anaconda\lib\site-packages (from
scikit-neuralnetwork) (0.4.3)
Requirement already satisfied: scikit-learn>=0.17 in
c:\users\gurram\appdata\roaming\python\python37\site-packages (from scikit-
neuralnetwork) (1.0.2)
Requirement already satisfied: numpy in d:\anaconda\lib\site-packages (from

5
 Lasagne>=0.1->scikit-neuralnetwork) (1.18.1)
Requirement already satisfied: scipy>=0.14 in
c:\users\gurram\appdata\roaming\python\python37\site-packages (from
Theano>=0.8->scikit-neuralnetwork) (1.7.3)
Requirement already satisfied: six>=1.9.0 in d:\anaconda\lib\site-packages (from
Theano>=0.8->scikit-neuralnetwork) (1.14.0)
Requirement already satisfied: joblib>=0.11 in d:\anaconda\lib\site-packages
(from scikit-learn>=0.17->scikit-neuralnetwork) (0.14.1)
Collecting threadpoolctl>=2.0.0
Downloading threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Installing collected packages: Lasagne, Theano, scikit-neuralnetwork,
threadpoolctl
Successfully installed Lasagne-0.1 Theano-1.0.5 scikit-neuralnetwork-0.7
threadpoolctl-3.1.0

0.3 Training the Multilayer Perceptron Classifier using Backpropagation algo-

rithm
[12]: # importing required library
import sklearn.neural_network as nn

# Creating an instance of MLPClassifier class

# Taking maximum number of iterations = 1000
# constructing MLP network with 3 hidden layers with
# 100 neurons in hidden layer 1,
# 75 neurons in hidden layer 2,
# 50 neurons in hidden layer 3

mlp = nn.MLPClassifier(random_state = 560,

hidden_layer_sizes = [100, 75, 50],
max_iter = 1000)

[14]: # Training the MLP classifier

mlp.fit(X_train, np.ravel(y_train))

pred_test = mlp.predict(X_test)
mlp_accuracy = accuracy_score(y_test, pred_test)
print('% of Accuracy using MultiLayer Perceptron: ', "{0:0.2f}".
↪format(mlp_accuracy*100))

% of Accuracy using MultiLayer Perceptron: 87.50