Scribd
Upload
6 views14 pages

Unit2 - Types of Classifications

This document covers multiclass classification techniques in machine learning, detailing strategies such as one-versus-rest (OvR) and one-versus-one (OvO) for classifying multiple classes. It also discusses model training techniques, evaluation metrics, and introduces multilabel classification, which allows for multiple outputs per instance. Additionally, it touches on multioutput classification where each label can have multiple values, providing examples and references for further reading.

Uploaded by

manaskagankar07
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
6 views14 pages

Unit2 - Types of Classifications

This document covers multiclass classification techniques in machine learning, detailing strategies such as one-versus-rest (OvR) and one-versus-one (OvO) for classifying multiple classes. It also discusses model training techniques, evaluation metrics, and introduces multilabel classification, which allows for multiple outputs per instance. Additionally, it touches on multioutput classification where each label can have multiple values, providing examples and references for further reading.

Uploaded by

manaskagankar07
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 14

Machine Learning

Unit 2
Multiclass classification

Course: Machine Learning TY B. Tech(CSIT)


Faculty: Mrs. S. P. Patil, IT Dept., RIT
Multiclass classification
■ Multiclass classifiers (also called multinomial
classifiers) can distinguish between more than
two classes.
■ Example: classify the digit images into 10 classes
(from 0 to 9) is to train 10 binary classifiers, one
for each digit (a 0-detector, a 1-detector, a 2-
detector, and so on).
Multiclass classification
■ versus-the-rest (OvR) strategy (also called
one-versus-all).
– For classifying image, you get the decision score
from each classifier for that image and you
select the class whose classifier outputs the
highest score.
■ one-versus-one (OvO) strategy.
– To train a binary classifier for every pair of digits:
one to distinguish 0s and 1s, another to
distinguish 0s and 2s, another for 1s and 2s, and
so on.
– N classes, you need to train N × (N – 1) / 2
Example
■ Imagine you have a set of movie genres like action, comedy, and
drama, and you want to classify a movie into one or more genres.
■ One-vs-Rest classifier:
■ Three genres: Action, Comedy, and Drama.
– Action vs. Rest:
– Comedy vs. Rest:
– Drama vs. Rest:
■ Now, when a new movie comes in for classification, these three classifiers
are used.
■ Each one gives a decision — “Yes, this might be an Action movie,” “Yes, this
might be a Comedy movie,” or “Yes, this might be a Drama movie.”
■ If multiple classifiers say ‘Yes’, the movie might be assigned to multiple
genres.
Model Training Techniques
■ softmax activation in the output layer of the neural network.
– Function converts the raw model outputs into probabilities,
assigning higher probabilities to the correct classes.
■ categorical cross-entropy loss used as the objective
function during training.
– measures the dissimilarity between the predicted
probabilities and the actual class labels, guiding the model
to minimize errors and improve accuracy.

■ Evaluation Metrics :
– accuracy, precision, recall (sensitivity) and F1 score.
Error Analysis
■ Explore data preparation options, try out
■ Multiple models (shortlisting the best ones and fine-tuning
their hyperparameters using GridSearchCV), and
automate as much as possible.
■ Found a promising model and you want to find ways to
improve it.
■ One way to do this is to analyze the types of errors it
makes.
Multilabel Classification
■ Multilabel Classification: Classifier to output multiple
classes for each instance
■ Example: a face recognition classifier: what should it do if
it recognizes several people in the same picture? It should
attach one tag per person it recognizes.
■ If the classifier has been trained to recognize three faces,
Alice, Bob, and Charlie. Then when the classifier is shown
a picture of Alice and Charlie, it should output [1, 0, 1]
(meaning “Alice yes, Bob no, Charlie yes”).
Examples

■ Document Tagging: Assigning multiple tags or topics to a


document, such as labeling an article as both "technology"
and "business."
■ Image Classification with Multiple Labels: Identifying
and labeling multiple objects or features within an image,
like recognizing both "cat" and "outdoor" in a photograph.
Source: https://www.geeksforgeeks.org/multiclass-classification-vs-multi-label-
Model Training Techniques:
■ Sigmoid Activation:
– independently activates each output node, producing a value between
0 and 1, representing the likelihood of the corresponding label being
present.
■ Binary Cross-Entropy Loss:
– measure the dissimilarity between the predicted probabilities and the
actual presence or absence of each label.
■ Evaluation metrics:
– Hamming Loss: alculates the fraction of labels that are incorrectly
predicted.
– Precision at k: evaluates the precision of the top-k predicted labels,
recognizing that not all labels need to be considered
– Recall at k: assesses the recall of the top-k predicted labels
Multioutput classification

■ Generalization of multilabel classification where each label


can be multiclass (i.e., it can have more than two possible
values).
■ Take a input of noisy digit image, and it will (hopefully) output
a clean digit image, represented as an array of pixel
intensities, classifier’s output is multilabel (one label per pixel)
and each label can have multiple values (pixel intensity
ranges from 0 to 255).

noisy input clean target Train the classifier and make it clean
image image this image
References

■ Textbook
■ https://www.geeksforgeeks.org/multiclass-classification-vs-multi-label-
classification/

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy