Scribd
Upload
9 views24 pages

An Overview of Machine Learning

Uploaded by

Dhamu
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
9 views24 pages

An Overview of Machine Learning

Uploaded by

Dhamu
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 24

Dr.D.

Anitha
Associate Professor/ IT
Muthayammal Engineering College
(Autonomous)
Rasipuram
 What is machine learning?
 Learning system model
 Training and testing
 Performance
 Algorithms
 Machine learning structure
 What are we seeking?
 Learning techniques
 Applications
 Conclusion
 A branch of artificial intelligence, concerned
with the design and development of algorithms
that allow computers to evolve behaviors based
on empirical data.

 As intelligence requires knowledge, it is


necessary for the computers to acquire
knowledge.
Traditional Programming

Data
Computer Output
Program

Machine Learning

Data
Computer Program
Output
Testin
g
Input Learni
Sampl ng
es Metho
d
Syste
m
Trainin
g
 There are several factors affecting the performance:
 Types of training provided
 The form and extent of any initial background knowledge
 The type of feedback provided
 The learning algorithms used
 Two important factors:
 Modeling
 Optimization
 Evaluation

Accuracy

Precision and recall

Squared error

Likelihood

Posterior probability

Cost / Utility

Margin

Entropy

Etc.
 Tens of thousands of machine
learning algorithms
 Hundreds new every year
 Every machine learning algorithm
has three components:
 Representation
 Evaluation
 Optimization
 The success of machine learning system also
depends on the algorithms.

 The algorithms control the search to find and


build the knowledge structures.

 The learning algorithms should extract useful


information from training examples.
 Supervised learning ( )
 Training data includes desired outputs
 Prediction
 Classification (discrete labels), Regression (real values)
 Unsupervised learning ( )
 Training data does not include desired outputs
 Clustering
 Probability distribution estimation
 Finding association (in features)
 Dimension reduction
 Semi-supervised learning
Training data includes a few desired outputs
 Reinforcement learning
Supervised Unsupervised
learning learning

12 Semi-supervised
 Supervised learning
 Unsupervised learning
 Supervised: Low E-out or maximize probabilistic
terms
E-in: for training
set
E-out: for
testing set

 Unsupervised: Minimum quantization error,


Minimum distance, MAP, MLE(maximum likelihood
estimation)
Under-fitting VS. Over-fitting (fixed N)

erro
r

(model = hypothesis + loss


functions)
 Supervised learning categories and techniques
 Linear classifier (numerical functions)
 Parametric (Probabilistic functions)
 Naïve Bayes, Gaussian discriminant analysis (GDA),

Hidden Markov models (HMM), Probabilistic graphical


models
 Non-parametric (Instance-based functions)
 K-nearest neighbors, Kernel regression, Kernel density

estimation, Local regression


 Non-metric (Symbolic functions)
 Classification and regression tree (CART), decision tree

 Aggregation
 Bagging (bootstrap + aggregation), Adaboost, Random

forest
• Linear
classifier
, where w is an d-dim vector (learned)

Techniques:
 Perceptron
 Logistic regression
 Support vector machine (SVM)
 Ada-line
 Multi-layer perceptron (MLP)
Using perceptron learning
algorithm(PLA)

Traini Testin
ng rate:
Error g rate:
Error
0.10 0.156
Using logistic regression

Traini Testin
ng rate:
Error g rate:
Error
0.11 0.145
• Non-linear case

 Support vector machine (SVM):


 Linear to nonlinear: Feature transform and kernel function
 Unsupervised learning categories and techniques
 Clustering
 K-means clustering

 Spectral clustering

 Density Estimation
 Gaussian mixture model (GMM)

 Graphical models

 Dimensionality reduction
 Principal component analysis (PCA)

 Factor analysis
 Understanding domain, prior
knowledge, and goals
 Data integration, selection, cleaning,
pre-processing, etc.
 Learning models
 Interpreting results
 Consolidating and deploying discovered
knowledge
 Loop
 Virtual Personal Assistants
 Predictions while Commuting
 Videos Surveillance
 Social Media Services
 Email Spam and Malware Filtering
 Online Customer Support
 Product Recommendations
 Online Fraud Detection
We have a simple overview of some
techniques and algorithms in machine
learning. Furthermore, there are more
and more techniques apply machine
learning as a solution. In the future,
machine learning will play an
important role in our daily life.
[1] W. L. Chao, J. J. Ding, “Integrated
Machine Learning Algorithms for
Human Age Estimation”, NTU, 2011.

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy