Scribd
Upload
13 views4 pages

98 D2 Exp-6 ML

Nice

Uploaded by

Starc Gaming
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
13 views4 pages

98 D2 Exp-6 ML

Nice

Uploaded by

Starc Gaming
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 4

Aayush Shah

121A1098
D2
ML

EXPERIMENT – 6

Aim: To implement Ensemble Method: Ada Boost in Python and


understand its working and significance.

Theory:
Ensemble and AdaBoost – Concept:
Ensemble methods combine multiple weak learners to improve overall model
performance, and AdaBoost (Adaptive Boosting) is one such technique.
Unlike Random Forest, which builds trees independently, AdaBoost
sequentially builds a series of models, with each new model focusing on the
mistakes made by the previous ones. It assigns higher weights to incorrectly
classified instances, guiding the next learner to focus more on these errors.
The final prediction is made by combining the weighted votes of all models.
Algorithm – AdaBoost:
Initialize equal weights for all data points.
Train a weak learner (e.g., a shallow decision tree) on the dataset.
Calculate the weighted error and update the weights of the misclassified points.
Train the next learner with updated weights and repeat for a predefined number
of iterations.
Combine predictions using weighted voting for classification or
averaging for regression.
Python Implementation:
Import required libraries:
sklearn.ensemble.AdaBoostClassifier/Regressor. Load and split the
dataset into training and test sets.
Train the AdaBoost model with a chosen number of estimators (weak
learners). Use the trained model to predict on the test set and evaluate
performance with accuracy or error metrics.Ensemble and Ada Boost

Program :
Output :

Conclusion:
⚫ AdaBoost is an effective ensemble method that improves prediction
accuracy by focusing on hard-to-classify instances through adaptive
weighting.
⚫ It works well with simple base learners and is suitable for both
classification and regression tasks, though it may be sensitive to noisy
data.

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy