Scribd
Upload
10 views3 pages

Unit-3 - Introduction To ML, Part-1

This document introduces linear regression and logistic regression as machine learning algorithms, highlighting their applications in supervised learning. Linear regression is used for predictive analysis with continuous variables, while logistic regression is applied to binary dependent variables. The document also discusses the advantages and disadvantages of linear regression and explains the logistic function in the context of estimating probabilities.

Uploaded by

mamahlo543
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
10 views3 pages

Unit-3 - Introduction To ML, Part-1

This document introduces linear regression and logistic regression as machine learning algorithms, highlighting their applications in supervised learning. Linear regression is used for predictive analysis with continuous variables, while logistic regression is applied to binary dependent variables. The document also discusses the advantages and disadvantages of linear regression and explains the logistic function in the context of estimating probabilities.

Uploaded by

mamahlo543
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

Unit-3: Introduction to ML, Part-1

Basics of Linear Regression:

Linear Regression is an ML algorithm used for Supervised learning system.


Linear regression is a quiet and simple statistical regression method used for predictive
analysis and shows the relationship between the continuous
Variables.

1. If there is a single input variable (x), such linear regression is called “simple linear
regression”. And if there is more than one input variable, such linear regression is called
“multiple linear regression”.
2. Cost function optimizes the regression coefficients or weights and
measures how a linear regression model is performing.

3. The cost function is used to find the accuracy of the mapping function that maps the input
variable to the output variable. This mapping function is also known as the Hypothesis
function
4. Gradient descent is a method of updating a0 and a1 to minimize the cost function (MSE).
5. In the gradient descent algorithm, the number of steps you take is the learning rate, and
this decides how fast the algorithm converges to the minima.

Advantages and Disadvantages of Linear Regression:

Advantages Disadvantages

Linear regression performs exceptionally well for The assumptions of linearity between dependent
linearly seperable data and independent variables.

Easier to implement,interpret and efficient to train. It is often quite prone to noise and overfitting

It handles overfitting pretty well using Linear regression is quite sensitive to outliers
dimensionally reduction
techniques,regualarization,and cross-validation

One more advantage is the extrapolation beyond a It is prone to multicollinearity


specific data set

Logistic Regression:

Logistic regression is a statistical model used to analyze the relationship between a


binary dependent variable and one or more independent variables. It is a type of regression
analysis that is used when the dependent variable is categorical and the independent
variable(s) are continuous or categorical. The logistic regression model estimates the
probability of the occurrence of an event, which is represented by the binary dependent
variable. The output of the model is a logistic function, which maps the input variables to a
value between 0 and 1.

The logistic function, also known as the sigmoid function, is defined as follows:
p = 1 / (1 + e^(-z))
where p is the probability of the occurrence of the event, e is the base of the natural
logarithm, and z is the linear combination of the independent variables and their coefficients.
The logistic regression model uses maximum likelihood estimation to estimate the
coefficients of the independent variables that maximize the likelihood of the observed data.
The model can be used to predict the probability of the occurrence of the event for new data.
Logistic regression has a wide range of applications, including in medical research, social
sciences, and business. It is particularly useful in cases where the dependent variable is
dichotomous, meaning that it has only two possible values.
Logistic Regression is much similar to Linear Regression except that how they are
used. Linear Regression is used for solving Regression problems, whereas Logistic
regression is used for solving the classification problems. The curve from the logistic function
indicates the likelihood of something such as whether the cells are cancerous or not, a
mouse is obese or not based on its weight, etc. Logistic regression uses the concept of
predictive modeling as regression; therefore, it is called logistic regression, but is used to
classify samples; Therefore, it falls under the classification algorithm.

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy