Demand Theory and Estimation
Demand Theory and Estimation
Quantity demanded
6.
REGRESSION ANALYSIS
To estimate the regression coefficients in a simple linear regression
model, we can use formulas derived from the Ordinary Least Squares
(OLS) method. The OLS method minimizes the sum of the squared
differences between observed values and predicted values.
Let’s go through the process of calculating the coefficients aaa and bbb
in a linear regression model:
Simple Linear Regression Model
In a simple linear regression, we have:
Y=a+bX+e
where:
Y is the dependent variable,
X is the independent variable,
a is the intercept (or constant term),
b is the slope coefficient, and
e is the error term.
Formulas to Estimate a and b
The formulas to estimate a and b (known as the least squares
estimators) are:
∑( Xi− Xˉ )(Yi−Yˉ )
b¿ ∑ (Xi−Xˉ )2
Where:
Xi and Yi are individual observed values,
Xˉ is the mean of the X values, and
Yˉ is the mean of the Y values.
Step-by-Step Calculation
1. Calculate Xˉ\bar{X}Xˉ and Yˉ\bar{Y}Yˉ:
∑ Xi ∑ Yi
Xˉ= n ,Yˉ= n
First, find (Xi−Xˉ)( and (Yi−Yˉ) for each data point and their products.
Xi Yi Xi−Xˉ=X* Yi−Yˉ= Y* (Xi−Xˉ)(Yi−Yˉ) (Xi−Xˉ)2
1 2 -2 -3 6 4
2 3 -1 -2 2 1
Xi Yi Xi−Xˉ=X* Yi−Yˉ= Y* (Xi−Xˉ)(Yi−Yˉ) (Xi−Xˉ)2
3 5 0 0 0 0
4 7 1 2 2 1
5 8 2 3 6 4
∑ X∗¿=6 ¿ ∑ Y ∗¿=10 ¿ ∑ X∗Y ∗¿= 16 ∑ X∗2=10
n=5
Now, sum up the values in the last two columns:
∑ (Xi−Xˉ) (Yi−Yˉ) =6+2+0+2+6=16
∑ (Xi−Xˉ) 2=4+1+0+1+4=10
∑( Xi− Xˉ )(Yi−Yˉ )
Now, calculate b: ¿ ∑ (Xi−Xˉ )2
16
b= 10 =1.6
After the equation solve using either substitution method and elimination
method.
10= 5a+6b………………..i
16= 6a+10b……………..ii
16 -10 b= 6a
16 10
− =a
6 6
8 5
a= 3 - 3 b
5
10=5( ¿ ¿- 3 b ¿+ 6 b
1 1
10= 13 3 -8 3 b +6b
10= 40/3-7/3b
10-40/3=
-10/3= -7/3b
b= 10/7= 1.428571429
a= 8/3-5/3(10/7)
a= 0.285714285714286
Y= 0.285714285714286+1.428571429X
The expression in fraction form becomes:
2 10
y= + X
7 7
Let’s estimate y at x= 6
2 10
y= + (6)
7 7
10 60
×6=
7 7
2 60
y= +
7 7
2+ 60 62
y= =
7 7
y≈8.8571
. The differences in solutions obtained from the two methods—the formula method and the
simultaneous equations method—may arise from several factors, including numerical precision,
rounding errors, or the specific assumptions made in each method. Here’s a breakdown of each
approach:
Formula Method
1. Derived from Sums: The formula method directly utilizes sums of products and squares
from the data points. It calculates aaa and bbb based on aggregate statistics derived from
the data.
2. Least Squares Estimation: This method employs least squares estimation principles,
aiming to minimize the sum of squared errors between observed and predicted values.
Thus, it is closely tied to the statistical properties of the data set.
3. Impact of Data Variability: Variability in data can influence results. If data points are
outliers, the calculated regression coefficients may differ when based on different aspects
of the data set (e.g., total sums versus individual equations).
1. Set of Linear Equations: This method uses derived linear equations based on aggregate
sums to create a system of simultaneous equations.
2. Dependency on Variables: The results depend on how the equations are structured and
solved. Any slight changes in approach to forming these equations or in calculating
values can lead to variations in the results.
3. Solving Technique: The method of solving (whether substitution or elimination) may
introduce discrepancies. For example, if rounding occurs during calculations, this can
lead to different results.
1. Rounding Errors: In both methods, numerical rounding at various steps can accumulate
and lead to differences in the final estimates for aaa and bbb.
2. Data Sensitivity: Regression coefficients can be sensitive to the specific values used,
particularly if the data set has outliers or is not perfectly linear.
3. Assumptions in Calculation: Each method might be making different assumptions about
the data or how the relationships between variables should be modeled.
Conclusion
In practice, if both methods are correctly applied and yield significantly different coefficients, it
is essential to check each calculation step for accuracy and consistency. It might also be
beneficial to use statistical software to verify results, as these tools will typically handle rounding
and numerical precision issues more effectively.
For further reading on regression analysis and the methods used, you might find useful insights
in resources such as: