20ma402 Ps Unit II DCM
20ma402 Ps Unit II DCM
This document is confidential and intended solely for the educational purpose of
RMK Group of Educational Institutions. If you have received this document
through email in error, please notify the system manager. This document
contains proprietary information and is intended only to the respective group /
learning community as intended. If you are not the addressee you should not
disseminate, distribute or copy through e-mail. Please notify the sender
immediately by e-mail if you have received this document by mistake and delete
this document from your system. If you are not the intended recipient you are
notified that disclosing, copying, distributing or taking any action in reliance on
the contents of this information is strictly prohibited.
20MA402 PROBABILITY
AND STATISTICS
S. No TOPIC
3 discuss the concept of testing of hypothesis for small and large samples.
5 identify and interpret the control charts for variables and attributes.
PREREQUISITES
Differentiation
1
Integration
2 Higher Secondary level
TOTAL: 75 PERIODS
COURSE OUTCOMES
CO PO1 PO2 PO3 PO4 PO5 PO6 PO7 PO8 PO9 PO1 PO1 PO1 PSO PSO PSO
0 1 2 1 2 3
1 2 1 - - - - - - - - - - 2 - -
2 3 2 - - - - - - - - - - - - -
3 3 2 1 1 - - - - - - - - - - -
4 2 1 1 - - - - - - - - - - - -
5 1 - 1 - - - - - - - - - 1 - -
6 3 2 1 - - - - - - - - - 1 - -
Activity based learning enhances students’ critical thinking and collaborative skills.
Experiential learning being the core, various activities such as quiz competitions,
group discussion, etc. are conducted for all the five units to enhance the learning
abilities of students. The students are the center of the activities, where student’s
opinions are valued, questions are encouraged, and discussions are done. These
activities empower the students to explore and learn by themselves.
2.1 Introduction:
Definition
Let S be the sample space. Let X = X (s) and Y = Y (s) be two functions
each assigning a real number to each outcome s S. Then ( X , Y ) is a two-
dimensional random variable.
If the possible values of(𝑋, 𝑌) are finite, then (𝑋, 𝑌) is called a two-dimensional
discrete random variable and it can be represented by(𝑥𝑖 , 𝑦𝑗 ), 𝑖 = 1,2, … 𝑛; 𝑗 = 1,2, … 𝑚.
For two discrete random variables 𝑋and 𝑌, we write the probability that 𝑋will
take the value 𝑥𝑖 and 𝑌 will take the value 𝑦𝑗 as𝑃(𝑋 = 𝑥𝑖 , 𝑌 = 𝑦𝑗 ). Consequently, 𝑃(𝑋 =
𝑥𝑖 , 𝑌 = 𝑦𝑗 ) is the probability of intersection of the events𝑋 = 𝑥𝑖 and𝑌 = 𝑦𝑗 .
Y Y1 Y2 Y3 …
X
X1 P11 p12……
X2 P21 p22 …
X3
……
Example: If the joint p.d.f of (𝑋, 𝑌) is given by 𝑝(𝑥, 𝑦) = 𝐾(2𝑥 + 3𝑦), 𝑥 = 0,1,2; 𝑦 =
1,2,3. Find ′𝐾′.
Solution: Given
If(𝑋, 𝑌) can take all the values in a region 𝑅 in the𝑋𝑌 plane, then(𝑋, 𝑌) is called
a two dimensional continuous random variable.
Solution:
∞ ∞
𝑖)𝑓𝑋𝑌 (𝑥, 𝑦) ≥ 0𝑖𝑖) 𝑓𝑋𝑌 (𝑥, 𝑦)𝑑𝑥𝑑𝑦 = 1 ,then 𝑓(𝑥, 𝑦)is a joint density function.
−∞ −∞
𝑥 2 +𝑦 2
Given𝑓(𝑥, 𝑦) = 4𝑥𝑦𝑒 − , 𝑥 > 0, 𝑦 > 0
𝑖)𝑓(𝑥, 𝑦) ≥ 0, 𝑥, 𝑦 > 0
∞ ∞ ∞ ∞
𝑥 2 +𝑦 2
𝑖𝑖) 𝑓(𝑥, 𝑦)𝑑𝑥𝑑𝑦 = 4𝑥𝑦𝑒 − 𝑑𝑥𝑑𝑦
−∞ −∞ 0 0
∞ ∞
𝑥 2 +𝑦 2
=4 𝑥𝑦𝑒 − 𝑑𝑥𝑑𝑦
0 0
∞ ∞
2 2
=4 𝑥𝑒 −𝑥 𝑑𝑥 𝑦𝑒 −𝑦 𝑑𝑦
0 0
∞
1 1 2 1
=4 ∵ 𝑒 −𝑥 𝑑𝑥 =
2 2 0 2
=1
Note:
Note:
𝑏
1. 𝑃 𝑎 ≤ 𝑋 ≤ 𝑏 = 𝑎 𝑥
𝑓 𝑋 𝑑𝑥
𝑏
2. 𝑃 𝑐 ≤ 𝑌 ≤ 𝑑 = 𝑎 𝑦
𝑓 𝑌 𝑑𝑦
𝑑 𝑏
3. 𝑃 𝑎 ≤ 𝑋 ≤ 𝑏, 𝑐 ≤ 𝑌 ≤ 𝑑 = 𝑐 𝑎
𝒇 𝒙, 𝒚 𝒅𝒙𝒅𝒚
Conditional Probability
𝑃 𝑋 = 𝑥𝑖 , 𝑌 = 𝑦𝑗 = 𝑃 𝑋 = 𝑥𝑖 𝑃 𝑌 = 𝑦𝑗
Problems
x/y Y
1 2 3 4 5 6
0 0 0 1/32 2/32 2/32 3/32
1 1/16 1/16 1/8 1/8 1/8 1/8
X
2 1/32 1/32 1/64 1/64 0 2/64
(I) Find all the marginal probability distributions and (ii) conditional probability
distributions of 𝑋 given 𝑌. Also find (iii) 𝑃(𝑋 ≤ 1), (iv) 𝑃(𝑌 ≤ 3),
(v) 𝑃(𝑋 ≤ 1/ 𝑌 ≤ 3), (vi) 𝑃(𝑋 + 𝑌 ≤ 4 ).
Solution:
x/y Y
1 2 3 4 5 6 P(X)
0 0 0 1/32 2/32 2/32 3/32 8/32
1 1/16 1/16 1/8 1/8 1/8 1/8 10/16
X
2 1/32 1/32 1/64 1/64 0 2/64 8/64
P(Y) 3/32 3/32 11/64 13/64 6/32 16/6
4
i) Marginal probability distribution of 𝑋.
𝑋 𝑃(𝑋)
0 8/32
1 10/16
2 8/64
𝑃 𝑋 = 0, 𝑌 = 1 𝑝01
𝑃 𝑋 = 0/𝑌 = 1 = = =0
𝑃 𝑌=1 𝑃 𝑌=1
𝑃 𝑋 = 1, 𝑌 = 1 𝑝11 1
𝑃 𝑋 = 1/𝑌 = 1 = = = 16 = 2 3
𝑃 𝑌=1 𝑃 𝑌=1 3
32
𝑃 𝑋 = 2, 𝑌 = 1 𝑝21 1
𝑃 𝑋 = 2/𝑌 = 1 = = = 32 = 1 3
𝑃 𝑌=1 𝑃 𝑌=1 3
32
𝑃 𝑋 = 0, 𝑌 = 2 𝑝02
𝑃 𝑋 = 0/𝑌 = 2 = = =0
𝑃 𝑌=2 𝑃 𝑌=2
𝑃 𝑋 = 1, 𝑌 = 2 𝑝12 1
𝑃 𝑋 = 1/𝑌 = 2 = = = 16 = 2 3
𝑃 𝑌=2 𝑃 𝑌=2 3
32
𝑃 𝑋 = 2, 𝑌 = 2 𝑝22 1
𝑃 𝑋 = 2/𝑌 = 2 = = = 32 = 1 3
𝑃 𝑌=2 𝑃 𝑌=2 3
32
𝑃 𝑋 = 0, 𝑌 = 3 𝑝03 1
𝑃 𝑋 = 0/𝑌 = 3 = = = 32 = 2
𝑃 𝑌=3 𝑃 𝑌=3 11 11
64
𝑃 𝑋 = 1, 𝑌 = 3 𝑝13 1
𝑃 𝑋 = 1/𝑌 = 3 = = = 8 =8
𝑃 𝑌=3 𝑃 𝑌=3 11 11
64
𝑃 𝑋 = 2, 𝑌 = 3 𝑝23 1
𝑃 𝑋 = 2/𝑌 = 3 = = = 64 = 1
𝑃 𝑌=3 𝑃 𝑌=3 11 11
64
𝑃 𝑋 = 0, 𝑌 = 4 𝑝04 2
𝑃 𝑋 = 0/𝑌 = 4 = = = 32 = 4
𝑃 𝑌=4 𝑃 𝑌=4 13 13
64
𝑃 𝑋 = 1, 𝑌 = 4 𝑝14 1
𝑃 𝑋 = 1/𝑌 = 4 = = = 8 =8
𝑃 𝑌=4 𝑃 𝑌=4 13 13
64
𝑃 𝑋 = 2, 𝑌 = 4 𝑝24 1
𝑃 𝑋 = 2/𝑌 = 4 = = = 64 = 1
𝑃 𝑌=4 𝑃 𝑌=4 13 13
64
𝑃 𝑋 = 0, 𝑌 = 5 𝑝05 2
𝑃 𝑋 = 0/𝑌 = 5 = = = 32 = 1 3
𝑃 𝑌=5 𝑃 𝑌=5 6
32
𝑃 𝑋 = 1, 𝑌 = 5 𝑝15 1
𝑃 𝑋 = 1/𝑌 = 5 = = = 8 =2
𝑃 𝑌=5 𝑃 𝑌=5 6 3
32
𝑃 𝑋 = 2, 𝑌 = 5 𝑝25 0
𝑃 𝑋 = 2/𝑌 = 5 = = = =0
𝑃 𝑌=5 𝑃 𝑌=5 6
32
𝑃 𝑋 = 0, 𝑌 = 6 𝑝06 3
𝑃 𝑋 = 0/𝑌 = 6 = = = 32 = 3
𝑃 𝑌=6 𝑃 𝑌=6 16 8
64
𝑃 𝑋 = 1, 𝑌 = 6 𝑝16 1
𝑃 𝑋 = 1/𝑌 = 6 = = = 8 =1
𝑃 𝑌=6 𝑃 𝑌=6 16 2
64
𝑃 𝑋 = 2, 𝑌 = 6 𝑝26 2
𝑃 𝑋 = 2/𝑌 = 6 = = = 64 = 1
𝑃 𝑌=6 𝑃 𝑌=6 16 8
64
iii P X ≤ 1 = P X = 0 + P(X = 1)
= 8 32 + 10 16 = 28 32 = 7 8
iv P Y ≤ 3 = P Y = 1 + P Y = 2 + +P(Y = 3)
= 3 32 + 3 32 + 11 64 = 23 64
P X ≤ 1, Y ≤ 3
v P X ≤ 1/Y ≤ 3 =
𝑃(Y ≤ 3)
P X ≤ 1, Y ≤ 3 = 𝑃01 + 𝑃02 + 𝑃03 + 𝑃03 + 𝑃11 + 𝑃12 + 𝑃13
= 0 + 0 + 1 32 + 1 16 + 1 16 + 1 8 = 9 32
P X ≤ 1, Y ≤ 3 9
P X ≤ 1/Y ≤ 3 = = 32 = 18
𝑃(Y ≤ 3) 23 23
64
vi) P(X + Y ≤ 4 ).
Probability distribution of X + Y
X+Y 1 2 3 4 5 6 7 8
P(X+Y) 0 1/16 4/32 7/32 13/64 15/64 1/8 2/64
P X + Y ≤ 4 = 0 + 1 16 + 4 32 + 7 32 = 13 32
Solution:
The joint probability mass function of 𝑋, 𝑌 is given by
𝑝 𝑥, 𝑦 = 𝑘 2𝑥 + 3𝑦 ,𝑥 = 0,1,2, 𝑦 = 1,2,3
Probability distribution is
Y 1 2 3
X
0 3k 6k 9k
1 5k 8k 11k
2 7k 10k 13k
⟹ 𝑃𝑖𝑗 = 1
⟹ 72𝑘 = 1
⟹ 𝑘 = 1 72
𝑋 𝑃(𝑋)
0 18K=18/72
1 24K=24/72
2 30K=30/72
𝑌 𝑃(𝑌)
1 15K=15/72
2 24K=24/72
3 33K=33/72
= 3 72 + 6 72 + 5 72 + 8 72 = 22 72 = 11 36
P X ≤ 1, Y ≤ 2 11
v)P X ≤ 1/Y ≤ 2 = = 36 = 22
P Y≤2 39 39
72
1. The joint probability mass function of a bivariate discrete random variable (𝑋, 𝑌)
is given by 𝑃(𝑋, 𝑌) = 𝐾(2𝑥 + 𝑦) , 𝑥 = 0,1.2; 𝑦 = 1,2.3.
Find the marginal probability mass function of 𝑋 and 𝑌.
Also find probability distribution of (𝑋 + 𝑌).
Solution:
The joint probability mass function of 𝑋, 𝑌 is given by 𝑃(𝑋, 𝑌) = 𝐾(2𝑥 + 𝑦) ,
𝑥 = 0,1.2; 𝑦 = 1,2.3.
Probability distribution is
Y 1 2 3
X
0 k 2k 3k
1 3k 4k 5k
2 5k 6k 7k
⟹ 𝑃𝑖𝑗 = 1
⟹ 36𝑘 = 1
⟹ 𝑘 = 1 36
𝑋 𝑃(𝑋)
0 6K=6/36
1 12K=12/36
2 18K=18/36
𝑌 𝑃(𝑌)
1 9K=9/36
2 12K=12/36
3 15K=15/36
Probability distribution of X + Y
𝑋+𝑌 1 2 3 4 5
𝑃(𝑋 + 𝑌) 1/36 5/36 12/36 11/36 7/36
1. The two-dimensional random variable (𝑋, 𝑌) has the joint density function
𝑥 +𝑦
𝑓(𝑥, 𝑦) = , 𝑋 = 1,2,3; 𝑌 = 1,2.
21
𝑌 = 1,2.
Probability distribution is
Y 1 2
X
1 2/21 3/21
2 3/21 4/21
3 4/21 5/21
𝑋 𝑃(𝑋)
1 5/21
2 7/21
3 9/21
𝑌 𝑃(𝑌)
1 9/21
2 12/21
𝑃 𝑋 = 1, 𝑌 = 1 𝑝11 2
𝑃 𝑋 = 1/𝑌 = 1 = = = 21 = 2 9
𝑃 𝑌=1 𝑃 𝑌=1 9
21
𝑃 𝑋 = 2, 𝑌 = 1 𝑝21 3
𝑃 𝑋 = 2/𝑌 = 1 = = = 21 = 3 9
𝑃 𝑌=1 𝑃 𝑌=1 9
21
𝑃 𝑋 = 3, 𝑌 = 1 𝑝31 4
𝑃 𝑋 = 3/𝑌 = 1 = = = 21 = 4 9
𝑃 𝑌=1 𝑃 𝑌=1 9
21
Conditional probability distribution of 𝑋 given 𝑌=2
𝑃 𝑋 = 1, 𝑌 = 2 𝑝12 3
𝑃 𝑋 = 1/𝑌 = 2 = = = 21 = 3
𝑃 𝑌=2 𝑃 𝑌=2 12 12
21
𝑃 𝑋 = 2, 𝑌 = 2 𝑝22 4
𝑃 𝑋 = 2/𝑌 = 2 = = = 21 = 4
𝑃 𝑌=2 𝑃 𝑌=2 12 12
21
𝑃 𝑋 = 3, 𝑌 = 2 𝑝32 5
𝑃 𝑋 = 3/𝑌 = 2 = = = 21 = 5
𝑃 𝑌=2 𝑃 𝑌=2 12 12
21
𝑃 𝑋 = 1, 𝑌 = 1 𝑝11 2
𝑃 𝑌 = 1/𝑋 = 1 = = = 21 = 2 5
𝑃 𝑋=1 𝑃 𝑋=1 5
21
𝑃 𝑋 = 1, 𝑌 = 2 𝑝12 3
𝑃 𝑌 = 2/𝑋 = 1 = = = 21 = 3 5
𝑃 𝑋=1 𝑃 𝑋=1 5
21
𝑃 𝑋 = 2, 𝑌 = 1 𝑝21 3
𝑃 𝑌 = 1/𝑋 = 2 = = = 21 = 3 7
𝑃 𝑋=2 𝑃 𝑋=2 7
21
𝑃 𝑋 = 2, 𝑌 = 2 𝑝22 4
𝑃 𝑌 = 2/𝑋 = 2 = = = 21 = 4 7
𝑃 𝑋=2 𝑃 𝑋=2 7
21
𝑃 𝑋 = 3, 𝑌 = 1 𝑝31 4
𝑃 𝑌 = 1/𝑋 = 3 = = = 21 = 4 9
𝑃 𝑋=3 𝑃 𝑋=3 9
21
𝑃 𝑋 = 3, 𝑌 = 2 𝑝32 5
𝑃 𝑌 = 2/𝑋 = 3 = = = 21 = 5 9
𝑃 𝑋=3 𝑃 𝑋=3 9
21
i) Probability distribution of X + Y
𝑋+𝑌 2 3 4 5
𝑃(𝑋 + 𝑌) 2/21 6/21 8/21 5/21
ii) 𝑃 𝑋 + 𝑌 ≤ 2 = 2 21
Problems for Practice
1. The joint probability mass function of a bivariate discrete random variable (𝑋, 𝑌) is
given by
x
1 2
y
1 0.1 0.2
2 0.3 0.4
2. The joint probability mass function of (𝑋, 𝑌) is given by 𝑃(𝑥, 𝑦) = 𝑘(𝑥 + 2𝑦),
𝑥 = 0,1,2, and 𝑦 = 0,1,2. Find (i) all the marginal and conditional distributions of
𝑋 𝑎𝑛𝑑 𝑌 (ii) probability distribution of (𝑋 + 𝑌), (iii) 𝑃(𝑋 + 𝑌 ≤ 2)
1
1. The joint p.d.f of 𝑋, 𝑌 is given by 𝑓 𝑥, 𝑦 = 8
6 − 𝑥 − 𝑦 , 0 ≤ 𝑥 ≤ 2, 2 ≤ 𝑦 ≤ 4 .
Also find
Solution:
i) Marginal density of 𝑋
∞
𝑓𝑥 𝑋 = 𝑓 𝑥, 𝑦 𝑑𝑦
−∞
4
1
= 6 − 𝑥 − 𝑦 𝑑𝑦
2 8
4
1 𝑦2
= 6𝑦 − 𝑥𝑦 −
8 2 2
1
= 24 − 4𝑥 − 8 − 12 + 2𝑥 + 2
8
1
𝑓𝑥 𝑋 = 6 − 2𝑥
8
Marginal density of 𝑌
∞
𝑓𝑦 𝑌 = 𝑓 𝑥, 𝑦 𝑑𝑥
−∞
2
1
= 6 − 𝑥 − 𝑦 𝑑𝑋
0 8
2
1 𝑥2
= 6𝑥 − − 𝑥𝑦
8 2 0
1
= 12 − 2 − 2𝑦 − 0
8
1
= 10 − 2𝑦
8
1
𝑓𝑦 𝑌 = 5−𝑦
4
i) Conditional density of 𝑋
𝑓 𝑥, 𝑦
𝑓 𝑋 𝑌 =
𝑓𝑦 𝑌
1
6−𝑥−𝑦 6−𝑥−𝑦
=8 =
1 2 5−𝑦
4 5−𝑦
Conditional density of 𝑌
𝑓 𝑥, 𝑦
𝑓 𝑌 𝑋 =
𝑓𝑦 𝑌
1
6−𝑥−𝑦 6−𝑥−𝑦
=8 =
1 6 − 2𝑥
8 6 − 2𝑥
ii) 𝑃 𝑋 < 1 ∩ 𝑌 < 3 = 𝑃 𝑋 < 1, 𝑌 < 3
= 𝑓 𝑥, 𝑦 𝑑𝑥𝑑𝑦
3 1
1
= 6 − 𝑥 − 𝑦 𝑑𝑥𝑑𝑦
2 0 8
3 1
𝑥2
= 6𝑥 − − 𝑦𝑥 𝑑𝑦
2 2 0
3
1
= 6 − − 𝑦 𝑑𝑦
2 2
3
𝑦 𝑦2 3 9 3
= 6𝑦 − − = 18 − − − 12 + 1 + 2 =
2 2 2
2 2 8
3
𝑃 𝑋 <1∩𝑌 <3 =
8
3 3−𝑦
1
= 6 − 𝑥 − 𝑦 𝑑𝑥𝑑𝑦
2 0 8
3 3−𝑦
𝑥2
= 6𝑥 − − 𝑦𝑥 𝑑𝑦
2 2 0
3 2
3−𝑦
= 6 3−𝑦 − − 𝑦 3 − 𝑦 𝑑𝑦
2 2
3
9 + 𝑦 2 − 6𝑦
18 − 6𝑦 − − 3𝑦 + 𝑦 2 𝑑𝑦
2 2
3
6𝑦 2 9𝑦 𝑦 3 6𝑦 2 3𝑦 2 𝑦 3
= 18𝑦 − − − + − +
2 2 6 4 2 3 2
5
=
24
𝑃 𝑋<1,𝑌<3
ii) 𝑃 𝑋<1 𝑌<3 =
𝑃 𝑌<3
3
𝑃 𝑌<3 = 𝑓𝑦 𝑌 𝑑𝑦
2
3
1
= 5 − 𝑦 𝑑𝑦
2 4
3
1 𝑦2
= 5𝑦 −
4 2 2
1 9
= 15 − − 10 + 2
4 2
5
𝑃 𝑌<3 =
8
3
𝑃 𝑋 < 1 8 3
𝑌<3 = 5 =5
8
Solution:
⟹ 𝑓 𝑥, 𝑦 𝑑𝑥𝑑𝑦 = 1
𝑅
∞ ∞
k x ye
(
− x2 + y 2 )
⟹ 𝑑𝑥𝑑𝑦 = 1
0 0
∞ ∞
x ye
(
− x2 + y 2 )
⟹𝑘 𝑑𝑥 𝑑𝑦 = 1
0 0
∞ ∞ ∞
𝑥𝑒 −𝑥 𝑑𝑥 = 1 2)
2 2 2
⟹𝑘 𝑥𝑒 −𝑥 𝑑𝑥 𝑦𝑒 −𝑦 𝑑𝑦 = 1 (∴
0 0 0
⟹𝑘 1 2 1 2 =1
⟹𝑘=4
∞
𝑓𝑥 𝑋 = 𝑓 𝑥, 𝑦 𝑑𝑦
0
∞
2 2
𝑓𝑥 𝑋 = 4𝑥𝑒 −𝑥 𝑦𝑒 −𝑦 𝑑𝑦
0
∞
2 2
𝑓𝑥 𝑋 = 4𝑥𝑒 −𝑥 𝑦𝑒 −𝑦 𝑑𝑦
0
2 1 2
= 4𝑥𝑒 −𝑥 = 2𝑥𝑒 −𝑥
2
2
𝑓𝑥 𝑋 = 2𝑥𝑒 −𝑥
∞
𝑓𝑦 𝑌 = 𝑓 𝑥, 𝑦 𝑑𝑥
−∞
∞
2 2
= 4𝑥𝑒 −𝑥 𝑦𝑒 −𝑦 𝑑𝑥
0
∞
−𝑦 2 2
= 4𝑦𝑒 𝑥𝑒 −𝑥 𝑑𝑥
0
2 1 2
= 4𝑦𝑒 −𝑦 = 2𝑦𝑒 −𝑦
2
2
𝑓𝑦 𝑌 = 2𝑦𝑒 −𝑦
2 2 𝑥 2 +𝑦 2
𝑓𝑥 𝑋 𝑓𝑦 𝑌 = 2𝑥𝑒 −𝑥 2𝑦𝑒 −𝑦 =4𝑥𝑦𝑒 − = 𝑓 𝑥, 𝑦
Solution:
x
=2 y 0
𝑓𝑥 𝑋 = 2𝑥
∞
𝑓𝑦 𝑌 = 𝑓 𝑥, 𝑦 𝑑𝑥
−∞
2
= 2 𝑑𝑥
0
1
=2 x y
𝑓𝑦 𝑌 = 2 1 − 𝑦
𝑓𝑥 𝑋 𝑓𝑦 𝑌 = 2𝑥 ∗ 2 1 − 𝑦 = 4𝑥 1 − 𝑦 ≠ 𝑓 𝑥, 𝑦
2 1
𝑓 𝑋 𝑌 = =
2 1−𝑦 1−𝑦
Conditional density of Y
𝑓 𝑥, 𝑦
𝑓 𝑌 𝑋 =
𝑓𝑥 𝑋
2 1
𝑓 𝑌 𝑋 = =
2𝑥 x
Find
(i) The value of c
(ii) 𝑓𝑥 𝑋 , 𝑓𝑦 𝑌
(iii) 𝑓 𝑌 𝑋
Solution:
⟹ 𝑓 𝑥, 𝑦 𝑑𝑥𝑑𝑦 = 1
𝑅
2 x
⟹ cx(x − y)𝑑𝑥𝑑𝑦 = 1
0 −x
2 x
2
𝑦2
⟹𝑐 𝑥 𝑦− 𝑑𝑦 = 1
0 2 −x
2
𝑥2 𝑥2
⟹𝑐 𝑥3 − + 𝑥3 + 𝑑𝑦 = 1
0 2 2
2
⟹𝑐 0
2𝑥 3 𝑑𝑦 = 1
2
𝑥4
⟹𝑐2 =1
4 0
16
⟹ 𝑐2 =1
4
1
⟹𝑐=
8
1
∴ 𝑓 𝑥, 𝑦 = 8 x(x − y), 0 ≤ 𝑥 ≤ 2, −x ≤ 𝑦 ≤ x
0, 𝑒𝑙𝑠𝑒𝑤ℎ𝑒𝑟𝑒
x
1 𝑦2
= 𝑥2 𝑦 −
8 2 −x
1 3 𝑥2 𝑥2
= 𝑥 − + 𝑥3 +
8 2 2
2𝑥 3 𝑥 3
𝑓𝑥 𝑋 = =
8 4
Marginal density of 𝑌
In region 𝑅1, −2 ≤ 𝑦 ≤ 0
∞
𝑓𝑦 𝑌 = 𝑓 𝑥, 𝑦 𝑑𝑥
−∞
2
1
= x(x − y) 𝑑𝑋
−y 8
2
1 𝑥3 𝑥2 𝑦
= −
8 3 2 −𝑦
1 8 5𝑦 3
= − 2y +
8 3 6
1 y 5𝑦 3
𝑓𝑦 𝑌 = − +
3 4 48
In region 𝑅2, 0 ≤ 𝑦 ≤ 2
∞
𝑓𝑦 𝑌 = 𝑓 𝑥, 𝑦 𝑑𝑥
−∞
2
1
= x(x − y) 𝑑𝑋
y 8
2
1 𝑥3 𝑥2 𝑦
= −
8 3 2 𝑦
1 8 4y 𝑦 3 𝑦 3
= − − +
8 3 2 3 2
1 y 𝑦3
𝑓𝑦 𝑌 =3 − 4 + 48
1 y 5𝑦 3
− + , −2 ≤ 𝑦 ≤ 0
𝑓𝑦 𝑌 = 3 4 483
1 y 𝑦
− + , 0≤𝑦≤2
3 4 48
𝑓 𝑥, 𝑦
𝑓 𝑌 𝑋 =
𝑓𝑥 𝑥
1
x(x − y) (x − y)
𝑓 𝑌 𝑋 =8 =
𝑥3 2x 2
4
(iv) 𝑃 𝑋>1 1
𝑌<2
(v) 𝑃 𝑋<𝑌
(vi) 𝑃(𝑋 + 𝑌 ≤ 1 ).
Solution:
i) Marginal density of 𝑋
∞
𝑓𝑥 𝑋 = 𝑓 𝑥, 𝑦 𝑑𝑦
−∞
1
𝑥2
= x𝑦 2 + 𝑑𝑦
0 8
1
x𝑦 3 𝑥 2 𝑦
= −
3 8 0
x 𝑥2
𝑓𝑥 𝑋 = −
3 8
Marginal density of Y
∞
𝑓𝑦 𝑌 = 𝑓 𝑥, 𝑦 𝑑𝑥
−∞
2
𝑥2
= x𝑦 2 + 𝑑𝑋
0 8
2
𝑥2 𝑦2 𝑥3
= +
2 24 0
4𝑦 2 8 1
= + = 2𝑦 2 +
2 24 3
1
𝑓𝑦 𝑌 = 2𝑦 2 +
3
2
ii) 𝑃 𝑋>1 = 1 𝑥
𝑓 𝑋 𝑑𝑥
2 2
x 𝑥2 𝑥2 𝑥3
= − 𝑑𝑥 = +
1 3 8 6 24 1
4 8 1 1 19
= + − − =
6 24 6 24 24
1
1
i) 𝑃 𝑌< = 2𝑓
0 𝑦
𝑌 𝑑𝑦
2
1
1
= 2
0
2𝑦 2 + 𝑑𝑦
3
1
2𝑦 3 𝑦 2 2 1 1
= 3
+ 3 =24 + 6= 4
0
1
𝑃 𝑋>1,𝑌<
ii) 𝑃 𝑋>1 1 = 1
2
𝑌< 𝑃 𝑌<
2
2
1
2
1 2 𝑥2
𝑃 𝑋 > 1, 𝑌 < = x𝑦 2 + 𝒅𝒙𝒅𝒚
2 0 1 8
1 2
𝑥2𝑦 2 𝑥3
= 0
2 + 𝑑𝑦
2 24 1
1 1
2 8 𝑦2 1 2 7 3𝑦 2
= 2𝑦 2 + − − 𝑑𝑦 = + 𝑑𝑦
0 24 2 24 0 24 2
1
7y 𝑦 3 2 7 1 10 5
= + = + = =
24 2 0
48 16 48 24
1 5
𝑃 𝑋 > 1, 𝑌 < =
2 24
1 5
𝑃 𝑋 > 1, 𝑌 < 2 5
∴𝑃 𝑋>1 24
1 = 1
=
1
=
6
𝑌<2 𝑃 𝑌<2 4
iii) 𝑃 𝑋<𝑌 = 𝑅
𝑓 𝑥, 𝑦 𝑑𝑥𝑑𝑦 ∴ 𝑙𝑖𝑚𝑖𝑡 𝑜𝑓 𝑅 𝑖𝑠 ,0 ≤ 𝑥 ≤ 𝑦 & 0 ≤ 𝑦 ≤ 1
1 y
𝑥2
2
= x𝑦 + 𝒅𝒙𝒅𝒚
0 0 8
1 𝑦
𝑥2 𝑦2 𝑥3
= + 𝑑𝑦
0 2 24 0
1
𝑦4 𝑦3
= + 𝑑𝑦
0 2 24
1
𝑦5 𝑦4 1 1 53
= + = + =
10 96 0
10 96 480
i) 𝑃(𝑋 + 𝑌 ≤ 1 ) = 𝑅
𝑓 𝑥, 𝑦 𝑑𝑥𝑑𝑦 ∴ 𝑙𝑖𝑚𝑖𝑡 𝑜𝑓 𝑅 𝑖𝑠 0 ≤ 𝑥 ≤ 1 − 𝑦 & 0 ≤ 𝑦 ≤ 1
1 1−y
𝑥2
= x𝑦 2 + 𝑑𝑥𝑑𝑦
0 0 8
1 1−𝑦
𝑥2 𝑦2 𝑥3
= + 𝑑𝑦
0 2 24 0
1
𝑦2 1 − 𝑦 2
1−𝑦 3
= + 𝑑𝑦
0 2 24
1
𝑦 2 − 2𝑦 3 + 𝑦 4 1−𝑦 3
13
= + 𝑑𝑦 =
0 2 24 480
13
⟹ 𝑃(𝑋 + 𝑌 ≤ 1 ) =
480
Solution:
i) Marginal density of 𝑋
∞
𝑓𝑥 𝑋 = 𝑓 𝑥, 𝑦 𝑑𝑦
−∞
1
= 8𝑥𝑦 𝑑𝑦
x
1
𝑦2 1 𝑥2
= 8𝑥 = 8𝑥 −
2 𝑥
2 2
𝑓𝑥 𝑋 = 4𝑥 1 − 𝑥 2
Marginal density of 𝑌
∞
𝑓𝑦 𝑌 = 𝑓 𝑥, 𝑦 𝑑𝑥
−∞
y
= 8𝑥𝑦 𝑑𝑥
0
𝑦
𝑥2 𝑦2
= 8𝑦 = 8𝑦 = 4𝑦 3
2 0
2
𝑓𝑦 𝑌 = 4𝑦 3
𝑓 𝑥, 𝑦
𝑓 𝑋 𝑌 =
𝑓𝑦 𝑌
8𝑥𝑦
=
4𝑦 3
2𝑥
𝑓 𝑋 𝑌 = 2
𝑦
𝑓 𝑥, 𝑦
𝑓 𝑌 𝑋 =
𝑓𝑥 𝑥
8𝑥𝑦
=
4𝑥 1 − 𝑥 2
2𝑥
𝑓 𝑌 𝑋 ==
1 − 𝑥2
𝑓𝑥 𝑋 𝑓𝑦 𝑌 = 4𝑥 1 − 𝑥 2 4𝑦 3 ≠ 𝒇 𝒙, 𝒚
Exercises
𝑥𝑦
𝑥2 + , 0 < 𝑥 < 1,0 < 𝑦 < 2
𝑓(𝑥, 𝑦) = 3
0, 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
Find
1 1
<𝑋<
b) 𝑃 4
1
2
.
𝑌=
3
𝐸 𝑋 = 𝑥𝑃 𝑋 = 𝑥𝑖
𝑖
𝐸 𝑌 = 𝑦𝑃 𝑌 = 𝑦𝑗
𝑗
𝐸 𝑋2 = 𝑥 2 𝑃 𝑋 = 𝑥𝑖
𝑖
𝐸 𝑌2 = 𝑦 2 𝑃 𝑌 = 𝑦𝑗
𝑗
𝐸 𝑋𝑌 = 𝑥 𝑦𝑃𝑖𝑗
𝑖
𝑗
i) 𝐸 𝑋 = 𝑥𝑓𝑋 𝑥 𝑑𝑥
ii) 𝐸 𝑌 = 𝑦 𝑓𝑌 𝑦 𝑑𝑦
iii) 𝐸 𝑋2 = 𝑥 2 𝑓𝑋 𝑥 𝑑𝑥
Variance:
2
i) Variance of 𝑋 is given by 𝑉𝑎𝑟 𝑋 = 𝐸 𝑋 2 − 𝐸 𝑋
2
ii) Variance of 𝑌 is given by 𝑉𝑎𝑟 𝑌 = 𝐸 𝑌 2 − 𝐸 𝑌
2.5 CORRELATION
So far, we learned about the joint probability distribution of two random variables
𝑋 𝑎𝑛𝑑 𝑌. Here, we will extend our study of the relationship between two random
variables by learning how to quantify the degree to which two random variables 𝑋 and
𝑌 are associated or correlated. Here, we will begin our attempt to compute the
dependence between two random variables and by exploring what is called the
covariance between the two random variables. Now we will start with a formal
definition of the covariance.
Covariance
𝐶𝑂𝑉 𝑋, 𝑌 = 𝜎𝑋𝑌 = 𝐸 𝑋 − 𝜇𝑥 𝑌 − 𝜇𝑦
𝐶𝑂𝑉 𝑋, 𝑌 = 𝜎𝑋𝑌 = 𝐸 𝑋𝑌 − 𝐸 𝑋 𝐸 𝑌
Now that we know how to calculate the covariance between two random
variables, X and Y, let's turn our attention to seeing how the covariance helps us
calculate what is called the correlation coefficient.
Correlation Coefficient
𝐶𝑂𝑉(𝑋, 𝑌)
𝜌𝑋𝑌 =
𝜎𝑥 𝜎𝑦
NOTE
A regression line is a straight line that describes how a response variable 𝑦 changes
as an explanatory variable 𝑥 changes. We often use a regression line to predict the
value of y for a given value of 𝑥.
𝑥 − 𝑥 = 𝑏𝑥𝑦 𝑦 − 𝑦ത
𝜎 𝐶𝑜𝑣 (𝑋,𝑌)
Where 𝑏𝑥𝑦 is called regression coefficient X on Y and 𝑏𝑥𝑦 = 𝜌 𝜎𝑥 𝑜𝑟
𝑦 𝜎𝑦 2
𝑥𝑖 𝑦𝑖
𝑥=𝐸 𝑋 = 𝑛
, 𝑦ത = 𝐸 𝑌 = 𝑛
𝑥 − 𝑥 = 𝑏𝑥𝑦 𝑦 − 𝑦ത
𝜎 𝐶𝑜𝑣 (𝑋,𝑌)
Where 𝑏𝑥𝑦 is called regression coefficient X on Y and 𝑏𝑥𝑦 = 𝜌 𝜎𝑥 𝑜𝑟
𝑦 𝜎𝑦 2
𝑥𝑖 𝑦𝑖
𝑥=𝐸 𝑋 = 𝑛
, 𝑦ത = 𝐸 𝑌 = 𝑛
𝑦 − 𝑦ത = 𝑏𝑦𝑥 𝑥 − 𝑥
𝜎𝑦 𝐶𝑜𝑣 (𝑋,𝑌)
Where 𝑏𝑦𝑥 is called regression coefficient Y on X and 𝑏𝑦𝑥 = 𝜌 𝜎 𝑜𝑟
𝑥 𝜎𝑥 2
𝑥𝑖 𝑦𝑖
𝑥=𝐸 𝑋 = , 𝑦ത = 𝐸 𝑌 =
𝑛 𝑛
𝑛 𝑥𝑦 − 𝑥 𝑦
𝑏𝑥𝑦 =
𝑛 𝑦2 − 𝑦 2
𝑛 𝑥𝑦 − 𝑥 𝑦
𝑏𝑦𝑥 =
𝑥2 − 𝑥 2
Solution:
𝐸 𝑥𝑦 = 𝑥𝑦𝑓 𝑥, 𝑦 𝑑𝑥𝑑𝑦
𝑅
1 1−𝑦
= 𝑥𝑦 3 𝑥 + 𝑑𝑥𝑑𝑦
0 0
1 1−𝑦
=3 𝑦 (𝑥2 + 𝑦𝑥)𝑑𝑥𝑑𝑦
0 0
1 𝑥3 𝑦𝑥 2
=3 0
𝑦[3 + 2
] 1−𝑦
0
𝑑𝑦33
1
(1 − 𝑦)3 𝑦(1 − 𝑦)2
=3 𝑦[ + ]𝑑𝑦
0 3 2
1
(1 − 𝑦)3 𝑦 2 (1 − 𝑦)2
=3 𝑦 + 𝑑𝑦
0 3 2
1
𝑌 𝑦 2 (1 + 𝑦 2 − 2𝑌)
=3 [ 1 − 𝑦 3 − 3𝑦 + 3𝑦 2 + ]𝑑𝑦
0 3 2
1
1 (𝑦 2 + 𝑦 4 − 2𝑦 3 )
=3 𝑦 − 𝑦 4 − 3𝑦 2 + 3𝑦 3 + ]𝑑𝑦
0 3 2
𝑦2 𝑦5 𝑦3 3 𝑦3 𝑦5 𝑦4
= − − 3 + 3𝑦 3 + + −2
2 5 3 2 3 5 4
1 1 3 −1 3 3 1
= − −1+ + + − =
2 5 4 2 10 4 10
1
𝐸 𝑥𝑦 =
10
𝑦=1−𝑥
= 𝑓𝑥 𝑥 = 𝑓 𝑥, 𝑦 𝑑𝑦
𝑦=0
1−𝑥
= 3 𝑥 + 𝑦 𝑑𝑦
0
𝑦2 1 − 𝑥 1−𝑥 2
= 3 𝑥𝑦 + = 3 𝑥 1−𝑥 +
2 0 2
1 + 𝑥 2 − 2𝑥
3 𝑥 − 𝑥2 +
2
3 3
= 2𝑥 − 2𝑥 2 + 1 + 𝑥 2 − 2𝑥 = 1 − 𝑥2
2 2
1−𝑥 1−𝑦
𝑓𝑦 𝑦 = 𝑓 𝑥, 𝑦 𝑑𝑥 = 3 𝑥 + 𝑦 𝑑𝑥
0 0
𝑥2 1−𝑦
=3 + 𝑦𝑥
2 0
(1 − 𝑦)2
=3 + 𝑦(1 − 𝑦)
2
3
𝑓𝑦 𝑦 = 1 − 𝑦2
2
1 1 1
3 3 𝑥2 𝑥4 3 3 3
𝐸 𝑥 = 𝑥𝑓𝑥 𝑥 𝑑𝑥 = 𝑥 1 − 𝑥 2 𝑑𝑥 = − = − =
0 0 2 2 2 4 0
4 8 8
1 1 1
3 2
3 𝑦2 𝑦4 3 3 3
𝐸 𝑦 = 𝑦𝑓𝑦 𝑦 𝑑𝑦 = 𝑦 1 − 𝑦 𝑑𝑦 = − = − =
0 0 2 2 2 4 0
4 8 8
1 3 3 1 9 13
𝐶𝑜𝑣 𝑥, 𝑦 = 𝐸 𝑥𝑦 − 𝐸 𝑥 𝐸 𝑦 = − = − =−
10 8 8 10 64 320
2 − 𝑥 − 𝑦, 0 ≤ 𝑥 ≤ 1, 0 ≤ 𝑦 ≤ 1
2. The Joint P.D.F of (x,y) is given by f(x,y)= .
0, 𝑒𝑙𝑠𝑒𝑤ℎ𝑒𝑟𝑒
Find 𝑟(𝑥, 𝑦)
Solution:
𝟏 1
𝑦2
𝒇𝒙 𝒙 = 𝒇 𝒙, 𝒚 𝒅𝒚 = ( 2 − 𝑥 − 𝑦)𝑑𝑦 = 2𝑦 − 𝑥𝑦 −
𝟎 2 0
1 3
= 2−𝑥− = −𝑥
2 2
1 1
𝑥2
𝑓𝑦 𝑦 = 𝑓 𝑥, 𝑦 𝑑𝑥 = ( 2 − 𝑥 − 𝑦)𝑑𝑥 = 2𝑥 − 𝑥𝑦 −
0 2 0
1 3
= 2−𝑦− = −𝑦
2 2
1 1 1
3 3 𝑥2 𝑥3
𝐸 𝑥 = 𝑥𝑓𝑥 𝑥 𝑑𝑥 = 𝑥 − 𝑥 𝑑𝑥 = −
0 0 2 2 2 3 0
3 1 9−4 5
= − = =
4 3 12 12
1 1 1
3 3 𝑦2 𝑦3
𝐸 𝑦 = 𝑦𝑓𝑦 𝑦 𝑑𝑦 = 𝑦 − 𝑦 𝑑𝑦 = −
0 0 2 2 2 3 0
3 1 9−4 5
= − = =
4 3 12 12
1 1
2 2 2
3 3 𝑥3 𝑥4
𝐸 𝑥 = 𝑥 𝑓𝑥 𝑥 𝑑𝑥 = 𝑥 − 𝑥 𝑑𝑥 = −
0 2 2 3 4 0
1 1 1
= − =
2 4 4
1 1
2 2 2
3 3 𝑦3 𝑦4
𝐸 𝑦 = 𝑦 𝑓𝑦 𝑦 𝑑𝑦 = 𝑦 − 𝑦 𝑑𝑦 = −
0 2 2 3 4 0
1 1 1
= − =
2 4 4
1 1 1 1
𝑥2 𝑥3 𝑥2
𝐸 𝑥𝑦 = 𝑥𝑦 2 − 𝑥 − 𝑦 𝑑𝑥𝑑𝑦 = 2 𝑦 − 𝑦 − 𝑦2 𝑑𝑦
0 0 0 2 3 2 0
1
𝑦 𝑦2
= 𝑦− − 𝑑𝑦
0 3 2
1
𝑦2 𝑦2 𝑦3 1 1 1 1 1 1
= − − = − − = − =
2 6 6 0
2 6 6 2 3 6
1 5 5 1 25 1
𝐶𝑜𝑣 𝑥, 𝑦 = 𝐸 𝑥𝑦 − 𝐸 𝑥 𝐸 𝑦 = − = − =−
6 12 12 6 144 144
2
2 1 5 1 25 36 − 25 11
𝜎𝑥2 =𝐸 𝑥 2
− 𝐸 𝑥 = − = − = =
4 12 4 144 144 144
2
2 1 5 1 25 36 − 25 11
𝜎𝑦2 = 𝐸 𝑦 2 − 𝐸 𝑦 = − = − = =
4 12 4 144 144 144
1
− 144 1
ρ 𝑥𝑦 = = −
11 11 11
144 144
𝑥+𝑦 0 ≤ 𝑥 ≤ 1, 0 ≤ 𝑦 ≤ 1
𝑓 𝑥, 𝑦 =
0 𝐸𝑙𝑠𝑒𝑤ℎ𝑒𝑟𝑒
Compute 𝜌(𝑥, 𝑦)
Solution:
1 1
𝑦2 1 1
𝑓𝑥 𝑥 = 𝑓 𝑥, 𝑦 𝑑𝑦 = 𝑥 + 𝑦 𝑑𝑦 = 𝑥𝑦 + =𝑥+
2 0 2
0 0
1 1
1
𝑓𝑦 𝑦 = 𝑓 𝑥, 𝑦 𝑑𝑥 = 𝑥 + 𝑦 𝑑𝑥 = 𝑦 +
2
0 0
1 1
1 𝑥 𝑥 23 𝑥 2 1 1 7
𝐸 𝑥 = 𝑥+ 𝑑𝑥 = 𝑥2 + 𝑑𝑥 = + = + =
2 2 3 4 3 4 12
0 0
1
1 7
𝐸 𝑦 = 𝑦 𝑦+ 𝑑𝑦 =
2 12
0
1
1 𝑥 4 1 𝑥3 1 6 + 4 10 5
𝐸 𝑥2 = 𝑥2 𝑥 + 𝑑𝑥 = + = + =
2 4 2 3 0 24 24 12
0
1
2
5
𝐸 𝑦 = 𝑦 2 𝑓𝑦 𝑦 𝑑𝑦 =
12
0
𝐸 𝑥𝑦 = 𝑥𝑦 𝑓 𝑥, 𝑦 𝑑𝑥𝑑𝑦
1 1 1
𝑥3 𝑥2 1
= 𝑥𝑦 𝑥 + 𝑦 𝑑𝑥𝑑𝑦 = 𝑦 +𝑦 𝑑𝑦
3 2 0
0 0 0
1
1 𝑦 𝑦2 𝑦3 1
= 𝑦 + 𝑑𝑦 = +
3 2 6 6 0
0
1 1 2 1
+ = =
6 6 6 3
𝐶𝑜𝑣 𝑥, 𝑦
𝜌 𝑥, 𝑦 =
𝜎𝑥 𝜎𝑦
𝐶𝑜𝑣 𝑥, 𝑦 = 𝐸 𝑥𝑦 − 𝐸 𝑥 − 𝐸 𝑦
1 7 7 1 49
= − = =
3 12 12 3 144
48 − 49 −1
= =
144 144
2
2 5 7 5 49
𝜎𝑥2 =𝐸 𝑥 2
− 𝐸 𝑥 = − = −
12 12 12 144
60 − 49 11
= =
144 144
11
𝜎𝑦2 =
144
−1
144 −1
𝜌 𝑥, 𝑦 = =
11 11
144
4. Compute the coefficient of correlation between X and Y using the following data
𝑋 1 3 5 7 8 10
𝑌 8 12 15 17 18 20
Solution:
𝑥 𝑦 𝑋2 𝑌2 𝑥𝑦
1 8 1 64 8
3 12 9 144 36
5 15 25 225 75
7 17 49 289 119
8 18 64 324 144
19 20 100 400 200
Total = 34 90 248 1446 582
𝜂=6
𝑥 = 34
𝑦 = 90
𝑥 2 = 248
𝑦 2 = 1446
𝑥𝑦 = 582
𝑛 𝑥𝑦 − 𝑥 𝑦
𝑟𝑥𝑦 =
𝑥2 − 𝑥 2 𝑛 𝑦2 − 𝑦 2
6 × 582 − (34)(90)
=
6 × 248 − (34)2 𝑛 6 × 1446 − 90 2
𝑟𝑥𝑦 = 0.9879
Solution:
Regression line 𝑥 on 𝑦 ⇒ 3𝑥 + 𝑦 = 10
3𝑥 = 10 − 𝑦
10 𝑦
𝑥= −
3 3
−1
∴ 𝑏𝑥𝑦 =
3
Regression line 𝑦 on 𝑥 ⇒ 3𝑥 + 4𝑦 = 12
3𝑥 = 10 − 𝑦
12 3𝑥
𝑦= −
4 4
−3
∴ 𝑏𝑥𝑦 = 4
𝑟 = ± 𝑏𝑥𝑦 𝑏𝑦𝑥
−1 −3
= − 3 4
1 −1
= − 4
= 2
3𝑥 + 𝑦 = 10
3𝑥 + 4𝑦 = 12
Solving, we get
28 2
𝑥 = , 𝑦 =
9 3
Exercises:
3 𝑥 2 +𝑦 2 0≤𝑥≤1,0≤𝑦≤1
1. The joint p.d.f. of (𝑥, 𝑦) is given by 𝑓 𝑥, 𝑦 =
2 0 𝐸𝑙𝑠𝑒𝑤 ℎ𝑒𝑟𝑒
𝑥+𝑦
3 0 ≤ 𝑥 ≤ 1, 0 ≤ 𝑦 ≤ 2
0 𝐸𝑙𝑠𝑒𝑤ℎ𝑒𝑟𝑒
Find 𝑟 𝑥, 𝑦
3. Find the coefficient of correlation between X and Y using the following data
𝑋 5 10 15 20 25
𝑌 16 19 23 26 30
Ans: -0.9907
𝑋 1 2 3 4 5 6 7 8 9
𝑌 9 8 10 12 11 13 14 16 15
Also find the reg. lines and estimate the value of 𝑦 when 𝑥 = 6.2.
5. Find the coefficient of correlation and obtain the lines of regression from data
given below.
𝑋 65 66 67 67 68 69 70 72
𝑌 67 68 65 68 72 72 69 71
Problems.
Solution:
If 𝑥 and 𝑦 are independent, then 𝐸 𝑥𝑦 = 𝐸 𝑥 𝐸 𝑦
𝐶𝑜𝑣 𝑥, 𝑦 = 0
𝑉𝑎𝑟 𝑥 = 36, 𝑉𝑎𝑟 𝑦 = 16
Let 𝑢 = 𝑥 + 𝑦, 𝑣 = 𝑥 = 𝑦
𝐶𝑜𝑣 𝑢,𝑣
To find 𝑟 𝑢, 𝑣 = 𝜎𝑢 𝜎𝑣
𝐶𝑜𝑣 𝑢, 𝑣 = 𝐸 𝑢𝑣 − 𝐸 𝑢 𝐸 𝑣
= 𝐸 𝑥2 − 𝑦2 − 𝐸 𝑥 + 𝐸 𝑦 𝐸 𝑥 − 𝐸 𝑦
= 𝐸 𝑥2 − 𝐸 𝑦2 − 𝐸 𝑥 2
− 𝐸 𝑦2
2 2
= 𝐸 𝑥2 − 𝐸 𝑥 − 𝐸 𝑦2 − 𝐸 𝑦
= 𝑉𝑎𝑟 𝑥 − 𝑉𝑎𝑟 𝑦 = 36 − 16 = 20
2
𝜎𝑢2 = 𝐸 𝑢2 − 𝐸 𝑢
2 2
=𝐸 𝑥+𝑦 − 𝐸 𝑥+𝑦
2 2
= 𝐸 𝑥 2 + 𝐸 𝑦 2 + 2𝐸 𝑥𝑦 − 𝐸 𝑥 + 𝐸 𝑦 + 2𝐸 𝑥 𝐸 𝑦
2 2
= 𝐸 𝑥2 − 𝐸 𝑥 + 𝐸 𝑦2 − 𝐸 𝑦
2 2
=𝐸 𝑥−𝑦 − 𝐸 𝑥−𝑦
2 2
= 𝐸 𝑥 2 + 𝐸 𝑦 2 − 2𝐸 𝑥𝑦 − 𝐸 𝑥 + 𝐸 𝑦 − 2𝐸 𝑥 𝐸 𝑦
2 2
= 𝐸 𝑥2 − 𝐸 𝑥 + 𝐸 𝑦2 − 𝐸 𝑦
20 20 5
𝑟 𝑢, 𝑣 = = =
52 52 52 13
2. If 𝑋, 𝑌 and 𝑍 are uncorrelated RV’s with zero mean and standard deviation 5,
12 and 9 respectively, and if 𝑈 = 𝑋 + 𝑌 and 𝑉 = 𝑌 + 𝑍 , find the correlation
coefficient between 𝑈 and 𝑉.
Solution:
𝐸 𝑥 = 𝐸 𝑦 = 𝐸 𝑧 = 0, 𝜎𝑥 = 5, 𝜎𝑧 = 12, 𝜎𝑧 = 9
2
𝑉𝑎𝑟 𝑥 = 𝐸 𝑥 2 − 𝐸 𝑥 = 5 2
⇒ 𝐸 𝑥 2 = 25
𝐸 𝑦 2 = 144, 𝐸 𝑧 2 = 8
𝐸 𝑦𝑧 =E 𝑦 E 𝑧 = 0
𝐸 𝑥𝑧 =E 𝑥 E 𝑧 = 0
E 𝑢 = E 𝑥+𝑦 =𝐸 𝑥 + 𝐸 𝑦 =0
E 𝑣 =0
E 𝑢𝑣 = 𝐸 𝑥 + 𝑦 𝑦+𝑧 = 𝐸 𝑥𝑦 + 𝑥𝑧 + 𝑦 2 + 𝑦𝑧
= 𝐸 𝑥𝑦 + 𝐸 𝑥𝑧 + 𝐸 𝑦 2 + 𝐸 𝑦𝑧 = 𝐸 𝑦 2
𝐸 𝑢𝑣 = 144
𝐶𝑜𝑟 𝑢𝑣
∴ 𝐶𝑜𝑟 𝑢, 𝑣 =
𝜎𝑢 𝜎𝑣
144 − 0 144 48
= =
169 225 13 × 15 65
Exercises:
1. If 𝑥 and 𝑦 are independent random variables with mean 2 and 3 and variance
1 and 2. Find the mean and variance of 𝑍 = 2𝑥 − 5𝑦.
2. If 𝑥, 𝑦, and 𝑧 are uncorrelated random variable with same variance. Find the
correlation coefficient between 𝑥 + 𝑦 and 𝑦 + 𝑧
3. If 𝑥 and 𝑦 are uncorrelated random variables with zero means and same
variance, prove that 𝑢 = 𝑥 cos ∝ +𝑦 sin ∝ and 𝑉 = 𝑥 sin ∝ − 𝑦 cos ∝ are also
uncorrelated.
Ans: 𝑥
തതത = 3, 𝑦 = 1 & r(x,y)=0.7638
1. The Joint probability mass function of (𝑥, 𝑦) is given by 𝑝(𝑥, 𝑦) = 𝑘(𝑥, 𝑦), 𝑥 =
1,2,3,4 , 𝑦 = 1,2,3. Find 𝑟(𝑥, 𝑦)
Solution
1
𝑃𝑖𝑗 = 1 ⇒ 54𝑘 = 1 ⟹ 𝑘 =
54
150
𝐸 𝑥 = xP x = 150𝑘 =
56
116
𝐸 𝑦 = yP y = 116𝑘 =
56
480
𝐸 𝑥 2 = 𝑥 2 P x = 480𝑘 =
56
284
𝐸 𝑦 2 = 𝑦 2 P y = 284𝑘 =
56
𝐸 𝑥𝑦 = xyP xy
320
⟹ 320𝑘 =
54
320 150 116 160 75 58
𝑐𝑜𝑣 𝑥, 𝑦 = 𝐸 𝑥𝑦 − 𝐸 𝑥 𝐸 𝑦 = − = −
54 54 54 27 27 27
4320 − 4350 30
= =−
729 729
2 2
480 150 240 75
𝜎𝑥2 =𝐸 𝑥 2
− 𝐸 𝑥 2
= − = −
54 54 27 27
6480 − 5625 855
= =
729 729
2 2
284 116 160 58
𝜎𝑦2 = 𝐸 𝑦 2 − 𝐸 𝑦 2
= − = −
54 54 27 27
3834 − 3364 470
= =
729 729
30
− 729 30
𝑟 𝑥, 𝑦 = =− = −0.047
855 470 401850
729 729
Exercises
5 15
𝑋
𝑌
10 0.2 0.4
20 0.3 0.1
𝜕𝑥 𝜕𝑥
𝐽 = 𝜕𝑧 𝜕𝑤
𝜕𝑦 𝜕𝑦
𝜕𝑧 𝜕𝑤
Note:
If only one relation 𝑧 = 𝑔(𝑥, 𝑦) is given, then assume the other relation as 𝑤 = 𝑦
Solution
Given 𝑓𝑥 𝑥 = 𝑒 −𝑥 , 𝑥 ≥ 0 , 𝑓𝑦 𝑦 = 𝑒 −𝑦 , 𝑦 ≥ 0
Let 𝑣 = 𝑦
𝑥+𝑦
𝑢= ⇒ 𝑥 = 2𝑢 − 𝑦 ⇒ 𝑥 = 2𝑢 − 𝑣
2
𝜕𝑥 𝜕𝑥
𝐽 = 𝜕𝑢 𝜕𝑣 = 2 −1
=2
𝜕𝑦 𝜕𝑦 0 1
𝜕𝑢 𝜕𝑣
𝑣
𝑓 𝑢, 𝑣 = 2𝑒 − 𝑥+𝑦 = 2𝑒 −2𝑢 , 𝑢 ≥ 0, 𝑣 ≥ 0, ≤𝑢
2
To find 𝑓𝑢 𝑢
Range space
𝑣=𝑦≥0
𝑥 = 2𝑢 − 𝑣 ≥ 0,2𝑢 ≥ 𝑣
𝑣
⟹ 𝑣 ≤ 2𝑢 ⇒ ≤𝑢
2
𝑣
𝑢→ 𝑡𝑜 ∞
2
𝑣 → 0 𝑡𝑜 2𝑢
𝑓𝑢 𝑢 = 𝑓 𝑢, 𝑣 𝑑𝑣
−2𝑢
−2𝑢
= 2𝑒 −2𝑢 𝑑𝑣 = 2𝑒 −2𝑢 𝑣 0 = 4𝑢𝑒 −2𝑢
0
𝑓𝑢 𝑢 = 4𝑢𝑒 −2𝑢
Let W = Y
𝑋
𝑍= ⇒ X = ZW
𝑌
𝜕𝑥 𝜕𝑥
𝐽 = 𝜕𝑧 𝜕𝑤 = 𝑤 𝑧
=𝑤
𝜕𝑦 𝜕𝑦 0 1
𝜕𝑧 𝜕𝑤
f z, w = 3𝑤𝑒 −𝑤 (𝑧+3) , 𝑧, 𝑤 ≥ 0
∞
𝑓𝑧 𝑧 = 𝑓 𝑧, 𝑤 𝑑𝑤
0
∞
= 3𝑤𝑒 −𝑤(𝑧+3) 𝑑𝑤
0
Put 𝑤 𝑧 + 3 = 𝑡 ⇒ 𝑧 + 3 𝑑𝑤 = 𝑑𝑡
∞
𝑡 𝑑𝑡 3 ∞
=3 𝑒 −𝑡 = 2
− 𝑡𝑒 −𝑡 − 𝑒 −𝑡 0
0 𝑧+3 𝑧+3 𝑧+3
3 3
= 2
0+1 = 2
𝑧+3 𝑧+3
3
𝑓𝑧 𝑧 = 2
,𝑧 ≥ 0
𝑧+3
∴ 𝑓 𝑥 = 𝑒 −𝑥 , 𝑥 ≥ 0, 𝑓 𝑦 = 𝑒 −𝑦 , 𝑦 ≥ 0
∴ 𝑓 𝑥, 𝑦 = 𝑓 𝑥 𝑓 𝑦 = 𝑒 −(𝑥+𝑦) , 𝑥, 𝑦 ≥ 0, (since 𝑥,𝑦 are independent)
Given U = X − Y ⇒ 𝑋 = 𝑈 + 𝑌 ⇒ 𝑋 = 𝑈 + 𝑉
Assume 𝑉 = 𝑌 ⇒ 𝑌 = 𝑉
We know that f u, v = 𝐽 𝑓 𝑥, 𝑦
Where
𝜕𝑥 𝜕𝑥
𝐽 = 𝜕𝑢 𝜕𝑣 = 1 1
=1
𝜕𝑦 𝜕𝑦 0 1
𝜕𝑢 𝜕𝑣
𝑓 𝑢, 𝑣 = 1. 𝑒 −(𝑥+𝑦) = 𝑒 −(𝑢+𝑣+𝑣)
𝑓 𝑢, 𝑣 = 𝑒 −(𝑢+2𝑣)
To find 𝑓𝑢 𝑢
Range space: 𝑥 ≥ 0, 𝑢 + 𝑣 ≥ 0 ⇒ 𝑢 ≥ −𝑣
𝑦 ≥ 0, 𝑣 ≥ 0
Case i) 𝑢 < 0
∞
𝑓𝑢 𝑢 = 𝑒 −(𝑢+2𝑣) 𝑑𝑣
−𝑢
∞
= 𝑒 −𝑢 𝑒 −2𝑣 𝑑𝑣
−𝑢
∞
−𝑢
𝑒 −2𝑣
=𝑒
−2 −𝑢
−𝑢
𝑒 2𝑢
=𝑒 0+
2
𝑒𝑢
𝑓𝑢 𝑢 = ,𝑢 < 0
2
∞
𝑒 −2𝑣
= 𝑒 −𝑢
−2 0
1
= 𝑒 −𝑢 0 +
2
𝑒 −𝑢
𝑓𝑢 𝑢 = ,𝑢 > 0
2
𝑒𝑢
, 𝑢<0
∴ 𝑓𝑢 𝑢 = 2
𝑒 −𝑢
, 𝑢>0
2
Solution:
Given 𝑓 𝑥 = 𝑒 −𝑥 , 𝑥 ≥ 0, 𝑓 𝑦 = 𝑒 −𝑦 , 𝑦 ≥ 0
𝑋
⟹𝑈= , 𝑋 = 𝑈𝑉. and , 𝑉 = 𝑈𝑉 + 𝑌 ⟹ 𝑌 = 𝑉 − 𝑈𝑉 ⟹ 𝑌 = 𝑉(1 − 𝑈)
𝑉
𝜕𝑥 𝜕𝑥
𝐽 = 𝜕𝑢 𝜕𝑣 = 𝑣 𝑢
= 𝑣 1 − 𝑢 + 𝑣𝑢
𝜕𝑦 𝜕𝑦 −𝑣 1−𝑢
𝜕𝑢 𝜕𝑣
𝐽 =𝑣
𝑓 𝑢, 𝑣 = 𝑣. 𝑒 −(𝑥+𝑦) = 𝑣𝑒 −(𝑣)
To find 𝑓𝑢 𝑢 , 𝑓𝑣 𝑣
Range space: 𝑥 ≥ 0, ⟹ 𝑢𝑣 ≥ 0 ⇒ 𝑢 ≥ 0, 𝑣 ≥ 0
𝑦 ≥ 0, ⟹ 𝑣 ≥ 0,1 − 𝑢 ≥ 0, 𝑢 ≤ 1
⟹ 𝑣 ≥ 0, 0 ≤ 𝑢 ≤ 1
∞
𝑓𝑢 𝑢 = 𝑣𝑒 −(𝑣) 𝑑𝑣
0
0 =1
∞
= − 𝑣𝑒 −𝑣 − 𝑒 −𝑣
𝑓𝑢 𝑢 = 1, 0 ≤ 𝑢 ≤ 1
1
𝑓𝑣 𝑣 = 𝑣𝑒 −(𝑣) 𝑑𝑢
0
= 𝑣𝑒 −𝑣 𝑢 10 = 𝑣𝑒 −𝑣 , 𝑣 ≥ 0
Also, 𝑓𝑢 𝑢 𝑓𝑣 𝑣 = 1. 𝑣𝑒 −𝑣 = 𝑣𝑒 −𝑣 = 𝑓 𝑢, 𝑣
Exercises
Find P( X 1, Y 1)
a)0.32 b) 0.42 c) 0.34 d) 0.53
a)1/2 b) 4 c) 2 d)1/6
16 2 x 0 x 1, 0 y 1
Consider f ( x, y ) = . Find marginal density function
0 otherwise
of X
a)3x b) 2x c) 2 d) 1/2x
17. 3 y 0 x 1, 1 y 2
Consider f ( x, y ) = . Find all the marginal density
0 otherwise
function of X
a)3x b) 9 c) 2
18. The two regression equations are 4𝑥 − 5𝑦 + 33 = 0 𝑎𝑛𝑑 20𝑥 − 9𝑦 = 107.
find the means of x,y
a)𝑥 = 13 , 𝑦ത = 12 b) 𝑥 = 13 , 𝑦ത = 17 c) 𝑥 = 12 , 𝑦ത = 6 d)
𝑥 = 8 , 𝑦ത = 12
19. If X and Y are independent random variables with variance 2and 3. Find
the variance of 3 X +4 Y .
a)31 b) 55 c) 66 d) 60
20. If the independent random variables X and Y have the variances 36 and 16
respectively. Find the
covariance between ( X + Y ) and ( X − Y )
a)30 b) 12 c) 20 d) 60
1 2 3 4 5 6 7 8 9 10
c a a b c b c c d a
11 12 13 14 15 16 17 18 19 20
a a a b a b b b c c
Assignment-I
Two dimensional D. R. V & C.R.V
1. The two dimensional random variable (X,Y) has the joint probability mass
x + 2y
function f ( x, y ) = , 𝑥 = 0,1,2; 𝑦 = 0,1,2. (i) Find all the marginal
27
distributions of X and Y (ii) probability distribution of (X+Y) (iii) 𝑃(𝑋 + 𝑌 ≤ 2).
8
1
Compute (1) P X 1 (2) P Y (3) P X Y
2
3. Two dimensional random variable (X,Y) have the joint probability density
8 xy, 0 x y 1
function f ( x, y ) = .
0 , elsewhere
i) Find the Marginal and Conditional distributions
1 1 3
ii) Are X and Y independent iii) Find P X Y .
4 2 4
x/y Y
1 2 3 4 5 6
0 0 0 1/32 2/32 2/32 3/32
X 1 1/16 1/16 1/8 1/8 1/8 1/8
2 1/32 1/32 1/64 1/64 0 2/64
Find all the marginal and conditional probability distributions.
Also find (i)P(X≤1) (ii)P(Y≤3) (iii)P(X≤1/ Y≤3) (iv)P(X+Y≤ 4 ).
V = X −Y .
3. The two lines of regression are 8x −10 y + 66 = 0 and 40 x −18 y − 214 = 0. The
variance of x is 9. Find
Q. Questions &Answers K CO
No. Level
The joint probability mass function of a bivariate discrete
random variable ( X , Y ) is given by the following table:
x
1 2 3
y
e−3 y
6e−2 x e −3 y dy = 6e −2 x −2 x
= 2e , x 0
0 −3 0
The Conditional density of y given X = x is given by
f ( x, y ) 6e −2 x −3 y
f ( y / x) = = = 3e −3 y , y 0
f x ( x) 2e −2 x
− 0
f ( x, y ) 2y
Now f ( y / x ) = = , 0 y 1 − x.
f x ( x) (1 − x) 2
1− x 1− x
2 y2 2
E Y / X = X = y f ( y / x ) dy = dy = (1 − x)
0 0
(1 − x) 2
3
1− x 1− x
2 y3 1
E Y 2 / X = X = y 2 f ( y / x ) dy = dy = (1 − x) 2
0 0
(1 − x) 2
2
Var Y / X = 0 = E y / X = 0 − E y / X = 0
2 2
1 4 1
= (1 − x) 2 − (1 − x) 2 = (1 − x) 2 .
2 9 18
1+1 2
1
E X − X Y − Y 0.
( )( )
X Y
1 + 1 2 r ( X , Y ) 0, −1 r ( X , Y ) 1
( E ( X ) ) − ( E (Y ) )
= E X 2 − E Y 2 −
2 2
= E ( X ) − ( E ( X ) ) − E (Y ) − ( E (Y ) )
2 2 2 2
= X2 − Y2 = 36 − 16 = 20.
3 1− r2 2 1
0.6 = = 2r 2 + 3r − 2 = 0 r = .
5 r 5 2
(
N 150, 150 )
i.e,
120 − 150 Sn − 150 160 − 150
P 120 Sn 160 = P
150 150 150
= P −2.45 Z 0.85
= 0.4927 + 0.2939 = 0.7866
Q. Questions K CO
No. Level
If the joint p.d.f of ( X ,Y ) is given by
9 (1 + x + y )
, x 0, y 0.
f ( x, y ) = 2(1 + x)4 (1 + y )4
0
elsewhere
(i) Find the marginal densities of X and Y
(ii) Find the conditional densities of X and Y
(iii) Are X and Y independent
1. 3(2 x + 3) 3(2 y + 3) K1 CO2
Ans.: (i) f x ( x) = , x 0 f y ( y) = ,y0 (ii)
4(1 + x) 4
4(1 + y ) 4
6(1 + x + y )
f ( x / y) =
(2 x + 3)(1 + y ) 4
6(1 + x + y )
f ( y / x) = , x 0, y 0 (iii) X and Y are
(2 y + 3)(1 + x) 4
dependent.
8 xy 0 x y 1
The joint density function of X and Y f ( x, y) =
0 elsewhere
1
(ii) Var Y / X = x
1
2. (i) Find P X Y K1 CO2
2 4
(iii) Are X and Y are correlated; if so find the coefficient
of the correlation.
Ans.: = 0.490
Two dice are thrown. Let X 1 be the random variable which
denote the outcome of the first die and X 2 denote the
outcome of the second die. Let Y = max( X1 , X 2 ) .
3. (i) Form the distribution table of X 1 and Y. K2 CO2
(ii) (ii) Find the Var(Y)
(iii) Find the Cov(X, Y)
Ans.: Var(Y)=1.97145 Cov(X,Y)= -76.80556
X 62 64 65 69 70 71 72 74
9. K1 CO2
Y 126 125 139 145 165 152 180 208
Application of probability is the content beyond the syllabus. Probability Theory has
the following application
i) the earthquake risk assessment.
ii) the reliability of circuits and systems to statistical methods for hypothesis
testing,
iii) decision making under uncertainty, and parameter estimation,
iv) electronic systems with applications to reliability, system engineering,
engineering decision-making
View the lecture on YouTube:
https://nptel.ac.in/courses/111/104/111104079/
ASSESSMENT SCHEDULE
https://youtu.be/xTpHD5WLuoA
Correlation:
https://www.easycalculation.com/code-c-program-correlation-co-efficient.html
https://tutorialspoint.dev/algorithm/mathematical-algorithms/program-find-
correlation-coefficient
For the following problems in correlation compute the correlation using the above
C/Python Program also compute the graph in excel sheet. Submit every thing in ppt
format.
1. Calculate the coefficient of correlation for the height (in inches) of father (X)
and their son (Y)
X 65 66 67 67 68 69 70 72
Y 67 68 65 68 72 72 69 71
2. The marks obtained by 10 students in Mathematics and Statistics are given below.
Find the correlation coefficient of two subjects.
Marks in 75 30 60 80 53 35 15 40 38 48
Maths
Marks in 85 45 54 91 58 63 35 43 45 44
Statistics
PRESCRIBED TEXT BOOKS & REFERENCE BOOKS
TEXTBOOKS:
1. R.A. Johnson, I. Miller and J. Freund, "Miller and Freund’s Probability and
Statistics for Engineers", Pearson Education, Asia, 8th Edition, 2015.
2. J.S. Milton and J.C. Arnold, "Introduction to Probability and Statistics", Tata
McGraw Hill, 4th Edition, 2007.
REFERENCES:
1. J.L. Devore, "Probability and Statistics for Engineering and the Sciences",
Cengage Learning, New Delhi, 8th Edition, 2014.
4. M.R. Spiegel, J. Schiller and R.A. Srinivasan, "Schaum‘s Outline of Theory and
Problems of Probability and Statistics", Tata McGraw Hill Edition, 2004.
5. R.E. Walpole, R.H. Myers, S.L. Myers and K. Ye, "Probability and Statistics for
Engineers and Scientists". Pearson Education, Asia, 9th Edition, 2012.
Thank you
Disclaimer:
This document is confidential and intended solely for the educational purpose of RMK Group of
Educational Institutions. If you have received this document through email in error, please notify the
system manager. This document contains proprietary information and is intended only to the
respective group / learning community as intended. If you are not the addressee you should not
disseminate, distribute or copy through e-mail. Please notify the sender immediately by e-mail if you
have received this document by mistake and delete this document from your system. If you are not
the intended recipient you are notified that disclosing, copying, distributing or taking any action in
reliance on the contents of this information is strictly prohibited.