Correlation
Correlation
= _f!E[(Y -E(Y)V1
a -
=_.f!.
a
ayl
=[~x2
. "
,+ kCJXCJY] + ['CJX ... k.] COy (X. Y)
CJy' ",a.
.=.(CJx + [cov(x.n]·,
CJxkCJy)
- CJy
= (CJx +
(+ kay) (1 + r)CJx
,-
U and V will be uncorrelated if
r(U, V) = 0 => COy (U, V) = 0
i.e., if (c;sx + k~y) (I- + r) CJx = 0
=> CJx+kCJy=O (.:CJx~O,r~-I)
CJx
=> k =--
CJy
Example 10·7·. The "randOm variables. X ,and Y are jointly normally
distributed and U and V.are·dejine(!by ,"
.. U <;: X cos· a + f sin a,
V = y.' cos a - X sin a
Show thai V and V will be pncorre,lated if
2rCJxCJy
tan2a
." = CJx2 r- CJy. .2',
where r =. COTTo (X, fJ, CJ~ = VaT (XJ and CJ; =- Var (V). Are U and V then
independent? .
[Delhi Uraiv. B.Se. (Stat. Bora••) 1989; (Math •• JI01&ll.), 1990]
Solution. We have
COy (lI, V) =E[(U - E(C!» [V - E(V)}]
=E[[(X -E (X)) cos a + (f -'E(y») sin a]
x [[f - E(Y») cos a - (X - P(X») sin a]]
Fundamentals otMa~ti~ Statistics
2r axCJy
or if ·tan 2a = .2 . 2
ax - ay-
However, r(U. V) = 0 does ~ot imply that the variables.U and V are
independenL [For detailed discussion,see Theorerpl0·2, page 104.].
Example 10·S. [IX, Yare standardized random variables. and
1.+ 2ab
r(aX + bY, bX + aY) = a2 + b 2 " .(*)
find r(X. Y), the coefficient 01 correlation between X and Y.
[Sardar PaI,1 UIIi". B.Sc., 1993; Delhi UIIi". B.Sc. lStat. Hons.), 1989]
.
Solution. Since X and Y are standardised random variables, we have .
E(X) = E(Y) =0 . j'
and Var (X) = Var (Y) ='1'~ E(X2) = E(f2) = 1
and Cov(X, Y) = E (X Y) ~ E(XY) = r(X,y).axCJt'
,.:(**)
= r(X,Y)
Also we have
r(aX + bY, bX + aY)
_ E[(aX + bY)(bX + aY)] - E(aX + bn E(bX +'an
- [Var·(aX + bY) .. Var{IfX + aY)]m
= E[abX2,+ a 2 XY + b 2 YX + aby2] - 0
{[a 2 Var (X) + b 2 Var (Y) + 2ab COY (X.y)]
x [b 2 Var (X) + a 2 Var Y T 2ba Coy (X,y)])·l/2
. ab.l + a 2 rex, Y) + ·b 2 rex. Y) + ab.l
= ([a 2 + b 2 .+ 2ab r(X, f)][bl + a 2 + 2ba r(X, Y)]) 1(1.
[Using (**)]
_ 2ab + (a 2 + b 2). reX. n
- a 2 + b 2 + 2ab. r(X, Y)
From (*) and (**). we get
1 + 2ab _ (a 2 + b 2). r(X, -y) + 2ab
a2 + b 2 - a 2 + b 2 + 2ab: r(X, Y).
.
Cross multiplying, we get
10·13
(aZ + IJ2) (1 + lab) + lab. r(X, y) (1 +"2ab) = (a2 + 1J2)2. r(X, y) + lab (a2 + IP)
:::> (a4 + !J4 + 202b 2 - 'tab - 4 a21JZ). r (X. Y) =(a2 + IJZ)
[(a2 _1JZ)2 - lab] r(X; Y) = a 2 + b2
a2 + b2
r (X, Y) =(a2 ~ b2)2 _ 'tab
Example 10·9. If X a¢ Y are uncorrelated random variables with means
zero andvariancesCJI 2anda,.2 respectively, show thai
U =X cos a + Y sin a, V =X sin a - Y cos a
haVe a correlation coefficient p given by
CJI2 - CJ22
p = [(CJ12 - CJ22)2 + 4CJ12cJ2~ cosec2 2a]1I2
Solution. We are given that
= =
r(X, Y) 0 ~ Coy (X, Y) 0, CJll CJ? and = CJ22CJr = •.. (1)
We have
CJU2 = V(X cos a + Y sin a)
= cosla V(X) + sin2a V(y) + 2 sin a cos a Cov (X. Y)
=cosla CJI2 + ~in2a CJ22 [Using (1)]
Similarly, L.
CJ'; =V(X sin u - Y cos a) =sin2a.CJ12 + cos2a.CJ22
Cov (U, V) =E[(U -E(U)} [V -E(V}}]
=E[ {(X -E(X» Cos a + {(Y -E(Y) sin a}
x [(X -E(X» sin a - (Y -E(Y» cos a}]
=sin a cos a V(X) - cos2a Cov (X, Y)
+ sin2 a 'Cov (X, Y) - sin a cos a V(Y)
=(CJ12 - CJ22) sin a cos a [Using (1)]
2 _ [Cov (U, V)]2
Now p - CJU2CJv2
= (cos2a CJI2 + sinZa CJ22) (siJl2a CJ12 + cosZa CJ/)
== sinZa cos2a(CJ14 + CJ24) + CJl2a22 (cos4 a + sin4a)
= sinZa COS2a(CJI4 + CJ24) + CJl2a~2[(sinZa+ cos2a)2- 2 sin2a cos2a)
=sinZa cosla (CJ1.4 + CJ24 - 2CJl2a22) + CJI2a22
=sinla cos2a (CJ12 - CJ22)2 + CJ12a·i
rr= CJl2a22 + sip2a COSla(CJ1 2 - CJ?)2
~(CJ12 - CJ22)2 sin 2 2a
= CJ12CJ22 + sin2 2a. ~ (CJ12 - CJ22)2
~ qfMatbematical StatWtio.
(a1 2 - (22)2 ,
= 40'12cr22 COS~~ta + (0'1 2 -'-.0'22)2
_ 0'1 2 -0'22
=> P- 2 2 20
[(0'1 - 0'2 )2 +'40'1 22 cosec22a]lf2
X . Y 1
-bY +' dV= -eV + aV= ad -be
X = ad:...
1 be (dV -bV). }
.. ,(***)
Y =ad ~ be (-e V + a V)
Var (X) =(ad _1be)2 [til O'el + b20''; - 2 bd Cov (V, V)
=(ad ~ bc)2JiPael + b2 6';]
[Since p. V are uncorrelated ~ =
Cov (V. V) 0]
Similarly, we have
(b) If X and Y src ~ormal ~d im,ependent with zero means and standard
deviations 9 and 12 respectively, and if X + 2Yand leX - Y are non-"correlated.
find k.
(c) X. Y, Z ~e random variables each with expectation 10 and variances I.
4 and 9 respectively. The correlation coeffiCients are
r(X, y) =0, r(Y. 2) =r (X, y) =1/4
Obtain the numerical values of :
(;) E(X + Y - 22), (il) Cov (X + 3, Y + 3), (iii) V(X - 2 Z) and
(iv) Cov (3X, 52)
Ans. (i) =0, (il) 0, (iii) 34, and (ill) 45/4.
(d) XaDd Y an. discrete random variables. If Var (X) = Var(Y) = CJ2,
2
Cov (X, Y) = ~ , find (i) Var (2X - 3y), (il) Corr (2X + 3, '2Y - 3).
8. (0) Prove that:
V(aX ±by) =a2V(X) + blV(Y) ± 2ab Cov (X. Y)
Hence deduce that if X and Y.are independent
V(X ± Y) =V(X) + V(Y)
(b) Prove that correlation coefficient between X and Y is positive or
negative according as
CJx + Y > or < CJ x _ y
9. Show that if X and Y are·two ranc;lom variables each assuming only twO
values and the correlation co-efficient between them is zero, then they are
independent Indicate with justification whether the result is true in general.
Find the correlation coeffident between X and. a - X, where X is any
randOm variable and a is constant.
10. (a) Xi (i =1, 2, "3) are uncorrelated variables each having the same
standard deviation. Obtain the correlation between Xl + X~ and X; + X3'
Ans. 1/2
(b) If Xi (i =1, 2, ~) are three uncorrelated variables having stimdard
deviations O'r, CJ2 and CJ3 respectively, obtain the coefficient of correlation
between (Xl + Xv and (X2 + X3).
Ans. /..J (CJ12 + CJ22) (CJ22 + CJ32)
CJ22
(c) Two random variables X and Y have zero means, the same variance (J2
and zero correlation. Show thlilt
V =X co~ (l + Y sin a and V =X sirta - Y cos a
have the same variance 0'2 and zero correlation. )
Ulangalore Uni". B.Sc., 1991
(d) Let X and Y be iincorrelated random variabl~. If U =X + Y ~d
V =X - Y. prove that the coefficient of correlation between U and V IS
(O:x 2 - O'y2)/(CJX2 + CJy2). where CJx2 and .q,z
are v~ances of X and r
respectively. . ,
(e) Two independent random variables X and Y have the following
variances: O'xZ =36, O'yZ =16. Calculate the coefficient of correlation betWeen
U=X+YandV=X-Y