Bgpev2 Asymptotic
Bgpev2 Asymptotic
Asymptotic Theory
c A. Colin Cameron
Univ. of Calif.- Davis
Advanced Econometrics
Bavarian Graduate Program in Economics
.
Based on A. Colin Cameron and Pravin K. Trivedi (2009, 2010),
Microeconometrics using Stata (MUS), Stata Press.
and A. Colin Cameron and Pravin K. Trivedi (2005),
Microeconometrics: Methods and Applications (MMA), C.U.P.
1. Introduction
p d
For simplicity, the formal result N (ȳ µ) ! N [0, σ2 ] is often
re-expressed in terms of ȳ
a
I ȳ N [0, σ2 /N ]
a
I means \is asymptotically distributed as"
I this means N is large enough that the normal is a good approximation
I but N is not so large that σ2 /N = 0.
Outline
1 Introduction
2 Sequences of random variables
3 Convergence in probability
4 Laws of large numbers (for averages)
5 Convergence in distribution
6 Central limit theorems (for averages)
7 Some Key Results
8 Simulations for LLN and CLT
9 Appendix: Some Further Asymptotic Results
Appendix: Sampling Schemes
Appendix: OLS under Simple Random Sampling
jaN aj < ε.
What happens as N ! ∞?
I jbN b j may exceed ε due to randomness, so bN 9 b exactly
I instead use convergence in probability.
Consistency
b
Suppose the sequence bN is an estimator, say bN = β.
b!p b is consistent for β.
I If β β, a constant, then we say β
A simple consistency proof uses convergence in mean square
I that is lim E[(bN b )2 ] = 0
N !∞
ms
I ! implies convergence in probability.
b is used to estimate β
Suppose β
I b β )2 ] = V[ β
E[( β b ] + (bias[ β
b ])2 as MSE = variance + bias2
ms
b ! β if V[ β
b ] ! 0 and bias[ β b ] ! 0 as N ! ∞
I so β
b p
I it follows that β ! β if the variance and bias go to zero as N ! ∞.
p
We use the weaker convergence in probability as βb! β is possible
b
even if the mean and variance of β do not exist.
bN = X̄N = 1
N ∑N
i =1 Xi .
5. Convergence in distribution
X̄N E[X̄N ]
bN = ZN = p [0, 1].
V[X̄N ]
Note that
p
ZN = (X̄N E[X̄N ])/ [X̄N ]
Vq in general
= ∑N (Xi N
E[Xi ])/ ∑i =1 V[Xi ] if Xi independent over i
pi =1
= N (X̄N µ)/σ if Xi i.i.d.
X̄N µ d
p ! N [0, 1].
σ/ N
p d
It follows that µ) ! N [0, σ2 ].
N (X̄N
p d
More generally we often nd N (b
β β) ! N [0, V ].
p
I Scale consistent b
β up by N to get a limit distribution.
XN [ µ N , VN ] .
Transformation Theorem:
d p
If aN ! a (a random variable) and bN ! b (a constant), then
d
(i ) aN + bN ! a + b
d
(ii ) aN bN ! ab
d
(iii ) aN /bN ! a/b, provided Pr[b = 0] = 0.
then
d
HN aN ! N [Hµ, HAH0 ].
Leading example is OLS:
p 1 0 1
b
N (β β0 ) = ( X X) 1
p (X0 u )
N N
d 1 1 10
! N [A 0, A BA ].
. mean x
. mean x
.4
.3
Density
.2 .1
0
-4 -2 0 2 4
z from many samples
Liapounov CLT:
Let fXi g be independent with E[Xi ] = µi and V[Xi ] = σ2i .
(2+δ)/2
If lim ∑N
i =1 E[jXi µ i j2+ δ ] / ∑ N 2
i =1 σ i = 0, for some
d
choice of δ > 0, then ZN ! N [0, 1].
I The Liapounov CLT relaxes i.i.d. assumption but needs existence of
(2 + δ)th absolute moment.
Cramer-Wold Device:
d d
If λ0 bN ! N [ , ] for all λ 6= 0 then bN ! N [ , ].
I So prove a multivariate CLT by proving a scalar CLT for λ0 bN .
plim N1 ∑Ni =1 xi ui
= β+
plim N1 ∑N 2
i =1 xi
= β+ 0 = β,
E[x 2 ]
I 2. Convert to p1
N
∑N
i =1 xi ui
p p1 ∑N
i =1 xi ui
p1 ∑N
i =1 xi ui = σ 2 E[x 2 ] p
N
N σ 2 E[x 2 ]
d p
! σ 2 E[x 2 ] N [0, 1]
d
! N [0, σ2 E[x 2 ]]
using product limit normal rule.
c A. Colin Cameron Univ. of Calif.- Davis (Advanced
BGPEEconometrics
Course: Asymptotic
BavarianTheory
Graduate Program in Economics
July 22-26,
. Based
2013 on A.30Colin
/ 31Ca
9. Appendix OLS under simple random sampling
d N [0,σ2 E[x 2 ]]
! 1 N 2
plim N ∑i =1 xi
d N [0,σ2 E[x 2 ]]
! E[x 2 ]
h i
d 1
! N 0, σ2 E[x 2 ]
using plim N 1 ∑N 2 2
i =1 xi =E[x ] from consistency proof
and the product normal limit rule
d d p
(or aN bN ! a b if aN ! a and bN ! b ).