Scribd
Upload
7 views5 pages

Part 01

The document is a course script on Probability Theory by Jakob Creutzig, outlining fundamental concepts such as measure and integration, random variables, limit theorems, and conditional expectations. It includes references to key literature and a structured table of contents detailing various topics within probability theory. The introduction discusses stochastic models and provides examples illustrating the application of limit theorems and conditional probabilities.

Uploaded by

hirakmahapatra07
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
7 views5 pages

Part 01

The document is a course script on Probability Theory by Jakob Creutzig, outlining fundamental concepts such as measure and integration, random variables, limit theorems, and conditional expectations. It includes references to key literature and a structured table of contents detailing various topics within probability theory. The introduction discusses stochastic models and provides examples illustrating the application of limit theorems and conditional probabilities.

Uploaded by

hirakmahapatra07
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 5

Probability Theory

Jakob Creutzig
Skript nach einer Vorlage von
Thomas Müller-Gronbach, Klaus Ritter

Darmstadt, WS 2006/07

Literature
In particular,

H. Bauer, Probability Theory, de Gruyter, Berlin, 1996.

P. Billingsley, Probability and Measure, Wiley, New York, first edition,


1979, third edition, 1995.

J. Elstrodt, Maß- und Integrationstheorie, Springer, Berlin, first edition,


1996, third edition, 2002.

P. Gänssler, W. Stute, Wahrscheinlichkeitstheorie, Springer, Berlin, 1977.

i
Contents

I Introduction 1

II Measure and Integral 3


1 Classes of Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
2 Measurable Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
3 Product Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
4 Construction of (Probability) Measures . . . . . . . . . . . . . . . . . . 19
5 Integration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
6 Lp -Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
7 The Radon-Nikodym-Theorem . . . . . . . . . . . . . . . . . . . . . . . 33
8 Kernels and Product Measures . . . . . . . . . . . . . . . . . . . . . . . 37
9 Image Measures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

III Basic Concepts of Probability Theory 48


1 Random Variables and Distributions . . . . . . . . . . . . . . . . . . . 48
2 Convergence in Probability . . . . . . . . . . . . . . . . . . . . . . . . . 52
3 Convergence in Distribution . . . . . . . . . . . . . . . . . . . . . . . . 55
4 Uniform Integrability . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
5 Independence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65

IV Limit Theorems 71
1 Zero-One Laws . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
2 Strong Law of Large Numbers . . . . . . . . . . . . . . . . . . . . . . . 74
3 Weak Law of Large Numbers . . . . . . . . . . . . . . . . . . . . . . . . 81
4 Characteristic Functions . . . . . . . . . . . . . . . . . . . . . . . . . . 82
5 The Central Limit Theorem . . . . . . . . . . . . . . . . . . . . . . . . 87
6 Law of the Iterated Logarithm . . . . . . . . . . . . . . . . . . . . . . . 93

V Conditional Expectations and Martingales 94


1 Conditional Expectations . . . . . . . . . . . . . . . . . . . . . . . . . . 94
2 Discrete-Time Martingales . . . . . . . . . . . . . . . . . . . . . . . . . 102

ii
3 Optional Sampling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
4 Ausblick . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109

iii
Chapter I

Introduction

A stochastic model : a probability space (Ω, A, P ) together with a collection of random


variables (measurable mappings) Ω → R, say.
Examples of probability spaces, known from ’Introduction to Statistics’ or ‘Analysis’:
P
(i) Given: a countable set Ω and f : Ω → R+ such that ω∈Ω f (ω) = 1.
Take the power set A = P(Ω) and define
X
P (A) = f (ω), A ⊂ Ω.
ω∈A

R
(ii) Given: f : Rk → R+ such that Rk f (ω) dω = 1.
Let Ω = Rk , take the σ-algebra A = B(Rk ) of Borel sets in Rk and define
Z
P (A) = f (ω) dω, A ∈ B(Rk ).
A

Main topics in this course:

(i) construction of probability spaces, including the theory of measure and integra-
tion,

(ii) limit theorems,

(iii) conditional probabilities and expectations.

Example 1. Limit theorems like the law of large numbers or the central limit theorem
deal with sequences X1 , X2 , . . . of random variables and their partial sums
n
X
Sn = Xi
i=1

(gambling: cumulative gain after n trials; physics: position of a particle after n


collisions).
√
Under which conditions and in which sense does Sn /n or Sn / n converge, as n tends
to infinity?

1
Example 2. Limit theorems hold in particular for independent and identically dis-
tributed (i.i.d.) random variables X1 , X2 , . . . with E(Xi ) = 0 and Var(Xi ) = 1. Then
√
Sn /n ‘converges’ to zero and Sn / n ‘converges’ to the standard normal distribution.
In particular, in a simple case of gambling: Xi takes values ±1 with probability 1/2.
Existence of such a model? Existence for every choice of the distribution of Xi ?

Example 3. The fluctuation of a stock price defines a function on the time interval
R+ with values in R (for simplicity, we admit negative stock prices at this point).
What is a reasonable σ-algebra on the space Ω of all mappings R+ → R or on the
subspace of all continuous mappings? How can we define (non-discrete) probability
measures on these spaces in order to model the random dynamics of stock prices?
Analogously for random perturbations in physics, biology, etc.
More generally, the same questions arise for mappings I → S with an arbitrary
non-empty set I and S ⊂ Rd (physics: phase transition in ferromagnetic materials,
the orientation of magnetic dipoles on a set I of sites; medicine: spread of diseases,
certain biometric parameters for a set I of individuals; environmental science: the
concentration of certain pollutants in a region I).

Example 4. Consider two random variables X1 and X2 . If P ({X2 = v}) > 0 then
the conditional probability of {X1 ∈ A} given {X2 = v} is defined by

P ({X1 ∈ A} ∩ {X2 = v})


P ({X1 ∈ A} | {X2 = v}) = .
P ({X2 = v})

How can we reasonably extend this definition to the case P ({X2 = v}) = 0, e.g.,
for X2 being normally distributed? How does the observation X2 = v change our
stochastic model? Cf. Example 3.

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy