STAT 102 Part 13
STAT 102 Part 13
A. Discrete distributions
1. Bernoulli distribution
2. Binomial distribution
3. Poisson distribution
4. Hypergeometric distribution
5. Geometric distribution
6. Negative binomial distribution
B. Continuous distributions
1. Uniform distribution
2. Exponential distribution
3. Normal distribution
4. Gamma distribution
5. Beta distribution
Bernoulli distribution
Bernoulli trial
A trial that has two possible outcomes is known as a Bernoulli trial. The two
outcomes are called ‘success’ (probability 𝑝𝑝) and ‘failure’ (probability 1 − 𝑝𝑝).
Examples
1. A fair coin is tossed. Here, head (or tail) is a success. 𝑃𝑃(𝐻𝐻) = 𝑝𝑝 = 0.5.
2. An unfair coin is tossed. 𝑃𝑃(𝐻𝐻) = 𝑝𝑝 = 0.7 (say).
3. A fair die is tossed. 𝑃𝑃(6) = 𝑝𝑝 = 1/6.
4. A patient is tested for COVID-19. 𝑃𝑃(+) = 𝑝𝑝 = 0.05 (say).
Bernoulli random variable
Let a Bernoulli trial be performed once. Then, 𝑆𝑆 = {𝑠𝑠, 𝑓𝑓}. Let 𝑋𝑋 be the number of
successes obtained. Then, 𝑋𝑋 is a Bernoulli random variable with possible values ‘0’
and ‘1’. It has the following pmf:
𝑥𝑥 0 1
𝑃𝑃(𝑋𝑋 = 𝑥𝑥) 1 − 𝑝𝑝 𝑝𝑝
We can write the above pmf as follows:
𝑃𝑃(𝑋𝑋 = 𝑥𝑥) = 𝑝𝑝 𝑥𝑥 (1 − 𝑝𝑝)1−𝑥𝑥 ; 𝑥𝑥 = 0, 1.
Note
Here, 𝑝𝑝 is the ‘parameter’ of the probability distribution. It characterizes the
probability distribution (population). We write,
𝑋𝑋 ~ Bernoulli(𝑝𝑝).
That is, 𝑋𝑋 follows Bernoulli distribution with parameter 𝑝𝑝.
Mean and variance
𝐸𝐸(𝑋𝑋) = 0 × (1 − 𝑝𝑝) + 1 × 𝑝𝑝 = 𝑝𝑝
𝐸𝐸(𝑋𝑋 2 ) = 02 × (1 − 𝑝𝑝) + 12 × 𝑝𝑝 = 𝑝𝑝
𝑉𝑉(𝑋𝑋) = 𝑝𝑝 − 𝑝𝑝2 = 𝑝𝑝(1 − 𝑝𝑝)
Note that, mean > variance.
Also, 𝑉𝑉(𝑋𝑋) ≤ 0.25. (Why?)
Example
In a multiple-choice question (MCQ), there are four choices. A student does not
know the correct answer and selects one of the choices at random. Let 𝑋𝑋 be the
number of correct answers (out of 1 question). Then
𝑋𝑋 ~ Bernoulli(𝑝𝑝 = 0.25).
Binomial distribution
Binomial experiment
A binomial experiment consists of 𝑛𝑛 independent Bernoulli trials, where 𝑛𝑛 is a
positive integer. The probability of success (𝑝𝑝) is same in each trial.
Example
1. A fair coin is tossed 5 times. Here, 𝑛𝑛 = 5 and 𝑝𝑝 = 0.5.
2. A coin (probability of head 0.7) is tossed 10 times. Here, 𝑛𝑛 = 10 and 𝑝𝑝 = 0.7.
Binomial random variable
Let 𝑛𝑛 independent Bernoulli trials be performed, each having probability of success
𝑝𝑝. Let 𝑋𝑋 be the number of successes obtained. Then, 𝑋𝑋 is a binomial random variable
with possible values 0, 1, 2, ⋯ , 𝑛𝑛. It has the following pmf:
𝑛𝑛
𝑃𝑃(𝑋𝑋 = 𝑥𝑥) = � � 𝑝𝑝 𝑥𝑥 (1 − 𝑝𝑝)𝑛𝑛−𝑥𝑥 ; 𝑥𝑥 = 0, 1, 2, ⋯ , 𝑛𝑛.
𝑥𝑥
Note
The distribution has two parameters 𝑛𝑛 and 𝑝𝑝. We write
𝑋𝑋 ~ binomial(𝑛𝑛, 𝑝𝑝).
That is, 𝑋𝑋 follows binomial distribution with parameters 𝑛𝑛 and 𝑝𝑝.