A survey of Probability concepts

Chapter 5
 Learning Objectives
• Define probability.
• Explain the terms experiment, event, outcome.
• Define the terms conditional probability and joint probability.
• Calculate probability using the rules of addition and rules of multiplication.
 Definition
A probability is a measure of the likelihood that an event in the
future will happen. It can only assume a value between 0 and 1.
• A value near zero means the event is unlikely to happen. A value near one means it
is likely.
• There are three ways of assigning probability:
• classical,
• empirical, and
• subjective.
 Experiment, Outcome, Event
• An experiment is the observation of some activities or the act of
taking some measurement.
• An outcome is the particular result of an experiment.
• An event is the collection of one or more outcomes of an
experiment.
Experiment, Outcome, Event
 Assigning Probabilities

Three approaches to assigning probabilities

• Classical
• Empirical
• Subjective
 Classical Probability

Consider an experiment of rolling a six-sided die. What is the probability of the event “an even
number of spots appear face up”?
The possible outcomes are:

There are three “favorable” outcomes (a two, a four, and a six) in the collection of six equally
likely possible outcomes.
 Empirical Probability

• The empirical approach to probability is based on what is called the

law of large numbers. The key to establishing probabilities empirically
is that more observations will provide a more accurate estimate of the
probability.
 Empirical Probability
𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑡𝑖𝑚𝑒𝑠 𝑡ℎ𝑒 𝑒𝑣𝑒𝑛𝑡 𝑜𝑐𝑐𝑢𝑟𝑠
𝐸𝑚𝑝𝑖𝑟𝑖𝑐𝑎𝑙 𝑝𝑟𝑜𝑏𝑎𝑏𝑖𝑙𝑖𝑡𝑦 =
𝑇𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑜𝑏𝑠𝑒𝑟𝑣𝑎𝑡𝑖𝑜𝑛𝑠
• Example: On February 1, 2003, the Space Shuttle Columbia
exploded. This was the second disaster in 113 space missions for
NASA. On the basis of this information, what is the probability
that a future mission is successfully completed?
 Subjective Probability

• If there is little or no past experience or information on

which to base a probability, it may be arrived at
subjectively.
Summary of Types of Probability
 Mutually Exclusive and Independent Events

• Events are mutually exclusive if the occurrence of

any one event means that none of the others can
occur at the same time.
• Events are independent if the occurrence of one
event does not affect the occurrence of another.
 Collectively Exhaustive Events

• Events are collectively exhaustive if at least

one of the events must occur when an
experiment is conducted.
 Complement Probability
• P(A) means the probability that event A occurs.
• P(~A) means the probability that event A does NOT occur.
• To calculate P(~A)
𝑃 ~𝐴 = 1 − 𝑃 𝐴
Recall NASA’s example, what is the probability that a future mission is
unsuccessful?
 Complement Probability
• Example: A coin is tossed four times. what is the probability that all four
tosses will result in a head face up? What is the probability that not all four
tosses will result in a head face up?
A: All four tosses result in a head face up.
1
𝑃 𝐴 = = 0.0625
16
𝑃 ~𝐴 = 1 − 0.0625 = 0.9375
 Joint Probability
• Joint probability is a probability that measures the likelihood two or more
events will happen concurrently.
• For two events A and B we write the joint probability as 𝑃(𝐴 𝑎𝑛𝑑 𝐵),
𝑃(𝐴 ∩ 𝐵), or 𝑃(𝐴𝐵).
• What is P(A and B) if A and B are mutually exclusive.
• What is P(A and B) if A and B are independent.
• How do we calculate the joint probability?
 Union of the Events
• If we have two events A and B the union of the events is either event A or
event B or both occur on a single performance of an experiment.
• For two events A and B we write the union probability as 𝑃(𝐴 𝑜𝑟 𝐵) or
𝑃(𝐴 ∪ 𝐵).
• What is P(A or B) if A and B are mutually exclusive.
• What is P(A or B) if A and B are independent.
• How do we calculate the union probability?
 Conditional Probability
• Conditional probability is the probability of a particular event occurring,
given that another event has occurred.
• For two events A and B we write the conditional probability of event A
occurring, given that event B has occurred as 𝑃 A B .
• What is 𝑃 A B if A and B are mutually exclusive.
• What is 𝑃 A B if A and B are independent.
• How do we calculate 𝑃 A B .
 Rules of Addition
• Special rule of Addition:
If two events A and B are mutually exclusive, the probability of one or the
other event’s occurring equals the sum of their probabilities.
𝑃 𝐴 𝑜𝑟 𝐵 = 𝑃 𝐴 + 𝑃(𝐵)
Example: In a class we have 40 students from three countries. 10 Saudis, 20
Indians, and 10 Egyptians. What is the probability that a selected student is
either from India or from Egypt?
 Rules of Addition
• General rule of Addition:
If we have two events A and B the probability that either event A or event B or
both occur is:
𝑃 𝐴 𝑜𝑟 𝐵 = 𝑃 𝐴 + 𝑃 𝐵 − 𝑃(𝐴 𝑎𝑛𝑑 𝐵)
Example: In a class of 35 students, 15 students speak English, 25 students
speak Arabic, 10 students speak both Arabic and English, and 5 students speak
French. What is the probability that a selected student speaks Arabic or
English?
 Rules of Multiplication
• Special rule of Multiplication:
If two events A and B are independent, the probability that the two events will
happen concurrently is the probability of one event multiply the probability of
the other event.
𝑃 𝐴 𝑎𝑛𝑑 𝐵 = 𝑃 𝐴 ∗ 𝑃(𝐵)
Example: In an experiment of tossing a fair coin, what is the probability that a
head will face up in the first trial and in the second trial?
 Rules of Multiplication
• General rule of Multiplication:
If we have two events A and B the probability that the two events will happen
concurrently is:
𝑃 𝐴 𝑎𝑛𝑑 𝐵 = 𝑃 A B ∗ 𝑃 𝐵
𝑃 𝐴 𝑎𝑛𝑑 𝐵 = 𝑃 B A ∗ 𝑃(𝐴)
 Rules of Multiplication
Example: A golfer has 15 golf shirts in his closet. Suppose 10 of these shirts
are white and the others blue. He gets dressed in the dark, so he just grabs a
shirt and puts it on. He plays golf two days in a row and does not do laundry.
What is the likelihood both shirts selected are white?
Let 𝐴1 first shirt selected is white.
And 𝐴2 second shirt selected is white.
10 9
We want 𝑃(𝐴1 and 𝐴2 ). We have is 𝑃 𝐴1 = , and 𝑃 𝐴2 𝐴1 =
15 14
 Example 1
• Example: A manufacturer of preassembled windows produced 50 windows
yesterday. This morning the quality assurance inspector reviewed each window for
all quality aspects. Each was classified as acceptable or unacceptable and by the shift
on which it was produced. Thus we reported two variables on a single item. The two
variables are shift and quality. The results are reported in the following table.
 Example 1
• What is the probability that a randomly selected window is defective and produced in a day shift?
• What is the probability that a randomly selected window is acceptable and produced in a night shift?
• What is the probability that a randomly selected window is defective given that it was produced in a
day shift?
• What is the probability that a randomly selected window is produced in a night shift given it is
acceptable?
 Example 2
• In a small village of 416 people. Each one has a black cow or yellow cow or
both. If the number of people who owned black cow is 316 and the number
of people who owned a yellow cow 280 people. What is the probability that
a randomly selected person:
1. Do have black cow and yellow cow?
2. Does not have a yellow cow?
3. Do have a black cow given that he/she has a yellow cow?
 Tree Diagram
The tree diagram is a graph that is helpful in organizing calculations that
involve several stages. Each segment in the tree is one stage of the problem.
The branches of a tree diagram are weighted by probabilities.
 Tree Diagram
6 3 3
3 Day ∗ =
6 50 6 50
2
6 6 2 2
Defectives Afternoon ∗ =
6 50 6 50
1
50 6 1 1
6 ∗ =
Night 50 6 50
44 17 17
17 Day ∗ =
44 44
50 44 50
13
50 44 44 13 13
Acceptable Afternoon ∗ =
50 44 50
14
44 14 14
44 Night ∗ =
50 44 50
 Bayes’ Theorem
𝑃 𝐵 𝐴1 ∗ 𝑃(𝐴1 )
𝑃 𝐴1 𝐵 =
𝑃 𝐵 𝐴1 ∗ 𝑃 𝐴1 + 𝑃 𝐵 𝐴2 ∗ 𝑃(𝐴2 )
• Assume in the pervious formula the events 𝐴1 and 𝐴2 are mutually exclusive
and collectively exhaustive, and 𝐴1 refers to either event 𝐴1 or 𝐴2 . Hence 𝐴1
and 𝐴2 are in this case complements. The meaning of the symbols used is
illustrated by the following example
 Bayes’ Theorem
• Suppose 5 percent of the population of Umen, a fictional Third World country,
have a disease that is peculiar to that country. We will let 𝐴1 refer to the event
“has the disease” and 𝐴2 refer to the event “does not have the disease.” Thus,
we know that if we select a person from Umen at random, the probability the
individual chosen has the disease is .05, or 𝑃 𝐴1 = 0.05 This probability,
𝑃 𝐴1 = P has the disease = 0.05 is called the prior probability. It is given
this name because the probability is assigned before any empirical data are
obtained.
 Bayes’ Theorem
• The prior probability a person is not afflicted with the disease is therefore .95, or 𝑃 𝐴2
= 0.95 found by 1 − 0.05
• There is a diagnostic technique to detect the disease, but it is not very accurate. Let B
denote the event “test shows the disease is present.” Assume that historical evidence
shows that if a person actually has the disease, the probability that the test will indicate
the presence of the disease is .90. Using the conditional probability definitions
developed earlier in this chapter, this statement is written as:
𝑃 𝐵 𝐴1 = 0.90
• Assume the probability is .15 that for a person who actually does not have the disease
the test will indicate the disease is present. 𝑃 𝐵 𝐴2 = 0.15
 Bayes’ Theorem
• Let’s randomly select a person from Umen and perform the test. The test
results indicate the disease is present. What is the probability the person
actually has the disease? In symbolic form, we want to know 𝑃(𝐴1 |𝐵) which
is interpreted as: 𝑃 ℎ𝑎𝑠 𝑡ℎ𝑒 𝑑𝑖𝑠𝑒𝑎𝑠𝑒 𝑡ℎ𝑒 𝑡𝑒𝑠𝑡 𝑟𝑒𝑠𝑢𝑙𝑡𝑠 𝑎𝑟𝑒 𝑝𝑜𝑠𝑖𝑡𝑖𝑣𝑒).
The probability is called a posterior probability.
 Bayes’ Theorem
If there are n mutually exclusive and collectively exhaustive events 𝐴1 , 𝐴2 , 𝐴3 … 𝐴𝑛 then the
Bayes’ theorem becomes:

𝑃 𝐴𝑖 𝑃(𝐵|𝐴𝑖 )
𝑃 𝐴𝑖 𝐵 = 𝑃 𝐴1 𝑃 𝐵 𝐴1 + 𝑃 𝐴2 𝑃 𝐵 𝐴2 +⋯+𝑃 𝐴𝑛 𝑃(𝐵|𝐴𝑛 )