Topic7. Probability
Topic7. Probability
Topic 7
Probability
In Topic 6, we determined the number of possible outcomes using counting techniques. In Topic 7,
we will discuss how likely an outcome can occur. First, let us define some terms and notations.
• Sample space, denoted by 𝑆, is the set of all possible outcomes of some experiment.
• Sample point is an element in 𝑆.
• Event, denoted by any capital letter, is a set of outcomes in 𝑆. It is a subset of 𝑆.
• 𝑛 is the total number of possible outcomes in 𝑆.
Consider the experiment of tossing a fair die. Then, 𝑺 = {𝟏, 𝟐, 𝟑, 𝟒, 𝟓, 𝟔}. The numbers 𝟏, 𝟐, 𝟑, 𝟒, 𝟓, 𝟔
are sample points in 𝑺 thus 𝒏 = 𝟔.
Suppose we let event 𝑨 be an outcome that is greater than or equal to 4. So, 𝑨 = {𝟒, 𝟓, 𝟔}
The question now is, “How likely will A occur?” or “What is the chance of A occurring?” or “What is
the probability of A?” We denote this probability as 𝑷(𝑨).
We define probability as the likelihood that a particular event will occur, expressed numerically from
0 to 1 (or from 0% to 100%), inclusive. It is synonymous to chance. When it is 𝟎, it means that 𝐴 will
not occur. For example, the probability that a human being will give birth to a carabao is 0−this will
not occur; this is an impossible event. When it is 1, then the event is a sure event. For example, the
probability that a human being giving birth to another human being is 1.
This approach assumes that there are finite number of outcomes in a random experiment and
that each outcome is equally likely to occur. For example, when a coin is tossed, we know that a
“Head” or a “Tail” (H or T, respectively) can occur, and we know that 𝑃(𝐻) = 1/2 and 𝑃(𝑇) =
1/2. In general, if 𝐴 is an event in 𝑆, then
Suppose a coin is tossed many times. Outcomes may look like this:
HTHHHTTHTHTTTHHTHTTHTHHHHTHTHTHTHHHHTHTTH…………
To get 𝑃(𝐻), we simply count how many 𝐻′𝑠 has come up divided by the total number of tosses
made. In general, if 𝐴 is an event in 𝑆, then
hvvvalle
Page 2 of 12
3. Subjective approach
In this approach, probability of an event is based on one’s belief on the likelihood of this event’s
occurrence. When someone says “The probability of rain today is 89%”, it is based on his own
judgment or what has occurred before.
Let us look at the example of tossing a die. Then 𝑆 = {1,2,3,4,5,6} and 𝑛 = 6. Suppose 𝐴1 is an event
where 𝐴1 =observing an outcome equal to 6. Then, 𝐴1 = {6}. What is 𝑃(𝐴1 )?
By definition,
𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝐴1 𝑜𝑢𝑡𝑐𝑜𝑚𝑒𝑠 𝑖𝑛 𝑆 1
𝑃(𝐴1 ) = = = 0.17
𝑛 6
So the probability of observing a number equal to 6 is equal to 0.17 or there is a 17% probability of
observing a number equal to 6.
1
Suppose 𝐴2 = observing an outcome equal to 2. So 𝐴2 = {2}. Then 𝑃(𝐴2 ) = 6 = 0.17
Now let us go back to some examples in Topic 6.
OOTDs
𝑆 = {𝑠𝑒𝑡 𝑜𝑓 𝑎𝑙𝑙 𝑂𝑂𝑇𝐷𝑠}, so 𝑛 = 12.
Let 𝐴 = 𝑂𝑂𝑇𝐷 𝑖𝑠 𝑏𝑙𝑜𝑢𝑠𝑒, 𝑠𝑘𝑖𝑟𝑡, 𝑠𝑎𝑛𝑑𝑎𝑠 = {𝑏𝑙𝑜𝑢𝑠𝑒, 𝑠𝑘𝑖𝑟𝑡, 𝑠𝑎𝑛𝑑𝑎𝑙𝑠}
1
𝑃(𝐴) = 12
hvvvalle
Page 3 of 12
Sexes of children
𝑆 = {𝑠𝑒𝑡 𝑜𝑓 𝑎𝑙𝑙 𝑠𝑒𝑥𝑒𝑠 𝑜𝑓 𝑡ℎ𝑒 1𝑠𝑡, 2𝑛𝑑, 𝑎𝑛𝑑 3𝑟𝑑 𝑐ℎ𝑖𝑙𝑑𝑟𝑒𝑛) → see tree diagram, 𝑛=8
Let 𝐹 = 𝑠𝑒𝑐𝑜𝑛𝑑 𝑐ℎ𝑖𝑙𝑑 𝑖𝑠 𝑎 𝑔𝑖𝑟𝑙 = {𝐵𝐺𝐵, 𝐺𝐺𝐺, 𝐺𝐺𝐵, 𝐵𝐺𝐺} ;
𝑃(𝐹) = 4/8 = 0.5
Let 𝐺 = 1𝑠𝑡 𝑐ℎ𝑖𝑙𝑑 𝑖𝑠 𝑔𝑖𝑟𝑙 𝑎𝑛𝑑 3𝑟𝑑 𝑐ℎ𝑖𝑙𝑑 𝑖𝑠 𝑏𝑜𝑦 1*2*1=2 ways
= {𝐺𝐺𝐵, 𝐺𝐵𝐵}
2
𝑃(𝐺) = = 0.25
8
𝑛=6
Let 𝐼 = {𝑀𝑎𝑥 𝑖𝑠 𝑠𝑡𝑎𝑛𝑑𝑖𝑛𝑔 𝑎𝑡 𝑡ℎ𝑒 𝑐𝑒𝑛𝑡𝑒𝑟} = {(𝑆𝑢𝑒, 𝑀𝑎𝑥, 𝑃𝑎𝑧), (𝑃𝑎𝑧, 𝑀𝑎𝑥, 𝑆𝑢𝑒)} 2*1*1=2
2
𝑃(𝐼) = 6 = 0.33
hvvvalle
Page 4 of 12
Suppose Dinah bets on the numbers 𝟒𝟓, 𝟎𝟐, 𝟑𝟒, 𝟐𝟑, 𝟏𝟕, 𝟓𝟐. What is her probability of winning?
She wins if her numbers, 45,02,34,23,17,52, in any order, are drawn during the designated time of
the lottery.
𝟏
𝑷[𝒘𝒊𝒏𝒏𝒊𝒏𝒈] = 𝟐𝟖,𝟗𝟖𝟗,𝟔𝟕𝟓
The probabilities obtained above are all under classical probability approach. Let us look at the results
of a survey made by a researcher:
Suppose she randomly selects a person from her respondents. What is the probability that the person
selected has Parrot as favorite pet?
What she obtains is a probability using the A posteriori approach. A simple reminder to differentiate
A priori from A Posteriori approach: We can obtain the probabilities in A Priori approach even without
doing the actual experiment because the outcomes can easily be known, whereas in A posteriori, we
have to perform the experiment first before the outcomes can be known thus probabilities can be
computed only after such experiment.
hvvvalle
Page 5 of 12
Rules of Probability
Rule 1
For any event 𝑨 in 𝑺, 𝟎 ≤ 𝑷(𝑨) ≤ 𝟏.
Rule 1 emphasizes that a probability cannot exceed +𝟏 nor can it be a negative value. A probability
is any value in the real number line from 0 𝑡𝑜 1 inclusive, as illustrated below:
or
|-------------------------𝑃(𝐴)----------------------------| |--------------------------𝑃(𝐴)--------------------|
Rule 2
The sum of the probabilities of all possible outcomes in 𝑺 is equal to 𝟏.
Outcome 1 2 3 4 5 6 Total
Probability 1/6 1/6 1/6 1/6 1/6 1/6 6/6 = 1
Rule 3
If 𝑷(𝑨) is the probability that 𝑨 will occur, then 𝑷(𝑨𝑪 )is the probability that 𝑨 will
not occur (or the complement of A). Note that 𝑷(𝑨𝑪 ) = 𝟏 − 𝑷(𝑨).
hvvvalle
Page 6 of 12
16 16 74
If 𝑃(𝐶𝑎𝑡) = 90, then 𝑃(𝐶𝑎𝑡 𝐶 ) = 1 − 𝑃(𝐶𝑎𝑡) = 1 − 90 = 90
Intuitively, this numerator is the sum of the frequencies for Dog, Parrot, and Fish.
Rule 4
𝑷(𝑨 ∪ 𝑩) = 𝑷(𝑨) + 𝑷(𝑩) − 𝑷(𝑨 ∩ 𝑩)
or
𝑷(𝑨 𝒐𝒓 𝑩) = 𝑷(𝑨) + 𝑷(𝑩) − 𝑷(𝑨 𝒂𝒏𝒅 𝑩)
Rule 4 is called the General Additive Rule which involves multiple events. Say in 𝑆, there are events
A and B. Maybe we are interested in the probability that A and B will occur or maybe in the probability
that either A or B will occur. We are interested in probability of the intersection and union of events,
respectively. What is an intersection of two events A and B? An intersection of events A and B is an
event that contains all elements that can be found in both events (all elements common to both
events) whereas the union of two events A and B is an event that contains all elements in event A or
in event B or in both. The probability of such events, in symbols:
𝑃(𝐴 𝒂𝒏𝒅 𝐵) = 𝑃(𝐴 ∩ 𝐵) means the probability that events A and B will occur at the
same time; also called the probability of the intersection of
events A and B;
𝑃(𝐴 𝒐𝒓 𝐵) = 𝑃(𝐴 ∩ 𝐵) means the probability that either events A or B will occur;
also called the union of events A and B
Example
What is 𝑃(𝐴 ∩ 𝐵)? 𝑃(𝐴 ∩ 𝐵) = 0 Why 0? It is 0 because when you toss one coin, you only
get either a head or a tail, but not both. It is an impossible
event. Remember, it is only one toss.
hvvvalle
Page 7 of 12
Example
2
Let 𝐶 = 𝑜𝑢𝑡𝑐𝑜𝑚𝑒 𝑖𝑠 𝑎 𝑛𝑢𝑚𝑏𝑒𝑟 𝑔𝑟𝑒𝑎𝑡𝑒𝑟 𝑡ℎ𝑎𝑛 4 = {5,6} 𝑃(𝐶) = 6
3
𝐷 = 𝑜𝑢𝑡𝑐𝑜𝑚𝑒 𝑖𝑠 𝑎𝑛 𝑒𝑣𝑒𝑛 𝑛𝑢𝑚𝑏𝑒𝑟 = {2,4,6} 𝑃(𝐷) = 6
3
𝐸 = 𝑜𝑢𝑡𝑐𝑜𝑚𝑒 𝑖𝑠 𝑎𝑛 𝑜𝑑𝑑 𝑛𝑢𝑚𝑏𝑒𝑟 = {1,3,5} 𝑃(𝐸) = 6
2
𝐹 = 𝑜𝑢𝑐𝑜𝑚𝑒 𝑖𝑠 𝑎 𝑛𝑢𝑚𝑏𝑒𝑟 𝑙𝑒𝑠𝑠 𝑡ℎ𝑎𝑛 3 = {1,2} 𝑃(𝐹) =
6
Using Rule 4 right away will still give the same answer:
2 3 1 4
𝑃(𝐶 ∪ 𝐷) = 𝑃(𝐶) + 𝑃(𝐷) − 𝑃(𝐶 ∩ 𝐷) = 6 + 6 − 6 = 6
2 3 1 4
𝑃(𝐹 ∪ 𝐸) = 𝑃(𝐹) + 𝑃(𝐸) − 𝑃(𝐹 ∩ 𝐸) = 6 + 6 − 6 = 6
3 2 1 4
𝑃(𝐸 ∪ 𝐶) = 𝑃(𝐸) + 𝑃(𝐶) − 𝑃(𝐸 ∩ 𝐶) = + − =
6 6 6 6
hvvvalle
Page 8 of 12
Let A=card is red D=card is a number card G=card is a number greater than 7
B=card is black E=card is a heart
C=card is a face card F=card is a suit card
𝑃(𝐴 ∩ 𝐵) = ________
𝑃(𝐴 ∪ 𝐵) = ________
𝑃(𝐵 ∪ 𝐶) = ________
𝑃(𝐷 ∪ 𝐶) = ________
𝑃(𝐸 ∪ 𝐵) = ________
𝑃(𝐶 ∪ 𝐷) = ________
𝑃(𝐷 ∪ 𝐸) = ________
𝑃(𝐷 𝑐 ) = __________
hvvvalle
Page 9 of 12
Events A and B are said to mutually exclusive if they cannot occur simultaneously or at the same time.
For example, if you pick one card from a well-shuffled deck of cards, then it cannot be a face card and
a number card at the same time. Or when you toss a coin, then the outcome cannot be a head and
tail at the same time. On the other hand, events A and B are said to be independent if A does not
depend on B or vice versa. For example, the sex of the second sibling does not depend on the sex of
the first sibling. This translates to probabilities too.
Take note that event A and event B are independent of each other if event A’s (or B’s) probability of
occurring is the same whether or not event B (or event A) occurs.
Example
Example
hvvvalle
Page 10 of 12
Example
Toss three fair coins. 𝑆 = (𝐻𝐻𝐻, 𝐻𝐻𝑇, 𝐻𝑇𝐻, 𝐻𝑇𝑇, 𝑇𝑇𝑇, 𝑇𝑇𝐻, 𝑇𝐻𝐻, 𝑇𝐻𝑇) 𝑛 = 8
4 1
Let A=observing a tail on the first coin = {𝑇𝑇𝑇, 𝑇𝑇𝐻, 𝑇𝐻𝐻, 𝑇𝐻𝑇} 𝑃(𝐴) = 8 = 2
4 1
B=observing heads on the second coin={𝐻𝐻𝐻, 𝐻𝐻𝑇, 𝑇𝐻𝐻, 𝑇𝐻𝑇} 𝑃(𝐵) = 8 = 2
3
C=observing only two heads={𝐻𝐻𝑇, 𝐻𝑇𝐻, 𝑇𝐻𝐻} 𝑃(𝐶) =
8
7
D=observing at least one tail={𝐻𝐻𝑇, 𝐻𝑇𝐻, 𝐻𝑇𝑇, 𝑇𝑇𝑇, 𝑇𝑇𝐻, 𝑇𝐻𝐻, 𝑇𝐻𝑇} 𝑃(𝐷) =8
6 3
E=observing at most two heads={𝐻𝐻𝑇, 𝐻𝑇𝐻, 𝐻𝑇𝑇, 𝑇𝑇𝐻, 𝑇𝐻𝐻, 𝑇𝐻𝑇} 𝑃(𝐸) =8 =4
On your own, check if the remaining sets are mutually exclusive or independent.
hvvvalle
Page 11 of 12
Conditional Probability
You may ask yourself, “What is the probability that I will pass Stat 121 this semester given that I failed
in two exercises?” Or “What is the probability that tomorrow will rain given that today rained?” This
type of probability is the conditional probability that “event B will occur given that event A has
already occurred”, and our notation for this is
𝑷(𝑩∩𝑨)
𝑷(𝑩/𝑨) = 𝑷(𝑨)
provided that 𝑃(𝐴) ≠ 0 (The / sign means “given that”)
Example
What is the probability that a man randomly selected from this group
𝟐𝟑𝟓
1. has lung cancer? 𝑷(𝑳+ ) = 𝟒𝟑𝟓 = 𝟎. 𝟓4
𝟐𝟓𝟎
2. is a smoker? 𝑷(𝑺+ ) = 𝟒𝟑𝟓 = 𝟎. 𝟓𝟕
𝟐𝟎𝟎
3. is a smoker and has lung cancer? 𝑷(𝑺+ ∩ 𝑳+ ) = 𝟒𝟑𝟓 = 𝟎. 𝟒𝟔
𝟐𝟎𝟎
𝑷(𝑳+ ∩ 𝑺+ ) 𝟐𝟎𝟎
5. has lung cancer given that he is a smoker? 𝑷(𝑳+ /𝑺+ ) = 𝑃(𝑺+ )
= 𝟒𝟑𝟓
𝟐𝟓𝟎 = 𝟐𝟓𝟎 = 𝟎. 𝟖𝟎
𝟒𝟑𝟓
6. is not a smoker but has lung cancer? 𝑷(𝑺− ∩ 𝑳+ ) = 𝑷(𝑺− ) + 𝑷(𝑳+ ) − 𝑷(𝑺− ∩ 𝑳+ )
185 235 35 385
= 435 + 435 − 435 = 435 = 0.89
hvvvalle
Page 12 of 12
Example
1. Find the sample space first. It helps if a tree diagram is constructed. Remember the counting
methods discussed in Topic 6. Visualize the problem, if possible, using small number of elements
2. Define events clearly.
3. Be aware of the words “or” and “and”.
4. Check that the probability is between 0 and 1 only, inclusive. If it exceeds +1 or is less than 0
(negative), then you are not computing it correctly.
hvvvalle