Session on Probability Basics Part-1
Session on Probability Basics Part-1
1. Random Experiment
2. Trial
3. Outcome
4. Sample Space
Sample Space of a random experiment is the set of all possible outcomes that can occur.
Generally, one random experiment will have one set of sample space.
5. Event
Event is a specific set of outcomes from a random experiment or process. Essentially, it's a
subset of the sample space. An event can include a single outcome, or it can include
multiple outcomes. One random experiments can have multiple events.
1. Rolling a die
2. Tossing a coin twice
3. Titanic example
1. Simple Event: Also known as an elementary event, a simple event is an event that consists
of exactly one outcome.
For example, when rolling a fair six-sided die, getting a 3 is a simple event.
For example, when rolling a die, the event "rolling an odd number" is a compound event
because it consists of three simple events: rolling a 1, rolling a 3, or rolling a 5.
3. Independent Events: Two events are independent if the occurrence of one event does not
affect the probability of the occurrence of the other event.
For example, if you flip a coin and roll a die, the outcome of the coin flip does not affect the
outcome of the die roll.
4. Dependent Events: Events are dependent if the occurrence of one event does affect the
probability of the occurrence of the other event.
For example, if you draw two cards from a deck without replacement, the outcome of the
first draw affects the outcome of the second draw because there are fewer cards left in the
deck.
5. Mutually Exclusive Events: Two events are mutually exclusive (or disjoint) if they cannot
both occur at the same time.
For example, when rolling a die, the events "roll a 2" and "roll a 4" are mutually exclusive
because a single roll of the die cannot result in both a 2 and a 4.
6. Exhaustive Events: A set of events is exhaustive if at least one of the events must occur
when the experiment is performed.
For example, when rolling a die, the events "roll an even number" and "roll an odd
number" are exhaustive because one or the other must occur on any roll.
In simplest terms, probability is a measure of the likelihood that a particular event will occur. It
is a fundamental concept in statistics and is used to make predictions and informed decisions
in a wide range of disciplines, including science, engineering, medicine, economics, and social
sciences.
Empirical Probability -
A. Suppose that, in our 100 tosses, we get heads 55 times and tails 45 times. What is the empirical
probability of getting a head
B. Let's say you have a bag with 50 marbles. Out of these 50 marbles, 20 are red, 15 are blue, and 15 are
green. You start to draw marbles one at a time, replacing the marble back into the bag after each draw.
After 200 draws, you find that you've drawn a red marble 80 times, a blue marble 70 times, and a green
marble 50 times. What is the empirical probability of getting a red marble?
Theoretical Probability
Theoretical (or classical) probability is used when each outcome in a sample space is equally
likely to occur. If we denote an event of interest as Event A, we calculate the theoretical
probability of that event as:
A. Consider a scenario of tossing a fair coin 3 times. Find the probability of getting exactly 2 heads.
In the context of probability theory, a random variable is a function that maps the Discrete RV
Continuous RV
outcomes of a random process (known as the sample space) to a set of real numbers.
Input: The input to the function is an outcome from the sample space of a random
process.
Output: The output of the function is a real number that we assign to each possible
outcome.
A probability distribution is a list of all of the possible outcomes of a random variable along
with their corresponding probability values.
The mean of a random variable, often called the expected value, is essentially the average
outcome of a random process that is repeated many times. More technically, it's a weighted
average of the possible outcomes of the random variable, where each outcome is weighted by
its probability of occurrence.
The variance of a random variable is a statistical measurement that describes how much
individual observations in a group differ from the mean (expected value).