← All Posts
Math · Probability & Statistics · Axioms of Probability· Part 5 of 7

Equally Likely Outcomes

Many real experiments — rolling a fair die, drawing a card from a well-shuffled deck, picking a ball from a bag — come with strong physical symmetry that makes every elementary outcome equally likely. The axioms then collapse into a single formula:

$\displaystyle P(E) = \frac{|E|}{|S|}.$

This is the classical definition of probability, and it explains why combinatorial analysis is the lifeblood of an introductory probability course: probabilities reduce to counting.

Why It Works (From the Axioms)

Suppose $|S| = N$ and every elementary outcome has the same probability $p$. By Axiom 3 applied to the disjoint singletons,

$1 = P(S) = \sum_{s \in S} p = N p \quad\Longrightarrow\quad p = \frac{1}{N}.$

For an event $E$ with $|E| = k$, again by Axiom 3,

$P(E) = \sum_{s \in E} p = k \cdot \frac{1}{N} = \frac{|E|}{|S|}.$

So the classical formula is not a separate definition: it is a theorem that follows from the axioms once we add the modelling assumption "all outcomes equally likely". The whole game becomes counting $|E|$ and $|S|$, which is exactly what the Combinatorial Analysis series taught us to do.

The hidden danger. The classical formula only holds when outcomes are equally likely. The most common modelling error in introductory probability is to assume equal likelihood when the experiment doesn't enforce it. Always ask: by what physical symmetry are these outcomes equally likely?

A Five-Step Recipe

Almost every classical probability problem follows the same workflow.

  1. Identify the experiment. What is the underlying random process?
  2. Choose a sample space in which the outcomes are equally likely. Often this means modelling outcomes as ordered tuples even if order doesn't seem to matter, because ordering creates symmetry.
  3. Compute $|S|$ using a counting tool (multiplication rule, permutations, combinations, ...).
  4. Express the event $E$ as a subset of $S$ and compute $|E|$ by the same kind of argument.
  5. Divide. $P(E) = |E| / |S|$.

Example 1. Sum of Two Dice

Roll two fair dice. What is $P(\text{sum} = 7)$?

If we instead used unordered pairs, $\{1,6\}$ and $\{2,5\}$ would each appear once, but $\{3,3\}$ and $\{4,4\}$ would also appear once — yet a $(3,3)$ outcome is half as likely as a $(1,6)$ in the real experiment. The unordered sample space is not equally likely. This is the classical “ordered vs unordered” trap.

Example 2. Poker Hands

Deal 5 cards from a standard 52-card deck. What is $P(\text{full house})$?

A "full house" is three of a kind plus a pair (e.g. three jacks and two sevens).

Example 3. The Urn (Balls and Boxes)

An urn contains $r$ red and $b$ blue balls. Draw $k$ without replacement. What is $P(\text{exactly } j \text{ red})$?

This is the hypergeometric distribution.

This single formula recovers, as special cases, "what's the probability the first card is an ace?", "what's the probability of drawing 2 hearts in 5 cards?", and lots more.

Example 4. The Birthday Problem

$n$ people are in a room. What is the probability that at least two share a birthday?

Assume $365$ equally likely birthdays and that the $n$ birthdays are independent — so $|S| = 365^n$ ordered birthday tuples are equally likely.

Computing “at least one collision” directly is awful (lots of overlap). Use the complement (Proposition 2 from Part 4).

The number of birthday tuples with all birthdays distinct is $365 \cdot 364 \cdots (365 - n + 1)$. So

$\displaystyle P(\text{all distinct}) = \frac{365 \cdot 364 \cdots (365 - n + 1)}{365^n} = \prod_{k=0}^{n-1} \left(1 - \frac{k}{365}\right),$

and

$P(\text{at least one shared}) = 1 - P(\text{all distinct}).$

The surprise: $n = 23$ already gives $P(\text{shared}) \approx 0.507$. By $n = 50$ it's $\approx 0.97$. Most people guess much higher than $23$.

Visual: Birthday Probabilities Climbing

Step through values of $n$ and watch $P(\text{at least one shared birthday})$ rise. The crossing of $1/2$ at $n = 23$ is a famous counter-intuitive moment.

▶ Visual: Birthday paradox — probability of a shared birthday in a group of $n$

Each step adds another person to the room. We track $P(\text{all distinct}) = \prod_{k=0}^{n-1}(1 - k/365)$ and its complement.

Why the Birthday Number Feels Wrong

People guess huge values for $n$ because they unconsciously ask “how many people do I need to share a birthday with me?”, which has answer roughly $365 \log 2 \approx 253$. But the question is “some two people share”, which involves $\binom{n}{2}$ pairs — quadratically many opportunities. A rough heuristic: collisions become likely once $\binom{n}{2} \approx 365$, i.e.\ $n \approx \sqrt{2 \cdot 365} \approx 27$. Spot-on.

Connection to Combinatorial Analysis

Every classical probability problem in this section dropped one of these counting tools from the previous series:

If a counting formula confuses you here, revisit that post first.

When the Outcomes Are Not Equally Likely

Most real experiments have non-uniform weights. Two strategies:

  1. Refine the sample space until equality holds. Drawing a card from a deck where some cards have been removed is non-uniform on the rank, but uniform on the underlying card; pick the right $S$ and the formula returns.
  2. Switch to weighted sums. If $S = \{s_1, s_2, \ldots\}$ with non-uniform $p_i$, then $P(E) = \sum_{s_i \in E} p_i$. The axioms still hold; the classical formula doesn't.

Common Mistakes

Practice

  1. A bowl contains 6 white and 5 black balls. Draw 4 without replacement. Find $P(\text{2 white and 2 black})$.
  2. $5$ cards are dealt from a standard deck. Find $P(\text{flush})$ and $P(\text{straight})$ (5 cards in sequence; allow A as low or high).
  3. Toss a fair coin 10 times. Find the probability of exactly 3 heads.
  4. $n = 30$ people in a room. Estimate $P(\text{shared birthday})$ to two decimal places.
  5. Three balls are drawn at random from an urn containing 8 white, 4 black, and 2 orange balls. Find the probability that the colours are all different.
  6. Show that the matching-problem probability from the previous post can also be computed via $1 - |D_n|/n!$ where $D_n$ is the number of derangements of $\{1, \ldots, n\}$.