Probability· Note 03

Conditional Probability

Year 2 · Semester ElulLast updated

Definition

Conditional Probability is the probability of A if B occurs. Denoted by P(A∣B)P(A|B).

A Die Is Rolled

Let A be the event of rolling greater than a three.
Let B be the event of rolling an even number.
Ω={1,2,3,4,5,6}\Omega=\{1,2,3,4,5,6\}
We are told that B happens. Now what is the probability of A?


Ωnew={2,4,6}\Omega_{\text{new}}=\{2,4,6\}
Given our Ωnew\Omega_{\text{new}}, Anew={4,6}A_{\text{new}}=\{4,6\}

∣Anew∣∣Ωnew∣=23\frac{|A_{\text{new}}|}{|\Omega_{\text{new}}|}=\frac23

The Formula

P(A∣B)=P(A∩B)P(B)P(A|B)=\frac{P(A\cap B)}{P(B)}
Reuven Has 2 Children

Let A be the event that Reuven has exactly 2 boys.
Let B be the event that Reuven has at least one boy.
Given that Reuven has at least one boy, what is the probability of Reuven having 2 boys?


Applying The Formula, P(A∣B)=P(A∩B)P(B)P(A|B)=\frac{P(A\cap B)}{P(B)}
Since A⊆BA\subseteq B, P(A∩B)P(B)=P(A)P(B)=1434=13\frac{P(A\cap B)}{P(B)}=\frac{P(A)}{P(B)}=\frac{\frac14}{\frac34}=\frac13

P(A∩B)P(B)=13\frac{P(A\cap B)}{P(B)}=\frac13

Independent Events

Events AA and BB are independent events  if P(A∣B)=P(A)P(A|B)=P(A)
(Meaning, if knowing BB happened has no effect on the probability of AA.)

Properties of Independent Events

  1. Independence is mutual.
    • If P(A∣B)=P(A)P(A|B)=P(A), then P(B∣A)=P(B)P(B|A)=P(B).
  2. A,BA, B are independent   ⟺  P(A∩B)=P(A)⋅P(B)\iff P(A\cap B)=P(A)\cdot P(B)
    • This extends to nn mutually independent events.
Don’t mix this up with disjoint events!

Disjoint events are not the same thing as independent events.

In fact, if P(A),P(B)≠0P(A),P(B)\not=0, then if they are disjoint A,BA,B must be dependent.

Evaluating Conditional Probabilities

Example

A=A= I visit New York
B=B= I visit the Statue of Liberty

Given P(A)=0.7P(A)=0.7 and P(B∣A)=0.4P(B|A)=0.4, what is P(B)P(B)?


P(B)=P(B∩A)P(B)=P(B\cap A) because B⊆AB\subseteq A.
By definition: P(B∣A)=P(B∩A)P(A)P(B|A)=\frac{P(B\cap A)}{P(A)}.
Multiplying both sides by P(A)P(A) gives us:

P(B∩A)=P(A)⋅P(B∣A)P(B∩A)=0.7⋅0.4=0.28P(B∩A)=P(B)=0.28\begin{align}P(B\cap A)&=P(A)\cdot P(B|A)\\P(B\cap A)&=0.7\cdot 0.4&=0.28\\P(B\cap A)&=P(B)&=0.28\end{align}

Law of Total Probability (LTP)

Introductory Example
Given 2 jars

The probability of picking jar 1 is 14\frac14, and picking jar 2 is 34\frac34. A ball is selected at random from the chosen jar. What is the probability that I select a blue ball?

Define events:

A1=Choose jar 1A2=Choose jar 2B=Choose a blue ball\begin{align}A_1&=\text{Choose jar }1\\A_2&=\text{Choose jar }2\\B&=\text{Choose a blue ball}\\\end{align}

We know P(A1)=14P(A_1)=\frac14, P(A2)=34P(A_2)=\frac34.
P(B∣A1)=23P(B\mid A_1)=\frac23, P(B∣A2)=13P(B\mid A_2)=\frac13.
So, how do we find P(B)P(B)?

Note that B=(B∩A1)∪(B∩A2)B=(B\cap A_1)\cup(B\cap A_2), which are disjoint events.
B∩A1⊆A1B\cap A_1\subseteq A_1, hence, P(B∩A1)=P(A1)⋅P(B∣A1)P(B\cap A_1)=P(A_1)\cdot P(B\mid A_1)
B∩A2⊆A2B\cap A_2\subseteq A_2, hence, P(B∩A2)=P(A2)⋅P(B∣A2)P(B\cap A_2)=P(A_2)\cdot P(B\mid A_2)

P(B)=P(B∩A1)+P(B∩A2)=P(A1)⋅P(B∣A1)+P(A2)⋅P(B∣A2)=14⋅23+34⋅13=512\begin{align}P(B)&=P(B\cap A_1)&+&P(B\cap A_2)\\&=P(A_1)\cdot P(B\mid A_1)&+&P(A_2)\cdot P(B\mid A_2)\\&=\frac14\cdot\frac23&+&\frac34\cdot\frac13\\\\&=\frac5{12}\end{align}

Let A1,…AnA_1,\dots A_n be disjoint events which partition Ω\Omega.
Let BB be any event.
Then:

The Law

BB is the union of the intersection of AkA_k and BB, for all kk: 
B=(B∩A1)∪(B∩A2)∪⋯∪(B∩An)B=(B\cap A_1)\cup(B\cap A_2)\cup\dots\cup(B\cap A_n)
Then,

P(B)=∑k=1nP(Ak)⋅P(B∣Ak)P(B)=\sum_{k=1}^n{P(A_k)\cdot P(B|A_k)}

Proof

This is very likely on the #ProbabilityExam

INCOMPLETE!

I’m a bit behind on notes and stuff. If this note been published more than 10 days ago (you can see on the footer), please let me know and I’ll be sure to finish this page up