\(\newcommand{\set}[1]{\{1,2,\dotsc,#1\,\}} \newcommand{\ints}{\mathbb{Z}} \newcommand{\posints}{\mathbb{N}} \newcommand{\rats}{\mathbb{Q}} \newcommand{\reals}{\mathbb{R}} \newcommand{\complexes}{\mathbb{C}} \newcommand{\twospace}{\mathbb{R}^2} \newcommand{\threepace}{\mathbb{R}^3} \newcommand{\dspace}{\mathbb{R}^d} \newcommand{\nni}{\mathbb{N}_0} \newcommand{\nonnegints}{\mathbb{N}_0} \newcommand{\dom}{\operatorname{dom}} \newcommand{\ran}{\operatorname{ran}} \newcommand{\prob}{\operatorname{prob}} \newcommand{\Prob}{\operatorname{Prob}} \newcommand{\height}{\operatorname{height}} \newcommand{\width}{\operatorname{width}} \newcommand{\length}{\operatorname{length}} \newcommand{\crit}{\operatorname{crit}} \newcommand{\inc}{\operatorname{inc}} \newcommand{\HP}{\mathbf{H_P}} \newcommand{\HCP}{\mathbf{H^c_P}} \newcommand{\GP}{\mathbf{G_P}} \newcommand{\GQ}{\mathbf{G_Q}} \newcommand{\AG}{\mathbf{A_G}} \newcommand{\GCP}{\mathbf{G^c_P}} \newcommand{\PXP}{\mathbf{P}=(X,P)} \newcommand{\QYQ}{\mathbf{Q}=(Y,Q)} \newcommand{\GVE}{\mathbf{G}=(V,E)} \newcommand{\HWF}{\mathbf{H}=(W,F)} \newcommand{\bfC}{\mathbf{C}} \newcommand{\bfG}{\mathbf{G}} \newcommand{\bfH}{\mathbf{H}} \newcommand{\bfF}{\mathbf{F}} \newcommand{\bfI}{\mathbf{I}} \newcommand{\bfK}{\mathbf{K}} \newcommand{\bfP}{\mathbf{P}} \newcommand{\bfQ}{\mathbf{Q}} \newcommand{\bfR}{\mathbf{R}} \newcommand{\bfS}{\mathbf{S}} \newcommand{\bfT}{\mathbf{T}} \newcommand{\bfNP}{\mathbf{NP}} \newcommand{\bftwo}{\mathbf{2}} \newcommand{\cgA}{\mathcal{A}} \newcommand{\cgB}{\mathcal{B}} \newcommand{\cgC}{\mathcal{C}} \newcommand{\cgD}{\mathcal{D}} \newcommand{\cgE}{\mathcal{E}} \newcommand{\cgF}{\mathcal{F}} \newcommand{\cgG}{\mathcal{G}} \newcommand{\cgM}{\mathcal{M}} \newcommand{\cgN}{\mathcal{N}} \newcommand{\cgP}{\mathcal{P}} \newcommand{\cgR}{\mathcal{R}} \newcommand{\cgS}{\mathcal{S}} \newcommand{\bfn}{\mathbf{n}} \newcommand{\bfm}{\mathbf{m}} \newcommand{\bfk}{\mathbf{k}} \newcommand{\bfs}{\mathbf{s}} \newcommand{\bijection}{\xrightarrow[\text{onto}]{\text{$1$--$1$}}} \newcommand{\injection}{\xrightarrow[]{\text{$1$--$1$}}} \newcommand{\surjection}{\xrightarrow[\text{onto}]{}} \newcommand{\nin}{\not\in} \newcommand{\prufer}{\mbox{prüfer}} \DeclareMathOperator{\fix}{fix} \DeclareMathOperator{\stab}{stab} \DeclareMathOperator{\var}{var} \newcommand{\inv}{^{-1}} \newcommand{\lt}{ < } \newcommand{\gt}{ > } \newcommand{\amp}{ & } \)

Section10.2Conditional Probability and Independent Events

A jar contains twenty marbles of which six are red, nine are blue and the remaining five are green. While blindfolded, Xing selects two of the twenty marbles random (without replacement) and puts one in his left pocket and one in his right pocket. He then takes off the blindfold.

The probability that the marble in his left pocket is red is \(6/20\). But Xing first reaches into his right pocket, takes this marble out and discovers that it is blue. Is the probability that the marble in his left pocket is red still \(6/20\)? Intuition says that it's slightly higher than that. Here's a more formal framework for answering such questions.

Let \((S,P)\) be a probability space and let \(B\) be an event for which \(P(B)>0\). Then for every event \(A\subseteq S\), we define the probability of \(A\), given \(B\), denoted \(P(A|B)\), by setting \(P(A|B)=P(A\cap B)/P(B)\).

Discussion10.8

Returning to the question raised at the beginning of the section, Bob says that this is just conditional probability. He says let \(B\) be the event that the marble in the right pocket is blue and let \(A\) be the event that the marble in the left pocket is red. Then \(P(B)=9/20\), \(P(A) = 6/20\) and \(P(A\cap B)=(9\cdot6)/380\), so that \(P(A|B)= \frac{54}{380}\frac{20}{9}=6/19\), which is of course slightly larger than \(6/20\). Alice is impressed.

Example10.9

Consider the jar of twenty marbles from the preceding example. A second jar of marbles is introduced. This jar has eighteen marbles: nine red, five blue and four green. A jar is selected at random and from this jar, two marbles are chosen at random. What is the probability that both are green? Bob is on a roll. He says “Let \(G\) be the event that both marbles are green, and let \(J_1\) and \(J_2\) be the event that the marbles come from the first jar and the second jar, respectively. Then \(G= (G\cap J_1)\cup (G\cap J_2)\), and \((G\cap J_1)+(G\cap J_2)=\emptyset\). Furthermore, \(P(G|J_1)=\binom{5}{2}/\binom{20}{2}\) and \(P(G|J_2)=\binom{4}{2}/\binom{18}{2}\), while \(P(J_1)=P(J_2)=1/2\). Also \(P(G\cap J_i)=P(J_i)P(G|J_i)\) for each \(i=1,2\). Therefore, \begin{equation*} P(G)=\frac{1}{2}\frac{\binom{5}{2}}{\binom{20}{2}}+ \frac{1}{2}\frac{\binom{4}{2}}{\binom{18}{2}}=\frac{1}{2}\left(\frac{20}{380}+ \frac{12}{306}\right). \end{equation*} That's about \(4.6\)%.”

Now Alice is speechless.

Subsection10.2.1Independent Events

Let \(A\) and \(B\) be events in a probability space \((S,P)\). We say \(A\) and \(B\) are independent if \(P(A\cap B)=P(A)P(B)\). Note that when \(P(B)\neq 0\), \(A\) and \(B\) are independent if and only if \(P(A)=P(A|B)\). Two events that are not independent are said to be dependent. Returning to our earlier example, the two events (\(A\): the marble in Xing's left pocket is red and \(B\): the marble in his right pocket is blue) are dependent.

Example10.10

Consider the two jars of marbles from Example 10.9. One of the two jars is chosen at random and a single marble is drawn from that jar. Let \(A\) be the event that the second jar is chosen, and let \(B\) be the event that the marble chosen turns out to be green. Then \(P(A)=1/2\) and \(P(B)=\frac{1}{2}\frac{5}{20}+ \frac{1}{2}\frac{4}{18}\). On the other hand, \(P(A\cap B)=\frac{1}{2} \frac{4}{18}\), so \(P(A\cap B)\neq P(A)P(B)\), and the two events are not independent. Intuitively, this should be clear, since once you know that the marble is green, it is more likely that you actually chose the first jar.

Example10.11

A pair of dice are rolled, one red and one blue. Let \(A\) be the event that the red die shows either a \(3\) or a \(5\), and let \(B\) be the event that you get doubles, i.e., the red die and the blue die show the same number. Then \(P(A)=2/6\), \(P(B)=6/36\), and \(P(A\cap B) = 2/36\). So \(A\) and \(B\) are independent.