Introduction

Column

Probability and Counting Problems

In this section, we will look at

  1. Probability: the fundamentals of probability, conditional probability, Venn Diagrams

  2. Counting Problems: combinations, permutations and binomial coefficients.

  3. Random Variables: Introduction to random variables, sampling.

Probability

Column

Probability

Probability
  • Probability theory is the mathematical study of randomness. A probability model of a random experiment is defined by assigning probabilities to all the different outcomes.
  • Probability is a numerical measure of the likelihood that an event will occur. Thus, probabilities can be used as measures of degree of uncertainty associated with outcomes of an experiment. Probability values are always assigned on a scale from 0 to 1.
  • A probability of 0 means that the event is impossible, while a probability near 0 means that it is highly unlikely to occur.
  • Similarly an event with probability 1 is certain to occur, whereas an event with a probability near to 1 is very likely to occur.

Conditional Probability

Conditional Probability

The conditional probability of an event is the probability that an event A occurs given that another event B has already occurred. This type of probability is calculated by restricting the sample space that we’re working with to only the set B.

The formula for conditional probability can be rewritten using some basic algebra. Instead of the formula:

\[P(A | B) = \frac{P(A \cap B) }{P( B )} \]


Multiplication Rule

The multiplication rule is a result used to determine the probability that two events, \(A\) and \(B\), both occur. The multiplication rule follows from the definition of conditional probability.\

The result is often written as follows, using set notation: \[ P(A|B)\times P(B) = P(B|A)\times P(A) \qquad \left( = P(A \cap B) \right) \]

Bayes Theorem

Bayes’ Theorem is a result that allows new information to be used to update the conditional probability of an event.

Recall the definition of conditional probability: \[ P(A|B) = \frac{P(A \cap B)}{P(B)} \]

Using the multiplication rule, gives Bayes’ Theorem in its simplest form:

\[ P(A|B) = \frac{P(B|A)\times P(A)}{P(B)} \]

The general form of Bayes’ theorem is \[ P(A|B) = \frac{P(A \mbox{ and }B)}{P(B)} \]

Equivalently Bayes’ Theorem can be expressed as \[\begin{equation*} P(B|A)=\frac{P\left(A|B\right) \times P(B) }{P\left( A\right) }. \end{equation*}\]

Probability Trees

Probability Trees
  • A probability tree diagram shows all the possible events.
  • The first event is represented by a dot.
  • From the dot, branches are drawn to represent all possible outcomes of the event.
  • The probability of each outcome is written on its branch.
  • How do you calculate the overall probabilities?
  • You multiply probabilities along the branches
  • You add probabilities down columns
Questions

**{Basics of Probability} %====================================%

  • ***{Random Experiment} A random experiment is one whose outime is determined by chance.

  • ***{Sample Space} In a probabilistic experiment, the sample space is the set of all possible outcomes of the experiment. Suppose the probabilistic experiment is the toss of a dice. The six numbers that can appear face up, from 1 to 6, are the 6 possible outcomes of the experiment. Hence, the sample space is: \[S={1,2,3,4,5,6}\]

  • ***{Sample Points} In a probabilistic experiment, a sample point is one of the possible outcomes of the experiment. The set of all sample points is called sample space.

  • **{Events} An event A* is merely collection of outcomes, or in other words, a subset of the sample space.

***{Sample Spaces and Events}

  • The set of all possible outcomes of a probability experiment is called a ***{}, which is usually denoted by \(\boldsymbol{S}\).
  • The sample space is an exhaustive list of all the possible outcomes of an experiment. We call individual elements of this list ***{}.
  • Each possible outcome is represented by one and only one sample point in the sample space.

Probability Questions - Worked Examples

Column

Playing Card and Dice Questions

Worked Example 1

A card is drawn at random from a pack of cards. Let A be the event that the card is red and B be the event that the card is king.

Does the colour of card affect its probability of being a king?

Solution

Click here for demonstrated solution

Independent Events

Independent Events

Worked Example 1

Suppose that A and B are two independent events with P(A), the probability that A occurs, equal to 0.4, and P(B), the probability that B occurs, equal to 0.5. You may assume that A and B are independent events.

Exercises
  1. Calculate \(P(A \cap B)\), the probability of both A and B occuring (i.e. simultaneously).
  2. Calculate \(P(A \cup B)\), the probability of either A and B (or both) occuring.
Solution


Worked Example 2

Suppose that \(A\) and \(B\) are events from a sample space such that \(P(A) = 0.65\) and \(P(B) =0.45\) and \(P(A\cap B) = 0.32\)

Exercises
  1. Find \(P(B^{c})\).
  2. Find \(P(B|A)\).
  3. Find \(P(A \;\cup\;B)\).
  4. Find \(P(A^{c} \;\cup\;B^{c})\).
Solution

Counting Problems

Joint Random Variables

Column

Worked Example 1

Joint Distribution of Random Variables - Health Science Example

Solution

Consider the random variable \(\LARGE{X}\) taking the value \(\LARGE{X = 1}\) if a randomly selected person is a smoker, or \(\LARGE{X = 0}\) otherwise.

  • The random variable \(\LARGE{Y}\) describes the amount of physical exercise per week for this randomly selected person.

  • It can take the values 0 (less than one hour of exercise per week), 1 (one to two hours) and 2 (more than two hours of exercise per week).

The joint distribution of \(\LARGE{X}\) and \(\LARGE{Y}\) is given by the joint probability function in the following table.

Y= 0 Y= 1 Y= 2
X = 0 0.2 0.3 0.25
X = 1 0.1 0.1 0.05



The random variable \(\LARGE{R = (3 - Y)^2(X + 1) }\) is used as a risk index for a particular heart disease.

Exercises

  1. Calculate the probability that a randomly selected person does more than two hours of exercise per week.
  2. Decide whether \(\LARGE{X}\) and \(\LARGE{Y}\) are independent or not and justify your answer.
  3. Derive the probability function of \(\LARGE{R}\).
  4. Calculate the expectation of \(\LARGE{R}\).