Intro. Probability Theory

September 1, 2020 December 1, 2020

University of Colorado Boulder

Undergraduate/Graduate

Studies axioms, combinatorial analysis, independence and conditional probability, discrete and absolutely continuous distributions, expectation and distribution of functions of random variables, laws of large numbers, central limit theorems, and simple Markov chains if time permits

1. Combinatorial Analysis

  1. Principle of Counting
  2. Permutations
  3. Combinations
  4. Number of Integer Solutions of Equations
2. Axioms of Probability

  1. Sample Space and Events
  2. Axioms of Probability
  3. Some Simple Propositions
  4. Sample Spaces Having Equally Likely Outcomes
  5. Probability as a Continuous Set Function
  6. Probability as a Measure of Belief
3. Conditional Probability and Independence

  1. Conditional Probabilities
  2. Bayes’s Formula
  3. Independent Events
  4. P(.|F) is a Probability
4. Random Variables

  1. Random Variables
  2. Discrete Random Variables
  3. Expected Value
  4. Expectation of a function of a RV
  5. Variance
  6. Bernoulli and Binomial
  7. Poisson RV
  8. Geometric RV
  9. Expected Value of Sums of Random Variables
  10. Properties of the Cumulative Distribution Function
5. Continuous Random Variables

  1. Continuous Random Variables
  2. Expectation and Variance of Continuous RV
  3. Uniform RV
  4. Normal RV
  5. Exponential RV
  6. Distribution of a Function of a RV
6. Jointly Distributed Random Variables

  1. Joint Distribution Functions
  2. Independent RV
  3. Sum of Independent RV: Examples
7. Properties of Expectation

  1. Expectation of Sums of Random Variables
  2. Moments of the Number of Events that Occur
  3. Covariance, Variance of Sums and Correlations
  4. Conditional Expectation
  5. Conditional Expectation and Prediction
  6. Moment Generating Function
8. Limit Theorems

  1. Chebyshev’s Inequality and Weak Law of Large Numbers
  2. Central Limit Theorem
  3. Law of Large Numbers