Probability Theory Lecture

Abstract

This lecture overviews Probability Theory  that has many applications in a multitude of scientific and engineering disciplines, notably in Pattern Recognition and Machine Learning. It covers the following topics in detail: 

1. a) Probability Space, Bayes theorem.
2. b) One random variable, cumulative probability functions, probability density functions, expectation operators, mean, variance, functions of random variables, normal, uniform, Laplacian distributions.
3. b) Two random variables, joint cumulative probability functions, joint probability density functions, expectation operators, independence, correlation coefficient, functions of two random variables, 2D normal, uniform, Laplacian distributions.
4. c) Multiple Random Variables, random vectors, joint cumulative probability functions, joint probability density functions, expectation operators, independence, correlation matrix, covariance matrix, functions of two random variables, multivariate normal distributions.

Finally, a section is devoted on random number and random vector generation.

 1D probability distributions.

2D probability distributions.

Probability-Theory-v4.2.1

Understanding Questionnaire

https://docs.google.com/forms/probability-theory

Tutorial Exercises

1. Linear Transformation of Random Variables Tutorial Exercise 1
2. Linear Transformation of Random Variables Tutorial Exercise 2
3. Polar Coordinates and Random Variables Tutorial Exercise
4. Random Variable with Normal Distribution Tutorial Exercise
5. Random Variable with Uniform Distribution Tutorial Exercise
6. Transformation of Random Variables Tutorial Exercise
7. Two Random Variables with Normal Distribution Tutorial Exercise
8. Two Random Variables with Uniform Distribution Tutorial Exercise