CS723 : Probability and Stochastic Processes

Course Overview

Course Synopsis

This is a graduate level course. The course will start by presenting fundamental concepts of probability theory. It will then develop mathematically sound concepts of random variables and their processing through PDF and CDF.

Course Learning Outcomes

Upon successful completion of this course, students should be able to:

  • Feel comfortable about concepts and terminology of probability theory and its domains of application.
  • Apply set-theoretic probabilistic modeling of un-predictable phenomena and academic and real-life problems.
  • Solve simple problems related to random variables, their distribution functions, expected values, moments, and their conditional expectations.
  • Work with jointly distributed pairs of random variables using their joint and marginal densities.
  • Understand how sequence of random variables behave and converge to predictable behaviour.


Course Calendar

1 Introduction to Probability and Stochastic Processes
2 Set Theory
3 Relations, Functions, Probability
4 Probability; Experiments: Repeated, Dependent, Cascaded
5 Joint Probability, Conditional Probability, Interesting Events, Total Probability
6 Combinatronics, Birthday Problem, Bayes Rule
Academic Term Paper
7 Bayes Rule: Application, Partitioned Footpath, Partioned Floor, Trains on a Junction, . .
8 Trains on a Junction, A local bus stop, Random line partition
9 Equally likely outcomes, Random variables, Chuk-a-luck, Binomial & Poisson Distributions,
Assignment No. 1
10 CDF of Poisson PMF, Joint Distribution: Example, Marginal PMF
11 Conditional Distribution, Conditional PMF, Expected Value, Transformation of RV’s
12 Transformation of RV’s, Conditional Expectation, Co-variance / Correlation
13 Continuous Random Variable, Probability Density Function, PDF CDFof a Continuous RV, . . .
14 CDF of a Continuous RV, CDF PDF of Nozzle Height, Exponential RV
15 Failure of TV Set, Gaussian RV
Assignment No. 2
16 Mean of Transformed RV, Height Distribution of Humans, Higher Moments, . . .
17 Scaling of Gaussian RV, Standard Gaussian Events, Joint Distributions, Pair of RVs, . . .
18 Pair of RVs, Buffon's Needle, Exponential RV Pair, Pair of Erlang RVs
19 Exponential RV Pair, Pair of Dependent RVs, Correlation & Covariance, . . .
20 Correlation & Covariance, Correlated Gaussian RVs
21 Function of two RVs, Evaluation of Fz(Z), CDF / PDF of Z = X + Y, . . .
22 Function of two RVs, Evaluation of Fz(Z), CDF / PDF of: Z = Y / X, Z = max (X, Y), . . .
23 Multiple derived RVs, Probability Computation, . . .
24 Pair of derived RVs
25 Direct computation of derived CDF
26 Non-invertible Transformations
27 Moments of U and V from f(x, y)
28 Expectation of transformed random variables, Covariance matrix, Eigenvalues & eigenvectors
29 Vector RVs, Transforming Vector RVs
30 PDF of Z = X+X ? 2X, Characteristic Functions, . . .
31 Convergence of Sequence, Convergence of RVs
32 Norm of Vectors and Function, Convergence of RV's, Inequalities
33 Markov Chains
34 Markov Chains, Total Probability
35 Markov Chains
36 Markov Chains, A few Definitions
37 Markov Chains
38 Markov Chains
39 Markov Chains
40 Markov Chains (Cont.)
Academic Term Paper Presentation
41 Markov Chains (Cont.).
42 Markov Chains (Cont.)..
Course Viva
43 Markov Chains (Cont.)...
44 Markov Chains (Cont.)....
45 Markov Chains (Cont.).....