Probability concept, randomness, total probability theorem, Bayes' rule, random variables, density and distribution functions, expected value, variance and moments, relation between random variables, sample mean and variance, experimental distributions, statistical inference, classification and characterization of random variables, correlation functions, properties of auto-correlation and cross-correlation functions, sample mean and sample correlation functions.