Crash Course - Statistics

Introduction

General notations

Probability

• $\mathrm{\Omega }$ abstract set representing the sample space of a random experiment. The elements in $\omega \in \mathrm{\Omega }$ are the possible outcomes of the experiment.
• $\mathcal{P}(\mathrm{\Omega })$: power set of $\mathrm{\Omega }$, the set of all possible subsets of $\mathrm{\Omega }$.
  
• Most of subsets $A,B,\dots$ will be thought as events.
• Collection of subsets $\mathcal{A},\mathcal{B},\dots$.
• The empty set $\mathrm{\varnothing }$.
• $\mathcal{B}$ is a $\sigma$-field, usually connected with the sample space $\mathrm{\Omega }$.
• $\mathcal{B}(\mathbb{R})$ is the Borel $\sigma$-field of $\mathbb{R}$.
• $\mathbb{P}$ is a probability measure function $\mathbb{P}:\mathcal{B}\to [0,1]$.
• $(\mathrm{\Omega },\mathcal{B},\mathbb{P})$ is a probability space.
• $\bigsqcup$ is a shortcut to denote a disjoint union, for example writing $A\bigsqcup B$ means that the sets $A$ and $B$ are disjoint, while writing $A\cup B$ means that the sets $A$ and $B$ are not disjoint.

Linear algebra

• Bold and capital letter stands for a matrix, e.g. $\mathbf{X}$.
• Bold with small letter stands for a vector, e.g. $\mathbf{x}$.
• Small letter not bold denotes a scalar, e.g. $x$.

Syllabus

• Part 1. Probability
  1. Set and events
     • Set operations
     • Indicator function
     • Limits of sets
     • Fields and $\sigma$-fields
  2. Probability measure
     • Consequences of the axioms
     • Maps and inverse map
     • Induced distribution function
     • Independence
  3. Random variables
  4. Expectation
     • Review of inequalities
  5. Conditional expectation
     • Properties of conditional expectation
     • Conditional probability
  6. Characteristic functions
  7. Convergence concepts
     • Types of convergence
     • Laws of large numbers
     • Central limit theorem
• Part 2. Statistics:
  1. Population, sample and moments
     • Expectation
     • Variance and covariance
     • Skewness
     • Kurtosis
  2. Maximum likelihood
  3. Multivariate data
• Part 3. Statistical models:
  1. Statistical models
     • The matrix of data
     • Joint, conditional and marginals
     • Conditional expectation model
  2. Introduction to linear models
     • Estimators of b
     • Variance decomposition
     • Multivariate R squared
  3. Classic linear models
  4. Generalized least square
  5. Restricted linear models
  6. Multiequationals linear models
• Part 4. Time Series:
  1. Time series
     • Stationarity
     • Lag operator
     • Notable processes
  2. AR and MA processes
  3. ARMA processes
  4. GARCH processes
  5. GARCH(1,1) Moments
• Part 5. Tests:
  1. Hypothesis tests
  2. Normality tests
  3. Stationarity tests
  4. Autocorrelation tests
  5. Value at Risk tests
• Part 6. Robustness:
  1. Tukey Functions
• Part 7. Distributiobs:
  1. Gaussian Mixture