Random variables · Definition

Cumulative distribution function

probabilityrandom variables

Before you start you need to know

It describes a random variable of any kind with a single function, without distinguishing whether it is discrete or continuous.

Definition

The cumulative distribution function \(F_X\) of a random variable \(X\) gives, for each real number \(x\), the probability \(P\) that \(X\) takes a value less than or equal to \(x\).

\[F_X(x)=P(X\le x)\]

The cumulative distribution function is obtained by accumulating probability from the left. For a discrete variable, \(F(x)=\sum_{t\le x}p(t)\) is a staircase that jumps at each possible value; for a continuous one, \(F(x)=\int_{-\infty}^{x}f(t)\,dt\) is a curve without jumps. With \(f(x)=2x\) on \([0,1]\) we get \(F(x)=x^2\) on that interval.

Every \(F\) has three properties: it never decreases, tends to 0 as \(x\to-\infty\) and to 1 as \(x\to+\infty\); it is also right-continuous. Conversely, any function with these properties is the distribution of some variable. This gives a quick way to show that a candidate is not valid.

With it, interval probabilities become subtractions: \(P(a<X\le b)=F(b)-F(a)\) and \(P(X>a)=1-F(a)\). The jumps of \(F\) are the masses, \(P(X=a)=F(a)-F(a^-)\), and where \(F\) is differentiable the density is \(f(x)=F'(x)\). A common mistake is confusing \(P(X>a)\) with \(F(a)\), or adding instead of subtracting.

Quantiles are read by inverting \(F\): the value \(m\) with \(F(m)=\tfrac12\) is the median. The expectation that comes next in the course can be computed from either the mass or the density, and \(F\) is the thread connecting both descriptions.

Think about it

Can a cumulative distribution function take the value 1.2 at some point?

No: \(F(x)\) is a probability, so it always lies between 0 and 1.

If \(F\) is a staircase with a jump of 0.3 at \(x=4\), what does that say about \(X\)?

That \(P(X=4)=0.3\): the variable is discrete (at least at that point) and 4 is a value carrying mass 0.3.

Exercises 10

References

  • Joseph K. Blitzstein, Jessica Hwang, Introduction to Probability, 2nd edition, CRC Press, 2019. §3.6
  • Sheldon Ross, A First Course in Probability, 10th edition, Pearson, 2019. §4.9
  • Ronald E. Walpole, Raymond H. Myers, Sharon L. Myers, Keying Ye, Probabilidad y estadística para ingeniería y ciencias, 9.ª edición, Pearson, 2012. §3.2