Given a sequence of real-valued random variables defined on a probability space
, it is a standard result that the supremum
is measurable. To ensure that this is well-defined, we need to allow X to have values in , so that
whenever the sequence
is unbounded above. The proof of this fact is simple. We just need to show that
is in
for all
. Writing,
the properties that are measurable and that the sigma-algebra
is closed under countable intersections gives the result.
The measurability of the suprema of sequences of random variables is a vital property, used throughout probability theory. However, once we start looking at uncountable collections of random variables things get more complicated. Given a, possibly uncountable, collection of random variables , the supremum
is,
(1) |
However, there are a couple of reasons why this is often not a useful construction:
- The supremum need not be measurable. For example, consider the probability space
with
the collection of Borel or Lebesgue subsets of
, and
the standard Lebesgue measure. For any
define the random variable
and, for a subset A of
, consider the collection of random variables
. Its supremum is
which is not measurable if A is a non-measurable set (e.g., a Vitali set).
- Even if the supremum is measurable, it might not be a useful quantity. Letting
be the random variables on
constructed above, consider
. Its supremum is the constant function
. As every
is almost surely equal to 0, it is almost surely bounded above by the constant function
. So, the supremum
is larger than we may expect, and is not what we want in many cases.
The essential supremum can be used to correct these deficiencies, and has been important in several places in my notes. See, for example, the proof of the debut theorem for right-continuous processes. So, I am posting this to use as a reference. Note that there is an alternative use of the term `essential supremum’ to refer to the smallest real number almost surely bounding a specified random variable, which is the one referred to by Wikipedia. This is different from the use here, where we look at a collection of random variables and the essential supremum is itself a random variable.
The essential supremum is really just the supremum taken within the equivalence classes of random variables under the almost sure ordering. Consider the equivalence relation if and only if
almost surely. Writing
for the equivalence class of X, we can consider the ordering given by
if
almost surely. Then, the equivalence class of the essential supremum of a collection
of random variables is the supremum of the equivalence classes of the elements of
. In order to avoid issues with unbounded sets, we consider random variables taking values in the extended reals
.
Definition 1 An essential supremum of a collection
of
-valued random variables,
is the least upper bound of
, using the almost-sure ordering on random variables. That is, S is an
-valued random variable satisfying
- upper bound:
almost surely, for all
.
- minimality: for all
-valued random variables Y satisfying
almost surely for all
, we have
almost surely.
It is straightforward to see that the essential supremum is unique up to almost sure equivalence, although showing that it always exists is a bit trickier.
Theorem 2 For any collection
of
-valued random variables, its essential supremum exists and is uniquely defined up to almost-sure equivalence.
Proof: Uniqueness follows from the definition. If S and T are both essential suprema, then they are upper bounds of under the almost sure ordering. By the minimality property, both
and
almost surely, so
almost surely.
To prove existence, we reduce to the existence of suprema of bounded subsets of by taking expectations of a bounded function of the random variables. Start by choosing a continuous, bounded and strictly increasing function
. For example, we can take
Also, let be the collection of maxima
of finite sequences of random variables in
, together with the constant function
. Clearly,
is closed under taking the maximum of pairs of random variables. We set,
As f is measurable and bounded, the expectations are well-defined. Then, as is nonempty, it contains a sequence
such that
tends to
. Replacing
by
if necessary, we may suppose that
is an increasing sequence. We show that
is an essential supremum of . As
and
is increasing, we have
.
First of all, for any , the maxima
are in
. By monotone convergence,
(2) |
If the event has positive probability then the nonnegative random variable
is strictly positive with positive probability giving
contradicting (2). So, almost surely.
Next, suppose that Y is an -valued random variable satisfying
almost surely, for all X in
. Then
almost surely and, taking the limit,
almost surely. ⬜
In the case of countable collections of random variables the essential supremum coincides, almost surely, with the pointwise supremum (1), as we would expect.
Lemma 3 If
is a countable collection of
-valued random variables then
almost surely.
Proof: Assuming that is nonempty, we can write it as
. As noted above, the supremum of a countable sequence of random variables is measurable, so
is measurable and clearly satisfies the upper bound property. Next, suppose that X is an upper bound of in the almost sure ordering. Then,
almost surely, for all n. Countable additivity of probability measures gives
almost surely, so S satisfies the minimality property. ⬜
Finally, we note that the essential supremum of can always be expressed as the supremum of some countable sequence chosen from the collection of random variables
.
Lemma 4 Let S be a nonempty collection of
-valued random variables. Then, there exists a sequence
in
with
almost surely.
Proof: If is the collection of maxima of finite sequences of random variables in
, the proof of theorem 2 constructed a sequence
with
an essential supremum of S. As
is the supremum of a finite subset
of
, we have
Letting be an enumeration of the countable set
, we have
. ⬜
2 thoughts on “Essential Suprema”