In the previous post, the concept of Feller processes was introduced. These are Markov processes whose transition function satisfies certain continuity conditions. Many of the standard processes we study satisfy the Feller property, such as standard Brownian motion, Poisson processes, Bessel processes and Lévy processes as well as solutions to many stochastic differential equations. It was shown that all Feller processes admit a cadlag modification. In this post I state and prove some of the other useful properties satisfied by such processes, including the strong Markov property, quasi-left-continuity and right-continuity of the filtration. I also describe the basic properties of the infinitesimal generators. The results in this post are all fairly standard and can be found, for example, in Revuz and Yor (Continuous Martingales and Brownian Motion).

As always, we work with respect to a filtered probability space . Throughout this post we consider Feller processes *X* and transition functions defined on the lccb (locally compact with a countable base) space *E* which, taken together with its Borel sigma-algebra, defines a measurable space .

Recall that the law of a homogeneous Markov process *X* is described by a transition function on some measurable space . This specifies that the distribution of conditional on the history up until an earlier time is given by the measure . Equivalently,

for any bounded and measurable function . The strong Markov property generalizes this idea to arbitrary stopping times.

Definition 1LetXbe an adapted process and be a transition function.

Then,Xsatisfies thestrong Markov propertyif, for each stopping time , conditioned on the process is Markov with the given transition function and with respect to the filtration .

As we see in a moment, Feller processes satisfy the strong Markov property. First, as an example, consider a standard Brownian motion *B*, and let be the first time at which it hits a fixed level . The *reflection principle* states that the process defined to be equal to *B* up until time and reflected about *K* afterwards, is also a standard Brownian motion. More precisely,

is a Brownian motion. This useful idea can be used to determine the distribution of the maximum . If then either the process itself ends up above *K* or it hits *K* and then drops below this level by time *t*, in which case . So, by the reflection principle,

In fact, the reflection principle is a consequence of the strong Markov property, as follows. First, by the strong Markov property, the process is a Brownian motion independently of the stopped process . As the law of standard Brownian motion is symmetric, this has the same distribution as . So, has the same joint distribution as .

Let us now write out explicitly what the strong Markov property means. If is a stopping time then, conditioning on , the Markov property applied to under the filtration is equivalent to

(1) |

(almost surely) for all times . Simplifying this a bit gives the following.

Lemma 2A processXis strong Markov with transition function on state spaceEif and only if, for every finite stopping time , every , and bounded measurable ,

(2)

*Proof:* Applying (1) with *s*=0 gives (2). To prove the converse, suppose that (2) holds and pick any stopping time and times . Then, is a finite stopping time for any constant and, by (2),

Then, using the fact that and agree on the set ,

Letting *T* increase to infinity gives (1). ⬜

We now prove that Feller processes are strong Markov.

Theorem 3Every cadlag Feller process satisfies the strong Markov property.

*Proof:* Suppose that *X* is a cadlag Feller process with transition function . We just need to show that (2) holds for a bounded stopping time and fixed time . First, the case where takes values in a countable set is easily handled, and does not even require the Feller property. Just the Markov property is needed. Letting *Z* be a bounded -measurable random variable, is -measurable for all fixed times *s*, giving

Next let be any stopping time and, for each nonnegative integer *n*, let be the first time after which is a multiple of 1/*n*. That is , which is a stopping time taking values in a countable subset of . So,

for bounded -measurable *Z*. From the definition of the Feller property, if then is jointly continuous in *t* and right-continuous in *s*. So, taking limits

This extends to all bounded measurable by the functional monotone class theorem, giving (2) as required. ⬜

In the study of continuous-time stochastic processes it is common to assume that the underlying filtration satisfies the `usual conditions’. That is, it is complete and right-continuous. On the other hand, in these notes, I have not done this. Completeness of the filtration has been used throughout, so that the debut theorem for right-continuous processes holds and so that we can take cadlag versions of processes. However, I have not been assuming right-continuity of the filtration. For Feller processes, as it turns out, right-continuity is automatic in any case. That is, the complete filtration generated by a Feller process is right-continuous.

Theorem 4LetXbe a Feller process andbe its natural filtration. Suppose that is the sigma algebra generated by together with the zero probability sets in .

Then, is a right-continuous filtration,

*Proof:* Suppose that *X* is Feller with state space *E* and transition function . The aim is to prove the identity

(3) |

(almost surely) for every bounded -measurable random variable *Z*. As is the sigma-algebra generated by (up to zero probability sets), it is enough to prove the result for *Z* of the form

(4) |

for times and functions . The functional monotone class theorem then extends this to all bounded and -measurable *Z*.

First, consider for some time and . As the Feller process *X* has a cadlag modification, will be right-continuous in probability w.r.t. *t*. So, the Markov property gives

as required.

Extending the result to all *Z* of the form (4) is just an application of induction on *n*. So, suppose that the (3) holds for *n* replaced by *n*-1. If then *Z* is -measurable, and the result is trivial. If then setting gives

Finally, if then setting and

the Markov property gives . Also, the induction hypothesis gives (3) with in place of *Z*. So,

as required. ⬜

One consequence of the right-continuity of the filtration is the following zero-one law. Consider, for example, a standard Brownian motion *B*. It can be shown hits zero infinitely often for *t* in any neighborhood of 0, with probability one. Events such as this are -measurable for each and, therefore, measurable. The following result states that all such events have probability zero or one. So, in fact, any Feller process with fixed initial state must either equal *x* infinitely often in any neighbourhood of 0 with probability one or, again with probability one, there must be a nonempty interval on which it does not equal *x*.

Corollary 5 (Blumenthal’s zero-one law)LetXbe a Feller process with fixed initial value . Letting be its natural filtration, every satisfies or .

*Proof:* As is fixed at *x*, the sigma-algebra it generates contains only sets with probability zero or one. If is the sigma-algebra generated by together with the zero probability sets then, by Theorem 4, . However, is generated by sets of zero probability. ⬜

Recall that, for a Poisson process *X*, its jump times are totally inaccessible. That is, for any predictable stopping time , it is almost surely continuous at time , so . This property holds for all Feller processes, and is referred to as *quasi-left-continuity*. By definition, a stopping time is predictable if there exists a sequence of stopping times increasing to . Then, as . For arbitrary jointly measurable processes, quasi-left-continuity is defined as follows.

Definition 6A processXtaking values in a topological spaceEisquasi-left-continuousif and only if, for each finite stopping time and sequence of stopping times increasing to ,

almost surely as .

We now prove that Feller processes satisfy this property.

Theorem 7Every cadlag Feller process is quasi-left-continuous.

*Proof:* Let *X* be a cadlag Feller process on state space *E* and with transition function . Then choose a finite predictable stopping time and a sequence of stopping times increasing to . The aim is to prove the identity

(5) |

for bounded measurable functions . Then, taking gives as required.

As the Borel sigma-algebra on an lccb space *E* is generated by functions in , it is sufficient to prove (5) for for functions , as the functional monotone class theorem then extends (5) to all bounded and measurable *u*. Given any such functions *f*, *g*, the continuity of in both *x* and *t* together with the strong Markov property (2) applied at the stopping times gives,

for any . Taking the limit as gives

as required. ⬜

Another property of homogeneous Poisson processes is that the times between jumps are exponentially distributed. This also carries through to arbitrary Feller processes in the following form; the time spent at any fixed level *x*, if it is not zero or infinite, has the exponential distribution. In fact, the following result almost holds for all right-continuous Markov processes. The Feller property is only used to show that is a stopping time (using right-continuity of the filtration) and that *X* is discontinuous at whenever (using the strong Markov property).

Theorem 8LetXbe a cadlag Feller process with fixed initial value , and setIf the underlying filtration is complete then is a stopping time. Furthermore, one of the following properties holds.

- almost surely.
- almost surely.
- There is a such that has the distribution. In this case, with probability one, so
Xis discontinuous at .

*Proof:* Without loss of generality we can assume that the underlying filtration is the one generated by *X* together with the zero probability sets, since the filtration can always be replaced by this without altering the conclusion of the theorem. By right-continuity of *X*,

Theorem 4 says that the filtration is right continuous and, by the following, is a stopping time.

Now define the function by . For any , conditioning on the set gives and, by the Markov property, the process has the same distribution as . Therefore, conditioned on has the same distribution as ,

The only solutions to this functional equation for a right-continuous and decreasing function are,

- , in which case almost surely.
- , in which case almost surely.
- for some constant . So, has the exponential distribution of rate . Now define the process . By definition of , is almost surely zero. However, by the strong Markov property, conditioned on the event the random variable has the same distribution as and is therefore almost surely positive. So,

⬜

#### Infinitesimal Generators

Except in certain simple cases it is often not possible to explicitly write out the transition function describing a Feller process. Instead, the infinitesimal generator is used. This approximately describes the transition kernel for small times *t*, and can be viewed as the derivative of at time 0, . As the transition function is likely not to be differentiable in any strong sense, the generator is only defined on some subset of .

Definition 9Let be a Feller transition function on the lccb spaceE. Then, is said to be in the domain of the infinitesimal generator if the limit

(6) exists under the uniform topology on .

The operator is called theinfinitesimal generatorof the semigroup .

Equation (6) can alternatively be written as

(7) |

where denotes a term vanishing faster than *t* as . So, the generator *A* gives the first-order approximation to for small *t*.

Restricted to , the operator is differentiable with derivative given by . Equation (8) is a version of the Kolmogorov backward equation.

Theorem 10Let . Then, for all . Furthermore, is differentiable (w.r.t. the norm topology on ) and

(8)

*Proof:* By definition, tends to in as , over . Applying the bounded linear operator to this gives

as over . This shows that has the right-hand derivative . We need to extend this to show that it is actually differentiable. By the Feller property, is continuous in *s*. In fact, all functions with a continuous right-hand derivative are differentiable. We can integrate to get

as . Therefore, is indeed differentiable. Next,

as , over . By definition this means that and . ⬜

Recall from the previous post that, associated with the transition function , there is a resolvent defined for any as

This is a transition kernel on *E* and, if is Feller, then for all . Restricted to , is a continuous linear map satisfying and as . Resolvents and infinitesimal generators are closely related.

Theorem 11Let be a Feller transition function and . Then, is equal to the image of the resolvent on and, considering as a map from to ,

(9)

*Proof:* The second of equations (9) is just a rearrangement of the first. We can apply to for any and ,

By the Feller property, as , giving

So, by equation (7), and . Rearranging gives

(10) |

Now, choosing any , equation (8) and integration by parts gives,

Rearranging gives , so . Together with (10), this gives equation (9) as required. ⬜

Using the resolvent simplifies the proofs of some of the properties of the generator. In particular, its domain is dense in and *A* is closed. In the following lemma, the topology given by the uniform norm on is used.

Lemma 12The domain is a dense subset of , andAis a closed operator. That is, if converge to such that , then and .

*Proof:* Setting , Theorem 11 gives . Taking the limit then, as is a bounded operator, this gives . Again by Theorem 11, this says that *f* is in and . ⬜

A Feller transition function is uniquely determined by its generator. However, this result not nearly as useful as it sounds. This is because, in all but a small number of special cases, we do not know what the domain is. Usually, we just have *A* defined on some dense subspace of , such as the twice continuously differentiable functions, and this is not enough to apply the following result.

Lemma 13Let and be Feller transition functions on an lccb spaceEwith generatorsAandBrespectively.

Suppose that the domains of the generators satisfy and, restricted to , . Then, for allt.

*Proof:* Denote the resolvents of and by and respectively. Theorem 11 gives

for all . So, the resolvents are identical. However, resolvents are just Laplace transforms of the transition function and, by invertibility of Laplace transforms, for almost every *t*. By continuity in *t*, as required. ⬜

An alternative proof of Lemma 13 follows from applying (8) for any ,

So, .

Finally, the generator of a Feller process can be rewritten in terms of a *martingale problem*. The martingale approach, introduced by Stroock and Varadhan, is a very useful method in the theory of stochastic differential equations and Markov processes. For example, it is instrumental in the famous Stroock-Varadhan uniqueness theorem which shows that stochastic differential equations of the form

satisfy uniqueness in law for the n-dimensional process *X*. This is under the condition that are continuous functions such that is a nonsingular nxn matrix for any *x*, and are bounded and measurable.

The martingale description of the generator is as follows.

Lemma 14LetXbe a cadlag Feller process with transition function and generatorA. Then, for , the process

is a martingale.

*Proof:* Choose times and let *Z* be a bounded -measurable random variable. Taking expectations of and applying the Markov property gives,

as required. Here, (8) has been used to express as a derivative. ⬜

Lemma 14 almost gives a complete description of the generator associated with a Feller process *X*, but not quite. To strengthen this result to give an alternative characterization of the generator, we must consider running the Markov process *X* from each possible starting position .

In the following theorem, we let be the set of cadlag functions with coordinate process . Then, is the sigma-algebra generated by and . For each , Corollary 4 of the previous post implies that there is a unique probability measure on under which *X* is a Feller process with the given transition function and . Then, is a filtered probability space.

Theorem 15Let be a Feller transition function and . Then, and if and only the process

is a martingale under the measure for all .

*Proof:* If then Lemma 14 says that *M* is a martingale. Conversely, suppose that *M* is a martingale under the measure . Then,

However, the Feller property says that as , giving

By equation (7), this says that and . ⬜

For example, suppose that is an n-dimensional process satisfying the stochastic differential equation

for an m-dimensional Brownian motion *B* and measurable functions . Defining the function by , consider the differential operator

For any twice-continuously differentiable function , Ito’s lemma gives

So, is a local martingale. If it is known that solutions to the SDE are in fact Feller processes, such as is the case when the coefficients are Lipschitz continuous, then Theorem 15 says that any twice continuously differentiable such that vanishes at infinity is in the domain of the generator, and the generator agrees with *L* on such functions.

Hey George,

just stumbled upon your blog, very cool stuff! I’d like to read a bit more on SDEs permitting a solution which is a Feller process. This can become very nasty I think, so I am interested in some (hopefully) easy to check criteria. I have seen that even simple SDEs, driven by Levy Processes are not Feller. There is a counterexample in the phd thesis of Schnurr (check apendix B): http://deposit.ddb.de/cgi-bin/dokserv?idn=995080879&dok_var=d1&dok_ext=pdf&filename=995080879.pdf

I have some Levy driving process, so not sure if the solution is Feller (which would be nice). Any references? Thanks.

Hi.

I don’t have any references to hand (but do remember that there are theorems giving sufficient conditions for a solution to an SDE to be Feller). You need to check several conditions (i) Uniquess in law (ii) Weak existence of solutions (iii) Continuity with respect to initial conditions (iv) Time homogenity and (v) as for bounded functions

fof compact support.Conditions (i) and (ii) are things that you need to check in any case. Also, (iii) is the kind of result that would normally be proven along with uniqueness in law, and will hold for continuous coefficients. Property (iv) should be clear when it holds, and holds for an SDE with no time dependence in the coefficients and driven by independent Lévy processes. Properties (i)-(iii) will be satisfied for locally Lipschitz coefficents as long as the solution doesn’t blow up. So, (v) can be the tricky one. You need to show that the probability of being within some compact region at a fixed time

tvanishes as the initial state goes to infinity. Thinking about it, if you have an SDEfor a Lévy process

Z= (Z^{1},…,Z) then I think that (v) will be satisfied as long as^{n}ahas sub-linear growth. This is because the size of jump in_{k}Zrequired forXto jump back to near the origin grows to infinity asXbecomes large. The counterexample you mention, (B.3) in the linked paper, hasagrowing linearly in_{k}X. For continuous driving terms (Brownian motion + drift) linear growth is enough for (v) to be satisfied.I don’t have time to be looking for references now, but, if I come across any references I’ll post here.

Very nice blog indeed.

Something I have been wondering about for a while is under which conditions a Feller process that is strongly Markov would also have a reflection principle. More generally speaking, under which conditions would a (multi-dimensional) process that is strongly Markov also posses a reflection principle? I haven´t come across any references that treats this problem.

Hello,

I have a question that I would like to ask you. If we have a property A for Feller processes with negative jumps then we can say that the property A holds for Levy processes with negative jumps, right?

Is this true? Feller processes contain Levy processes?

I hope to receive your answer soon!

Thank you!

Yes, all Levy processes are Feller.

Dear Mr.George Lowther,

Thank you for such a nice blog. I would like to know if a doubly stochastic Poisson process (i.e. with stochastic intensity) satisfies Theorem 4 above, and if not then eventually under which condition it would be true (e.g. when the intensity process is a levy process?).

Looking forward to your reply.

I think you need to formulate it precisely, but I expect that a necessary (and maybe sufficient) condition is that the filtration generated by the intensity process is right-continuous.

Hi, I think there is a typo on the first line of the paragraph before Definition 6. should be .

Fixed. Thanks!

Hi, I think there is a typo in the proof of theorem 8, item 3, , should be .

Fixed. Thanks!

Hi, I think there is a typo in the proof of lemma 14, second line of eqnarray, first term: should be .

Fixed. Thanks!