Density Formula in Malliavin Calculus by Using Stein’s Method and Diffusions

Abstract

Let G be a random variable of functionals of an isonormal Gaussian process X defined on some probability space. Studies have been conducted to determine the exact form of the density function of the random variable G. In this paper, unlike previous studies, we will use the Stein’s method for invariant measures of diffusions to obtain the density formula of G. By comparing the density function obtained in this paper with that of the diffusion invariant measure, we find that the diffusion coefficient of an Itô diffusion with an invariant measure having a density can be expressed as in terms of operators in Malliavin calculus.

1. Introduction

Let $X=\left\{X\right(h),h\in \mathfrak{H}\}$, where $\mathfrak{H}$ is a real separable Hilbert space, be an isonormal Gaussian process defined on a probability space $(\Omega ,\mathfrak{F},\mathbb{P})$, and let G be a random variable of functionals of an isonormal Gaussian process X. The following formula on the density of a random variable G is a well-known fact of the Malliavin calculus: if ${\displaystyle \frac{DG}{{\parallel DG\parallel }_{\mathfrak{H}}}}$ belongs to the domain of divergence operator $\delta$, then the law of G has a continuous and bounded density $p_G$, given by

$$p_G\left(x\right)=\mathbb{E}\left[{\mathbf{1}}_{\{G>x\}}\delta \left({\displaystyle \frac{DG}{{\parallel DG\parallel }_{\mathfrak{H}}}}\right)\right]\mathrm{for} \mathrm{all}x\in \mathbb{R}.$$

Several examples are detailed in the section titled “Malliavin Calculus” of Nualart’s book [1] (or [2]). Nourdin and Viens (2009) prove a new general formula for $p_G$ that does not refer to divergence operator $\delta$. For a random variable $G\in {\mathbb{D}}^{1,2}$ with $\mathbb{E}\left[G\right]=0$, where ${\mathbb{D}}^{1,2}$ is the domain of the Malliavin derivative operator D with respect to X, such that the Malliavin derivative $DG$ of G is a random element belonging in $\mathfrak{H}$ with $\mathbb{E}[\parallel DG{\parallel }_{\mathfrak{H}}^2]<\infty$, we define the function $g_G$ by

$$g_G\left(x\right)=\mathbb{E}\left[{\langle DG,-D{L}^{-1}G\rangle }_{\mathfrak{H}}\right|G=x].$$

(1)

The operator L appearing in (1) is the so-called generator of the Ornstein–Uhlenbeck semigroup and $L^{-1}$ is its pseudo-inverse. For details, see Section 2. It is well known that $g_G$ is non-negative on the support of the law of G (see Proposition 3.9 in [3]).

Under some general conditions on a random variable G, Nourdin and Viens (2009) obtained the new formula of the density $p_G$ for the law of G, provided that it exists. A precise statement is given in the following theorem.

Theorem 1.

([Nourdin and Viens]). The law of G admits a density (with respect to Lebesgue measure), say $p_G$, if and only if the random variable $g_G\left(G\right)$ is almost surely strictly positive. In this case, the support of $p_G$, denoted by $supp\left(p_G\right)$, is a closed interval of $\mathbb{R}$ containing zero and, for almost all $x\in supp\left(p_G\right)$,

$$p_G\left(x\right)={\displaystyle \frac{\mathbb{E}\left[\right|G\left|\right]}{2g_G\left(x\right)}}exp\left(-{\int }_0^x{\displaystyle \frac{y}{g_G\left(y\right)}}dy\right).$$

(2)

Assume that the density p satisfies the following conditions: it is continuous and bounded, with ${\int }_l^u{x}^{2}p\left(x\right)dx<\infty$. Let us set an interval $I=(l,u)$ ($-\infty \le l<u\le \infty$). Then,

$$\left\{\begin{array}{cc}p\left(x\right)>0\hfill & ifx\in I\hfill \\ p\left(x\right)=0\hfill & ifx\in I^c\hfill \end{array}\right..$$

We define a continuous function b on I such that there exists $e\in (l,u)$, satisfying

$$\left\{\begin{array}{cc}b\left(x\right)>0\hfill & ifx\in (l,e)\hfill \\ b\left(x\right)<0\hfill & ifx\in (e,u)\hfill \end{array}\right.,$$

where $bp$ is bounded on I and

$${\int }_l^{u}b\left(x\right)p\left(x\right)dx=0.$$

Define

$$a\left(x\right)={\displaystyle \frac{2}{p\left(x\right)}}{\int }_l^{x}b\left(y\right)p\left(y\right)dy.$$

(3)

Then, the diffusion with the invariant density p has the Stochastic Differential Equation (SDE) with the form

$$d{X}_t=b\left(X_t\right)dt+\sqrt{a\left(X_t\right)}d{W}_t,$$

(4)

where W is a standard Brownian motion. Equation (4) should be interpreted as an informal way of expressing the corresponding integral equation,

$$X_t=X_0+{\int }_0^{t}b\left(X_s\right)ds+{\int }_0^t\sqrt{a\left(X_s\right)}d{W}_s.$$

(5)

The stochastic integral used in Equation (5) is of an Itô integral.

In the previous studies in this field (see [1,2,4]), the density function was obtained using the integration-by-parts formula (see Lemma 1 below) in Malliavin calculus. On the other hand, in this paper, we derive the new density formula of a random variable G, satisfying appropriate conditions related to Malliavin calculus, from the following equation obtained by using Stein’s method: for every $z\in \mathbb{R}$,

$$\begin{array}{ccc}\hfill \mathbb{P}(G\le z)-\mathbb{P}(F\le z)& =& \mathbb{E}\left[{\tilde{h}}_z^{\prime }\left(G\right)\left({\displaystyle \frac{1}{2}}a\left(G\right)+{\langle -D{L}^{-1}b\left(G\right),DG\rangle }_{\mathfrak{H}}\right)\right]\hfill \\ & & +\mathbb{E}\left[b\left(G\right)\right]\mathbb{E}\left[{\tilde{h}}_z\left(G\right)\right],\hfill \end{array}$$

(6)

where F is a random variable with the invariant density p and ${\tilde{h}}_z$ is a solution to the Stein’s equation (for a detailed explanation of Stein’s method, see [5,6,7]).

The density function obtained in this paper provides a surprising method for solving an existing problem (see Theorem 2 in [8]) linked to diffusions with an invariant density. As an application of our results, we will show that the diffusion coefficient a of SDE (4) can be written in an explicit form, like (1), if the random variable G in (6), with its value on I, has a density p and satisfies $b\left(G\right)\in L^2(\Omega )$. The rest of this paper is organized as follows. Section 2 reviews some basic notations, and the contents of Malliavin calculus. In Section 3, we will briefly discuss the construction of a diffusion process with an invariant density p, and then describe our main results. Finally, as an application of our main results, in Section 4, we give some examples.

2. Preliminaries

Malliavin Calculus

In this section, we present some basic facts about Malliavin operators defined on spaces of random elements that are functionals of possibly infinite-dimensional Gaussian fields. For a more detailed explanation, see [1,9]. Suppose that $\mathfrak{H}$ is a real separable Hilbert space with a scalar product denoted by ${\langle ·,·\rangle }_{\mathfrak{H}}$. Let $X=\left\{X\right(h),h\in \mathfrak{H}\}$ be an isonormal Gaussian process, which is a centered Gaussian family of random variables such that $\mathbb{E}\left[X\left(h\right)X\left(g\right)\right]={\langle h,g\rangle }_{\mathfrak{H}}$. For every $n\ge 1$, let ${\mathbb{H}}_n$ be the nth Wiener chaos of X, which is the closed linear subspace of ${\mathbb{L}}^2(\Omega )$ generated by $\{H_n\left(X\left(h\right)\right):h\in \mathfrak{H},\parallel h{\parallel }_{\mathfrak{H}}=1\}$, where $H_n$ is the nth Hermite polynomial. We define a linear isometric mapping $I_n:{\mathfrak{H}}^{\odot n}\to {\mathbb{H}}_n$ by $I_n\left(h^{\otimes n}\right)=n!H_n\left(X\left(h\right)\right)$, where ${\mathfrak{H}}^{\odot n}$ is the symmetric tensor product. It is well known that any square integrable random variable $F\in L^2(\Omega ,\mathfrak{F},\mathbb{P})$ ($\mathfrak{F}$ denotes the $\sigma$-field generated by X) can be expanded into a series of multiple stochastic integrals,

$$F=\sum _{q=0}^{\infty }{I}_q\left(f_q\right),$$

where $f_0=\mathbb{E}\left[F\right]$, the series converges in $L^2$, and the functions $f_q\in {\mathfrak{H}}^{\odot q}$ are uniquely determined by F.

Let $\mathfrak{S}$ be the class of smooth and cylindrical random variables F of the form

$$F=f(X\left({\phi }_1\right),\cdots ,X\left({\phi }_n\right)),$$

(7)

where $n\ge 1$, $f\in {\mathcal{C}}_b^{\infty }\left({\mathbb{R}}^n\right)$ and ${\phi }_i\in \mathfrak{H}$, $i=1,\cdots ,n$. The Malliavin derivative of F with respect to X is the element of $L^2(\Omega ,\mathfrak{H})$ defined by

$$DF=\sum _{i=1}^n{\displaystyle \frac{\partial f}{\partial x_i}}(X\left({\phi }_1\right),\cdots ,X\left({\phi }_n\right)){\phi }_i.$$

(8)

We denote by ${\mathbb{D}}^{l,p}$ the closure of its associated smooth random variable class with respect to the norm

$${\parallel F\parallel }_{l,p}^p={\mathbb{E}\left(\right|F|}^p)+\sum _{k=1}^l\mathbb{E}(\parallel D^{k}F{\parallel }_{{\mathfrak{H}}^{\otimes k}}^p).$$

We denote by $\delta$ the adjoint of the operator D, also called the divergence operator. The domain of $\delta$, denoted by $\mathrm{Dom}\left(\delta \right)$, is an element $u\in {\mathbb{L}}^2(\Omega ;\mathfrak{H})$, such that

$$|\mathbb{E}(<D^{l}F,u{>}_{{\mathfrak{H}}^{\otimes l}}){|\le C(\mathbb{E}\left|F\right|}^2{)}^{1/2}\mathrm{for} \mathrm{all}F\in {\mathbb{D}}^{l,2}.$$

If $u\in \mathrm{Dom}\left(\delta \right)$, then $\delta \left(u\right)$ is the element of $L^2(\Omega )$ defined by the duality relationship,

$$\mathbb{E}\left[F\delta \left(u\right)\right]=\mathbb{E}\left[{\langle DF,u\rangle }_{\mathfrak{H}}\right]\mathrm{for} \mathrm{every}F\in {\mathbb{D}}^{1,2}.$$

Recall that $F\in L^2(\Omega )$ can be expanded as $F=\mathbb{E}\left[F\right]+{\sum }_{q=1}^{\infty }{P}_{q}F$, where $p_q$ is the projection operator $L^2(\Omega )$ to the qth Wiener chaos ${\mathbb{H}}_n$. The operator L is defined through the projection operator $P_q$, $q=0,1,2\dots$, as $L={\sum }_{q=0}^{\infty }-q{P}_q$, and is called the infinitesimal generator of the Ornstein–Uhlenbeck semigroup. The relationship between the operator D, $\delta$, and L is given as follows: $\delta DF=-LF$, i.e., for $F\in L^2(\Omega )$, the statement $F\in \mathrm{Dom}\left(L\right)$ is equivalent to $F\in \mathrm{Dom}\left(\delta D\right)$ (i.e., $F\in {\mathbb{D}}^{1,2}$ and $DF\in \mathrm{Dom}\left(\delta \right)$), and in this case, $\delta DF=-LF$. For any $F\in L^2(\Omega )$, we define the operator $L^{-1}$, which is the pseudo-inverse of L, as $L^{-1}F={\sum }_{q=1}^{\infty }{\displaystyle \frac{1}{q}}{P}_{q}F$. Note that $L^{-1}$ is an operator with values in ${\mathbb{D}}^{2,2}$ and $L{L}^{-1}F=F-\mathbb{E}\left[F\right]$ for all $F\in L^2(\Omega )$.

3. Diffusion Process with Invariant Measures and Main Results

In this section, we will give the construction of a diffusion process with an invariant measure, and present our main results in this paper.

3.1. Diffusion Process with Invariant Measures

In this section, we will briefly describe the construction of a diffusion process with an invariant measure $\mu$ having a density p with respect to the Lebesgue measure (for more details, see [8,10]). Let F be a random variable with a probability measure $\mu$ on $I=(l,u)$ ($-\infty \le l<u\le \infty )$ with a density p, which is continuous, bounded, strictly positive on I, and $\mathbb{E}\left[F^2\right]<\infty$. Let b be a continuous function on I such that there exists $e\in (l,u)$ that satisfies $b\left(x\right)>0$ for $e\in (l,u)$ and $b\left(x\right)<0$ for $e\in (l.u)$. Moreover, the function $bp$ is bounded on I, and

$$\mathbb{E}\left[b\right(F\left)\right]=0.$$

(9)

For $x\in I$, define

$$a\left(x\right)={\displaystyle \frac{2}{p\left(x\right)}}{\int }_l^{x}b\left(y\right)p\left(y\right)dy.$$

(10)

Then, the diffusion coefficient a in (10) is strictly positive for all $x\in (l,u)$, and also satisfies $\mathbb{E}\left[a\right(F\left)\right]<\infty$. Equation (10) implies that, for some $c\in I$,

$$p\left(x\right)a\left(x\right)=p\left(c\right)a\left(c\right)exp\left({\int }_c^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right).$$

(11)

Then, the following SDE:

$$d{X}_t=b\left(X_t\right)dt+\sqrt{a\left(X_t\right)}d{B}_t,$$

(12)

has a unique ergodic Markovian weak solution with the invariant density p. Let ${\mathcal{C}}_0\left(I\right)=\{f:I\to \mathbb{R}|f\mathrm{is} \mathrm{continuous} \mathrm{on}I\mathrm{vanishing} \mathrm{at} \mathrm{the} \mathrm{boundary} \mathrm{of}I\}$. For $f\in {\mathcal{C}}_0\left(I\right)$, define

$$h_f\left(x\right)={\int }_0^x{\tilde{h}}_f\left(y\right)dy,$$

where

$${\tilde{h}}_f\left(x\right)={\displaystyle \frac{2{\int }_l^x(f\left(y\right)-\mathbb{E}\left[f\left(F\right)\right])p\left(y\right)dy}{a\left(x\right)p_F\left(x\right)}}.$$

Then, $h_f$ satisfies Stein’s equation,

$$\begin{array}{ccc}\hfill f\left(x\right)-\mathbb{E}\left[f\right(F\left)\right]& =& b\left(x\right)h_f^{\prime }\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)h_f^{″}\left(x\right)\hfill \\ & =& b\left(x\right){\tilde{h}}_f\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right){\tilde{h}}_f^{\prime }\left(x\right),\hfill \end{array}$$

(13)

where F is a random variable with a probability measure $\mu$ as its law.

3.2. Main Results

Before describing our main result in this paper, we begin with the following simple result, given in Theorem 2.9.1 in [9].

Lemma 1.

Suppose that $F,G\in {\mathbb{D}}^{1,2}$, and let $g:\mathbb{R}\to \mathbb{R}$ be a continuously differentiable with bounded derivative (or when g is only almost everywhere differentiable, one needs G to have an absolutely continuous). Then,

$$\mathbb{E}\left[Fg\left(G\right)\right]=\mathbb{E}\left[F\right]\mathbb{E}\left[g\left(G\right)\right]+\mathbb{E}\left[g^{\prime }\left(G\right){\langle DF,-D{L}^{-1}G\rangle }_{\mathfrak{H}}\right].$$

(14)

Let us set

$$g_{b\left(G\right)}\left(x\right)=\mathbb{E}\left[{\langle -D{L}^{-1}(b\left(G\right)-\mathbb{E}\left[b\left(G\right)\right]),DG\rangle }_{\mathfrak{H}}\right|G=x].$$

(15)

Similarly to the proof of Proposition 3.9 in [3], we will show that $g_{b\left(G\right)}\left(x\right)$ is non-negative almost everywhere with respect to the law of G.

Proposition 1.

Let $G\in {\mathbb{D}}^{1,2}$. Then, we have that $g_{b\left(G\right)}\left(x\right)\ge 0$ for almost everywhere with respect to the law of G; say, $H_G\left(x\right)=\mathbb{P}(G\le x)$.

Proof. 

Let q be a smooth non-negative real function. Define

$$Q\left(x\right)=\left\{\begin{array}{cc}{\int }_{\beta }^{x}q\left(y\right)dy\hfill & ifx\ge \beta \hfill \\ -{\int }_x^{\beta }q\left(y\right)dy\hfill & ifx<\beta ,\hfill \end{array}\right.$$

where $\beta \in \mathbb{R}$ is a constant that satisfies $b\left(x\right)-\mathbb{E}\left[b\right(G\left)\right]>0$ for $\beta \in (l,u)$ and $b\left(x\right)-\mathbb{E}\left[b\right(G\left)\right]<0$ for $\beta \in (l.u)$. Since $Q\left(x\right)\ge 0$ for $x\ge \beta$ and $Q\left(x\right)<0$ for $x<\beta$, we have $\mathbb{E}\left[\right(b\left(G\right)-\mathbb{E}\left[b\right(G\left)\right]\left)Q\right(G\left)\right]\ge 0$. An application of Lemma 14 yields that

$$\begin{array}{ccc}\hfill \mathbb{E}\left[\right(b\left(G\right)-\mathbb{E}\left[b\right(G\left)\right]\left)Q\right(G\left)\right]& =& \mathbb{E}\left[{\langle -D{L}^{-1}(b\left(G\right)-\mathbb{E}\left[b\left(G\right)\right]),DG\rangle }_{\mathfrak{H}}\right]\hfill \\ & =& {\int }_{-\infty }^{\infty }{g}_{b\left(G\right)}\left(x\right)q\left(x\right)d{H}_G\left(x\right)\ge 0.\hfill \end{array}$$

(16)

By an approximation of the function q, we can show that, for all Borel measurable sets $B\in \mathfrak{B}\left(\mathbb{R}\right)$, we have

$${\int }_B{g}_{b\left(G\right)}\left(x\right)q\left(x\right)d{H}_G\left(x\right)\ge 0.$$

This obviously implies that $g_{b\left(G\right)}\left(x\right)\ge 0$ for almost everywhere with respect to the law of G. □

Lemma 2.

If the random variable $g_{b\left(G\right)}\left(G\right)$ is almost surely strictly positive, then the law of G has a density with respect to Lebesgue measure; say, $p_G$.

Proof. 

By a similar argument to the proof of Theorem 3.1 in [4], we have that, for any Borel set $B\in \mathfrak{B}\left(\mathbb{R}\right)$ and any $n\ge 1$,

$$\begin{array}{ccc}& & \mathbb{E}\left[\left(b\left(G\right)\mathbb{E}\left[b\left(G\right)\right]\right){\int }_{-\infty }^G{\mathbf{1}}_{B\cap [-n,n]}\left(x\right)dx\right]\hfill \\ & =& \mathbb{E}\left[\left(b\left(G\right)\mathbb{E}\left[b\left(G\right)\right]\right){\mathbf{1}}_{B\cap [-n,n]}\left(G\right)g_{b\left(G\right)}\left(G\right)\right].\hfill \end{array}$$

(17)

The same argument as for the case of $b\left(G\right)=G$ in the proof of Theorem 3.1 in [4] shows that the law of G has a density. □

An explicit formula for the density is the following statement:

Theorem 2.

Let F be a random variable having the law μ, and let G be a random variable in ${\mathbb{D}}^{1,2}$ with $b\left(G\right)\in {\mathbb{L}}^2(\Omega )$. Assume that the random variable $g_{b\left(G\right)}\left(G\right)$ is almost surely strictly positive, and

$$\parallel b{\tilde{h}}_f{\parallel }_{\infty }\le {C\parallel f\parallel }_{\infty }=\underset{x\in I}{sup}\left|f\left(x\right)\right|<\infty .$$

(18)

In this case, the support of $p_G$, denoted by $supp\left(p_G\right)$, is a closed interval of $\mathbb{R}$ and, for almost all $x\in supp\left(p_G\right)$,

$$p_G\left(x\right)={\displaystyle \frac{p_G\left(\beta \right)g_{b\left(G\right)}\left(\beta \right)}{g_{b\left(G\right)}\left(x\right)}}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{b\left(y\right)-\mathbb{E}\left[b\right(G\left)\right]}{g_{b\left(G\right)}\left(y\right)}}dy\right)$$

(19)

for some $\beta \in supp\left(p_G\right)$.

Proof. 

Obviously, using (11) shows that the function ${\tilde{h}}_f$ can be written as

$$\begin{array}{ccc}\hfill {\tilde{h}}_f\left(x\right)& =& {\displaystyle \frac{2}{p_F\left(\beta \right)a\left(\beta \right)}}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & \times {\int }_l^x(f\left(y\right)-\mathbb{E}\left[f\left(F\right)\right])p_F\left(y\right)dy.\hfill \end{array}$$

(20)

Let us set $H_F\left(x\right)=\mathbb{P}(F\le z)$. If $f\left(x\right)={\mathbf{1}}_{(-\infty ,z]}\left(x\right)$ for $z\in \mathbb{R}$, we write $h_f=h_z$ and ${\tilde{h}}_f={\tilde{h}}_z$. Then, the function ${\tilde{h}}_z$ can be written as

$$\begin{array}{ccc}\hfill {\tilde{h}}_z\left(x\right)& =& {\displaystyle \frac{2}{p_F\left(\beta \right)a\left(\beta \right)}}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & \times \left\{\begin{array}{cc}{H}_F\left(z\right)[1-H_F\left(x\right)]\hfill & ifx\ge z\hfill \\ H_F\left(x\right)[1-H_F\left(z\right)]\hfill & ifx<z.\hfill \end{array}\right.\hfill \end{array}$$

(21)

From (21), it follows that, for $x\ge z$,

$$\begin{array}{ccc}\hfill {\tilde{h}}_z^{\prime }\left(x\right)& =& {\displaystyle \frac{2}{p_F\left(\beta \right)a\left(\beta \right)}}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & \times \left\{\left(-{\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)H_F\left(z\right)[1-H_F\left(x\right)]-p_F\left(x\right)H_F\left(z\right)\right\}.\hfill \end{array}$$

(22)

For $x<z$,

$$\begin{array}{ccc}\hfill {\tilde{h}}_z^{\prime }\left(x\right)& =& {\displaystyle \frac{2}{p_F\left(\beta \right)a\left(\beta \right)}}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & \times \left\{\left(-{\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)H_F\left(x\right)[1-H_F\left(z\right)]+p_F\left(x\right)[1-H_F\left(z\right)]\right\}.\hfill \end{array}$$

(23)

If $f\left(x\right)={\mathbf{1}}_{(-\infty ,z]}\left(x\right)$ for $x\in I$, we take $f_n\in {\mathcal{C}}_0\left(I\right)$ such that $\left\{f_n\right\}$ is an increasing sequence and $f_n\left(x\right)\to f\left(x\right)$ for all $x\in I$. Obviously, by the dominated convergence theorem, we have that, as $n\to \infty$,

$${\tilde{h}}_{f_n}\left(x\right)\to {\tilde{h}}_z\left(x\right)\mathrm{and}{\tilde{h}}_{f_n}^{\prime }\left(x\right)\to {\tilde{h}}_z^{\prime }\left(x\right)\mathrm{for} \mathrm{all}x\in I.$$

(24)

The bound of (18) yields that, for all $n\ge 1$,

$$\parallel b{\tilde{h}}_{f_n}{\parallel }_{\infty }\le C{\parallel f_n\parallel }_{\infty }\le 1.$$

(25)

Combining (11) with the bound in (18), we also obtain, for all $n\ge 1$,

$$\parallel a{\tilde{h}}_{f_n}^{\prime }{\parallel }_{\infty }\le C{\parallel f_n\parallel }_{\infty }\le 1.$$

(26)

From (13), it follows that, for $f_n\in {\mathcal{C}}_0\left(I\right)$,

$$\mathbb{E}\left[f_n\left(G\right)\right]-\mathbb{E}\left[f_n\left(F\right)\right]=\mathbb{E}\left[b\left(G\right){\tilde{h}}_{f_n}\left(G\right)\right]+\mathbb{E}\left[{\displaystyle \frac{1}{2}}a\left(G\right){\tilde{h}}_{f_n}^{\prime }\left(G\right)\right].$$

(27)

Due to the bounds of (25) and (26), the dominated convergence theorem can be applied to (27), which gives the following limit value:

$$\begin{array}{ccc}\hfill \mathbb{P}(G\le z)-\mathbb{P}\left[\right(F\le z)& =& \mathbb{E}\left[(b\left(G\right)-\mathbb{E}\left[b\left(G\right)\right]){\tilde{h}}_z\left(G\right)\right]\hfill \\ & & +\mathbb{E}\left[b\left(G\right)\right]\mathbb{E}\left[\right]{\tilde{h}}_z\left(G\right)]+\mathbb{E}\left[{\displaystyle \frac{1}{2}}a\left(G\right){\tilde{h}}_z^{\prime }\left(G\right)\right].\hfill \end{array}$$

(28)

Applying (14) in Lemma 1 to the first expectation in (28), we obtain that

$$\begin{array}{ccc}\hfill \mathbb{P}(G\le z)-\mathbb{P}\left[\right(F\le z)& =& \mathbb{E}\left[{\langle -D{L}^{-1}(b\left(G\right)-\mathbb{E}\left[b\left(G\right)\right]),DG\rangle }_{\mathfrak{H}}{\tilde{h}}_z^{\prime }\left(G\right)\right]\hfill \\ & & +\mathbb{E}\left[{\displaystyle \frac{1}{2}}a\left(G\right){\tilde{h}}_z^{\prime }\left(G\right)\right]+\mathbb{E}\left[b\left(G\right)\right]\mathbb{E}\left[{\tilde{h}}_z\left(G\right)\right]\hfill \\ & =& \mathbb{E}\left[{\tilde{h}}_z^{\prime }\left(G\right)\mathbb{E}\left[{\langle -D{L}^{-1}(b\left(G\right)-\mathbb{E}\left[b\left(G\right)\right]),DG\rangle }_{\mathfrak{H}}|G\right]\right]\hfill \\ & & +\mathbb{E}\left[{\displaystyle \frac{1}{2}}a\left(G\right){\tilde{h}}_z^{\prime }\left(G\right)\right]+\mathbb{E}\left[b\left(G\right)\right]\mathbb{E}\left[{\tilde{h}}_z\left(G\right)\right].\hfill \end{array}$$

(29)

Differentiating both sides in (29) yields that

$$\begin{array}{ccc}\hfill p_G\left(z\right)-p_F\left(z\right)& =& {\displaystyle \frac{\partial }{\partial z}}{\int }_{-\infty }^{\infty }{\tilde{h}}_z^{\prime }\left(x\right)\left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx\hfill \\ & & +\mathbb{E}\left[b\left(G\right)\right]{\displaystyle \frac{\partial }{\partial z}}{\int }_{-\infty }^{\infty }{\tilde{h}}_z\left(x\right)p_G\left(x\right)dx.\hfill \end{array}$$

(30)

Next, we concentrate on the computations of two integrals in (30). Using (22) and (23) gives that

$${\displaystyle \frac{\partial }{\partial z}}{\int }_{-\infty }^{\infty }{\tilde{h}}_z^{\prime }\left(x\right)\left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx:=J_1\left(z\right)+J_2\left(z\right),$$

where

$$\begin{array}{ccc}\hfill J_1\left(z\right)& =& {\displaystyle \frac{\partial }{\partial z}}{\int }_{-\infty }^z{\tilde{h}}_z^{\prime }\left(x\right)\left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx\hfill \\ \hfill J_2\left(z\right)& =& {\displaystyle \frac{\partial }{\partial z}}{\int }_z^{\infty }{\tilde{h}}_z^{\prime }\left(x\right)\left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx\hfill \end{array}$$

Obviously, we write $J_1\left(z\right)=J_{11}\left(z\right)+J_{12}\left(z\right)$,

$$\begin{array}{ccc}\hfill J_{11}\left(z\right)& =& {\tilde{h}}_z^{\prime }\left(z\right)\left\{g_{b\left(G\right)}\left(z\right)+{\displaystyle \frac{1}{2}}a\left(z\right)\right\}{p}_G\left(z\right),\hfill \\ \hfill J_{12}\left(z\right)& =& {\int }_{-\infty }^z{\displaystyle \frac{\partial }{\partial z}}{\tilde{h}}_z^{\prime }\left(x\right)\left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx.\hfill \end{array}$$

For $J_{12}$, we first differentiate ${\tilde{h}}_z^{\prime }\left(x\right)$ with respect to z. For $x<z$,

$$\begin{array}{ccc}\hfill {\displaystyle \frac{\partial }{\partial z}}{\tilde{h}}_z^{\prime }\left(x\right)& =& {\displaystyle \frac{2}{p_F\left(c\right)a\left(c\right)}}exp\left(-{\int }_c^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & \times \left\{\left({\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)H_F\left(x\right)p_F\left(z\right)-p_F\left(x\right)p_F\left(z\right)\right\}.\hfill \end{array}$$

(31)

By (23) and (31), we obtain

$$\begin{array}{ccc}\hfill J_{11}\left(z\right)& =& {\displaystyle \frac{2}{p_F\left(c\right)a\left(c\right)}}exp\left(-{\int }_c^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & \times \left\{\left(-{\displaystyle \frac{2b\left(z\right)}{a\left(z\right)}}\right)H_F\left(z\right)[1-H_F\left(z\right)]+p_F\left(z\right)[1-H_F\left(z\right)]\right\}\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(z\right)+{\displaystyle \frac{1}{2}}a\left(z\right)\right\}{p}_G\left(z\right),\hfill \end{array}$$

(32)

$$\begin{array}{ccc}\hfill J_{12}\left(z\right)& =& {\displaystyle \frac{2}{p_F\left(c\right)a\left(c\right)}}{\int }_{-\infty }^{z}exp\left(-{\int }_c^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & \times \left\{\left({\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)H_F\left(x\right)p_F\left(z\right)-p_F\left(x\right)p_F\left(z\right)\right\}\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx.\hfill \end{array}$$

(33)

For $x\ge z$,

$$\begin{array}{ccc}\hfill {\displaystyle \frac{\partial }{\partial z}}{\tilde{h}}_z^{\prime }\left(x\right)& =& {\displaystyle \frac{2}{p_F\left(\beta \right)a\left(\beta \right)}}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & \times \left\{\left(-{\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)p_F\left(z\right)[1-H_F\left(x\right)]-p_F\left(x\right)p_F\left(z\right)\right\}.\hfill \end{array}$$

(34)

On the other hand, we write $J_2\left(z\right)=J_{21}\left(z\right)+J_{22}\left(z\right)$, where

$$\begin{array}{ccc}\hfill J_{21}\left(z\right)& =& -{\tilde{h}}_z^{\prime }\left(z\right)\left\{g_{b\left(G\right)}\left(z\right)+{\displaystyle \frac{1}{2}}a\left(z\right)\right\}{p}_G\left(z\right),\hfill \\ \hfill J_{22}\left(z\right)& =& {\int }_z^{\infty }{\displaystyle \frac{\partial }{\partial z}}{\tilde{h}}_z^{\prime }\left(x\right)\left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx.\hfill \end{array}$$

From (33), we have that

$$\begin{array}{ccc}\hfill J_{21}\left(z\right)& =& -{\displaystyle \frac{2}{p_F\left(\beta \right)a\left(\beta \right)}}exp\left(-{\int }_c^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & \times \left\{\left(-{\displaystyle \frac{2b\left(z\right)}{a\left(z\right)}}\right)H_F\left(z\right)[1-H_F\left(z\right)]-p_F\left(z\right)H_F\left(z\right)\right\}\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(z\right)+{\displaystyle \frac{1}{2}}a\left(z\right)\right\}{p}_G\left(z\right),\hfill \end{array}$$

(35)

$$\begin{array}{ccc}\hfill J_{22}\left(z\right)& =& {\displaystyle \frac{2}{p_F\left(\beta \right)a\left(\beta \right)}}{\int }_z^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & \times \left\{\left(-{\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)[1-H_F\left(x\right)]p_F\left(z\right)-p_F\left(x\right)p_F\left(z\right)\right\}\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx.\hfill \end{array}$$

(36)

From (21), the differentiation of the second integral in (30) can be easily calculated as follows:

$$\begin{array}{ccc}& & \mathbb{E}\left[b\left(G\right)\right]{\displaystyle \frac{\partial }{\partial z}}{\int }_{-\infty }^{\infty }{\tilde{h}}_z\left(x\right)p_G\left(x\right)dx\hfill \\ & =& \mathbb{E}\left[b\left(G\right)\right]{\displaystyle \frac{\partial }{\partial z}}{\int }_{-\infty }^z{\tilde{h}}_z\left(x\right)p_G\left(x\right)dx\hfill \\ & & +\mathbb{E}\left[b\left(G\right)\right]{\displaystyle \frac{\partial }{\partial z}}{\int }_z^{\infty }{\tilde{h}}_z\left(x\right)p_G\left(x\right)dx\hfill \\ & =& {\displaystyle \frac{2\mathbb{E}\left[b\right(G\left)\right]}{p_F\left(\beta \right)a\left(\beta \right)}}\{-p_F\left(z\right){\int }_{-\infty }^{z}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)H_F\left(x\right)p_G\left(x\right)dx\hfill \\ & & +(1-H_F\left(z\right))exp\left(-{\int }_{\beta }^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)H_F\left(z\right)p_G\left(z\right)\}\hfill \\ & & +{\displaystyle \frac{2\mathbb{E}\left[b\right(G\left)\right]}{p_F\left(\beta \right)a\left(\beta \right)}}\{p_F\left(z\right){\int }_z^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)(1-H_F\left(x\right))p_G\left(x\right)dx\hfill \\ & & -H_F\left(z\right)exp\left(-{\int }_{\beta }^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)(1-H_F\left(z\right))p_G\left(z\right)\}\hfill \\ & =& {\displaystyle \frac{2p_F\left(z\right)\mathbb{E}\left[b\left(G\right)\right]}{p_F\left(\beta \right)a\left(\beta \right)}}\{-{\int }_{-\infty }^{z}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)H_F\left(x\right)p_G\left(x\right)dx\hfill \\ & & +{\int }_z^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)(1-H_F\left(x\right))p_G\left(x\right)dx\}.\hfill \end{array}$$

(37)

Combining (32), (33) and (35)–(37) yields that, for $z\in \mathbb{R}$,

$$\begin{array}{ccc}\hfill p_G\left(z\right)-p_F\left(z\right)& =& {\displaystyle \frac{2p_F\left(z\right)}{p_F\left(\beta \right)a\left(\beta \right)}}exp\left(-{\int }_{\beta }^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\left\{g_{b\left(G\right)}\left(z\right)+{\displaystyle \frac{1}{2}}a\left(z\right)\right\}{p}_G\left(z\right)\hfill \\ & & +{\displaystyle \frac{2p_F\left(z\right)}{p_F\left(\beta \right)a\left(\beta \right)}}[{\int }_{-\infty }^{z}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\left({\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)H_F\left(x\right)\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx\hfill \\ & & +{\int }_z^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\left(-{\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)[1-H_F\left(x\right)]\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx]\hfill \\ & & -{\displaystyle \frac{2p_F\left(z\right)}{p_F\left(\beta \right)a\left(\beta \right)}}{\int }_{-\infty }^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)p_F\left(x\right)\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx\hfill \\ & & +{\displaystyle \frac{2p_F\left(z\right)\mathbb{E}\left[b\left(G\right)\right]}{p_F\left(\beta \right)a\left(\beta \right)}}\{-{\int }_{-\infty }^{z}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)H_F\left(x\right)p_G\left(x\right)dx\hfill \\ & & +{\int }_z^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)(1-H_F\left(x\right))p_G\left(x\right)dx\}.\hfill \end{array}$$

(38)

Substituting $p_F$ in (11) for $p_F$ in the right-hand side of Equation (38), we obtain

$$\begin{array}{ccc}& & p_G\left(z\right)-p_F\left(z\right)\hfill \\ & =& {\displaystyle \frac{2}{a\left(z\right)}}\left\{g_{b\left(G\right)}\left(z\right)+{\displaystyle \frac{1}{2}}a\left(z\right)\right\}{p}_G\left(z\right)\hfill \\ & & +{\displaystyle \frac{2}{a\left(z\right)}}exp\left({\int }_{\beta }^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)[{\int }_{-\infty }^{z}exp\left(-{\int }_c^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\left({\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)H_F\left(x\right)\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx\hfill \\ & & +{\int }_z^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\left(-{\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)[1-H_F\left(x\right)]\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx]\hfill \\ & & -{\displaystyle \frac{2}{a\left(z\right)}}exp\left({\int }_{\beta }^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right){\int }_{-\infty }^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)p_F\left(x\right)\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx\hfill \\ & & +{\displaystyle \frac{2\mathbb{E}\left[b\right(G\left)\right]}{a\left(z\right)}}exp\left({\int }_{\beta }^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\{-{\int }_{-\infty }^{z}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)H_F\left(x\right)p_G\left(x\right)dx\hfill \\ & & +{\int }_z^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)(1-H_F\left(x\right))p_G\left(x\right)dx\}.\hfill \end{array}$$

(39)

From the formula of $p_F$ in (11) and (39), we obtain that, for some $\beta \in supp\left(p_G\right)$,

$$\begin{array}{ccc}& & -g_{b\left(G\right)}\left(z\right)p_G\left(z\right)\hfill \\ & =& {\displaystyle \frac{p_F\left(\beta \right)a\left(\beta \right)}{2}}exp\left({\int }_{\beta }^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & +exp\left({\int }_{\beta }^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\{{\int }_{-\infty }^{z}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\left({\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)H_F\left(x\right)\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx\hfill \\ & & +{\int }_z^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\left(-{\displaystyle \frac{2b\left(x\right)}{a\left(x\right)}}\right)[1-H_F\left(x\right)]\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx\}\hfill \\ & & -exp\left({\int }_{\beta }^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right){\int }_{-\infty }^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)p_F\left(x\right)\hfill \\ & & \times \left\{g_{b\left(G\right)}\left(x\right)+{\displaystyle \frac{1}{2}}a\left(x\right)\right\}{p}_G\left(x\right)dx\hfill \\ & & +\mathbb{E}\left[b\left(G\right)\right]exp\left({\int }_{\beta }^z{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\{-{\int }_{-\infty }^{z}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)\hfill \\ & & \times H_F\left(x\right)p_G\left(x\right)dx\hfill \\ & & +{\int }_z^{\infty }exp\left(-{\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right)(1-H_F\left(x\right))p_G\left(x\right)dx\}.\hfill \end{array}$$

(40)

Differentiating Equation (40) with respect to z proves that

$$\begin{array}{ccc}\hfill {\displaystyle \frac{\partial }{\partial z}}{g}_{b\left(G\right)}\left(z\right)p_G\left(z\right)& =& {\displaystyle \frac{2b\left(z\right)}{a\left(z\right)}}{g}_{b\left(G\right)}\left(z\right)p_G\left(z\right)\hfill \\ & & -\left({\displaystyle \frac{2b\left(z\right)}{a\left(z\right)}}\right)\left\{g_{b\left(G\right)}\left(z\right)+{\displaystyle \frac{1}{2}}a\left(z\right)\right\}{p}_G\left(z\right)-\mathbb{E}\left[b\left(G\right)\right]p_G\left(z\right)\hfill \\ & =& -(b\left(z\right)-\mathbb{E}\left[b\left(G\right)\right])p_G\left(z\right).\hfill \end{array}$$

(41)

This Equation (41) proves that, for almost all $z\in supp\left(p_G\right)$,

$$g_{b\left(G\right)}\left(z\right)p_G\left(z\right)=-{\int }_{-\infty }^z(b\left(x\right)-\mathbb{E}\left[b\left(G\right)\right])p_G\left(x\right)dx.$$

(42)

From (41) and (42), it follows that, for almost all $z\in supp\left(p_G\right)$,

$${\displaystyle \frac{\frac{d}{dz}\left(g_{b\left(G\right)}\left(z\right)p_G\left(z\right)\right)}{g_{b\left(G\right)}\left(z\right)p_G\left(z\right)}}=-{\displaystyle \frac{b\left(z\right)-\mathbb{E}\left[b\right(G\left)\right]}{g_{b\left(G\right)}\left(z\right)}}$$

(43)

Hence,

$${\displaystyle \frac{d}{dz}}log\left(g_{b\left(G\right)}\left(z\right)p_G\left(z\right)\right)=-{\displaystyle \frac{b\left(z\right)-\mathbb{E}\left[b\right(G\left)\right]}{g_{b\left(G\right)}\left(z\right)}}$$

(44)

By integrating both sides of (44) from $\beta \in supp\left(p_G\right)$ to z, we have

$$log\left(g_{b\left(G\right)}\left(z\right)p_G\left(z\right)\right)=log\left(g_{b\left(G\right)}\left(\beta \right)p_G\left(\beta \right)\right)-{\int }_{\beta }^z{\displaystyle \frac{b\left(x\right)-\mathbb{E}\left[b\right(\left(G\right)\left]\right)]}{g_{b\left(G\right)}\left(x\right)}}dx.$$

(45)

Equation (45) proves that, for almost all $z\in supp\left(p_G\right)$,

$$p_G\left(z\right)={\displaystyle \frac{g_{b\left(G\right)}\left(\beta \right)p_G\left(\beta \right)}{g_{b\left(G\right)}\left(z\right)}}exp\left(-{\int }_{\beta }^z{\displaystyle \frac{b\left(x\right)-\mathbb{E}\left[b\right(G\left)\right]}{g_{b\left(G\right)}\left(x\right)}}dx\right).$$

(46)

□

When a random variable G is general, it is not easy to find an explicit computation of $g_{b\left(G\right)}\left(\left(x\right)\right)$. In particular, when ${〈-D{L}^{-1}(b\left(G\right)-\mathbb{E}\left[b\left(G\right)\right]),DG〉}_{\mathfrak{H}}$ is not measurable with respect to the $\sigma$-field generated by G, there are cases where it is impossible to compute the expectation. Using the above Theorem 2, we derive the explicit form of $g_{b\left(G\right)}\left(x\right)$. The following theorem corresponds to Theorem 2 in [8].

Theorem 3.

A random variable $G\in {\mathbb{D}}^{1,2}$, taking its value on I, has the distribution μ and satisfies that $\mathbb{E}\left[b{\left(G\right)}^2\right]<\infty$ if and only if $\mathbb{E}\left[b\right(G\left)\right]=0$ and

$$g_{b\left(G\right)}\left(x\right)=-{\displaystyle \frac{1}{2}}a\left(x\right)forallx\in I.$$

(47)

Proof. 

Suppose that $\mathbb{E}\left[b\right(G\left)\right]=0$, and Equation (47) holds true. Let $p_F$ be a density of an invariant measure $\mu$ corresponding to a solution of SDE (12). Then, substituting $-{\displaystyle \frac{1}{2}}a\left(x\right)$ in (47) instead of $g_{b\left(G\right)}\left(x\right)$ in (19) gives that

$$\begin{array}{ccc}\hfill p_G\left(x\right)& =& {\displaystyle \frac{p_G\left(\beta \right)g_{b\left(G\right)}\left(\beta \right)}{g_{b\left(G\right)})\left(x\right)}}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{b\left(y\right)}{g_{b\left(G\right)}\left(y\right)}}dy\right)\hfill \\ & =& {\displaystyle \frac{p_G\left(\beta \right)a\left(\beta \right)}{a\left(x\right)}}exp\left({\int }_{\beta }^x{\displaystyle \frac{2b\left(y\right)}{a\left(y\right)}}dy\right).\hfill \end{array}$$

(48)

Combining (11) and (48), we obtain

$$p_G\left(x\right)={\displaystyle \frac{p_G\left(\beta \right)}{p_F\left(\beta \right)}}{p}_F\left(x\right).$$

(49)

This Equation (49) shows that $supp\left(p_G\right)=supp\left(p_F\right)$. Hence, integrating both sides of (49) over $I=(l,u)$ yields that

$${\displaystyle \frac{p_G\left(\beta \right)}{p_F\left(\beta \right)}}=1,$$

which implies that $p_G=p_F$ on I. If $p_G=p_F$ on I, then $\mathbb{E}\left[b\right(G\left)\right]=0$. From (10) and (42), it follows that

$$\begin{array}{ccc}\hfill a\left(x\right)& =& {\displaystyle \frac{2{\int }_l^{x}b\left(y\right)p_F\left(y\right)dy}{p_F\left(x\right)}}\hfill \\ & =& {\displaystyle \frac{2{\int }_l^{x}b\left(y\right)p_G\left(y\right)dy}{p_G\left(x\right)}}\hfill \\ & =& -2g_{b\left(G\right)}\left(z\right),\hfill \end{array}$$

which gives that (47) holds. □

4. Examples

In this section, two examples will be given where invariant measures have the standard Gaussian and uniform distribution.

4.1. The Standard Gaussian Distribution

When $\mu$ is the standard Gaussian distribution, then the coefficients in (13) are given by $a\left(x\right)=2$ and $b\left(x\right)=-x$, and $u=\infty$ and $l=-\infty$. Then, from (21), we have that

$$\begin{array}{ccc}\hfill h_z& =& e^{{\displaystyle \frac{x^2}{2}}}{\int }_{-\infty }^x\left[{\mathbf{1}}_{(-\infty ,z]}\left(y\right)\right)-\Phi \left(z\right)]e^{-x^{2}2}dy\hfill \\ & =& \left\{\begin{array}{cc}\sqrt{2\pi }{e}^{{\displaystyle \frac{x^2}{2}}}\Phi \left(x\right)(1-\Phi \left(z\right))\hfill & ifx\le z\hfill \\ \sqrt{2\pi }{e}^{{\displaystyle \frac{x^2}{2}}}\Phi \left(z\right)(1-\Phi \left(x\right))\hfill & ifx>z,\hfill \end{array}\right.\hfill \end{array}$$

(50)

where $\Phi \left(z\right)=\mathbb{P}(Z\le z)$. From (22), we have that, for $x>z$, taking $\beta =0$,

$$\begin{array}{ccc}\hfill {\tilde{h}}_z^{\prime }\left(x\right)& =& \sqrt{2\pi }x{e}^{{\displaystyle \frac{x^2}{2}}}\Phi \left(z\right)(1-\Phi \left(x\right))\hfill \\ & & -\sqrt{2\pi }{e}^{{\displaystyle \frac{x^2}{2}}}{p}_F\left(x\right)\Phi \left(z\right)\hfill \\ & =& [\sqrt{2\pi }x{e}^{{\displaystyle \frac{x^2}{2}}}(1-\Phi \left(x\right))-1]\Phi \left(z\right),\hfill \end{array}$$

(51)

and for $x<z$,

$$\begin{array}{ccc}\hfill {\tilde{h}}_z^{\prime }\left(x\right)& =& \sqrt{2\pi }x{e}^{{\displaystyle \frac{x^2}{2}}}\Phi \left(x\right)[1-\Phi \left(z\right)]\hfill \\ & & +\sqrt{2\pi }{e}^{{\displaystyle \frac{x^2}{2}}}{p}_F\left(x\right)[1-\Phi \left(z\right)]\hfill \\ & =& [\sqrt{2\pi }x{e}^{{\displaystyle \frac{x^2}{2}}}\Phi \left(x\right)+1][1-\Phi \left(z\right)].\hfill \end{array}$$

(52)

If $G\in {\mathbb{D}}^{1,2}$ and the random variable $g_{-G}\left(G\right)$ is almost surely strictly positive, then the density $p_G$ of G can be obtained, with $\beta =0$, by

$$\begin{array}{ccc}\hfill p_G\left(z\right)& =& {\displaystyle \frac{g_{-G}\left(0\right)p_G\left(0\right)}{g_{-G}\left(z\right)}}exp\left({\int }_0^z{\displaystyle \frac{x}{g_{-G}\left(x\right)}}dx\right)\hfill \\ & =& {\displaystyle \frac{g_G\left(0\right)p_G\left(0\right)}{g_G\left(z\right)}}exp\left(-{\int }_0^z{\displaystyle \frac{x}{g_G\left(x\right)}}dx\right).\hfill \end{array}$$

(53)

Since $\mathbb{E}\left[G\right]=0$, from (42), we see that

$$\begin{array}{ccc}\hfill g_G\left(0\right)p_G\left(0\right)& =& -g_{-G}\left(0\right)p_G\left(0\right)\hfill \\ & =& -{\int }_l^{0}x{p}_G\left(x\right)dx\hfill \\ & =& {\displaystyle \frac{1}{2}}\mathbb{E}\left[\right|G\left|\right].\hfill \end{array}$$

(54)

Substituting (54) into (53), we have

$$\begin{array}{ccc}\hfill p_G\left(z\right)& =& {\displaystyle \frac{\mathbb{E}\left[\right|G\left|\right]}{2g_G\left(z\right)}}exp\left(-{\int }_0^z{\displaystyle \frac{x}{g_G\left(x\right)}}dx\right),\hfill \end{array}$$

which is the density (19) in Theorem 1. If $g_G=\left(z\right)=1$,

$$\begin{array}{ccc}\hfill p_G\left(z\right)& =& {\displaystyle \frac{\mathbb{E}\left[\right|G\left|\right]}{2}}exp\left(-{\int }_0^{z}xdx\right)\hfill \\ & =& {\displaystyle \frac{1}{\sqrt{2\pi }}}exp\left(-{\displaystyle \frac{x^2}{2}}\right),\hfill \end{array}$$

which implies that Theorem 3 holds.

4.2. The Uniform Distribution

When $\mu$ is the uniform distribution, i.e., $F\sim \mathcal{U}\left(\right[0,1\left]\right)$, then the coefficients in (13) are given by

$$a\left(x\right)=x(1-x)\mathrm{and}b\left(x\right)=-\left(x-{\displaystyle \frac{1}{2}}\right)\mathrm{for}x\in (0,1).$$

From (21), we have that

$$\begin{array}{ccc}\hfill {\tilde{h}}_z\left(x\right)& =& {\displaystyle \frac{2}{p_F(1/2)a(1/2)}}exp\left({\int }_{1/2}^x{\displaystyle \frac{(2y-1))}{y(1-y)}}dy\right)\hfill \\ & & \times \left[\right(x\wedge z)-zx]\hfill \\ & =& 8exp\left({\int }_{1/2}^x{\displaystyle \frac{(2y-1))}{y(1-y)}}dy\right)\times [(x\wedge z)-zx]\hfill \\ & =& {\displaystyle \frac{2x}{1-x}}\times \left\{\begin{array}{cc}z(1-x)\hfill & ifx\ge z\hfill \\ x(1-z)\hfill & ifx<z,\hfill \end{array}\right..\hfill \end{array}$$

(55)

Then, the density of G is given by

$$p_G\left(x\right)={\displaystyle \frac{p_G\left(\beta \right)g_{b\left(G\right)}\left(\beta \right)}{g_{b\left(G\right)}\left(x\right)}}exp\left(-{\int }_{\beta }^x{\displaystyle \frac{b\left(y\right)-\mathbb{E}\left[b\right(G\left)\right]}{g_{b\left(G\right)}\left(y\right)}}dy\right).$$

(56)

Taking $\beta =\mathbb{E}\left[G\right]$, then

$$p_G\left(x\right)={\displaystyle \frac{p_G\left(\mathbb{E}\left[G\right]\right)g_{b\left(G\right)}\left(\mathbb{E}\left[G\right]\right)}{g_{b\left(G\right)}\left(x\right)}}exp\left(-{\int }_{\mathbb{E}\left[G\right]}^x{\displaystyle \frac{b\left(y\right)-\mathbb{E}\left[b\right(G\left)\right]}{g_{b\left(G\right)}\left(y\right)}}dy\right).$$

(57)

The relation (42) gives that

$$p_G\left(\mathbb{E}\left[G\right]\right)g_{b\left(G\right)}\left(\mathbb{E}\left[G\right]\right)=-{\displaystyle \frac{1}{2}}\mathbb{E}\left[\right|G-\mathbb{E}\left[G\right]\left|\right].$$

Hence, (57) can be written as

$$\begin{array}{ccc}\hfill p_G\left(x\right)& =& {\displaystyle \frac{\mathbb{E}\left[\right|G-\mathbb{E}\left[G\right]\left|\right]}{-2g_{-G}\left(x\right)}}exp\left({\int }_{\mathbb{E}\left[G\right]}^x{\displaystyle \frac{y-\mathbb{E}\left[G\right]}{g_{-G}\left(y\right)}}dy\right)\hfill \\ & =& {\displaystyle \frac{\mathbb{E}\left[\right|G-\mathbb{E}\left[G\right]\left|\right]}{2g_G\left(x\right)}}exp\left(-{\int }_{\mathbb{E}\left[G\right]}^x{\displaystyle \frac{y-\mathbb{E}\left[G\right]}{g_G\left(y\right)}}dy\right).\hfill \end{array}$$

(58)

Putting $\mathbb{E}\left[G\right]=0$, we know, from (58), that the density $p_G$ is identical to the density in Theorem 1. If $g_G\left(x\right)={\displaystyle \frac{1}{2}}x(1-x)$ for $x\in (0,1)$, a direct computation yields that

$$\begin{array}{ccc}\hfill p_G\left(x\right)& =& {\displaystyle \frac{1}{4x(1-x)}}exp\left(-{\int }_{1/2}^x{\displaystyle \frac{y-\frac{1}{2}}{\frac{1}{2}y(1-y)}}dy\right)\hfill \\ & =& {\displaystyle \frac{1}{4x(1-x)}}exp\left(-{\int }_{1/2}^x\left\{{\displaystyle \frac{-2(1-y)}{y(1-y)}}+{\displaystyle \frac{1}{y(1-y)}}\right\}dy\right)\hfill \\ & =& {\displaystyle \frac{1}{4x(1-x)}}exp\left(logx+log(1-x)+log4\right)\hfill \\ & =& {\mathbf{1}}_{[0,1]}\left(x\right),\hfill \end{array}$$

which implies that Theorem 3 holds true.

5. Conclusions and Future Works

When a random variable F follows an invariant measure $\mu$ that has a density $p_F$, and a random variable $G\in {\mathbb{D}}^{1,2}$ also allows for density $p_G$, this paper find an explicit formula of the density $p_G$ based on the coefficients in the diffusion associated with the density $p_F$. The significant feature of our works is that it shows that the density $p_G$ can be obtained by connecting the diffusion with the invariant measure and the density formula obtained in this paper provides a new and very useful method for solving an existing problem related to an invariant density of diffusions. If $g_{b\left(G\right)}$ is equal to the diffusion coefficient, Theorem 2 in [8] can be easily proven by using our result. A limitation of this study is that it is difficult for our method to directly prove that $g_{b\left(G\right)}>0$.

Future works will be carried out in three directions: (1) Using the results worked in this paper, we plan to derive a density formula associated with an Edgeworth expansion with general terms given in [11]. (2) In the case when G is a random variable belonging to a fixed Wiener chaos, we will obtain a more rigorous formula than the formula obtained in the previous works. (3) We will devise new methods to overcome the limitation of this study mentioned above.