Jump to content

Wiener process

From Wikipedia, the free encyclopedia

Wiener Process
Probability density function
Mean 0
Variance σ2t
A single realization of a one-dimensional Wiener process
A single realization of a three-dimensional Wiener process

In mathematics, the Wiener process (or Brownian motion, due to its historical connection with the physical process of the same name) is a real-valued continuous-time stochastic process named after Norbert Wiener.[1][2] It is one of the best known Lévy processes (càdlàg stochastic processes with stationary independent increments). It occurs frequently in pure and applied mathematics, economics, quantitative finance, evolutionary biology, and physics.

The Wiener process plays an important role in both pure and applied mathematics. In pure mathematics, the Wiener process gave rise to the study of continuous time martingales. It is a key process in terms of which more complicated stochastic processes can be described. As such, it plays a vital role in stochastic calculus, diffusion processes and even potential theory. It is the driving process of Schramm–Loewner evolution. In applied mathematics, the Wiener process is used to represent the integral of a white noise Gaussian process, and so is useful as a model of noise in electronics engineering (see Brownian noise), instrument errors in filtering theory and disturbances in control theory.

The Wiener process has applications throughout the mathematical sciences. In physics, researchers use it to model Brownian motion and other types of diffusion, often through the Fokker–Planck and Langevin equations, which describe how random motion evolves over time. It also underpins the rigorous path integral formulation of quantum mechanics: by the Feynman–Kac formula, one can represent solutions to the Schrödinger equation in terms of the Wiener process.[3] In physical cosmology, it also appears in models of eternal inflation. The Wiener process is prominent in the mathematical theory of finance as well, in particular the Black–Scholes option pricing model.[4]

Definitions

[edit]

Canonical definition

[edit]

The Wiener process W is a real-valued continuous-time stochastic process characterized by the following properties:[5]

  1. W0 = 0 almost surely.
  2. W has independent increments: for every t > 0, the future increments Wt+u−Wt,u>0, are independent of the past values Ws, s < t. Equivalently, for every t > 0 and u≥0, the increment Wt+u−Wt is independent of the sigma-algebra ℱtB=σ(Ws:0≤s≤t).
  3. W has Gaussian increments: for all u,t≥0, Wt+u−Wt∼𝒩(0,u). That is, a time step u results in an increment that is normally distributed with mean 0 and variance u.
  4. W has almost surely continuous paths: Wt is almost surely continuous in t.

That the process has independent increments means that if 0 ≤ s1 < t1 ≤ s2 < t2 then Wt1 − Ws1 and Wt2 − Ws2 are independent random variables, and the similar condition holds for n increments.

The Wiener measure is the probability law of the Wiener process on the space of continuous functions g with g(0) = 0 equipped with the Borel σ-algebra. An integral with respect to the Wiener measure may be called a Wiener integral.

Lévy characterization

[edit]

An alternative characterization of the Wiener process is the so-called Lévy characterization: A continuous (local) martingale W with W0 = 0 is a Wiener process if and only if its quadratic variation is [W, W]t = t (which means that Wt2 − t is a (local) martingale).

Gaussian process characterization

[edit]

The Wiener process can be equivalently defined as a Gaussian process Wt, that is, a stochastic process such that for every set of indices t1,…,tn≥0, the random vector (Wt1,…,Wtn) is multivariate Gaussian, which has continuous paths and such that for all s,t≥0 it holds[6]

E⁡[Wt]=0,Cov(Wt,Ws)=E⁡[WsWt]=min⁡(s,t).

In particular, the law of W on the space of continuous functions (equipped with the Borel σ-algebra) is uniquely determined, which is the Wiener measure.

Wiener representation

[edit]

Wiener (1923) also gave a representation of a Brownian path in terms of a random Fourier series. If ξn are independent Gaussian variables with mean zero and variance one, then Wt=ξ0t+2∑n=1∞ξnsin⁡πntπn and Wt=2∑n=1∞ξnsin⁡((n−12)πt)(n−12)π represent a Brownian motion on [0,1]. This representation can also be obtained using the Karhunen–Loève theorem.

The scaled process cWt/c is a Brownian motion on [0,c].

White noise representation

[edit]

In the physics and engineering literature, Brownian motion is often defined (informally) as

Wt=∫0tξ(s)ds

with the white noise process ξ satisfying for t,s≥0

E⁡[ξ(t)]=0,E⁡[ξ(t)ξ(s)]=δ(t−s),

with the Dirac delta "function" δ. However, as shown below, the paths of the Wiener process have unbounded variation and, thus, are not absolutely continuous, that is, Wt cannot be representated as an integral over a function ξ.

The mathematical formalization of the above defines a Gaussian white noise G (with Lebesgue intensity) as an isometry from the space of square-integrable functions L2(ℝ,ℬ(ℝ)) to the space of centered Gaussian random variables, that is, for f,g∈L2(ℝ) the evaluation G(f) is a Gaussian random variable and

E⁡[G(f)]=0,E⁡[G(f),G(g)]=⟨f,g⟩L2(ℝ).

Such a function G indeed exists. Intuitively (and again informally), the Gaussian white noise can be thought of as G(f)=⟨ξ,f⟩L2(ℝ), which means it is testing ξ against test functions f in the spirit of distribution theory. Using the linearity of ⟨⋅,f⟩ and the properties of ξ yields the properties of G.

This allows to define a pre-Brownian motion as

W~t:=G(1[0,t]),t≥0.

Pre-Brownian motions do not necessarily have continuous paths, but by Kolmogorov's continuity criterion, there exists a modification of W~ that does. Therefore, the Wiener process W can be defined as a pre-Brownian motion that has continuous paths.[7]

Donsker's theorem: Wiener process as a limit of a random walk

[edit]

The Wiener process can be constructed as the scaling limit of a random walk, or other discrete-time stochastic processes with stationary independent increments. This is known as Donsker's theorem. Like the random walk, the Wiener process is recurrent in one or two dimensions (meaning that it returns almost surely to any fixed neighborhood of the origin infinitely often) whereas it is not recurrent in dimensions three and higher (where a multidimensional Wiener process is a process such that its coordinates are independent Wiener processes).[8]

Let ξ1,ξ2,… be i.i.d. random variables with mean 0 and variance 1. For each n, define the constant interpolation of the random walk process

Wn(t)=1n∑1≤k≤⌊nt⌋ξk,t∈[0,1].

This is a random step function. Increments of Wn are independent because the ξk are independent. For large n, Wn(t)−Wn(s) is close to N(0,t−s) by the central limit theorem. Donsker's theorem asserts that as n→∞, Wn approaches a Wiener process.

This characterization explains mathematically the ubiquity of Brownian motion in natural phenomena.[9]

Properties of a one-dimensional Wiener process

[edit]
Five sampled processes, with expected standard deviation in gray

Basic properties

[edit]

fWt(x)=12πte−x2/(2t).

  • The covariance between Wt and Ws (s≤t) is[7]cov⁡(Ws,Wt)=E⁡[WsWt]=s. In particular, the variance is Var⁡(Wt)=t.

corr⁡(Ws,Wt)=cov⁡(Ws,Wt)σWsσWt=sst=st.

  • A useful decomposition for proving martingale properties, also called Brownian increment decomposition, is

Wt=Ws+(Wt−Ws),s≤t.

Covariance and correlation

[edit]

The covariance and correlation between Wt and Ws follow from the definition that non-overlapping increments are independent, of which only the property that they are uncorrelated is used.[10] Suppose that t1≤t2.

cov⁡(Wt1,Wt2)=E⁡[(Wt1−E⁡[Wt1])⋅(Wt2−E⁡[Wt2])]=E⁡[Wt1⋅Wt2].

Substituting Wt2=(Wt2−Wt1)+Wt1 we arrive at: E⁡[Wt1⋅Wt2]=E⁡[Wt1⋅((Wt2−Wt1)+Wt1)]=E⁡[Wt1⋅(Wt2−Wt1)]+E⁡[Wt12].

Since Wt1=Wt1−Wt0 and Wt2−Wt1 are independent, E⁡[Wt1⋅(Wt2−Wt1)]=E⁡[Wt1]⋅E⁡[Wt2−Wt1]=0.

Thus cov⁡(Wt1,Wt2)=E⁡[Wt12]=t1.

A corollary useful for simulation is that we can write, for t1 < t2: Wt2=Wt1+t2−t1⋅Z where Z is an independent standard normal variable.

Infinitesimal generator

[edit]

The infinitesimal generator of Brownian motion is given by[11]

Af(x)=limt→0E⁡[f(Wt+x)]−f(x)t=12f″(x),x∈ℝ,

for all f∈C2(ℝ) that vanish at infinity. This is an almost direct consequence of Itô's formula.

Running maximum

[edit]

The joint distribution of the running maximum

Mt=max0≤s≤tWs

and Wt is[7]

fMt,Wt(m,w)=2(2m−w)t2πte−(2m−w)22t,m≥0,w≤m.

To get the unconditional distribution of fMt, integrate over −∞ < w ≤ m: fMt(m)=∫−∞mfMt,Wt(m,w)dw=∫−∞m2(2m−w)t2πte−(2m−w)22tdw=2πte−m22t,m≥0,

the probability density function of a Half-normal distribution. The expectation[12] is E⁡[Mt]=∫0∞mfMt(m)dm=∫0∞m2πte−m22tdm=2tπ

If at time t the Wiener process has a known value Wt, it is possible to calculate the conditional probability distribution of the maximum in interval [0,t] (cf. Probability distribution of extreme points of a Wiener stochastic process). The cumulative probability distribution function of the maximum value, conditioned by the known value Wt, is: FMWt(m)=Pr⁡(MWt=max0≤s≤tWs≤m∣Wt)= 1− e−2m(m−Wt)t ,  m>max⁡(0,Wt)

Arcsine laws

[edit]

There are multiple (random) quantities T related to Brownian motion that follow the arcsine distribution:

Pr⁡(T≤t)=2πarcsin⁡(t),t∈[0,1].

These statements are referred to as the arcsine laws of Brownian motion.

First arcsine law

[edit]

The amount of time Brownian motion is positive, that is,

T=∫011{Wt>0}dt,

is arcsine-distributed.

Second arcsine law

[edit]

The last time Brownian motion hits zero in the time interval [0,1], that is,

T=sup⁡{t≤1:Wt=0},

is arcsine-distributed.[6]

Third arcsine law

[edit]

The time at which Brownian motion attains its maximum on [0,1], that is,

T=inf⁡{t≤1:Wt=maxs∈[0,1]Ws},

is arcsine-distributed.[7]

Self-similarity

[edit]
A demonstration of Brownian scaling, showing Vt=(1/c)Wct for decreasing c. Note that the average features of the function do not change while zooming in, and note that it zooms in quadratically faster horizontally than vertically.

Brownian scaling

[edit]

For every c > 0 the process Vt=(1/c)Wct is another Wiener process.

Time reversal

[edit]

The process Vt=W1−t−W1 for 0 ≤ t ≤ 1 is distributed like Wt for 0 ≤ t ≤ 1.

Time inversion

[edit]

The process Vt=tW1/t is another Wiener process.

Projective invariance

[edit]

Consider a Wiener process W(t), t∈ℝ, conditioned so that limt→±∞tW(t)=0 (which holds almost surely) and as usual W(0)=0. Then the following are all Wiener processes:[13] W1,s(t)=W(t+s)−W(s),s∈ℝW2,σ(t)=σ−1/2W(σt),σ>0W3(t)=tW(−1/t). Thus the Wiener process is invariant under the projective group PSL(2,R), being invariant under the generators of the group. The action of an element g=[abcd] is Wg(t)=(ct+d)W(at+bct+d)−ctW(ac)−dW(bd), which defines a group action, in the sense that (Wg)h=Wgh.

Conformal invariance in two dimensions

[edit]

Let W be a two-dimensional Wiener process, regarded as a complex-valued process with W0=0∈ℂ. Let D⊂ℂ be an open set containing 0, and τD be associated Markov time: τD=inf⁡{t≥0|Wt∉D}. If f:D→ℂ is a holomorphic function which is not constant, such that f(0)=0, then f(Wt) is a time-changed Wiener process in f(D).[14] More precisely, the process Y is Wiener in D with the Markov time S, where Yt=f(Wσ(t)) S(t)=∫0t|f′(Ws)|2ds σ(t)=S−1(t):t=∫0σ(t)|f′(Ws)|2ds.

Stopping times

[edit]

Hitting time of level sets

[edit]

The first hitting time Ta of the Wiener process of some value a>0, that is,

Ta=inf⁡{t≥0:Wt=a},

is Lévy-distributed, which means it has the Lebesgue density

f(t)=a2πt3exp⁡(−a22t)1[0,∞)(t),t∈ℝ.

In particular, E⁡[Ta]=∞. Moreover, Ta has the same distribution as a2/W12.[7]

Exit time of intervals

[edit]

Let τa be the first exit time of the interval [−a,a]. Its expectation equals

E⁡[τa]=a2,

and its Laplace transform is[7]

E⁡[e−tτa]=1cosh⁡(a2t),t≥0.

Hitting times of two level sets

[edit]

Let a<0<b and Tc=inf⁡{t≥0:Wt=c} be the first hitting time of a value c∈ℝ. Then,[7]

P⁡(Ta<Tb)=bb−a,P⁡(Tb<Ta)=−ab−a.

A class of Brownian martingales

[edit]

If a polynomial p(x, t) satisfies the partial differential equation (∂∂t+12∂2∂x2)p(x,t)=0 then the stochastic process Mt=p(Wt,t) is a martingale.

Example: Wt2−t is a martingale, which shows that the quadratic variation of W on [0, t] is equal to t. It follows that the expected time of first exit of W from (−c, c) is equal to c2.

More generally, for every polynomial p(x, t) the following stochastic process is a martingale: Mt=p(Wt,t)−∫0ta(Ws,s)ds, where a is the polynomial a(x,t)=(∂∂t+12∂2∂x2)p(x,t).

Example: p(x,t)=(x2−t)2, a(x,t)=4x2; the process (Wt2−t)2−4∫0tWs2ds is a martingale, which shows that the quadratic variation of the martingale Wt2−t on [0, t] is equal to 4∫0tWs2ds.

About functions p(xa, t) more general than polynomials, see local martingales.

Properties of sample paths

[edit]

The set of all functions w with the following properties has probability one under the Wiener measure. That is, a path (sample function) of the Wiener process has all these properties almost surely:

Qualitative properties

[edit]
  • For every ε > 0, the function w takes both (strictly) positive and (strictly) negative values on (0, ε).[7]
  • The function w is continuous everywhere, but nowhere differentiable (like the Weierstrass function).[4]
  • For any ϵ>0, w is nowhere (12+ϵ)-Hölder continuous,[6] but it is locally (12−ϵ)-Hölder continuous.[15]
  • Points of local maximum of the function w are a dense countable set;[4] the maximum values are pairwise different; each local maximum is sharp in the following sense: if w has a local maximum at t then lims→t|w(s)−w(t)||s−t|=∞. The same holds for local minima.
  • The function w has no points of local increase, that is, no t > 0 satisfies the following for some ε in (0, t): first, w(s) ≤ w(t) for all s in (t − ε, t), and second, w(s) ≥ w(t) for all s in (t, t + ε). (Local increase is a weaker condition than that w is increasing on (t − ε, t + ε).) The same holds for local decrease.[4]
  • The function w is of unbounded variation on every interval.[7]
  • The quadratic variation of w over [0,t] is t.
  • The set {t≥0:w(t)=0} of Zeros of the function w is perfect (closed and contains no isolated points), is nowhere dense, has Lebesgue measure 0 and has Hausdorff dimension 1/2 (therefore, is uncountable).

While it is not true that a path of Brownian motion is almost surely nowhere 12-Hölder continuous, for a fixed t≥0, it can be asserted that a path is almost surely not 12-Hölder continuous in t.[7]

Quantitative properties

[edit]

lim supt→+∞|w(t)|2tlog⁡log⁡t=1,almost surely.

Local modulus of continuity: lim supε→0+|w(ε)|2εlog⁡log⁡(1/ε)=1,almost surely.

Global modulus of continuity (Lévy): lim supε→0+sup0≤s<t≤1,t−s≤ε|w(s)−w(t)|2εlog⁡(1/ε)=1,almost surely.

The dimension doubling theorems say that the Hausdorff dimension of a set under a Brownian motion doubles almost surely.

Local time

[edit]

The image of the Lebesgue measure on [0, t] under the map w (the pushforward measure) has a density Lt. Thus, ∫0tf(w(s))ds=∫−∞+∞f(x)Lt(x)dx for a wide class of functions f (namely: all continuous functions; all locally integrable functions; all non-negative measurable functions). The density Lt is (more exactly, can and will be chosen to be) continuous. The number Lt(x) is called the local time at x of w on [0, t]. It is strictly positive for all x of the interval (a, b) where a and b are the least and the greatest value of w on [0, t], respectively. (For x outside this interval the local time evidently vanishes.) Treated as a function of two variables x and t, the local time is still continuous. Treated as a function of t (while x is fixed), the local time is a singular function corresponding to a nonatomic measure on the set of zeros of w.

These continuity properties are fairly non-trivial. Consider that the local time can also be defined (as the density of the pushforward measure) for a smooth function. Then, however, the density is discontinuous, unless the given function is monotone. In other words, there is a conflict between good behavior of a function and good behavior of its local time. In this sense, the continuity of the local time of the Wiener process is another manifestation of non-smoothness of the trajectory.

Information rate

[edit]

The information rate of the Wiener process with respect to the squared error distance, i.e. its quadratic rate-distortion function, is given by [16] R(D)=2π2Dln⁡2≈0.29D−1. Therefore, it is impossible to encode {wt}t∈[0,T] using a binary code of less than TR(D) bits and recover it with expected mean squared error less than D. On the other hand, for any ε>0, there exists T large enough and a binary code of no more than 2TR(D) distinct elements such that the expected mean squared error in recovering {wt}t∈[0,T] from this code is at most D−ε.

In many cases, it is impossible to encode the Wiener process without sampling it first. When the Wiener process is sampled at intervals Ts before applying a binary code to represent these samples, the optimal trade-off between code rate R(Ts,D) and expected mean square error D (in estimating the continuous-time Wiener process) follows the parametric representation [17] R(Ts,Dθ)=Ts2∫01log2+[S(φ)−16θ]dφ, Dθ=Ts6+Ts∫01min⁡{S(φ)−16,θ}dφ, where S(φ)=(2sin⁡(πφ/2))−2 and log+[x]=max⁡{0,log⁡(x)}. In particular, Ts/6 is the mean squared error associated only with the sampling operation (without encoding).

d-dimensional Wiener process

[edit]

A Wiener process can be straighforwardly extended to higher dimensions d≥2 as follows.

Definition

[edit]

A process W=(W1,…,Wd) is a d-dimensional Wiener process, if W1,…,Wd are independent one-dimensional Wiener processes.[7]

Lévy characterization

[edit]

Let W=(W1,…,Wd) be an adapted stochastic process. The following are equivalent:[7]

  • W is a d-dimensional Wiener process.
  • W1,…,Wd are continuous local martingales and for i,j∈{1,…,d}, the covariation fulfills ⟨Wi,Wj⟩t=δijt for all t≥0, where δij is the Kronecker delta.

Generator representation

[edit]

The Wiener process can also be defined as the unique continuous Markov process starting in zero almost surely and whose generator is A=12Δ with domain Dom(A)={f∈C2(ℝd):f,∂ij2f∈C0(ℝd)}, where C0(ℝd) denotes the space of continuous functions vanishing at infinity.

In fact, given the above generator A, there exist a unique Feller semigroup (Pt)t≥0, that is, Pt is a Markov kernel with

  1. ∀x∈ℝd:P0(x,⋅)=δx, the Dirac measure at x,
  2. ∀s,t≥0,A∈ℬ(ℝd):Pt+s(x,A)=∫ℝdPt(y,A)Ps(x,dy),
  3. ∀f∈C0(ℝd):Ptf≡∫ℝdf(y)Pt(⋅,dy)∈C0(ℝd),
  4. ∀f∈C0(ℝd):limt→0‖Ptf−f‖L∞(ℝd)=0.


such that

Af=limt→0Ptf−ft,f∈Dom(A).

In this case, for f∈Dom(A), the correspondence is precisely

Ptf(x)=eAtf(x)=∫ℝd1(2πt)d/2exp⁡(−‖x−y‖22t)f(y)dy,x∈ℝd.

At the same time, there exist a unique Markov process W on (ℝ[0,∞),ℬ(ℝ)⊗[0,∞)) starting in zero such that

Pr(Wt+x∈⋅)=Pt(x,⋅),∀t≥0,x∈ℝd,

that is, the transition probabilities of Wt+x are given by Pt(x,⋅). Finally, by Kolmorov's continuity criterion, there exists a modification of W with continuous paths, which is the Wiener process.[7]

Properties of a d-dimensional Wiener process

[edit]

Path properties

[edit]

The following path properties hold almost surely (some of them follow directly from those of the one-dimensional Wiener process):

  • The paths are everywhere continuous, but nowhere differentiable.
  • For any ϵ>0, the paths are nowhere (12+ϵ)-Hölder continuous, but locally (12−ϵ)-Hölder continuous.
  • For d=2, the Wiener process is recurrent, that is, for every Borel set A, if the first hitting time inf⁡{t>0:Wt∈A} is not almost surely infinite, then Pr⁡(Wt∈A for infinitely many t>0)=1. In particular, the Wiener process returns arbitrarily close to the origin infinitely often almost surely.[18]
  • For d≥3, every compact set K is transient, that is, the last hitting time sup⁡{t≥0:Wt∈K} is almost surely finite. In particular, the Wiener process returns in a neighborhood of the origin only finitely many times almost surely.[18]

Infinitesimal generator

[edit]

Similarly to the one-dimensional case, the infinitesimal generator of Brownian motion is given by[11]

Af(x)=limt→0E⁡[f(Wt+x)]−f(x)t=12Δf(x),x∈ℝd,

where Δ is the Laplace operator, for all f∈C2(ℝd) that vanish at infinity.

Harmonic measure on the sphere

[edit]

The harmonic measure of Brownian motion on the sphere 𝕊d−1, that is, the distribution of Wτ, where τ=inf⁡{t≥0:Wt∈𝕊d−1} is the first hitting time of the unit sphere, when the process is started in x∈B1(0), is

μx(A)≡Pr⁡(Wτ+x∈A)=∫𝕊d−11A(y)q(x,y)dσ(y),A∈ℬ(ℝd),

where σ is the surface measure and

q(x,y)=1σ(𝕊d−1)1−‖x‖2‖x−y‖d,x∈B1(0),y∈𝕊d−1,

is the Poisson kernel for the unit ball.[18]

Occupation time formula

[edit]

Let D⊂ℝd be an open, bounded set and τDx=inf⁡{t≥0:Wt+x∈∂D} be the first exit time of Brownian motion, when started in x∈D. Then, the occupation time of a set A∈ℬ(ℝd) is given by

E⁡[∫0τDx1A(Wt+x)dt]=∫ℝd1A(y)G(x,y)dy,

where G is the Green function of the Laplace operator for the domain D, that is, the (distributional) solution of the equation

−ΔG(x,⋅)=δx,  in DG(x,⋅)=0,on ∂D

where δx is the Dirac measure in x. More generally, for a measurable function f that is either non-negative or integrable with respect to G(x,⋅)dλ, it holds[18]

E⁡[∫0τDxf(Wt+x)dt]=∫ℝdf(y)G(x,y)dy.

Representation of harmonic functions

[edit]

Let D⊂ℝd be a bounded open set. Let u be harmonic (Δu=0) in D and continuous in D¯. Then,

u(x)=E⁡[u(WτDx+x)],x∈D¯,

where τDx=inf⁡{t≥0:Wt+x∈Dc} is the first exit time of the Wiener process from D when started in x.[18]

Stopping times

[edit]

Moments of exit times

[edit]

Let D⊂ℝd be a bounded open domain with smooth boundary and let τx=inf⁡{t≥0:Wt+x∈Dc}. Then, for k∈ℕ, the function

uk(x)=E⁡[τxk],x∈D¯,

is the solution to the recursive differential equation

{12Δu1+1=0,k=112Δuk+kuk−1=0,k≥2 on D

with the boundary condition uk=0 on ∂D.[19] In particular, when D is the ball with radius R, then

E⁡[τx]=R2−‖x‖2d.

Distribution of exit time from a ball

[edit]

Let τR=inf⁡{t≥0:Wt∉BR} be the first exit time of Brownian motion from the ball with radius R and centered in the origin. Then[20]

Pr⁡(τR>t)=∑k=1∞ck,dexp⁡(−qk,d22R2t),

where q1,d<q2,d<… are the positive roots of the Bessel function Jd/2−1 and

ck,d=qk,dd/2−22d/2−2Γ(d/2)Jd/2(qk,d)

with the Gamma function Γ. In particular, τR has exponential tails.

Wiener process on Riemannian manifolds

[edit]
The generator of Brownian motion on Riemannian manifolds is 1⁄2 times the Laplace–Beltrami operator. The image above shows Brownian motion on the surface of a 2-sphere.

The Wiener process can be generalized in such a way that it evolves only on a Riemannian manifold M⊂ℝd such as a sphere. This requires the orthogonal projections P(x) onto the tangent space TxM for all x∈M. With this definition, the Wiener process X on M is defined as the solution to the Stratonovich equation dXti=∑j=1dP(x)ij∘dWtj,X0∈M, where W=(W1,…,Wd) is a d-dimensional standard Wiener process. It can be shown that X indeed evolves in M (which would not be case the solution to the same equation with the Stratonovich replaced by the Itô integral). Moreover, the infinitesimal generator of X is one-half the Laplace–Beltrami operator, which is a generalization of the Laplace operator for Riemannian manifolds.[21][22]

The special case of the unit sphere 𝕊d−1 possesses the projection operator P(x)y=y−⟨y,x⟩x,y∈ℝd, which leads to the Stroock representation of spherical Brownian motion[22] Xt=X0+∫0t(δij−XsiXsj)∘dWsj.

Infinite dimensional Wiener process

[edit]

The Wiener process can be generalized to a process taking values in an arbitrary separable Hilbert space (which means it possesses an orthonormal basis), although some technical difficulties arise. The construction of a Hilbert space-valued Wiener process is the starting point for stochastic partial differential equations, which are generalizations of partial differential equations driven by a Wiener process in time.

The definition of the Wiener process on a separable Hilbert space (H,⟨⋅,⋅⟩) requires the notion of a Gaussian random variable on H. Similarly to the d-dimensional case with d>1, a random variable Z with values in (H,ℬ(H)) is Gaussian if for all h∈H the projection ⟨Z,h⟩ is univariate Gaussian. One can show that the law of Z is uniquely determined by its mean m∈H and covariance operator Q (non-negative, symmetric and the series of eigenvalues is summable) via[23]

E⁡[⟨Z,h⟩]=⟨m,h⟩,E⁡[⟨Z−m,g⟩⟨Z−m,h⟩]=⟨g,Qh⟩.

In this case, one writes Z∼𝒩(m,Q).

The condition that the eigenvalues (λk)k∈ℕ of Q fulfill

∑k=1∞|λk|<∞

is called trace-class and excludes, in particular, the identity operator from the definition.

Q-Wiener process

[edit]

Given a non-negative, symmetric, trace-class operator Q, a stochastic process WQ=(WtQ)t≥0 with values in H is a Q-Wiener process if[23][24]

  1. W0Q=0,
  2. WQ has continuous trajectories, i.e., for all ω∈Ω and t≥0 it holds lims→t‖Ws(ω)−Wt(ω)‖=0,
  3. WQ has independent increments, i.e., for all 0≤t1<⋯<tn and n∈ℕ the random variables Wt1Q,Wt2Q−Wt1Q,…,WtnQ−Wtn−1Q are independent,
  4. the increments are centered Gaussian, namely WtQ−WsQ∼𝒩(0,(t−s)Q) for s<t.

Equivalently, the process can be defined as a series expansion of independent one-dimensional Wiener processes (βk)k∈ℕ in the basis (ek)k∈ℕ of eigenvectors of Q via[23]

WtQ=∑k=1∞λkβk(t)ek.

This justifies the need to require Q to be trace-class, since

E⁡[‖WtQ‖2]=t∑k=1∞|λk|,

which would otherwise diverge.

Cylindrical Wiener process

[edit]

The fact that one cannot define a Wiener process on H with covariance operator Q=I (the identity) is unsatisfying. Thus, another approach is required to make sense of

Wt=∑k=1∞βk(t)ek,

for independent one-dimensional Wiener processes (βk)k∈ℕ and an orthonormal basis (ek)k∈ℕ of H. One possibility consists in evaluating the process only in specific "directions" h∈H in space. For a Q-Wiener process WQ with a trace class operator Q (which is a well-defined process on H), the projection onto the direction h is

hWtQ:=⟨WtQ,h⟩.

The family (hWQ)h∈H is a collection of one-dimensional continuous Gaussian processes with

E⁡[hWtQ]=0,∀h∈HE⁡[hWtQgWsQ]=(t∧s)⟨h,Qg⟩,∀h,g∈H.

The above equations still uniquely characterise the process WQ, but it does not require that Q must be trace class anymore. Thus, going all the way back, a collection (hW)h∈H of one-dimensional continuous Gaussian processes is called a cylindrical Wiener process if[24]

E⁡[hWt]=0,∀h∈H,E⁡[hWtgWs]=(t∧s)⟨h,g⟩,∀h,g∈H.

This definition does not define a process W on H with covariance operator Q=I, but the processes hW behave as if they were the projections ⟨W,h⟩ of the process W if it would exist.

It is also possible to define W by embedding it linearly into another Hilbert space (H1,⟨⋅,⋅⟩1), in which the series representation does converge. This can be realised, for example, by taking H1=H, the embedding J:(H,⟨⋅,⋅⟩)→(H,⟨⋅,⋅⟩1) being the identity and

⟨h,g⟩1:=∑k=1∞1k2⟨h,ek⟩⟨g,ek⟩,h,g∈H,

for an orthonormal basis (ek)k∈ℕ of H with respect to ⟨⋅,⋅⟩. In this case,

W~t:=∑k=1∞βk(t)J(ek)

is a well-defined I-Wiener process on H1, since

∑k=1∞⟨ek,Iek⟩1=∑k=1∞1k2<∞,

and it is also called a cylindrical Wiener process on H. Many other pairs of surrogate Hilbert space (H1,⟨⋅,⋅⟩1) and embedding J are possible for this construction.[23]

Once again, W~ is not a process on (H,⟨⋅,⋅⟩) but on (H1,⟨⋅,⋅⟩1), which is either not the space or not the inner product one is interested in. The surrogate Hilbert space (H1,⟨⋅,⋅⟩1) is merely used as a ground on which W~ can be reasonably defined, but due to the injectivity of J, one may think of W~ as the unique representative of W on the space (H1,⟨⋅,⋅⟩1).

[edit]
Wiener processes with drift (blue) and without drift (red)
2D Wiener processes with drift (blue) and without drift (red)

Wiener process with drift

[edit]

The stochastic process defined by Xt=μt+σWt for μ∈ℝ is called a Wiener process with drift μ and infinitesimal variance σ2>0. These processes exhaust continuous Lévy processes, which means that they are the only continuous Lévy processes, as a consequence of the Lévy–Khintchine representation.

Brownian bridge

[edit]
Animation of the path W(t) − λtW(1) as λ increases from 0 to 1: a red Brownian-motion path changes into a blue Brownian bridge that ends at zero, and the shaded band narrows to zero at the right end.
The path W(t) − λtW(1) for λ increasing from 0 to 1: the Wiener process (red) at λ = 0, and at λ = 1 a Brownian bridge (blue), which has the law of W conditioned on W(1) = 0.

Two random processes on the time interval [0, 1] appear, roughly speaking, when conditioning the Wiener process to vanish on both ends of [0,1]. With no further conditioning, the process takes both positive and negative values on [0, 1] and is called Brownian bridge. Conditioned also to stay positive on (0, 1), the process is called Brownian excursion.[25] In both cases a rigorous treatment involves a limiting procedure, since the formula P(A|B) = P(A ∩ B)/P(B) does not apply when P(B) = 0.

Geometric Brownian motion

[edit]

The geometric Brownian motion is defined as

St=eμt−σ2t2+σWt.

It is a stochastic process which is used to model processes that can never take on negative values, such as the value of stocks.

Ornstein–Uhlenbeck process

[edit]

The stochastic process Xt=e−tWe2t is distributed like the Ornstein–Uhlenbeck process with parameters θ=1, μ=0, and σ2=2.

Integrated Brownian motion

[edit]

The time-integral of the Wiener process Wt(−1):=∫0tWsds is called integrated Brownian motion or integrated Wiener process. It arises in many applications and can be shown to have the distribution N(0, t3/3)[26] using Fubini's theorem and the fact that the covariance of the Wiener process is t∧s=min⁡(t,s).[27]

A more general process can be defined by Vf(t)=∫0tf′(s)Wsds=∫0t(f(t)−f(s))dWs. Then, for a>0, Var⁡(Vf(t))=∫0t(f(t)−f(s))2ds, cov⁡(Vf(t+a),Vf(t))=∫0t(f(t+a)−f(s))(f(t)−f(s))ds. In fact, Vf(t) is always a zero mean normal random variable. This allows for simulation of Vf(t+a) given Vf(t) by taking Vf(t+a)=A⋅Vf(t)+B⋅Z where Z is a standard normal variable and A=cov⁡(Vf(t+a),Vf(t))Var⁡(Vf(t)), B2=Var⁡(Vf(t+a))−A2Var⁡(Vf(t)). The case of Vf(t)=Wt(−1) corresponds to f(t)=t. All these results can be seen as direct consequences of the Itô isometry. The n-times-integrated Wiener process is a zero-mean normal variable with variance t2n+1(tnn!)2. This is given by the Cauchy formula for repeated integration.

Process of times to first hitting

[edit]

The time of hitting a single point x > 0 by the Wiener process is a random variable with the Lévy distribution. The family of these random variables (indexed by all positive numbers x) is a left-continuous modification of a Lévy process. The right-continuous modification of this process is given by times of first exit from closed intervals [0, x].[citation needed]

Local time

[edit]

The local time L = (Lxt)x ∈ R, t ≥ 0 of a Brownian motion describes the time that the process spends at the point x. Formally Lx(t)=∫0tδ(x−Ws)ds where δ is the Dirac delta function. The behaviour of the local time is characterized by Ray–Knight theorems.

Brownian martingales

[edit]

A Brownian martingale M is a martingale adapted to the Brownian filtration, that is, the filtration generated by the Wiener process. Examples for Brownian martingale are (Wt2−t)t≥0, the exponential martingale of Brownian motion (eθWt−θ22t)t≥0 or (E⁡[Z∣Wt])t≥0 for some integrable random variable Z.[7]

According to the martingale representation theorem, if M is a Brownian martingale adapted to the augmented Brownian filtration and supt≥0E⁡[Mt2]<∞, then it can be represented as a stochastic integral of some (unique) process h with E⁡[∫0∞hs2ds]<∞ against W:[7]

Mt=M0+∫0thsdWs.

In particular, a Brownian martingale with the above properties always has continuous paths.

Time change

[edit]

Every adapted continuous local martingale M with M0=0 and diverging quadratic variation (⟨M⟩∞=∞) can be expressed as Mt=W⟨M⟩t for all t≥0. In other words, M is a time changed Wiener process. This is known as the Dambis–Dubins–Schwarz theorem.[7]

Example: 2Wt = V(4t) where V is another Wiener process (different from W but distributed like W).

Example. Wt2−t=VA(t) where A(t)=4∫0tWs2ds and V is another Wiener process.

Corollary. (See also Doob's martingale convergence theorems) Let Mt be a continuous martingale, and M∞−=lim inft→∞Mt, M∞+=lim supt→∞Mt.

Then only the following two cases are possible: −∞<M∞−=M∞+<+∞, −∞=M∞−<M∞+=+∞; other cases (such as M∞−=M∞+=+∞,   M∞−<M∞+<+∞ etc.) are of probability 0.

Especially, a nonnegative continuous martingale has a finite limit (as t → ∞) almost surely.

All stated (in this subsection) for martingales holds also for local martingales.

Change of measure

[edit]

A wide class of continuous semimartingales (especially, of diffusion processes) is related to the Wiener process via a combination of time change and change of measure.

Using this fact, the qualitative properties stated above for the Wiener process can be generalized to a wide class of continuous semimartingales.[11][28]

Complex-valued Wiener process

[edit]

The complex-valued Wiener process may be defined as a complex-valued random process of the form Zt=Xt+iYt where Xt and Yt are independent Wiener processes (real-valued). In other words, it is the 2-dimensional Wiener process, where we identify ℝ2 with ℂ.[29]

Self-similarity

[edit]

Brownian scaling, time reversal, time inversion: the same as in the real-valued case.

Rotation invariance: for every complex number c such that |c|=1 the process c⋅Zt is another complex-valued Wiener process.

Time change

[edit]

If f is an entire function then the process f(Zt)−f(0) is a time-changed complex-valued Wiener process.

Example: Zt2=(Xt2−Yt2)+2XtYti=UA(t) where A(t)=4∫0t|Zs|2ds and U is another complex-valued Wiener process.

In contrast to the real-valued case, a complex-valued martingale is generally not a time-changed complex-valued Wiener process. For example, the martingale 2Xt+iYt is not (here Xt and Yt are independent Wiener processes, as before).

Brownian sheet

[edit]

The Brownian sheet is a multiparamateric generalization. The definition varies from authors, some define the Brownian sheet to have specifically a two-dimensional time parameter t while others define it for general dimensions.

See also

[edit]

Notes

[edit]
  1. ↑ Dobrow, Robert (2016). Introduction to Stochastic Processes with R. Wiley. pp. 321–322. Bibcode:2016ispr.book.....D. doi:10.1002/9781118740712. ISBN 9781118740651.
  2. ↑ Wiener, Norbert (1976). Masani, P. R. (ed.). Norbert Wiener: Collected Works with Commentaries. Vol. 1. Cambridge, MA: MIT Press. ISBN 978-0262230704.
  3. ↑ Kleinert, Hagen (2004). Path Integrals in Quantum Mechanics, Statistics, Polymer Physics, and Financial Markets (4th ed.). Singapore: World Scientific. ISBN 981-238-107-4.
  4. 1 2 3 4 Karatzas, Ioannis; Shreve, Steven E. (1998). Brownian Motion and Stochastic Calculus. Graduate Texts in Mathematics. Vol. 113 (2nd ed.). Springer. pp. 103, 108, 110. ISBN 978-0-387-97655-6.
  5. ↑ Durrett, Rick (2019). "Brownian Motion". Probability: Theory and Examples (5th ed.). Cambridge University Press. ISBN 9781108591034.
  6. 1 2 3 4 Klenke, Achim (2020). Probability Theory (3rd ed.). Springer. pp. 524, 526, 529, 531. ISBN 978-3-030-56401-8.
  7. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 Le Gall, Jean-François (2016). Brownian Motion, Martingales, and Stochastic Calculus. Graduate Texts in Mathematics. Vol. 274. Springer. pp. 11–19, 20, 30, 32, 37, 39, 50, 51, 62, 63, 119, 121, 127, 155–161. ISBN 978-3-319-31088-6.
  8. ↑ "Pólya's Random Walk Constants". Wolfram Mathworld.
  9. ↑ Lalley, Steven (2001). "Mathematical Finance 345 Lecture 5: Brownian Motion" (PDF). University of Chicago. Retrieved 2026-03-06.
  10. ↑ Stark, Henry; Woods, John (2002). Probability and Random Processes with Applications to Signal Processing (3rd ed.). New Jersey: Prentice Hall. ISBN 0-13-020071-9.
  11. 1 2 3 Revuz, Daniel; Yor, Marc (1999). Continuous Martingales and Brownian Motion. Grundlehren der mathematischen Wissenschaften. Vol. 293 (3rd ed.). Springer. pp. 286–287. ISBN 978-3-540-64325-8.
  12. ↑ Shreve, Steven E. (2008). Stochastic Calculus for Finance II: Continuous-Time Models. Springer. p. 114. ISBN 978-0-387-40101-0.
  13. ↑ Takenaka, Shigeo (1988). "On pathwise projective invariance of Brownian motion". Proceedings of the Japan Academy, Series A, Mathematical Sciences. 64 (2): 41–44. doi:10.3792/pjaa.64.41.
  14. ↑ Lawler, Greg (2005). Conformally invariant processes in the plane. American Mathematical Society. ISBN 978-0821836774.
  15. ↑ Mörters, Peter; Peres, Yuval; Schramm, Oded; Werner, Wendelin (2010). Brownian motion. Cambridge series in statistical and probabilistic mathematics. Cambridge: Cambridge University Press. p. 18. ISBN 978-0-521-76018-8.
  16. ↑ Berger, Toby (1970). "Information rates of Wiener processes". IEEE Transactions on Information Theory. 16 (2): 134–139. doi:10.1109/TIT.1970.1054423.
  17. ↑ Kipnis, Alon; Goldsmith, Andrea J.; Eldar, Yonina C. (2019). "The distortion-rate function of sampled Wiener processes". IEEE Transactions on Information Theory. 65 (1): 482–499. doi:10.1109/TIT.2018.2869911.
  18. 1 2 3 4 5 Chung, Kai Lai; Walsh, John B. (2005). Markov Processes, Brownian Motion, and Time Symmetry (2nd ed.). Springer. pp. 122–129, 145, 166, 169, 181. ISBN 978-0387-22026-0.
  19. ↑ Kinateder, K.K.J.; McDonald, P.; Miller, D. (1998). "Exit time moments, boundary value problems, and the geometry of domains in Euclidean space". Probability Theory and Related Fields. 111: 469–487.
  20. ↑ Ciesielski, Z.; Taylor, S.J. (1962). "First Passage times and Sojourn Times for Brownian Motion in Space and the Exact Hausdorff Measure of the Sample Path". Transactions of the American Mathematical Society. 103 (3): 434–450.
  21. ↑ Rogers, L.C.G.; Williams, David (2000). Diffusion, Markov Processes, and Martingales. Vol. 2 (2nd ed.). Cambridge University Press. p. 183. ISBN 0521775930.
  22. 1 2 Hsu, Elton P. (2002). Stochastic Analysis on Manifolds. American Mathematical Society. pp. 78–83. ISBN 9780821883884.
  23. 1 2 3 4 Liu, Wei; Röckner, Michael (2015). Stochastic Partial Differential Equations: An Introduction. Springer. pp. 9, 10, 14, 18, 50. ISBN 978-3-319-22353-7.
  24. 1 2 Da Prato, Giuseppe; Zabczyk, Jerzy (2014). Stochastic Equations in Infinite Dimensions (2nd ed.). Cambridge University Press. pp. 81, 84. ISBN 978-1-107-05584-1.
  25. ↑ Vervaat, W. (1979). "A relation between Brownian bridge and Brownian excursion". Annals of Probability. 7 (1): 143–149. doi:10.1214/aop/1176995155. JSTOR 2242845.
  26. ↑ "Interview Questions VII: Integrated Brownian Motion – Quantopia". www.quantopia.net. Retrieved 2017-05-14.
  27. ↑ Forum, "Variance of integrated Wiener process" Archived 2013-12-02 at the Wayback Machine, 2009.
  28. ↑ Doob, J. L. (1953). Stochastic Processes. New York: John Wiley & Sons. ISBN 978-0471218135. {{cite book}}: ISBN / Date incompatibility (help)
  29. ↑ Navarro-moreno, J.; Estudillo-martinez, M.D; Fernandez-alcala, R.M.; Ruiz-molina, J.C. (2009), "Estimation of Improper Complex-Valued Random Signals in Colored Noise by Using the Hilbert Space Theory", IEEE Transactions on Information Theory, 55 (6): 2859–2867, doi:10.1109/TIT.2009.2018329, S2CID 5911584

General references

[edit]
  • Karatzas, Ioannis; Shreve, Steven E. (1998). Brownian Motion and Stochastic Calculus (2nd ed.). Springer. ISBN 978-0-387-97655-6.
  • Klenke, Achim (2020). "Brownian Motion". Probability Theory (3rd ed.). Springer. ISBN 978-3-030-56401-8.
  • Le Gall, Jean-François (2016). Brownian Motion, Martingales, and Stochastic Calculus. Graduate Texts in Mathematics. Vol. 274. Springer. ISBN 978-3-319-31088-6.
  • Revuz, Daniel; Yor, Marc (2005). Continuous Martingales and Brownian Motion. A Series of Comprehensive Studies in Mathematics. Vol. 293 (3rd ed.). Springer. ISBN 978-3-642-08400-3.
[edit]