1. Introduction
Markovian quantum dynamics is very important in the theory of open quantum systems ([
1], Section 3.2). Even if the dynamics is not exactly Markovian, the Markovian approximation usually plays the role of zero-order approximation of some perturbation theory [
2,
3,
4] or the dynamics becomes Markovian after the inclusion of some degrees of freedom of the heat bath into the new system [
5,
6,
7,
8,
9,
10,
11,
12]. Several recent results [
13,
14,
15,
16,
17] also suggest that the dynamics of open quantum systems can become Markovian at long times with very high accuracy under very generic conditions.
There are many distinct approaches to the definition of quantum Markovianity [
18]. Most of them assume at least the Gorini–Kossakowski–Sudarshan–Lindblad (GKSL) equation for density matrix dynamics. Sometimes, only this assumption is included in the definition of quantum Markovianity and its measures [
19,
20,
21]. But even in the classical case, the Markovian master equation for one-time dynamics is not enough for the classical stochastic process to be Markov [
22,
23]. One of the most natural approaches to define the quantum Markov stochastic process in such a way that it generalizes classical Markovian dynamics is to assume that the multi-time correlation functions are defined by regression formulae. Nevertheless, now, quantum non-Markovianity is being actively studied [
24,
25,
26,
27], especially the non-Markovianity of multi-time correlations [
28,
29,
30,
31,
32].
In this work, we consider dynamics with a random Hamiltonian. It can lead to both GKSL and non-GKSL dynamics of the density matrix [
33,
34,
35,
36]. But even for GKSL dynamics, the correlation functions do not satisfy the quantum regression formulae in this case. There are some different examples in the literature with the same property, but dynamics with a random Hamiltonian seems to be very natural from the physical point of view. On the one hand, random Hamiltonians ([
37], Chapters 13–14) and unitary dynamics with random Hamiltonians [
38,
39] have been actively studied. On the other hand, we think that it is little understood from the viewpoint of multi-time correlations for such dynamics.
Despite the fact that the usual regression formulae are not valid in such a case, we show that it is still possible to calculate multi-time correlations explicitly. Namely, we calculate the so-called process tensor, which defines such correlations. Moreover, we represent the process tensor as a product of the process tensor for Markovian dynamics and another tensor, which we call the memory tensor and which characterizes the Markovianity violation for multi-time correlations.
We use the characterization of multi-time correlations of a quantum system in terms of the process tensor, which has become widespread in modern works on open quantum systems [
40,
41,
42]. So, in
Section 2, we introduce all necessary definitions. There are also several different approaches in the physical and mathematical literature to characterizing the multi-time correlations. So, in
Section 2, we briefly discuss their relation to the approach that we use. In
Section 2.1 and
Section 2.2, we specify the process tensors for closed and Markovian dynamics, respectively.
In
Section 3, we consider the model of dynamics with a random Hamiltonian with multiplicative dependence on a classical random variable. We calculate the one-time dynamics in this case. We introduce and calculate the memory tensor for such a model. And we discuss its physical meaning. To illustrate our results, we provide explicit formulae for the Gaussian and Poisson cases in
Section 3.1 and
Section 3.2, respectively.
In
Section 4, we discuss a more complicated model. We consider the model from
Section 3 as a free dynamics. And we perturbate it with a deterministic interaction Hamiltonian. We do not assume that the interaction Hamiltonian commutes with the free Hamiltonian or satisfies some simple commutation relation with it. So, for such a general case, it seems hard to obtain some non-perturbative formulae. But we develop systematic asymptotic expansions for one-time dynamics and the memory tensor.
In Conclusions, we summarize our results and discuss possible directions of further study.
2. Process Tensor and Regression Formulae
We consider only finite-dimensional matrices and maps throughout the work. We refer to linear maps between finite-dimensional matrices as super-operators. We also assume that the readers know the basic definitions from open quantum systems theory, quantum information theory and related areas of science such as density matrices and positive and completely positive maps (see, e.g., [
43]). But let us recall the definition of a quantum instrument, because we will need some generalizations of it in our work.
Definition 1. Let X be a finite set (of outcomes). Then, the function from X to completely positive, trace non-increasing maps is called an instrument ifis a trace-preserving map. From the point of view of quantum information theory, a completely positive, trace-preserving map is usually called a quantum channel ([
43], Section 6.3).
Definition 2. Let with elements , , such that . We call a vector of measurement times. Let be instruments, . Let us define a k-time factorized instrument aswhere . Despite the fact that the definitions of the vector of measurement times and the k-time factorized instrument are not couples, we combine them in one definition. We do so due to the fact that from the physical point of view the k-time factorized instrument is interpreted as an independent application of instruments to the quantum system at times , forming the vector of measurement times.
Similarly to [
41], let us introduce the following definition.
Definition 3. A linear map from the set of all -time factorized instruments with fixed to the matrices of the system is called a k-time process tensor ifis a density matrix for any -time factorized instrument . From the physical point of view, this density matrix is interpreted as a final state of the system at the time , when we have applied instruments non-selectively to the quantum system at times , . If we do not need to specify k explicitly, we will write just “multi-time factorized instrument” and “process tensor”.
Sometimes ([
40], Section V.D), the term “process tensor” is used for a linear function from the set of all
k-time (in contrast to
-time in the definition below) factorized instruments to the segment
. In the present notation, such a function has the form
where
is a
-time factorized instrument and
is a
k-time factorized instrument. From the physical point of view, this function gives a probability that we have obtained outcomes
as a result of applying instrument
to the quantum system at time
,
.
Usually, the process tensor depends on the vector of measurement times as a parameter, so we will write to emphasize this dependence.
Until recently, it has been common in the physics literature ([
1], Section 3.2.4) to define time-ordered correlation functions of von Neumann observables instead of process tensors. If, in Formula (
1), instead of instruments one formally (which is possible due to the linearity of
) sets
where
and
are Hermitian operators (von Neumann observables), then the time-ordered correlation functions can be defined as
where the left-hand side is written in usual physical notation ([
1], Section 3.2.4). By
for arbitrary (not necessarily Hermitian) matrices
, hereinafter we will denote a super-operator, which acts on a matrix
M as
.
Let us note that due to the fact that (
2) are not instruments, the operational meaning of such correlation functions is not so direct and it differs from its classical analogs. Nevertheless, it is possible to represent super-operator
as a linear combination of instruments ([
18], Section 3.5.2). Thus, the tensor product of them, which defines (
2), can also be represented as a linear combination of multi-time factorized instruments. But it is not a multi-time factorized instrument itself. So, from the physical point of view, the measurement procedure behind (
3) assumes time-correlated measurement rather than separate instruments at the specified times. And this fact is a bit hidden in the usual physical notation
of multi-time correlation functions. Actually, multi-time correlation functions are usually measured by some interference setups, which are indeed not just sequences of separated measurements. Such setups are usual for spectroscopy [
44,
45] or for measurements based on homodyne detection [
46] such as quantum tomography [
47,
48], which is still actively being developed [
49,
50].
If the process tensors are given for all possible sets of times, this fact can be considered as a possible definition of the quantum stochastic process in the sense of [
51]. But let us remark that, more widely used, the mathematical literature definition [
52] of a quantum stochastic process includes more information than the process tensor. The “gap” between these definitions is discussed, e.g., in [
53]. This “gap” occurs due to the fact that Formula (
3) does not allow one to calculate out-of-time-ordered correlation functions, but these functions have attracted much attention of researchers and, in particular, the regression formulae for them have been studied [
54].
We will not dwell further on the definition of quantum stochastic processes and will consider only the process tensors.
Let us remark that we consider finite sets of outcomes and finite-dimensional spaces in this work only for simplicity. The notion of instrument can be generalized to infinite sets of outcomes (but the set of outcomes should have a structure of a measurable set) and for infinite-dimensional Hilbert spaces ([
53], Section 4.1.1). This allows one to generalize Definitions 2 and 3 as well. If one considers only instruments for discrete observables, such a generalization is quite straightforward. But for continuous observables, there are known issues with the mathematical theory of their repeated measurements ([
53], Section 4.1.5).
The main idea of such issues can be caught from the following non-rigorous consideration. Let one measure a coordinate of the system, obtaining some fixed result, and want to measure momentum just after that. Then, the “distribution” of possible momenta, after the first measurement is done, is homogeneous on the whole real axis. But such “distributions” do not fit the usual (Kolmogorov) probability theory, as they are not
-additive. There are several approaches [
55,
56] to deal with such issues, but we will not dwell on these directions further, restricting overselves to the finite-dimensional case with a finite set of outcomes.
2.1. Regression Formulae for Closed Dynamics
For unitary dynamics of closed quantum systems, it is usually assumed that
where
is a
-time factorized instrument and
where
is a solution of the Cauchy problem
Usually, outside of open quantum systems theory, Formula (
4) is not written explicitly, but it is equivalent to the assumption that at the left-hand side of Equation (
3)
are just dynamics of von Neumann observables in the Heisenberg representation and the symbol
means just the average with respect to the initial density matrix
. That is why no significant discussion usually occurs when defining multi-time correlation functions for closed systems.
Let us remark that Equation (
4) can be used not only directly but also for multi-time generalization of the concept of decoherence-free subspaces [
57,
58,
59]. We can do so because, informally speaking, decoherence-free subspaces are such subspaces on which dynamics is effectively unitary. But to formalize it in our setup, we need to formulate this concept in terms of instruments instead of density matrices.
Definition 4. A linear subspace is called a support of instrument if it is a union over all density matrices ρ and over all of supports of matrices From the physical point of view, it is a union of supports of matrices, which can be “prepared” by the instrument from some density matrix .
Definition 5. A linear subspace is called a support of k-time factorized instrument (1) if it is a union of supports of the instruments . So, from the physical point of view, we “prepare” a state with such a support at least at one of the measurement times (but not necessarily all of them).
Definition 6. A linear subspace is called a decoherence-free subspace under -time factorized instruments if for any -time factorized instrument with support the process tensor can be computed by Formula (4) for some of the form (5). The usual definition ([
59], Defintion 1) of a decoherence-free space occurs for 0-time factorized instruments with a given support, which from the physical point of view are just all possible “preparations” of the initial states with a given support from an arbitrary state.
2.2. Regression Formulae for Markovian Dynamics
For general Markovian dynamics, the process tensor takes the form ([
40], Section D)
where
and
has the (possibly time-dependent) GKSL form [
60,
61]
where
. Formula (
6) generalizes Formula (
4) for closed dynamics. In physics, the formulae for correlation functions (
3) defined by process tensors (
6) are usually called regression formulae (or generalized regression formulae, using the term “regression formulae” only for the case
or
with a trivial instrument at time
), so we use this term for (
4) and (
6) as well.
For general quantum dynamics, if the one-time dynamics of the density matrix is given by
such that
is invertible, then one can define
If the super-operator
is completely positive, then dynamics is called CP-divisible ([
26], Definition 5.1).
satisfies the propagator property
for
, which is not necessarily true for
. In such a general case, we will use Formula (
6) as the definition of the Markovian process tensor
.
Formula (
6), informally speaking, means that multi-time dynamics is fully characterized by one-time dynamics. In particular, if each instrument
in the tensor (
6) has a support included in decoherence-free subspace in the usual sense, then
is reduced to some unitary maps
on such a support. Hence, the whole tensor (
6) reduces to the tensor of the form (
4) for a
-time factorized instrument
with such a support. Thus, in the Markovian case (
6), the usual decoherence-free subspaces are also decoherence-free subspaces under
-time factorized instruments for any
. And, in particular, these spaces are fully defined by the properties of generator (
7). But this is not necessarily the case for non-Markovian process tensors. This is important due to the fact that in many experimental setups [
44,
45] the quantum coherence is measured via multi-time correlation functions. So, we should remark that it can be related to quantum coherence in terms of density matrix dynamics only in the Makovian case.
In our calculation, we will rewrite Formula (
4) in another form. To do it, we will use Definition 1 from [
62], so let us recall it in the following form.
Definition 7. Let us define the contraction map as a linear map such that for any super-operators , …, one has Lemma 1. Let be defined by Equation (6). Then,where Proof. Using Definition 7 of the contraction map, we represent Equation (
6) in the form
Thus, using the definitions of
and
, we obtain (
10). □
We will see that Formula (
10) is useful for explicit calculations.
3. Dynamics with Random Hamiltonian
We consider finite-dimensional random unitary dynamics with a time-dependent Hamiltonian of the following form:
where
is a real random variable and
B is a Hermitian
complex matrix.
Let us define
as a solution to the Cauchy problem
or more explicitly as
Proposition 1. Let us define the averaged propagator aswhere is the mathematical expectation and is defined by (11). Then,where h is the characteristic function of the random variable ξ. The function of the super-operator is defined in terms of the spectral decomposition. Proof. As
B is Hermitian, then it can be represented in terms of the spectral decomposition ([
43], p. 18)
where
are the eigenvalues of matrix
B and
are orthogonal projectors (
,
) to eigenspaces correspondent to these eigenvalues. For any
, using
, we have
where the sum with respect to
runs over all the differences of the eigenvalues of
B. Such differences are usually called Bohr frequencies (see, e.g., [
63], p. 122) and they are nothing else but eigenvalues of the super-operator
. Thus, we have
where
As for any
,
and as
is self-adjoint with respect to the Hilbert–Schmidt scalar product
of matrices
A and
B, then
are the eigenprojectors of the super-operator
. Then, we have
where the function of the super-operator
is defined in terms of the spectral decomposition. So, we have obtained Equation (
13). □
If we assume that the initial condition
is deterministic, then the density matrix averaged by a random variable
has the form
with
defined by (
12). Then, using (
8) and (
9), we immediately obtain the following proposition.
Proposition 2. Let, in addition, h be continuously differentiable. Then,where If one assumes such a physical setup that only observations averaged with respect to a random variable
are accessible for given experimental capabilities (or only such averages are interesting for some other reasons), then, similarly to (
4) and (
14), it is natural to define the process tensor as
where
is defined by (
5) and (
11).
Let us remark that (
14) and (
18) can be represented in a more usual open quantum systems form by changing
to the partial trace with respect to a reservoir Hilbert space,
to the multiplication operator in a reservoir Hilbert space and
to
, where
is a diagonal density matrix.
The Markovian process tensor
is defined by Formula (
6), i.e.,
where
is defined by Formula (
15).
In the next theorem, we will also need to introduce
where
, i.e.,
acts as
B in the
j-th tensor multiplicand and as
I in all other tensor multiplicands.
Theorem 1. Let be defined by (18), with defined by (11), where ξ is a real random variable with the characteristic function such that . And let be defined by (6), where is defined by Formula (15). Then,where , which we call a memory tensor, is defined by Here, the function is defined in terms of the spectral decomposition.
Proof. Using Lemma 1, one can rewrite Formula (
18) as
where
Then,
where the function is defined in terms of the spectral decomposition, which can be justified similarly to the proof of Proposition 1.
Similarly, by Lemma 1, Formula (
19) takes the form
where
Then, using Formula (
22), we have
Thus, taking into account Formulae (
23) and (
25), we obtain (
21). □
To clarify Formula (
22), let us write it for
and
explicitly. For
, Formula (
22) takes the form
So, for
, it is trivial. For
, Formula (
22) takes the form
Let us remark that to calculate quantum multi-time correlations, we only need to use (
23) along with (
24), but we represented
in terms of the Markovian process tensor
and the memory tensor
. This is because we think it is natural to consider non-Markovian dynamics against the background of Markovian dynamics because the Markovian assumption about correlation functions is usually implicitly embedded in many physical setups. In particular, for Markovian dynamics, the memory tensor is trivial
.
Formula (
21) can also be interpreted as follows. The dynamics of multi-time correlations could be considered Markovian, but the sequence of the measurements is not factorized, which is described by the memory tensor
. It can be considered as transformation into a “Markovian picture”, in a certain sense analogous to the transformation from a Shroedinger picture to a Heisenberg picture.
Moreover, for
, the memory tensor
is invertible, so due to the linearity of the process tensor, one can rewrite (
21) as
From the physical point of view, it could be interpreted as the fact that the non-Markovian dynamics described by the process tensor
is seen for the observer to be a Markovian one if the observer performs some time-correlated measurements described by
but thinks that they are uncorrelated. And let us remark that, as we have discussed in
Section 2, even the measurement procedure for the usual correlation function is actually time-correlated, so time-correlated instruments can occur in physics quite naturally.
Of course, a deeper study of the physical realizability of such series of measurements described by or by should be performed to justify their physical meaning. But even at the present level, our results suggest that as other things in quantum theory the Markovianity should be considered not as a property of the system only, but rather as some observer-dependent property of the system.
Let us also remark that, similarly to Equations (
16) and (
17), one could write differential equations for
where
, with the initial conditions
It can be considered as muti-time generalization of quantum master equations.
To illustrate our results, let us consider some special cases.
3.1. Gaussian Case
Let us assume that the random variable
has the standard normal distribution, i.e., with
and
. Then, we have
Equation (
13) takes the form
and Equation (
15) takes the form
Let us remark that, in particular, this is an explicit example showing that in general it can be .
Equation (
17) for the generator takes the form
In particular, for any monotonically non-decreasing function
,
is a time-dependent GKSL generator (
7) with
and
, where
. Let us remark that if this is not the case, then
is still invertible but not
-divisible. It differs from some widely used physical models ([
1], Section 10.1) for which
-divisiblity becomes broken exactly by non-invertibility of
.
From the physical point of view, the most important cases are
The first case leads to time-independent GKSL dynamics, despite the fact that the initial random Hamiltonian depends non-trivially on time. Applications of such generators can be found, e.g., in [
64]. The second case for
leads to Gaussian decay of the off-diagonal elements of the density matrix, which occurs in physical applications ([
65], p. 14) but is usually explained by non-trivial environment spectral density. But our approach explaining it by a random Hamiltonian seems to be even more natural. And it predicts that the difference between our explanation and the one mentioned occurs in multi-time correlations, which can be tested experimentally.
Using Equation (
26), the memory tensor for
takes the form
So, it is an explicit non-trivial example with .
For
, multi-time master Equations (
27) and (
28) take the form
3.2. Poisson Case
Let us now assume that the random variable
has the Poisson distribution with
. Then, we have
Equation (
13) takes the form
and Equation (
15) takes the form
Equation (
17) for the generator takes the form
In particular, for the special case
, it takes the form
Thus, for
, the generator
has GKSL form (
7) with
and
. This condition is satisfied, e.g., for
and
.
Using Equation (
26), the memory tensor for
takes the form
For
, multi-time master Equations (
27) and (
28) take the form
5. Conclusions
In this work, we have introduced the memory tensor, which characterizes multi-time correlations in quantum systems against Markovian ones. In Theorem 1, we have calculated it explicitly for a simple model with a random Hamiltonian, with multiplicative dependence on a random variable. In Theorem 2, we have calculated it perturbatively for a model with a random free Hamiltonian and a deterministic interaction Hamiltonian. But we think that the introduced concepts and developed approaches can be used in a much broader context.
First of all, the concept of the memory tensor itself can be applied to other quantum problems and is not restricted to these specific models. Its interpretation in
Section 3 in terms of transformation into the “Markovian picture” is also general.
The analytical approach based on characteristic functions can be directly generalized for an arbitrary commutative random Hamiltonian. And it seems to be generalizable for more complex situations, when the randomness is quantum and is described by non-commuting reservoir variables in the Hamiltonian, but the system variables in the Hamiltonian are still commuting with each other. In such a case, the characteristic functions of quantum observables ([
43], Section 12.3.1) will occur.
Despite the fact that the explicit perturbative formulae in Theorem 2 are a bit sophisticated, the trick which was used in its proof allows one to calculate the process tensor perturbatively, similarly to the perturbative calculation of one-time dynamics.
For several physical models [
31,
32], in a usual open quantum system setup it is shown that only for flat spectral densities the regression formulae are satisfied, i.e., the memory is trivial. Thus, when one assumes corrections to weak coupling limit GKSL equations (e.g., Redfield without secular approximation, next-order time-convolutionless cumulant corrections, etc.), it automatically leads to a non-trivial memory tensor. The results of [
14,
16] suggest that under conditions of sufficiently fast decaying heat bath correlation functions, the memory tensor becomes constant after bath correlation time in a usual weak coupling limit setup. So, the systematic perturbative calculation of the memory tensor in the weak coupling limit setup is one of natural directions for further study.
We think that the multi-time master Equations (
27) and (
28) introduced in
Section 2.2 can be interesting for perturbative expansions based on cumulant expansions [
2,
3,
4] or on effective generators [
66,
67,
68,
69]. Namely, the perturbative derivation of such master equations in the setup of
Section 4 can be considered as a resummation of the asymptotic series from Theorem 2. And analogous multi-time master equations can be useful in the usual weak coupling limit setup in open quantum systems theory to derive corrections to regression formulae, e.g., their renormalization in the Bogolubov–van Hove limit [
14,
16,
70].
Let us remark that similarly to the specific model considered in this work, one can assume that the reservoir spectral density has a random parameter and experimentally we have only access to the averaged measurements on the systems. Then, even in the weak coupling limit, one can obtain a non-trivial memory tensor by averaging weak coupling limit Markovian dynamics. Similarly, it is natural to assume that only averaged reservoir spectral density is experimentally observable. In particular, the same experimentally observable reservoir spectral density can be obtained by a deterministic random variable leading to a trivial memory tensor in the weak coupling limit and many other ones with non-trivial memory tensors.
A similar thing can be done for the multi-bath setup for which usually the calculation of the heat flows is interesting [
71,
72,
73]. One can introduce a random parameter in such a way that the average heat flows will be the same for its different distributions, but this difference can be detected only by multi-time correlations of heat flows.