Lie Group Statistics and Lie Group Machine Learning Based on Souriau Lie Groups Thermodynamics & Koszul-Souriau-Fisher Metric: New Entropy Definition as Generalized Casimir Invariant Function in Coadjoint Representation

Abstract

In 1969, Jean-Marie Souriau introduced a “Lie Groups Thermodynamics” in Statistical Mechanics in the framework of Geometric Mechanics. This Souriau’s model considers the statistical mechanics of dynamic systems in their “space of evolution” associated to a homogeneous symplectic manifold by a Lagrange 2-form, and defines in case of non null cohomology (non equivariance of the coadjoint action on the moment map with appearance of an additional cocyle) a Gibbs density (of maximum entropy) that is covariant under the action of dynamic groups of physics (e.g., Galileo’s group in classical physics). Souriau Lie Group Thermodynamics was also addressed 30 years after Souriau by R.F. Streater in the framework of Quantum Physics by Information Geometry for some Lie algebras, but only in the case of null cohomology. Souriau method could then be applied on Lie groups to define a covariant maximum entropy density by Kirillov representation theory. We will illustrate this method for homogeneous Siegel domains and more especially for Poincaré unit disk by considering SU(1,1) group coadjoint orbit and by using its Souriau’s moment map. For this case, the coadjoint action on moment map is equivariant. For non-null cohomology, we give the case of Lie group SE(2). Finally, we will propose a new geometric definition of Entropy that could be built as a generalized Casimir invariant function in coadjoint representation, and Massieu characteristic function, dual of Entropy by Legendre transform, as a generalized Casimir invariant function in adjoint representation, where Souriau cocycle is a measure of the lack of equivariance of the moment mapping.

  La thèse de Kirillov, parue en 1962, a suscité immédiatement beaucoup d’intérêt…En outre, quantité de notions naturelles concernant les représentations s’interprètent géométriquement en terme d’orbites coadjointes: restriction à un sous-groupe, induction unitaire, produit tensoriel, mesure de Plancherel, la topologie de l’ensemble représentations unitaires irréductibles… Kirillov s’est vite convaincu, et il a convaincu la communauté mathématique que cette « méthode des orbites » devait être applicable à des groupes bien plus généraux que les groupes nilpotents. Il n’a pas hésité à aborder le cas des groupes de Lie connexes quelconques. Evidemment, des difficultés considérables ont surgi immédiatement. Néanmoins, Kirillov a indiqué une voie d’accès, qui ensuite a été largement utilisée.

- Jacques Dixmier, Brèves remarques sur l’œuvre de A.A. Kirillov

  On comprend ainsi comment Lagrange a pu développer les lois de la Mécanique des systèmes formés de solides sans s’occuper des variations de la température de ces corps et Fourier traiter des variations de la température de ces mêmes corps solides sans s’occuper de leur mouvement; comment on peut étudier le mouvement de la Terre, assimilée à un solide rigide, sans se préoccuper de la température de cet astre et étudier le refroidissement du globe terrestre sans se préoccuper de son mouvement. Une telle indépendance entre les problèmes qui ressortissent à la Mécanique et les problèmes qui ressortissent à la Théorie de la chaleur n’existe plus lorsque les systèmes auxquels on a affaire ne sont plus des systèmes classiques; si, par exemple, au lieu de regarder la Terre comme un solide rigide, d’état invariable, on tient compte des changements de volume, de forme, d’état physique et chimique qui accompagnent son refroidissement, on ne peut plus séparer le problème du mouvement de la Terre et le problème du refroidissement terrestre. … On sait que cette forme de relations supplémentaires avait été introduite par Newton et les géomètres du XVIIIème siècle dans la théorie du son. Ces considérations montrent que les questions qui ressortissent à la Thermodynamique ont dû solliciter l’attention des physiciens dès qu’on a voulu aborder l’étude des systèmes autres que des systèmes classiques; et, en fait, c’est la théorie de la propagation du son dans l’air qui a provoqué Laplace à créer la Thermodynamique.

- P. Duhem, L’intégrale des forces vives en thermodynamique, JMPA 4:5-19, 1898 [1,2,3,4]

  Sous cette aspiration, la physique qui était d’abord une science des “agents” doit devenir une science des “milieux”. C’est en s’adressant à des milieux nouveaux que l’on peut espérer pousser la diversification et l’analyse des phénomènes jusqu’à en provoquer la géométrisation fine et complexe, vraiment intrinsèque…Sans doute, la réalité ne nous a pas encore livré tous ses modèles, mais nous savons déjà qu’elle ne peut en posséder un plus grand nombre que celui qui lui est assigné par la théorie mathématique des groupes

- Gaston Bachelard, Etude sur l’Evolution d’un problème de Physique –La propagation thermique dans les solides, 1928

1. Introduction

The previous French quotes by the Mathematician Jacques Dixmier, the Physicist Pierre Duhem, and the Philosopher Gaston Bachelard are important to introduce the epistemological context of models that will be developed in the paper. Jacques Diximer refers to Alexander Kirillov seminal idea of coadjoint orbits method to consider Lie group representation model. Pierre Duhem makes comments to the origin of the gap between the theory of heat and the theory of Mechanics. Finally, Gaston Bachelard make prediction that new Thermodynamics foundations will be given by groups. We will try in this paper, to prove that these ideas could be reconciled by the Souriau model of Lie groups Thermodynamics through the mathematical structure of Lie algebra cohomology.

After a the state of the art and trends in Machine Learning based on Information Geometry, we will present, in this introduction, the main objective of this paper to jointly apply models from geometric statistical mechanics and tools from Information geometry to solve “Gauss density” definition problem for statistics on Lie groups and homogeneous manifolds. We will also present use-cases motivation for Lie group machine learning illustrating for Doppler statistics analysis with SU(1,1) statistics, and for kinematics data analysis with SE(2) statistics.

1.1. State of the Art and Trends in Machine Learning Based on Information Geometry

The classical simple gradient descent used in Deep Learning has two drawbacks: the use of the same non-adaptive learning rate for all parameter components, and a non-invariance with respect to parameter re-encoding inducing different learning rates. As the parameter space of multilayer networks forms a Riemannian space equipped with Fisher information metric, instead of the usual gradient descent method, the natural gradient or Riemannian gradient method, which takes account of the geometric structure of the Riemannian space, is more effective for learning. The natural gradient preserves this invariance to be insensitive to the characteristic scale of each parameter direction. The Fisher metric defines a Riemannian metric as the Hessian of two dual potential functions (the Entropy and the log-partition function). Yann Ollivier and Gaétan Marceau-Caron provided in 2016 [5] the first experimental results on non-synthetic data sets for the quasi-diagonal Riemannian Natural gradient descents for neural networks introduced previously by Yann Ollivier in [6] (MNIST, SVHN, and FACE data sets). The quasi-diagonal Riemannian algorithms consistently beat simple stochastic gradient gradient descents by a varying margin. The computational overhead with respect to simple backpropagation is around a factor 2, and reach their final performance quickly, thus requiring fewer training epochs and a smaller total computation time. The main goal of natural gradient is to obtain invariance properties, such as, for a neural network, insensitivity of the training algorithm to whether a logistic or tanh activation function is used, or insensitivity to simple changes of variables in the parameters, such as scaling some parameters. In 2017, same authors have introduced the resulting natural Langevin dynamics [7] combining the advantages of natural gradient descent and Fisher-preconditioned Langevin dynamics for large neural networks, validated on MNIST with Fisher matrix preconditioning. With all invariance properties of natural gradient, this Langevin Dynamics avoids overfitting as a regularization method, and replaces classical methods based on a controlled amount of noise to stochastic gradient descents, that ensures convergence to the Bayesian posterior on model parameters. The theoretically optimal covariance of the noise is the inverse Fisher metric, and Y. Ollivier and G. Marceau-Caron have shown how to implement this in practice with neural networks using efficient Fisher metric approximations. In 2017, Yann Ollivier has also introduced TANGO algorithm (True Asymptotic Natural Gradient Optimization) [8], which converges to a true natural gradient descent in the limit of small learning rates, without explicit Fisher matrix estimation, and where in large dimension, small learning rates will be required to approximate the natural gradient well. Y. Ollivier has also shown that it is possible to get arbitrarily close to exact natural gradient descent with a lightweight algorithm. About natural gradient for Deep Learning, we can refer to [9,10]. This year, Shun-ichi Amari [11] has given an elementary geometrical proof that any target function is realized in a sufficiently small neighborhood of any randomly connected deep network, provided the width (the number of neurons in a layer) is sufficiently large.

In this paper, we will introduce how to extend these approaches for data as elements of Lie groups or data lying on a homogeneous manifold where a Lie group acts transitively. This extension is considered in the framework and interconnexion of Souriau “Lie groups Thermodynamics”, Information Geometry and Kirillov representation theory [12] to define probability densities for Lie groups, as Souriau covariant Gibbs densities (density of Maximum of Entropy). We will develop this case for the matrix Lie group SU(1,1) (case with null cohomology) through the computation of Souriau’s moment map, and Kirillov’s orbit method. We will also develop the method for SE(2) Lie group (case with non-null cohomology) where a Souriau cocycle should be taken into account due to the defect of equivariance of the coadjoint action on the moment map.

Supervised learning approaches are based on neural networks whose parameters are estimated by natural gradient algorithms. Non-supervised algorithm are based on clustering by using technics called “k-means” or “Mean-shift” using distance between elements of the dataset. In both cases, if we want to extend these approaches for Lie groups dataset, we have to extend the notion of Gaussian densities and distance between elements. We propose to use Geometric Statistical Model coming from Geometric Statistical Mechanics to introduce “Gauss density” of Lie group elements. Jointly, we can associate a natural distance between these Lie group elements on the Symplectic manifold by means of KKS 2-form, introducing a natural Riemannian metric associated to Fisher Metric from Information Geometry. The objective of this paper is to explain how to use Geometric Statistical Mechanics tools in this context.

1.2. Objectives of this Paper

The purpose of this article is multiple. The work of Professor Jean-Marie Souriau is well known in the field of “Geometric Mechanics” of which he is one of the founders with his book “structure of dynamic systems” published in 1969, and in which he introduced the foundations of Symplectic Geometry. Inside this book, chapter IV dealing with the extension of Geometric Mechanics to Statistical Mechanics, has been little read or misunderstood by this community. We have discovered that this model was part of and generalized another discipline, which is called Information Geometry. We have demonstrated in other previous articles that one could generalize Fisher metric (invariant metric used in Information Geometry) for Lie groups, with this model. It is therefore a question of rehabilitating the work of Jean-Marie Souriau in a broader framework, which concerns statistics and machine learning extended to objects considered as elements of a Lie group or a homogeneous manifold.

The second goal is to solve with these new tools problems that were still unsolved in statistics and machine learning. These unresolved problems concern the definition and calculation of the expression of probability densities, playing the role of Gaussian density, for elements of a Lie group or elements of homogeneous manifolds. In this article, we completely solve the problem for 2 Lie groups very useful in machine learning but also in physics, the Lie groups SU(1,1) and SE(2). The calculation is not a simple application of the Souriau model, because it is necessary to establish the “moment map” associated with these groups and define a Laplace transform on their coadjoint orbits of these groups (action of the group on the dual space of Lie algebra). In a second step, we must use Information Geometry to write these covariant Gibbs densities in the correct parametrization which parametrizes the generalized Gaussian law from statistical moments on the homogeneous symplectic manifold associated with coadjoint orbits. In the case SU(1,1), which corresponds to a case of null cohomology (equivariance of the coadjoint operator on the moment application), as the homogeneous symplectic manifold to the coadjoint orbit is the Poincaré unit disk, we solve jointly, an open problem to define mathematically the notion of Gaussian density in this disk in hyperbolic geometry. With the property that this density is by construction invariant under the action of the group SU(1,1), which is the condition sine qua none to preserve the symmetries and the invariance of the associated Fisher metric. We show that this model achieves a breakthrough in machine learning, because we have a Gibbs density and a Fisher metric invariant by change of parametrization and invariant under the action of symmetries. Gibbs density allows us to extend the classical supervised statistical machine learning algorithms, and Fisher metric allows us to adress unsupervised learning problem as k-means problems in metric space. The model opens the way to machine learning for Lie groups with multiple applications in robotics, sensor signal processing, image processing.

In the last part of the article, based on this model, we give a new “geometric” definition of Entropy by showing that Entropy is an invariant Casimir function in coadjoint representation. The Casimir functions have been widely studied within the framework of Poisson structures and manifolds [13,14,15,16]. This characterization of Entropy is new, because previously Entropy was defined axiomatically. Using this Casimir function property, we show that it is possible to use full geometric approaches to construct the Entropy function only from the structure coefficients of the Lie group associated with the symmetries involved. We show that we can also introduce an Euler-Poincaré equation and its stochastic variant to study other open problems in statistics and thermodynamics. The application of this Casimir characterization, which is demonstrated in this article, are developed in another twin article published in the same special issue with François Gay-Balmaz [17].

1.3. Motivation of Lie Group Machine Learning with Use-Cases

Machine learning is a field of study of artificial intelligence, which is based on statistical approaches to give computers the ability to “learn” from data, that is, to classify data from observations in a supervised or non-supervised way. Machine learning generally has two phases. The first consists in estimating a model from data, called observations. This so-called “training” phase is generally carried out before the practical use of the model. The second phase corresponds to the start of production: the model being determined, new data can then be classified. According to the information available during the learning phase, learning is qualified in different ways. If the data is labeled (that is, the task response is known for that data), it is supervised learning. We speak of classification if the labels are discrete, or of regression if they are continuous. In the most general case, without a label, we seek to determine the underlying structure of the data (which can be a probability density) and it is then unsupervised learning. Machine learning can be applied to different types of data, such as graphs, trees, curves, or more simply feature vectors, which can be continuous or discrete. We propose to extend the approach, when datasets are element of matrix lie groups.

Learning algorithms can be categorized according to their learning mode. For supervised learning, the classes are predetermined and the examples known, and then the system learns to classify according to a classification model. An expert must label examples beforehand. The process takes place in two phases. For unsupervised learning, when the system or operator has only examples, but no label, and the number of classes and their nature have not been predetermined, we speak of unsupervised learning or clustering. No expert is required. The algorithm must discover for itself the more or less hidden structure of the data, by data partitioning and data clustering. The system must cluster the data according to their available attributes, to classify them into homogeneous groups of examples. Similarity is generally calculated according to a distance function between pairs of examples.

We will illustrate two problems of Machine Learning on Lie groups coming from Radar Industry. Target recognition on Radar micro-Doppler data could be modeled by a problem of classification of dataset considered as elements of SU(1,1) Lie group (see Figure 1). Radar complex time series of micro-Doppler observation of data are classically processed on sliding time window to estimate their associated covariance matrices that are characterized by a Toeplitz Hermitian Positive-definitiveness structure. Using a well-known Verblunsky/Trench Theorem, we can parametrize all Toeplitz Hermitian Positive Definite Covariance matrices of stationary Radar Time series in a product space with a real positive axis (for signal power) and a Poincaré polydisk (for Doppler Spectrum shape). If we consider the Poincaré Unit Disk as an homogeneous space where SU(1,1) Lie group acts transitively. Each data in Poincaré unit disk of this polydisk could be then coded by SU(1,1) matrix Lie group element. We have transformed the problem into a statistical learning challenge processing data of SU(1,1) matrix Lie group. Another exemple considers flying object recognition on their kinematics coded in SE(2) or SE(3) Lie Groups. 3D (or 2D) trajectories could be coded by SE(3) (or SE(2)) Lie group time series provided through Invariant Extended Kalman Filter (IEKF) Radar Tracker, that locally estimates displacement of Frenet-Seret frame. Object kinematics will be then coded by time series of SE(3) (or SE(2)) matrix Lie groups characterizing local rotation/translation of Frenet frame along the drone 3D (or 2D) trajectory. Statistics of this SE(3) (or SE(2)) Lie group elements will characterize flight mechanics of different kinds of object (birds, drones, …).

SU(1,1) or SE(2) are also fundamental tools in Image Processing (Sub-Riemannian Geometry of vision with SE(2)), in robotics (rigid bodies statistical analysis with SE(2)), in Natural Langage Processing (methods of graph-embedding in Poincaré disk with SU(1,1)), …. For instance, SU(1,1) Lie group which acts on Poincaré unit Disk is highly studied to embed isometrically a graph in an hyperbolic space. It is used by GAFAM (Google, Facebook, …) for Natural Language Processing by reducing graph analysis to a Machine Learning problem in Hyperbolic Poincaré Unit Disk. Hyperbolic Neural network [18] have been developed in this framework. SU(1,1) Lie group is also fundamental in Quantum physics to describe Coherent states of an electron in a magnetic field for instance [19] and Coherent states in Quantum Optics [20] (some statistical photon-counting aspects of SU(1,1) coherent states are emphasized). SE(2) Lie group is especially fundamental for Geometry of Vision considering sub-Riemannian approaches of the Citti-Petitot-Sarti Model [21] but also also in neuroimagery [22].

1.3.1. SU(1,1) Lie Group Machine Learning for Doppler Data Statistics Analysis

Lie group structure appears naturally on Doppler data, if we consider time series of locally stationary signal and their associated covariance matrix. Covariance matrix is Toeplitz Hermitian Positive Definite. Based on Theorem due to Verblunsky [23,24] and Trench [25], we can parametrize Hermitian Positive Definite Matrix in product space involving the Poincaré unit Polydisk:

$$\begin{array}{l}\phi :THDP(n)\to R_{+}^{*}\times D^{n-1}\\ R_n\mapsto \left(P_0,{\mu }_1,\dots ,{\mu }_{n-1}\right)\end{array}$$

(1)

where D is the Poincaré Unit Disk:

$$D=\left\{z=x+iy\in C/\left|z\right|<1\right\}$$

(2)

The Poincaré unit disk is an homogeneous bounded domain where the Lie group SU(1,1) act transitively. This Matrix Group is given by:

$$SU(1,1)=\left\{\left[\begin{array}{cc}a& b\\ b^{*}& a^{*}\end{array}\right]/{\left|a\right|}^2-{\left|b\right|}^2=1,a,b\in C\right\}$$

(3)

where SU(1,1) acts on the Poincaré Unit Disk by:

$$g\in SU(1,1)\Rightarrow g.z=\frac{az+b}{b^{*}z+a}$$

(4)

with Cartan Decomposition of SU(1,1)

$$\begin{array}{l}\left(\begin{array}{cc}a& b\\ b^{*}& a^{*}\end{array}\right)=\left|a\right|\left(\begin{array}{cc}1& z\\ z^{*}& 1\end{array}\right)\left(\begin{array}{cc}a/\left|a\right|& 0\\ 0& a^{*}/\left|a\right|\end{array}\right)\\ \mathrm{with}z=b{\left(a^{*}\right)}^{-1},\left|a\right|={\left(1-{\left|z\right|}^2\right)}^{-1/2}\end{array}$$

(5)

We can observe that $z=b{\left(a^{*}\right)}^{-1}$ could be considered as action of $g\in SU(1,1)$ on the centre on the unit disk $z=g.0=b{\left(a^{*}\right)}^{-1}$. The principal idea is that we can code any point $z=b{\left(a^{*}\right)}^{-1}$ in the unit disk by an element of the Lie group SU(1,1). Main advantage is that the point position is no longer coded by coordinates but intrinsically by transformation from the orogin 0 to this point. Finally, a covariance matrix of a stationary signal could be coded by (n−1) Matrix SU(1,1) Lie group elements:

$$\begin{array}{l}\mathrm{THPD}\to R_{+}^{*}\times D^{n-1}\to R_{+}^{*}\times SU{(1,1)}^{n-1}\\ R_n\mapsto \left(P_0,{\mu }_1,\dots ,{\mu }_{n-1}\right)\mapsto \left(P_0,\left[\begin{array}{cc}{a}_1& b_1\\ b_1^{*}& a_1^{*}\end{array}\right],\dots ,\left[\begin{array}{cc}{a}_{n-1}& b_{n-1}\\ b_{n-1}^{*}& a_{n-1}^{*}\end{array}\right]\right)\end{array}$$

(6)

1.3.2. SE(2) and SE(3) Lie Groups Machine Learning for Kinematics Data Statistics Analysis

When we consider a 3D trajectory of a mobile target, we can describe this curve by a time evolution of the local Frenet-Serret frame (local frame with tangent vector, normal vector and binormal vector) as illustrated in Figure 2. This frame evolution is described by the Frenet-Serret formula that gives the kinematic properties of the target moving along the continuous, differentiable curve in 3D Euclidean space ℝ³. More specifically, the formulas describe the derivatives of the so-called tangent, normal, and binormal unit vectors in terms of each other.

$$\frac{d}{dt}\left(\begin{array}{c}\overrightarrow{t}\\ \overrightarrow{n}\\ \overrightarrow{b}\end{array}\right)=\left[\begin{array}{ccc}0& \kappa & 0\\ -\kappa & 0& \gamma \\ 0& -\gamma & 0\end{array}\right]\left(\begin{array}{c}\overrightarrow{t}\\ \overrightarrow{n}\\ \overrightarrow{b}\end{array}\right)\mathrm{with}\{\begin{array}{l}\kappa :\mathrm{curvature}\\ \gamma :\mathrm{torsion}\end{array}$$

(7)

We will consider motions determined by exponentials of paths in the Lie algebra. Such a motion is determined by a unit speed space-curve $\tau (t)$. Now in a Frenet-Serret motion a point in the moving body moves along the curve and the coordinate frame in the moving body remains aligned with the tangent $\overrightarrow{t}$, normal $\overrightarrow{n}$, and binormal $\overrightarrow{b}$, of the curve. Using the 4-dimensional representation of the Lie group SE(3), the motion can be specified as:

$$G(t)=\left(\begin{array}{cc}R(t)& \tau (t)\\ 0& 1\end{array}\right)\in SE(3)$$

(8)

where $\tau (t)$ is the curve and the rotation matrix $R(t)$ has the unit vectors $\overrightarrow{t}$, $\overrightarrow{n}$, and $\overrightarrow{b}$ as columns:

$$R(t)=\left(\begin{array}{ccc}\overrightarrow{t}& \overrightarrow{n}& \overrightarrow{b}\end{array}\right)\in SO(3)$$

(9)

If we introduce the Darboux vector $\overrightarrow{\omega }=\gamma \overrightarrow{t}+\kappa \overrightarrow{b}$ that we can rewritte from Frenet-Serret Formulas:

$$\frac{d\overrightarrow{t}}{dt}=\overrightarrow{\omega }\times \overrightarrow{t},\frac{d\overrightarrow{n}}{dt}=\overrightarrow{\omega }\times \overrightarrow{n},\frac{d\overrightarrow{b}}{dt}=\overrightarrow{\omega }\times \overrightarrow{b}$$

(10)

Then, we can write with Ω is the 3 × 3 anti-symmetric matrix corresponding to $\overrightarrow{\omega }$:

$$\frac{dR}{dt}=\mathsf{\Omega }R$$

(11)

We note that $\frac{d\tau (t)}{dt}=\overrightarrow{t}$ and $\frac{d\overrightarrow{\omega }}{dt}=\frac{d\gamma }{dt}\overrightarrow{t}+\frac{d\kappa }{dt}\overrightarrow{b}$.

The instantaneous twist of the motion $G(t)$ is given by:

$$S_d=\frac{dG(t)}{dt}{G}^{-1}(t)=\left(\begin{array}{cc}\mathsf{\Omega }& \upsilon \\ 0& 0\end{array}\right)$$

(12)

This is the Lie algebra element corresponding to the tangent vector to the curve $G(t)$. It is well known that elements of the Lie algebra $se(3)$ can be described as lines with a pitch. The fixed axode of a motion $G(t)\in SE(3)$ is given by the axis of $S_d$ as t varies. The instantaneous twist in the moving reference frame is given by $S_b=G^{-1}(t)S_{d}G(t)$, that is, by the adjoint action on the twist in the fixed frame. The instantaneous twist $S_b$ can also be found from the relation:

$$S_b=G^{-1}(t)\frac{dG(t)}{dt}$$

(13)

$$S_b=G^{-1}\frac{dG}{dt}=\left(\begin{array}{cc}{R}^T& -R^T\tau \\ 0& 1\end{array}\right)\left(\begin{array}{cc}\mathsf{\Omega }R& \overrightarrow{t}\\ 0& 0\end{array}\right)=\left(\begin{array}{cc}{R}^T\mathsf{\Omega }R& R\overrightarrow{t}\\ 0& 0\end{array}\right)$$

(14)

We can observe that we could describe a 3D trajectory by a time series of SE(3) Lie group elements:

$$SE(3)=\left\{\left[\begin{array}{cc}R& \tau \\ 0& 1\end{array}\right]/R\in SO(3),\tau \in R^3\right\}$$

(15)

with

$$SO(3)=\left\{R/R^{T}R=R{R}^T=I,{\det }^{2}R=1\right\}$$

(16)

Then, the trajectory will be given by the following time series of SE(3) elements:

$$\left\{\left[\begin{array}{cc}{R}_1& {\tau }_1\\ 0& 1\end{array}\right],\left[\begin{array}{cc}{R}_2& {\tau }_2\\ 0& 1\end{array}\right],\dots ,\left[\begin{array}{cc}{R}_n& {\tau }_n\\ 0& 1\end{array}\right]\right\}\in SE{(3)}^n$$

(17)

2. New Results Introduced in the Paper

The paper is structured in two parts:

-

1st Part on “Gauss Density on Lie groups”: This part is totally new in Machine learning with an extension of “Gauss densities” (defined as Maximum Entropy model) for Lie groups coupling both Souriau model (introduced in statistical physics domain), with Information Geometry in Geometric Machine Learning domain. We illustrate with two use-cases SU(1,1) and SE(2) that are the most useful Lie groups in Image Processing (Sub-Riemannian Geometry of vision with SE(2)), in robotics (rigid bodies statistical analysis with SE(2)), in Natural Langage Processing (SU(1,1) with methods of graph-embedding in Poincaré disk), …. Some tentatives have been developed to define noise on Lie groups by adding additional Gaussian components on elements of the Lie algebra [26,27,28,29], but these models are not mathematically correct because they do not preserve the symmetries and the moment map associated to these symmetries by the Noether Theorem.

-

2nd part on “Entropy definition extension as Casimir Function”: This part gives a new geometric definition of Entropy as invariant Casimir function in coadjoint representation, explaining the invariance of entropy under the affine coadjoint action on moment map in the dual space of Lie algebra. This definition was not in the paper of Souriau. With this new definition, we can compute Entropy only by structure constraints given by the Lie group. It opens the door to new generalization of Maximum Entropy method and first of all computation of “Gaussian densities” for any Lie group. Applications of this new property is not developed in this paper but in a twin paper in the same special issue [17]. We refert to M. Gromov papers to consider more geometric structures of Entropy [30,31].

The main new results of this paper are the introduction of “Gauss density” for Lie groups or data on homogeneous space where a Lie groups acts transitively, and the full computation for SU(1,1) Lie group. This group acts transitively on the Poincaré unit disk, and so we have also solved an open problem related to Gauss density on this homogeneous space. For this purpose, the main approach has considered an extended definition of classical “Gauss density”, as introduced by Jaynes, in term of density of Maximum Entropy. In this way, the initial problem was transfert to a new one related to the good definition of Entropy for Lie groups. To address this problem, first, we have recalled the classical Euclidean case, where the Entropy $S(\eta )$ could be defined as the Legendre transform of minus the log-partition function $\mathsf{\Phi }(\theta )=-\log {\displaystyle \underset{R}{\int }}{e}^{-\langle \theta ,y\rangle }dy$ (defined by Laplace transform) by the following equation $S(\eta )=\langle \theta ,\eta \rangle -\mathsf{\Phi }(\theta )\mathrm{with}{\eta }_i=\frac{\partial \mathsf{\Phi }(\theta )}{\partial {\theta }_i}\mathrm{and}{\theta }_i=\frac{\partial S(\eta )}{\partial {\eta }_i}$. The next step was to explain how to extend the log-partition function for Lie groups. We have then considered the Laplace transform in the framework of Lie group representation theory as introduced by Alexander Kirillov and Geometric Statical Mechanics as modeled by Jean-Marie Souriau. We have preserved the same Legendre structure, and have defined the Entropy $S(Q)$, parametrized on the dual space of the Lie algebra $Q\in {\mathrm{g}}^{*}$ (called geometric heat), as Legendre transform of minus of the log-partition function $\mathsf{\Phi }(\beta )=-\log {\displaystyle \underset{M}{\int }{e}^{-\langle J(\xi ),\beta \rangle }d{\lambda }_{\omega }}$, parametrized on the Lie algebra by $\beta \in \mathrm{g}$ (called geometric Planck Temperature), from a Laplace transform defined on the homogeneous symplectic manifold (associated to the Lie group by the Kirrilov-Kostant-Souriau 2-form called KKS 2-form in the litterature). By introducing the moment map $J:M\to {\mathrm{g}}^{*}$, fundamental tool of representation theory introduced by Souriau, we were able to define the log-partition function on the coadjoint orbit of the Lie group, $\mathsf{\Phi }(\beta )=-\log {\displaystyle \underset{{\mathrm{g}}^{*}}{\int }{e}^{-\langle J(\xi ),\beta \rangle }d{\lambda }_{\omega }}$. The entropy is then given by the Legendre transform $S(Q)=\langle Q,\beta \rangle -\mathsf{\Phi }(\beta )\mathrm{with}Q=\frac{\partial \mathsf{\Phi }(\beta )}{\partial \beta }\in {\mathrm{g}}^{*}\mathrm{and}\beta =\frac{\partial S(Q)}{\partial Q}\in \mathrm{g}$. We have then defined the Gauss density for Lie groups as the density that maximizes this Entropy $S(Q)$ under the constraint of its associated first moment $Q=\frac{\partial \mathsf{\Phi }(\beta )}{\partial \beta }={\displaystyle \underset{M}{\int }J(\xi )p_{Gibbs}(\xi )}d{\lambda }_{\omega }$. The Gauss density is then established by analogy with thermodynamics as the Gibbs density $p_{Gibbs}(\xi )=e^{\mathsf{\Phi }(\beta )-\langle J(\xi ),\beta \rangle }=\frac{e^{-\langle J(\xi ),\beta \rangle }}{{\displaystyle \underset{M}{\int }{e}^{-\langle J(\xi ),\beta \rangle }}d{\lambda }_{\omega }}$. But this is not enough, because this density is not given in the good parametrization. We have proposed to express the Gibbs density with respect to the 1st statistical moment $Q$ (statistical mean of moment map) by inverting the relation $Q=\frac{\partial \mathsf{\Phi }(\beta )}{\partial \beta }=\mathsf{\Theta }\left(\beta \right)$. The Gibbs density $p_{Gibbs,Q}(\xi )=e^{\mathsf{\Phi }(\beta )-\langle J(\xi ),{\mathsf{\Theta }}^{-1}\left(Q\right)\rangle }$ with $\beta ={\mathsf{\Theta }}^{-1}\left(Q\right)$ will provide the extended definition of Gauss density in final good parametrization.

For the time being, no “Gaussian density” was defined on Poincaré unit disk with the mandatory property to be covariant under the action of SU(1,1) Lie group that acts transitively on this homogeneous bounded domain. We have applied the previous model via computation of moment map and developed the full computation of this extended Gauss density for SU(1,1) Lie group, $SU(1,1)=\left\{\left(\begin{array}{cc}a& b\\ b^{*}& a^{*}\end{array}\right)/a,b\in C,{\left|a\right|}^2-{\left|b\right|}^2=1\right\}$ and then deduced as consequence the gauss density for the Poincaré unit disk considered as the homogeneous symplectic manifold associated to the coadjoint orbit of the SU(1,1) Lie group via KKS 2 form. Considering the Lie algebra $su(1,1)=\left\{\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right)/r\in R,\eta \in C\right\}$ and the dual space of the Lie algebra $su{(1,1)}^{*}=\left\{\left(\begin{array}{cc}z& x+iy\\ -x+iy& -z\end{array}\right)/x,y,z\in R\right\}$, we have computed the moment map $J:D\to s{u}^{*}(1,1)$ defined by $J(z).u_i=J_i(z,z^{*})$, that maps $D$ the Poincaré unit disk into a coadjoint orbit in $s{u}^{*}(1,1)$, $J(z)=J_1\left(z,z^{*}\right)u_1^{*}+J_2\left(z,z^{*}\right)u_2^{*}+J_3\left(z,z^{*}\right)u_3^{*}=\rho \left(\begin{array}{cc}\frac{1+{\left|z\right|}^2}{1-{\left|z\right|}^2}& -2\frac{z^{*}}{1-{\left|z\right|}^2}\\ 2\frac{z}{1-{\left|z\right|}^2}& -\frac{1+{\left|z\right|}^2}{1-{\left|z\right|}^2}\end{array}\right)\in {\mathrm{g}}^{*}$ The moment map $J$ is a diffeomorphism of $D$ onto one sheet of the two-sheeted hyperboloid in $s{u}^{*}(1,1)$, determined by the following equation $J_1^2-J_2^2-J_3^2={\rho }^2,J_1\ge \rho \mathrm{with}$ $J_1{u}_1^{*}+J_2{u}_2^{*}+J_3{u}_3^{*}\in s{u}^{*}(1,1)$. But the full SU(1,1) Lie group is not related to any equilibrium Gibbs state (the open subset of the Lie algebra, associated to this Gibbs state is empty). We have then considered one-parameter subgroups of the Lie group $SU\left(1,1\right)$ such that the open subset ${\mathsf{\Lambda }}_{\beta }=\left\{\beta \in \mathrm{g}/{\displaystyle \underset{D}{\int }{e}^{-\langle J(z),\beta \rangle }d\lambda (z)}<+\infty \right\}$ is not empty. In the neighborhood of the identity element, the elements of $g\in SU\left(1,1\right)$ can be written as the exponential of an element $\beta$ of its Lie algebra. If we make the remark that we have the following relation ${\beta }^2=\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right)\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right)=\left({\left|\eta \right|}^2-r^2\right)I$, we can developed the exponential map by a Taylor expansion of the exponential function, which is given by the following relation $g=\exp \left(\epsilon \beta \right)={\displaystyle \sum _{k=0}^{\infty }\frac{{\left(\epsilon \beta \right)}^k}{k!}}=\left(\begin{array}{cc}\cosh \left(\epsilon R\right)+ir\frac{\sinh \left(\epsilon R\right)}{R}& \eta \frac{\sinh \left(\epsilon R\right)}{R}\\ {\eta }^{*}\frac{\sinh \left(\epsilon R\right)}{R}& \cosh \left(\epsilon R\right)-ir\frac{\sinh \left(\epsilon R\right)}{R}\end{array}\right)\mathrm{with}{R}^2={\left|\eta \right|}^2-r^2$.

We can observe that one condition is that ${\left|\eta \right|}^2-r^2>0$ then the subset to consider is given by the subset ${\mathsf{\Lambda }}_{\beta }=\left\{\beta =\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right),r\in R,\eta \in C/{\left|\eta \right|}^2-r^2>0\right\}$ such that ${\displaystyle \underset{D}{\int }{e}^{-\langle J(z),\beta \rangle }d\lambda (z)}<+\infty$. Finally, we have computed the covariant Gibbs density in the unit disk given by $\beta \in {\mathsf{\Lambda }}_{\beta }$ and by the moment map of the Lie group $SU\left(1,1\right)$, that could be expressed in the following equation: $p_{Gibbs}\left(z\right)=\frac{e^{-\langle J\left(z\right),\beta \rangle }}{{\displaystyle \underset{D}{\int }{e}^{-\langle J\left(z\right),\beta \rangle }d\lambda (z)}}==\frac{e^{-\langle \rho \left(\begin{array}{cc}\frac{1+{\left|z\right|}^2}{\left(1-{\left|z\right|}^2\right)}& \frac{-2z^{*}}{\left(1-{\left|z\right|}^2\right)}\\ \frac{2z}{\left(1-{\left|z\right|}^2\right)}& -\frac{1+{\left|z\right|}^2}{\left(1-{\left|z\right|}^2\right)}\end{array}\right),\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right)\rangle }}{{\displaystyle \underset{D}{\int }{e}^{-\langle J\left(z\right),\beta \rangle }d\lambda (z)}}\mathrm{with}d\lambda (z)=2i\rho \frac{dz\wedge d{z}^{*}}{{\left(1-{\left|z\right|}^2\right)}^2}$. To write the final Gibbs density with respect to its statistical moment, we rewrite the density with $Q=E\left[J(z)\right]$, by $\beta ={\mathsf{\Theta }}^{-1}\left(Q\right)\in \mathrm{g}$ where $Q=\frac{\partial \mathsf{\Phi }\left(\beta \right)}{\partial \beta }=\mathsf{\Theta }\left(\beta \right)\in {\mathrm{g}}^{*}$ and $Q=E\left[J(z)\right]=E\left[\rho \left(\begin{array}{cc}\frac{1+{\left|w\right|}^2}{\left(1-{\left|w\right|}^2\right)}& \frac{-2w^{*}}{\left(1-{\left|w\right|}^2\right)}\\ \frac{2w}{\left(1-{\left|w\right|}^2\right)}& -\frac{1+{\left|w\right|}^2}{\left(1-{\left|w\right|}^2\right)}\end{array}\right)\right]$.

To extend this approach for covariant Gibbs density on Siegel Unit Disk $SD=\left\{Z\in M_{pq}\left(C\right)/I_p-Z{Z}^{+}>0\right\}$, that is a classical matrix extension of Poincaré unit Disk, we have proposed to consider $G=SU(p,q)$ unitary group and the homogeneous space $G/K=SU(p,q)/S\left(U(p),U(q)\right)\mathrm{with}K=S\left(U(p)\times U(q)\right)=\left\{\left(\begin{array}{cc}A& 0\\ 0& D\end{array}\right)/A\in U(p),D\in U(q),\det (A)\det (D)=1\right\}$ and the moment map given by $J\left(Z\right)=i\lambda \left(\begin{array}{cc}{\left(I_p-Z{Z}^{+}\right)}^{-1}\left(-pZ{Z}^{+}-q{I}_p\right)& \left(p+q\right)Z{\left(I_q-Z^{+}Z\right)}^{-1}\\ -(p+q){\left(I_q-Z^{+}Z\right)}^{-1}{Z}^{+}& \left(p{I}_q+q{Z}^{+}Z\right){\left(I_q-Z^{+}Z\right)}^{-1}\end{array}\right)$.

After $SU\left(1,1\right)$ Lie group (case with null cohomology), we have considered the same model for $SE(2)$ Lie group with non-null cohomology that needs the use of symplectic one-cocycle to manage the defect of cohomology. We have considered the special Euclidean group $SE(2)=\left\{\left[\begin{array}{cc}{R}_{\phi }& \tau \\ 0& 1\end{array}\right]/R_{\phi }\in SO\left(2\right),\tau \in R^2\right\}$ with $SO(2)=\left\{R_{\phi }=\left[\begin{array}{cc}\cos \phi & -\sin \phi \\ \sin \phi & \cos \phi \end{array}\right]/\phi \in R\right\}$, and the Lie algebra $se\left(2\right)$ of $SE(2)$ $\left(\xi ,u\right)\in se(2)=R\times R^2\Rightarrow \left[\begin{array}{cc}-\xi \Im & u\\ 0& 0\end{array}\right]\in se\left(2\right)$ with $\Im =\left[\begin{array}{cc}0& 1\\ -1& 0\end{array}\right]$, to define the moment map $J_{\left(\xi ,u\right)}(x):R^2\to s{e}^{*}\left(2\right)$ that is given by the expression $J_{\left(\xi ,u\right)}(x)=J(x).\left(\xi ,u\right)$ with $J(x)=-2\left(\frac{1}{2}{\Vert x\Vert }^2,-\Im x\right),x\in R^2$. Then, the Gibbs density is deduced for generalized temperature $\beta \in \mathsf{\Omega }=\left\{\left(b,{\rm B}\right)\in se(2)/b<0,{\rm B}\in R^2\right\}$ by $p_{Gibbs}\left(x\right)=\frac{e^{-\langle J\left(x\right),\beta \rangle }}{{\displaystyle \underset{R^2}{\int }{e}^{-\langle J\left(x\right),\beta \rangle }d\lambda (x)}}=\frac{e^{\frac{1}{2}b{\Vert x\Vert }^2-{\rm B}.\Im x}}{{\displaystyle \underset{R^2}{\int }{e}^{\frac{1}{2}b{\Vert x\Vert }^2-{\rm B}.\Im x}d\lambda (x)}}$, with the log-partition function given by the following expression $\mathsf{\Phi }\left(\beta \right)=\log {\displaystyle \underset{R^2}{\int }{e}^{\frac{1}{2}b{\Vert x\Vert }^2-{\rm B}.\Im x}d\lambda (x)}=\log \left(-\frac{2\pi }{b}{e}^{-\frac{1}{2b}{\Vert B\Vert }^2}\right)$ with $Q=\frac{\partial \mathsf{\Phi }\left(\beta \right)}{\partial \beta }=\left(\frac{1}{b}-\frac{{\Vert {\rm B}\Vert }^2}{2b^2},\frac{1}{b}{\rm B}\right)=\mathsf{\Theta }\left(\beta \right)$ and where $Q\in {\mathsf{\Omega }}^{*}=\left\{\left(m,M\right)\in s{e}^{*}(2)/m+\frac{{\Vert M\Vert }^2}{2}<0\right\}$. To obtain the good parametrization related to statical moments, we have inverted the relation $\beta ={\mathsf{\Theta }}^{-1}\left(Q\right)=\left({\left(m+\frac{1}{2}{\Vert M\Vert }^2\right)}^{-1},{\left(m+\frac{1}{2}{\Vert M\Vert }^2\right)}^{-1}M\right)$, to provide the covariant Gibbs density parametrized by $\left(m,M\right)=E\left(J(x)\right)=E\left[-2\left(\frac{1}{2}{\Vert x\Vert }^2,-\Im x\right)\right]=\left[-E\left({\Vert x\Vert }^2\right),2\Im E(x)\right]$. The final Gauss density for SE(2) is then $p_{Gibbs}\left(x\right)=\frac{e^{\frac{\frac{1}{2}{\Vert x\Vert }^2-M.\Im x}{\left(m+\frac{1}{2}{\Vert M\Vert }^2\right)}}}{{\displaystyle \underset{R^2}{\int }{e}^{\frac{\frac{1}{2}{\Vert x\Vert }^2-M.\Im x}{\left(m+\frac{1}{2}{\Vert M\Vert }^2\right)}}d\lambda (x)}}$.

We conclude the paper by a deeper study of Souriau model structure. We observe that Souriau Entropy $S\left(Q\right)$ defined on coadjoint orbit of the group has a property of invariance $S\left(A{d}_g^{\#}(Q)\right)=S\left(Q\right)$ with respect to Souriau affine definition of coadjoint action $A{d}_g^{\#}(Q)=A{d}_g^{*}(Q)+\theta \left(g\right)$ where $\theta \left(g\right)$ is called the Souriau cocyle. In the framework of Souriau Lie groups Thermodynamics, we can then characterize the Entropy as a generalized Casimir invariant function in coadjoint representation, and Massieu characteristic function (or log-partition function), dual of Entropy by Legendre transform, as a generalized Casimir function in adjoint representation. When M is a Poisson manifold, a function on M is a Casimir function if and only if this function is constant on each symplectic leaf (the non-empty open subsets of the symplectic leaves are the smallest embedded manifolds of M which are Poisson submanifolds) [15]. Classically, the Entropy is defined axiomatically as Shannon or von Neumann Entropies without any geometric structures constraints. In this paper, the Entropy is also presented as solution of the Casimir equation ${\left(a{d}_{\frac{\partial S}{\partial Q}}^{*}Q\right)}_j+\mathsf{\Theta }{\left(\frac{\partial S}{\partial Q}\right)}_j=C_{ij}^{k}a{d}_{{\left(\frac{\partial S}{\partial Q}\right)}^i}^{*}{Q}_k+{\mathsf{\Theta }}_j=0$ with $\tilde{\mathsf{\Theta }}\left(X,Y\right)=\langle \mathsf{\Theta }(X),Y\rangle =J_{\left[X,Y\right]}-\left\{J_X,J_Y\right\}=-\langle d\theta (X),Y\rangle$$,X,Y\in \mathrm{g}$, where $\mathsf{\Theta }(X)=T_e\theta \left(X(e)\right)$ appears in case of non-null cohomology (non-equivariance of coadjoint operator on the moment map), with $\theta \left(g\right)$ the Souriau Symplectic cocycle. The dual space of the Lie algebra foliates into coadjoint orbits that are also the level sets on the entropy. The KKS (Kostant-Kirillov Souriau) 2-form, and the Souriau-Koszul-Fisher metric transform each orbit into a homogeneous Symplectic manifold. The information manifold foliates into level sets of the entropy that could be interpreted in the framework of Thermodynamics by the fact that motion remaining on this complex surfaces is non-dissipative, whereas motion transversal to these surfaces is dissipative, where the dynamic is given by $\frac{dQ}{dt}={\left\{Q,H\right\}}_{\tilde{\mathsf{\Theta }}}=a{d}_{\frac{\partial H}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H}{\partial Q}\right)$ with stable equilibrium when $H=S\Rightarrow \frac{dQ}{dt}={\left\{Q,S\right\}}_{\tilde{\mathsf{\Theta }}}=a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right)=0$. We have finally also observed that $dS={\tilde{\mathsf{\Theta }}}_{\beta }\left(\frac{\partial H}{\partial Q},\beta \right)dt$ where ${\tilde{\mathsf{\Theta }}}_{\beta }\left(\frac{\partial H}{\partial Q},\beta \right)=\tilde{\mathsf{\Theta }}\left(\frac{\partial H}{\partial Q},\beta \right)+\langle Q,\left[\frac{\partial H}{\partial Q},\beta \right]\rangle$, showing that Entropy production is linked with Souriau tensor related to Fisher metric.

The Casimir equations that we have introduced in non-zero cohomology case are consequences of the constancy of the entropy on adjoint orbits of the Lie algebra and of the equivariance of the map between the set of generalized temperatures and the dual space of the Lie algebra, as introduced by Jean-Marie in his 1974 paper. We explained this fact in the paper by starting elaboration of Casimir equations from the Souriau equation. Casimir equations are then presented in this context, as a fully equivalent form written in a new way, especially in the framework of Souriau Lie groups Thermodynamics. Souriau has not observed that the Entropy is an invariant Casimir function in coadjoint representation, but we can assume that he was fully aware of this invariant structure.

From Souriau equation $\langle Q,\left[\beta ,Z\right]\rangle +\tilde{\mathsf{\Theta }}\left(\beta ,Z\right)=0$ published in 1974, we have rewritten as direct consequence this equation on a Casimir form $a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right)=0$. This equation preserves the geometric structures included in Souriau equation but allow us to consider the Entropy from the point of view of Casimir invariant function. The concept of Entropy and the concept of Casimir function were, for the time being, two disjoint concepts that have been developed independently in the past. There is a large literature on Casimir function, especially the russian one that have characterized properties of Casimir function. We refer to Igor V. Shirokov who has proposed a method for constructing invariants of the coadjoint representation of Lie groups with an arbitrary dimension and structure based on local symplectic coordinates on the coadjoint orbits. With Oleg L. Kurnyavko, Igor V. Shirokov has also proposed a general method for constructing invariant Casimir functions. The second reference is about A.T. Fomenko and V.V. Trofimov who have also deeply studied Casimir functions (but in case of null cohomology) and have developed the following equation that we can write for Entropy in null cohomology case $S\left(A{d}_{e^{t\xi }}^{*}Q\right)=S(Q)+{\displaystyle \sum _{n=1}^{\infty }\frac{{\left(-\varphi (\xi )\right)}^{n}S}{n!}}(Q).t^n$ with $\varphi :\mathrm{g}\to Vec\left(\mathsf{\Gamma }\right)$ a representation of Lie algebras defined on basis $\left(e_1,e_2,\dots ,e_n\right)$ in $\mathrm{g}$. We refer to a twin paper [17] developing consequences of this new definition of Entropy as an invariant Casimir function. In this twin paper, we study the associated Euler-Poincaré equation $\frac{dQ}{dt}=a{d}_{\frac{\partial H}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H}{\partial Q}\right)$ and the stochastic extension based on a new Stratonovich differential equation for the stochastic process given by the following relation by mean of Souriau’s symplectic cocycle $dQ+\left[a{d}_{\frac{\partial H}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H}{\partial Q}\right)\right]dt+{\displaystyle \sum _{i=1}^N\left[a{d}_{\frac{\partial H_i}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H_i}{\partial Q}\right)\right]\circ d{W}_i\left(t\right)}=0$. These kind of stochastic equations have been also studied by Alexis Arnaudon and Daryl Holm but only in the restricted case of null-cohomology [32].

We give references from classical textbooks (as Souriau book and papers) to preprints because different approaches have been developed in parallel to address Lie groups statistics, as soon as mid of last century, but without bridges between these disciplines which have developed specific tools to address this problem. We have limited these references to main and important documents, which are characterized as seminal and as tutorial of their domains. We have preserved references in French, because some works as Souriau Lie groups Thermodynamics model have not been yet largely spread towards the different communities.

3. Learning Inference Lie Groups Thermodynamics and Covariant Gibbs Density

We identify the Riemanian metric introduced by Souriau based on cohomology, in the framework of “Lie groups thermodynamics” as an extension of classical Fisher metric introduced in information geometry. We have observed that Souriau metric preserves Fisher metric structure as the Hessian of the minus logarithm of a partition function, where the partition function is defined as a generalized Laplace transform on a sharp convex cone. Souriau’s definition of Fisher metric extends the classical one in case of Lie groups or homogeneous manifolds. Souriau has developed this “Lie groups thermodynamics” theory in the framework of homogeneous symplectic manifolds in geometric statistical mechanics for dynamical systems, but as observed by Souriau, these model equations are no longer linked to the symplectic manifold but equations only depend on the Lie group and the associated cocycle [33,34]. This analogy with Fisher metric opens potential applications in machine learning, where the Fisher metric is used in the framework of information geometry, to define the “natural gradient” tool for improving ordinary stochastic gradient descent sensitivity to rescaling or changes of variable in parameter space. In machine learning revised by natural gradient of information geometry, the ordinary gradient is designed to integrate the Fisher matrix. Amari has theoretically proved the asymptotic optimality of the natural gradient compared to classical gradient. With the Souriau approach, the Fisher metric could be extended, by Souriau-Fisher metric, to design natural gradients for data on homogeneous manifolds. Information geometry has been derived from invariant geometrical structure involved in statistical inference. The Fisher metric defines a Riemannian metric as the Hessian of two dual potential functions, linked to dually coupled affine connections in a manifold of probability distributions. With the Souriau model, this structure is extended preserving the Legendre transform between two dual potential function parametrized in Lie algebra of the group acting transentively on the homogeneous manifold.

3.1. Inference by Natutal Gradient and Legendre Structure

Classically, to optimize the parameter $\theta$ of a probabilistic model, based on a sequence of observations $y_t$, is an online gradient descent:

$${\theta }_t\leftarrow {\theta }_{t-1}-{\eta }_t\frac{\partial l_t{\left(y_t\right)}^T}{\partial \theta }$$

(18)

with learning rate ${\eta }_t$, and the loss function $l_t=-\log p\left(y_t/{\widehat{y}}_t\right)$. This simple gradient descent has a first drawback of using the same non-adaptive learning rate for all parameter components, and a second drawback of non invariance with respect to parameter re-encoding inducing different learning rates. Amari has introduced the natural gradient to preserve this invariance to be insensitive to the characteristic scale of each parameter direction. The gradient descent could be corrected by $I{(\theta )}^{-1}$ where $I$ is the Fisher information matrix with respect to parameter $\theta$, given by:

$$I\left(\theta \right)=\left[g_{ij}\right]\mathrm{with}{g}_{ij}={\left[-E_{y\sim p(y/\theta )}\left[\frac{{\partial }^2\log p\left(y/\theta \right)}{\partial {\theta }_i\partial {\theta }_j}\right]\right]}_{ij}$$

(19)

with natural gradient:

$${\theta }_t\leftarrow {\theta }_{t-1}-{\eta }_{t}I{(\theta )}^{-1}\frac{\partial l_t{\left(y_t\right)}^T}{\partial \theta }$$

(20)

Amari has proved that the Riemannian metric in an exponential family is the Fisher information matrix defined by:

$$g_{ij}=-{\left[\frac{{\partial }^2\mathsf{\Phi }}{\partial {\theta }_i\partial {\theta }_j}\right]}_{ij}\mathrm{with}\mathsf{\Phi }(\theta )=-\log {\displaystyle \underset{R}{\int }{e}^{-\langle \theta ,y\rangle }dy}$$

(21)

and the dual potential, the Shannon entropy, is given by the Legendre transform:

$$S(\eta )=\langle \theta ,\eta \rangle -\mathsf{\Phi }(\theta )\mathrm{with}{\eta }_i=\frac{\partial \mathsf{\Phi }(\theta )}{\partial {\theta }_i}\mathrm{and}{\theta }_i=\frac{\partial S(\eta )}{\partial {\eta }_i}$$

(22)

We can observe that $\mathsf{\Phi }(\theta )=-\log {\displaystyle \underset{R}{\int }{e}^{-\langle \theta ,y\rangle }dy}=-\log \psi \left(\theta \right)$ is linked with the cumulant generating function.

J.L. Koszul and E. Vinberg have introduced an affinely invariant Hessian metric on a sharp convex cone through its characteristic function:

$$\begin{array}{l}{\mathsf{\Phi }}_{\mathsf{\Omega }}(\theta )=-\log {\displaystyle \underset{{\mathsf{\Omega }}^{*}}{\int }{e}^{-\langle \theta ,y\rangle }dy=-\log }{\psi }_{\mathsf{\Omega }}(\theta )\mathrm{with}\theta \in \mathsf{\Omega }\mathrm{sharp}\mathrm{convex}\mathrm{cone}\\ {\psi }_{\mathsf{\Omega }}(\theta )={\displaystyle \underset{{\mathsf{\Omega }}^{*}}{\int }{e}^{-\langle \theta ,y\rangle }dy}\mathrm{with}\mathrm{Koszul-Vinberg}\mathrm{Characteristic}\mathrm{function}\end{array}$$

(23)

Jean-Louis Koszul has introduced the following forms

1st Koszul form:

$$\alpha =d{\mathsf{\Phi }}_{\mathsf{\Omega }}(\theta )=-d\log {\psi }_{\mathsf{\Omega }}(\theta )$$

(24)

2nd Koszul form:

$$\gamma =D\alpha =Dd\log {\psi }_{\mathsf{\Omega }}(\theta )$$

(25)

with the following property of positive definitiveness:

$$\begin{array}{l}\left(Dd\log {\psi }_{\mathsf{\Omega }}(x)\right)(u)=\frac{1}{{\psi }_{\mathsf{\Omega }}{(u)}^2}\left[{\displaystyle \underset{{\mathsf{\Omega }}^{*}}{\int }F{(\xi )}^{2}d\xi }.{\displaystyle \underset{{\mathsf{\Omega }}^{*}}{\int }G{(\xi )}^{2}d\xi }-{\left({\displaystyle \underset{{\mathsf{\Omega }}^{*}}{\int }F(\xi ).G(\xi )d\xi }\right)}^2\right]>0\\ \mathrm{with}F(\xi )=e^{-\frac{1}{2}\langle x,\xi \rangle }\mathrm{and}G(\xi )=e^{-\frac{1}{2}\langle x,\xi \rangle }\langle u,\xi \rangle \end{array}$$

(26)

Koszul has defined the following Diffeomorphism:

$$\eta =\alpha =-d\log {\psi }_{\mathsf{\Omega }}(\theta )={\displaystyle \underset{{\mathsf{\Omega }}^{*}}{\int }\xi p_{\theta }(\xi )d\xi }\mathrm{with}{p}_{\theta }(\xi )=\frac{e^{-\langle \xi ,\theta \rangle }}{{\displaystyle \underset{{\mathsf{\Omega }}^{*}}{\int }{e}^{-\langle \xi ,\theta \rangle }d\xi }}$$

(27)

with preservation of Legendre transform:

$$S_{\mathsf{\Omega }}(\eta )=\langle \theta ,\eta \rangle -{\mathsf{\Phi }}_{\mathsf{\Omega }}(\theta )\mathrm{with}\eta =d{\mathsf{\Phi }}_{\mathsf{\Omega }}(\theta )\mathrm{and}\theta =d{S}_{\mathsf{\Omega }}(\eta )$$

(28)

3.2. Souriau Lie Groups Thermodynamique and Souriau-Koszul-Fisher Metric

This relations have been extended by Jean-Marie Souriau in geometric statistical mechanics, where he developed a “Lie groups thermodynamics” of dynamical systems where the (maximum entropy) Gibbs density is covariant with respect to the action of the Lie group. In the Souriau model, previous structures of information geometry are preserved:

$$I(\beta )=-\frac{{\partial }^2\mathsf{\Phi }}{\partial {\beta }^2}\mathrm{with}\mathsf{\Phi }(\beta )=-\log {\displaystyle \underset{M}{\int }{e}^{-\langle U(\xi ),\beta \rangle }d{\lambda }_{\omega }}\mathrm{and}U:M\to {\mathrm{g}}^{*}$$

(29)

$$S(Q)=\langle Q,\beta \rangle -\mathsf{\Phi }(\beta )\mathrm{with}Q=\frac{\partial \mathsf{\Phi }(\beta )}{\partial \beta }\in {\mathrm{g}}^{*}\mathrm{and}\beta =\frac{\partial S(Q)}{\partial Q}\in \mathrm{g}$$

(30)

In the Souriau Lie groups thermodynamics model, $\beta$ is a “geometric” (Planck) temperature, element of Lie algebra $\mathrm{g}$ of the group, and $Q$ is a “geometric” heat, element of the dual space of the Lie algebra ${\mathrm{g}}^{*}$ of the group. Souriau has proposed a Riemannian metric that we have identified as a generalization of the Fisher metric:

$$I\left(\beta \right)=\left[g_{\beta }\right]\mathrm{with}{g}_{\beta }\left(\left[\beta ,Z_1\right],\left[\beta ,Z_2\right]\right)={\tilde{\mathsf{\Theta }}}_{\beta }\left(Z_1,\left[\beta ,Z_2\right]\right)$$

(31)

$$\mathrm{with}{\tilde{\mathsf{\Theta }}}_{\beta }\left(Z_1,Z_2\right)=\tilde{\mathsf{\Theta }}\left(Z_1,Z_2\right)+\langle Q,a{d}_{Z_1}(Z_2)\rangle \mathrm{where}a{d}_{Z_1}(Z_2)=\left[Z_1,Z_2\right]$$

(32)

Souriau has proved that all co-adjoint orbit of a Lie group given by ${\mathrm{O}}_F=\left\{A{d}_g^{*}F=g^{-1}Fg,g\in G\right\}\mathrm{subset}\mathrm{of}{\mathrm{g}}^{*},F\in {\mathrm{g}}^{*}$ carries a natural homogeneous symplectic structure by a closed G-invariant 2-form. If we define $K=A{d}_g^{*}={\left(A{d}_{g^{-1}}\right)}^{*}$ and $K_{*}(X)=-{\left(a{d}_X\right)}^{*}$ with $\langle A{d}_g^{*}F,Y\rangle =\langle F,A{d}_{g^{-1}}Y\rangle ,\forall g\in G,Y\in \mathrm{g},F\in {\mathrm{g}}^{*}$ where if $X\in \mathrm{g}$, $A{d}_g(X)=gX{g}^{-1}\in \mathrm{g}$, the G-invariant 2-form is given by the following expression ${\sigma }_{\mathsf{\Omega }}\left(a{d}_{X}F,a{d}_{Y}F\right)=B_F\left(X,Y\right)=\langle F,\left[X,Y\right]\rangle ,X,Y\in \mathrm{g}$. Souriau Foundamental Theorem is that « Every symplectic manifold on which a Lie group acts transitively by a Hamiltonian action is a covering space of a coadjoint orbit ». We can observe that for Souriau model, Fisher metric is an extension of this 2-form in non-equivariant case $g_{\beta }\left(\left[\beta ,Z_1\right],\left[\beta ,Z_2\right]\right)=\tilde{\mathsf{\Theta }}\left(Z_1,\left[\beta ,Z_2\right]\right)+\langle Q,\left[Z_1,\left[\beta ,Z_2\right]\right]\rangle$.

The Souriau additional term $\tilde{\mathsf{\Theta }}\left(Z_1,\left[\beta ,Z_2\right]\right)$ is generated by non-equivariance through Symplectic cocycle. The tensor $\tilde{\mathsf{\Theta }}$ used to define this extended Fisher metric is defined by the moment map $J(x)$, application from $M$ (homogeneous symplectic manifold) to the dual space of the Lie algebra ${\mathrm{g}}^{*}$, given by:

$$\tilde{\mathsf{\Theta }}(X,Y)=J_{\left[X,Y\right]}-\left\{J_X,J_Y\right\}$$

(33)

$$\mathrm{with}J(x):M\to {\mathrm{g}}^{*}\mathrm{such}\mathrm{that}{J}_X(x)=\langle J(x),X\rangle ,X\in \mathrm{g}$$

(34)

This tensor $\tilde{\mathsf{\Theta }}$ is also defined in tangent space of the cocycle $\theta \left(g\right)\in {\mathrm{g}}^{*}$ (this cocycle appears due to the non-equivariance of the coadjoint operator $A{d}_g^{*}$, action of the group on the dual space of the lie algebra; the action of the group on the dual space of the Lie algebra is modified with a cocycle so that the momentu map becomes equivariant relative to this new affine action):

$$Q\left(A{d}_g(\beta )\right)=A{d}_g^{*}(Q)+\theta \left(g\right)$$

(35)

$\theta \left(g\right)\in {\mathrm{g}}^{*}$ is called nonequivariance one-cocycle, and it is a measure of the lack of equivariance of the moment map.

$$\begin{array}{l}\tilde{\mathsf{\Theta }}\left(X,Y\right):\mathrm{g}\times \mathrm{g}\to \Re \mathrm{with}\mathsf{\Theta }(X)=T_e\theta \left(X(e)\right)\\ \mathrm{X},\mathrm{Y}\mapsto \langle \mathsf{\Theta }(X),Y\rangle \end{array}$$

(36)

The cocycle should verify:

$$\begin{array}{l}\theta (st)=J(\left(st\right).x)-A{d}_{st}^{*}J(x)\\ \theta (st)=\left[J(s.\left(t.x\right))-A{d}_s^{*}J\left(t.x\right)\right]+\left[A{d}_s^{*}J\left(t.x\right)-A{d}_s^{*}A{d}_t^{*}J(x)\right]\\ \theta (st)=\theta (s)+A{d}_s^{*}\left[J\left(t.x\right)-A{d}_t^{*}J(x)\right]\\ \theta (st)=\theta (s)+A{d}_s^{*}\theta (t)\end{array}$$

(37)

We can also compute tangent of one-cocycle $\theta$ at neutral element, to compute 2-cocycle $\mathsf{\Theta }$:

$$\begin{array}{l}\zeta \in \mathrm{g},{\theta }_{\zeta }\left(s\right)=\langle \theta \left(s\right),\zeta \rangle =\langle J\left(s.x\right),\zeta \rangle -\langle A{d}_s^{*}J\left(x\right),\zeta \rangle =\langle J\left(s.x\right),\zeta \rangle -\langle J\left(x\right),A{d}_{s^{-1}}\zeta \rangle \\ T_e{\theta }_{\zeta }\left(\xi \right)=\langle T_{x}J.{\xi }_p(x),\zeta \rangle +\langle J\left(x\right),a{d}_{\xi }\zeta \rangle \mathrm{with}{\xi }_p=X_{\langle J,\xi \rangle }\\ T_e{\theta }_{\zeta }\left(\xi \right)=X_{\langle J(x),\xi \rangle }\left[\langle J(x),\zeta \rangle \right]+\langle J\left(x\right),\left[\xi ,\zeta \right]\rangle \\ T_e{\theta }_{\zeta }\left(\xi \right)=-\left\{\langle J,\xi \rangle ,\langle J,\zeta \rangle \right\}+\langle J(x),\left[\xi ,\zeta \right]\rangle =\mathsf{\Theta }\left(\xi \right)\end{array}$$

(38)

We can also write: $T_{x}J\left({\xi }_p(x)\right)=-a{d}_{\xi }^{*}J(x)+\mathsf{\Theta }\left(\xi ,.\right)$

By differentiating the equation on affine action, we have:

$$dJ(Xx)=a{d}_{X}J(x)+d\theta (X),x\in M,X\in \mathrm{g}$$

(39)

$$\begin{array}{l}\langle dJ(Xx),Y\rangle =\langle a{d}_{X}J(x),Y\rangle +\langle \mathrm{d}\theta (X),Y\rangle ,x\in M,X,Y\in \mathrm{g}\\ \langle dJ(Xx),Y\rangle =\langle J(x),\left[X,Y\right]\rangle +\langle \mathrm{d}\theta (X),Y\rangle =\left\{\langle J,X\rangle ,\langle J,Y\rangle \right\}(x)\\ \langle J(x),\left[X,Y\right]\rangle -\left\{\langle J,X\rangle ,\langle J,Y\rangle \right\}(x)=-\langle \mathrm{d}\theta (X),Y\rangle \end{array}$$

(40)

It can be then deduced that the tensor could be also written:

$$\tilde{\mathsf{\Theta }}(X,Y)=J_{\left[X,Y\right]}-\left\{J_X,J_Y\right\}=-\langle d\theta (X),Y\rangle ,X,Y\in \mathrm{g}$$

(41)

with the cocycle property:

$$\tilde{\mathsf{\Theta }}\left(\left[X,Y\right],Z\right)+\tilde{\mathsf{\Theta }}\left(\left[X,Y\right],Z\right)+\tilde{\mathsf{\Theta }}\left(\left[X,Y\right],Z\right)=0,X,Y,Z\in \mathrm{g}$$

(42)

By noting the action of the group on the dual space of the Lie algebra:

$$G\times {\mathrm{g}}^{*}\to {\mathrm{g}}^{*},(s,\xi )\mapsto s\xi =A{d}_s^{*}\xi +\theta (s)$$

(43)

Associativity is also derived:

$$\begin{array}{l}(s_1{s}_2)\xi =A{d}_{s_1{s}_2}^{*}\xi +\theta (s_1{s}_2)=A{d}_{s_1}^{*}A{d}_{s_2}^{*}\xi +\theta (s_1)+A{d}_{s_1}^{*}\theta (s_2)\\ (s_1{s}_2)\xi =A{d}_{s_1}^{*}\left(A{d}_{s_2}^{*}\xi +\theta (s_2)\right)+\theta (s_1)=s_1\left(s_2\xi \right),\forall s_1,s_2\in G,\xi \in {\mathrm{g}}^{*}\end{array}$$

(44)

This study of the moment map $J$ equivariance, and the existence of an affine action of G on ${\mathrm{g}}^{*}$, whose linear part is the coadjoint action, for which the moment $J$ is equivariant, is at the cornerstone of Souriau theory of geometric mechanics and Lie groups thermodynamics.

3.3. Souriau Entropy and Souriau-Fisher-Koszul Metric Invariance under the Action of the Group and Covariant Souriau Gibbs Density

In Souriau’s Lie groups thermodynamics, the invariance by re-parameterization in information geometry has been replaced by invariance with respect to the action of the group. When an element of the group $g$ acts on the element $\beta \in \mathrm{g}$ of the Lie algebra, given by adjoint operator $A{d}_g$. Under the action of the group $A{d}_g(\beta )$, the entropy $S\left(Q\right)$ and the Fisher metric $I\left(\beta \right)$ are invariant:

$$\beta \in \mathrm{g}\to A{d}_g(\beta )\Rightarrow \{\begin{array}{l}S\left[Q\left(A{d}_g(\beta )\right)\right]=S\left(Q\right)\\ I\left[A{d}_g(\beta )\right]=I\left(\beta \right)\end{array}$$

(45)

In the framework of Lie group action on a symplectic manifold, equivariance of moment map could be studied to prove that there is a unique action a(.,.) of the Lie group $G$ on the dual ${\mathrm{g}}^{*}$ of its Lie algebra for which the moment map $J$ is equivariant, that means for each $x\in M$:

$$J\left({\mathsf{\Phi }}_g(x)\right)=a(g,J(x))=A{d}_g^{*}\left(J(x)\right)+\theta (g)$$

(46)

When coadjoint action is not equivariant, the symmetry is broken, and new “cohomological” relations should be verified in Lie algebra of the group. A natural equilibrium state will thus be characterized by an element of the Lie algebra of the Lie group, determining the equilibrium temperature $\beta$. The entropy $s(Q)$, parametrized by $Q$ the geometric heat (mean of energy $U$, element of the dual space of the Lie algebra) is defined by the Legendre transform of the Massieu potential $\mathsf{\Phi }\left(\beta \right)$ parametrized by $\beta$ ($\mathsf{\Phi }\left(\beta \right)$ is the minus logarithm of the partition function ${\psi }_{\mathsf{\Omega }}\left(\beta \right)$).

A Gibbs state, in the usual sense, is a statistical state at which the entropy is stationary with respect to all infinitesimal variations of the statistical state for which the mean value of the energy remains constant. In the sense of Souriau, a generalized Gibbs state is a statistical state at which the entropy is stationary with respect to all infinitesimal variations of the statistical state for which the mean value of the moment map remains constant. This generalization is very natural, since the energy can be considered as the moment map of the Hamiltonian action of the one-dimensional Lie group of time translations. Furthermore, each generalized Gibbs state is associated to an element of the Lie algebra of the group, called by Souriau a generalized temperature, and that the set of possible generalized temperature is not, in general the whole Lie algeba, but an open convex subset of the Lie algebra, which may be empty, for which some integrals encountered in the expression of the generalized Gibbs state are normally convergent. So, for some Lie groups, generalized Gibbs states do not exist, and there is no Souriau Lie groups thermodynamics.

Souriau has then defined a Gibbs density that is covariant under the action of the group:

$$\begin{array}{l}{p}_{Gibbs}(\xi )=e^{\mathsf{\Phi }(\beta )-\langle U(\xi ),\beta \rangle }=\frac{e^{-\langle U(\xi ),\beta \rangle }}{{\displaystyle \underset{M}{\int }{e}^{-\langle U(\xi ),\beta \rangle }}d{\lambda }_{\omega }},\mathrm{with}\mathsf{\Phi }(\beta )=-\log {\displaystyle \underset{M}{\int }{e}^{-\langle U(\xi ),\beta \rangle }}d{\lambda }_{\omega }\\ Q=\frac{\partial \mathsf{\Phi }(\beta )}{\partial \beta }=\frac{{\displaystyle \underset{M}{\int }U(\xi )e^{-\langle U(\xi ),\beta \rangle }}d{\lambda }_{\omega }}{{\displaystyle \underset{M}{\int }{e}^{-\langle U(\xi ),\beta \rangle }}d{\lambda }_{\omega }}={\displaystyle \underset{M}{\int }U(\xi )p(\xi )}d{\lambda }_{\omega }\end{array}$$

(47)

We can express the Gibbs density with respect to $Q$ by inverting the relation $Q=\frac{\partial \mathsf{\Phi }(\beta )}{\partial \beta }=\mathsf{\Theta }\left(\beta \right)$. Then $p_{Gibbs,Q}(\xi )=e^{\mathsf{\Phi }(\beta )-\langle U(\xi ),{\mathsf{\Theta }}^{-1}\left(Q\right)\rangle }$ with $\beta ={\mathsf{\Theta }}^{-1}\left(Q\right)$. All Souriau equations of Lie groups Thermodynamics are illustrated in Figure 3 and Figure 4.

Souriau completed his “geometric heat theory” by introducing a 2-form in the Lie algebra, that is a Riemannian metric tensor in the values of adjoint orbit of $\beta$, $\left[\beta ,Z\right]$ with $Z$ an element of the Lie algebra. This metric is given for $\left(\beta ,Q\right)$:

$$g_{\beta }\left(\left[\beta ,Z_1\right],\left[\beta ,Z_2\right]\right)=\langle \mathsf{\Theta }\left(Z_1\right),\left[\beta ,Z_2\right]\rangle +\langle Q,\left[Z_1,\left[\beta ,Z_2\right]\right]\rangle$$

(48)

where $\mathsf{\Theta }$ is a cocycle of the Lie algebra, defined by $\mathsf{\Theta }=T_e\theta$ with $\theta$ a cocycle of the Lie group defined by $\theta (M)=Q\left(A{d}_M(\beta )\right)-A{d}_M^{*}Q$.

We observe that Souriau Riemannian metric, introduced with symplectic cocycle, is a generalization of the Fisher metric, that we call the Souriau-Fisher metric, that preserves the property to be defined as a Hessian of the partition function logarithm $g_{\beta }=-\frac{{\partial }^2\mathsf{\Phi }}{\partial {\beta }^2}=\frac{{\partial }^2\log {\psi }_{\mathsf{\Omega }}}{\partial {\beta }^2}$ as in classical information geometry. We will establish the equality of two terms, between Souriau definition based on Lie group cocycle $\mathsf{\Theta }$ and parameterized by “geometric heat” Q (element of the dual space of the Lie algebra) and “geometric temperature” β (element of Lie algebra) and hessian of characteristic function $\mathsf{\Phi }\left(\beta \right)=-\log {\psi }_{\mathsf{\Omega }}(\beta )$ with respect to the variable β (as illustrated in Figure 5):

$$g_{\beta }\left(\left[\beta ,Z_1\right],\left[\beta ,Z_2\right]\right)=\langle \mathsf{\Theta }\left(Z_1\right),\left[\beta ,Z_2\right]\rangle +\langle Q,\left[Z_1,\left[\beta ,Z_2\right]\right]\rangle =\frac{{\partial }^2\log {\psi }_{\mathsf{\Omega }}}{\partial {\beta }^2}$$

(49)

If we differentiate this relation of Souriau theorem $Q\left(A{d}_g(\beta )\right)=A{d}_g^{*}(Q)+\theta \left(g\right)$, this relation occurs:

$$\frac{\partial Q}{\partial \beta }\left(-\left[Z_1,\beta \right],.\right)=\tilde{\mathsf{\Theta }}\left(Z_1,\left[\beta ,.\right]\right)+\langle Q,A{d}_{.Z_1}(\left[\beta ,.\right])\rangle ={\tilde{\mathsf{\Theta }}}_{\beta }\left(Z_1,\left[\beta ,.\right]\right)$$

(50)

$$-\frac{\partial Q}{\partial \beta }\left(\left[Z_1,\beta \right],Z_2.\right)=\tilde{\mathsf{\Theta }}\left(Z_1,\left[\beta ,Z_2\right]\right)+\langle Q,A{d}_{.Z_1}(\left[\beta ,Z_2\right])\rangle ={\tilde{\mathsf{\Theta }}}_{\beta }\left(Z_1,\left[\beta ,Z_2\right]\right)$$

(51)

$$\Rightarrow -\frac{\partial Q}{\partial \beta }=g_{\beta }\left(\left[\beta ,Z_1\right],\left[\beta ,Z_2\right]\right)$$

(52)

As the entropy is defined by the Legendre transform of the characteristic function, a dual metric of the Fisher metric is also given by the hessian of “geometric entropy” $S(Q)$ with respect to the dual variable given by Q: $\frac{{\partial }^{2}S(Q)}{\partial Q^2}$.

For the maximum entropy density (Gibbs density), the following three terms coincide: $\frac{{\partial }^2\log {\psi }_{\mathsf{\Omega }}}{\partial {\beta }^2}$ that describes the convexity of the log-likelihood function, $I(\beta )=-E\left[\frac{{\partial }^2\log p_{\beta }(\xi )}{\partial {\beta }^2}\right]$ the Fisher metric that describes the covariance of the log-likelihood gradient, whereas $I(\beta )=E\left[\left(\xi -Q\right){\left(\xi -Q\right)}^T\right]=Var(\xi )$ that describes the covariance of the observables. We can also observe that the Fisher metric $I(\beta )=-\frac{\partial Q}{\partial \beta }$ is exactly the Souriau metric defined through symplectic cocycle:

$$I(\beta )={\tilde{\mathsf{\Theta }}}_{\beta }\left(Z_1,\left[\beta ,Z_2\right]\right)=g_{\beta }\left(\left[\beta ,Z_1\right],\left[\beta ,Z_2\right]\right)$$

(53)

The Fisher metric $I(\beta )=-\frac{{\partial }^2\mathsf{\Phi }(\beta )}{\partial {\beta }^2}=-\frac{\partial Q}{\partial \beta }$ has been considered by Souriau as a generalization of “heat capacity”. Souriau called it $K$ the “geometric capacity”.

3.4. Covariant Souriau Gibbs Density and Information Manifold Foliation

R.F. Streater has studied in 1999, Information Geometry for some Lie algebra where for certain unitary representation of a Lie algebra, he has defined the statistical manifold of states as convex cone for which the partition function is finite, making reference to Bogoliubov-Kubo-Mori metric. But Streater has only developed the case with null cohomology for so (3) and sl (2,R) Lie alebras. Nevertheless, as observed by R.F. Streater in his paper “Information Geometry for some Lie algebras” [35], referring to Kirillov work and Roger Balian paper, “We can expect further natural structures to arise in this case. Indeed, it is known (*) that the dual to the Lie algebra, which parametrizes the state-space in this case, foliates into coadjoint orbits; there are also the level sets on the entropy; Kirillov form, and the BKM (Bogoliubov-Kubo-Mori) metric, together make each orbit into kähler space, along the lines proposed by Kostant. Motion along these holomorphic directions is nondissipative. The transversal to the orbits is a real half-line, which represents the dissipative direction…We study the case of sl (2,R) in the discrete series of representations. We show the information manifold foliates into level sets of the entropy, each being isometric to H, the Poincaré upper half-plane… The states of constant entropy are the hyperboloids and $\beta$ is the dissipative coordinate… For an integrable system described by a Lie algebra in a traceable representation, we find that the information manifold foliates into complex spaces; the level sets of entropy can be given a complex structure by the method of Kostant. Motion remaining on the complex surfaces is nondissipative, whereas motion transversal to these surfaces is dissipative. In information geometry, the state is parametrized by the canonical coordinates. Which function of them is measured by a thermometer? In our models, it is reasonable to designate $1/\beta$ to be the temperature; it is a dissipative coordinate, and it increases with time, showing that the system is thermalizing”.

4. Mathematical Definition of Souriau Moment Map

Previously, we have introduced the concept of Souriau’s moment map. In this chapter, we will introduce a mathematical definition of this tool, as defined in Souriau’s book [36] with modern notations [37,38,39,40,41]. Other details on moment map are also given in Jean-Louis Koszul’s Book [42].

4.1. Operations on Vector Fields

Consider a map $F:X\subset R^M\to Y\subset R^N$, $y=F(x)$, the derivative of $F$ at $x\in X$, $DF:X\to R^{N\times M}$ is given by:

$$\left(\begin{array}{c}\delta y^1\\ ⋮\\ \delta y^N\end{array}\right)=\left(\begin{array}{ccc}\frac{\partial y^1}{\partial x^1}& \cdots & \frac{\partial y^1}{\partial x^M}\\ ⋮& \ddots & ⋮\\ \frac{\partial y^N}{\partial x^1}& \cdots & \frac{\partial y^N}{\partial x^M}\end{array}\right)\left(\begin{array}{c}\delta x^1\\ ⋮\\ \delta x^M\end{array}\right)=DF(x)(\delta x)=\underset{t\to 0}{Lim}\frac{F(x+t\delta x)-F(x)}{t}$$

(54)

Second derivative is given by the linear map $D^{2}F:X\to R^{N\times M\times M}$:

$$\delta \left[\frac{\partial y}{\partial x}\right]=\frac{{\partial }^{2}y}{\partial x^2}(\delta x)=D^{2}F(x)(\delta x)$$

(55)

Consider a vector Field $V$ on $X\subset R^M$ defined by: $V:X\subset R^M\to R^M$, operations on vector fields are given by adjoint action and Lie bracket:

$$A{d}_{F}V(y)={\frac{d}{dt}\left[F\circ e^{tV}\circ F^{-1}\right](y)|}_{t=0}=DF(x)\left(V(x)\right)\mathrm{with}x=F^{-1}(y)$$

(56)

$$\left[U,V\right](x)={\frac{d}{ds}A{d}_{e^{sU}}V(x)|}_{s=0}=DU(x)\left(V(x)\right)-DV(x)\left(U(x)\right)$$

(57)

0-form is a scalar, 1-form are row $\omega =\left({\omega }_1\cdots {\omega }_M\right)$ in dual space. 2-forms can be regarded as antisymmetric matrices $\left({\omega }_{ij}\right)$ with $\omega \left(u,v\right)=u^t\left(\begin{array}{ccc}{\omega }_{11}& \cdots & {\omega }_{1M}\\ ⋮& \ddots & ⋮\\ {\omega }_{M1}& \cdots & {\omega }_{MM}\end{array}\right)v$. m-forms are all scalar multiples of the standard volume form vol, defined by $Vol\left(v_1,\cdots ,v_m\right)=\det \left(\mathrm{matrix}\mathrm{with}\mathrm{columns}{v}_1,\dots ,v_m\right)$.

4.2. Derivative Rules by Sophus Lie, Elie Cartan and Henri Cartan

With the following classical definitions:

• Pull back: $F^{*}\omega$ is a p-form on $X$

  $$F^{*}\omega \left(v_1,\cdots ,v_p\right)={\omega }_{F(x)}\left(DF(x)(v_1),\cdots ,DF(x)(v_p)\right)$$

  (58)
• Interior product: $i_V\omega$ is the (p−1)form on $M$ obtained by inserting $V(x)$ as the first argument of $\omega$

  $$i_V\omega \left(v_2,\cdots v_p\right)=\omega \left(V(x),v_2,\cdots ,v_p\right)$$

  (59)
• Exterior product:$\theta \wedge \omega$ is the (p + 1)-form on $X$ where $\omega$ is a p-form and $\theta$ is a 1-form on $M$ (where the hat indicates a term to be omitted):

  $$\theta \wedge \omega \left(v_0,\cdots ,v_p\right)={\displaystyle \sum _{i=0}^p{\left(-1\right)}^i\theta (v_i)\omega \left(v_0,\cdots ,{\widehat{v}}_i,\cdots ,v_p\right)}$$

  (60)
• Lie derivative: $L_V\omega$ is a p-form on $M$, and $L_V\omega =0$ if the flow of $V$ consists of symmetries of $\omega$:

  $$L_V\omega \left(v_1,\cdots ,v_p\right)={\frac{d}{dt}{e}^{tV*}\omega \left(v_1,\cdots ,v_p\right)|}_{t=0}$$

  (61)

  $d\omega$ is the (p+1)-form on $M$ defined by taking the ordinary derivative of $\omega$ and then antisymmetrizing:
• Exterior derivative:

  $$d\omega \left(v_0,\cdots ,v_p\right)={\displaystyle \sum _{i=0}^p{\left(-1\right)}^i\frac{\partial \omega }{\partial x}(v_i)(v_0,\cdots ,{\widehat{v}}_i,\cdots ,v_p)}$$

  (62)

  $$p=0,{\left[d\omega \right]}_i={\partial }_i\omega ;p=1,{\left[d\omega \right]}_{ij}={\partial }_i{\omega }_j-{\partial }_j{\omega }_i;p=2,{\left[d\omega \right]}_{ijk}={\partial }_i{\omega }_{jk}+{\partial }_j{\omega }_{ki}+{\partial }_k{\omega }_{ij}$$

  (63)

From these definitions, the properties of the exterior and Lie Derivative were established by Sophus Lie, Elie Cartan, and Henri Cartan:

$$L_V\omega =d{i}_V\omega +i_{V}d\omega$$

(64)

(Elie Cartan equation)

$$i_{\left[U,V\right]}\omega =i_V{L}_U\omega -L_U{i}_V\omega$$

(65)

(Henri Cartan equation)

$$L_{\left[U,V\right]}\omega =L_V{L}_U\omega -L_U{L}_V\omega$$

(66)

(Sophus Lie equation)

4.3. Souriau Moment Map

Considering Manifolds and Lie groups, We define the tangent bundle $TX$ of $X$ as the disjoint union of the $T_{x}X$, or the set of all pairs $\left(\begin{array}{c}\delta x\\ x\end{array}\right)$ with $x\in X$ and $\delta x\in T_{x}X$. If $F:X\to Y$ is a smooth map between manifolds, its tangent map is the map:

$$F_{*}\left(\begin{array}{c}\delta x\\ x\end{array}\right)=\left(\begin{array}{c}DF(x)(\delta x)\\ F(x)\end{array}\right)$$

(67)

A Lie group is a group $G$ with a manifold structure such that the product $\left(g,h\right)\mapsto gh$ and the inversion $g\mapsto g^{-1}$ are smooth maps from $G\times G$ (resp. G) to $G$. Its Lie algebra is the tangent space $g=T_{e}G$ at the identity element. A smooth action of $G$ on a manifold $X$ is a group morphism:

$$\begin{array}{l}\mathsf{\Phi }:G\times X\to Diff(X)\\ \left(g,x\right)\mapsto g.x\end{array}$$

(68)

The orbit of $x\in X$ is $G(x)=\left\{g.x:g\in G\right\}$.

The tangent space to an orbit at $x$:

$T_{x}G(x)=\left\{Z(x):Z\in \mathrm{g}\right\}=\mathrm{g}/{\mathrm{g}}_x$ with $Z(x)={\frac{d}{dt}{e}^{tZ}(x)|}_{t=0}$ and where

$${\mathrm{g}}_x=\left\{Z\in \mathrm{g}:Z(x)=0\right\}$$

(69)

Let $\left(M,\sigma \right)$ be a connected symplectic manifold. A vector field $\eta$ on $M$ is called symplectic if its flow preserves the 2-form: $L_{\eta }\sigma =0$. If we use Elie Cartan’s formula, we can deduce that $L_{\eta }\sigma =d{i}_{\eta }\sigma +i_{\eta }d\sigma =0$ but as $d\sigma =0$ then $d{i}_{\eta }\sigma =0$. We observe that the 1-form $i_{\eta }\sigma$ is closed. When this 1-form is exact, there is a smooth function $x\mapsto H$ on $M$ with:

$$i_{\eta }\sigma =-dH$$

(70)

This vector field $\eta$ is called Hamiltonian and could be defined as symplectic gradient $\eta ={\nabla }_{Symp}H$.

Let a Lie group $G$ that acts on $M$ and that also preserve $\sigma$. A moment map exists if these infinitesimal generators are actually hamiltonian, so that a map $J:M\to {\mathrm{g}}^{*}$ exists with:

$i_{Z_X}\sigma =-d{H}_Z$ where

$$H_Z=\langle J(x),Z\rangle$$

(71)

The Poisson bracket of two functions $H$, $H^{\prime }$ is defined by:

$$\begin{array}{l}\left\{H,H^{\prime }\right\}=\sigma \left(\eta ,{\eta }^{\prime }\right)=\sigma \left({\nabla }_{Symp}{H}^{\prime },{\nabla }_{Symp}H\right)\mathrm{with}{i}_{\eta }\sigma =-dH\mathrm{and}\\ i_{{\eta }^{\prime }}\sigma =-d{H}^{\prime }\end{array}$$

(72)

If $G$ is connected, then the moment map is G-equivariant if and only if it satisfies $\left\{H_Z,H_{Z^{\prime }}\right\}=H_{\left[Z,Z^{\prime }\right]}$.

Souriau has proved thet every coadjoint orbit of a Lie group is a homogeneous symplectic manifold when endowed with the KKS 2-form $\sigma \left(Z(x),Z^{\prime }(x)\right)=\langle x,\left[Z^{\prime },Z\right]\rangle$, and conversely, every homogeneous symplectic manifold of a connected Lie group G is, up to a possible covering, a coadjoint orbit of some central extension of G. $\sigma$ is G-invariant.

5. Poincaré Unit Disk, SU(1,1) Lie Group and Souriau Moment Map

We will introduce Souriau moment map for SU(1,1)/K group that acts transitively on Poincaré Unit Disk, based on moment map. More details on computation of moment map for SU(1,1)/K Lie group is given in Appendix A of this document.

5.1. Poincaré Unit Disk and SU(1,1) Lie Group

The group of complex unimodular pseudo-unitary matrices $SU(1,1)$, is the set of elements $u$ such that [43,44,45,46,47,48,49,50,51,52]:

$$uM{u}^{+}=M\mathrm{with}M=\left(\begin{array}{cc}+1& 0\\ 0& -1\end{array}\right)$$

(73)

We can show that the most general matrix $u$ belongs to the Lie group given by:

$$G=SU(1,1)=\left\{\left(\begin{array}{cc}a& b\\ b^{*}& a^{*}\end{array}\right)/{\left|a\right|}^2-{\left|b\right|}^2=1,a,b\in C\right\}$$

(74)

Its Cartan decomposition is given by:

$$\left(\begin{array}{cc}a& b\\ b^{*}& a^{*}\end{array}\right)=\left|a\right|\left(\begin{array}{cc}1& z\\ z^{*}& 1\end{array}\right)\left(\begin{array}{cc}a/\left|a\right|& 0\\ 0& a^{*}/\left|a\right|\end{array}\right)\mathrm{with}z=b{\left(a^{*}\right)}^{-1},\left|a\right|={\left(1-{\left|z\right|}^2\right)}^{-1/2}$$

(75)

$$\left(\begin{array}{cc}a& b\\ b^{*}& a^{*}\end{array}\right)\left(\begin{array}{cc}1& z\\ z^{*}& 1\end{array}\right)=\left|a^{\prime }\right|\left(\begin{array}{cc}1& z^{\prime }\\ {z^{\prime }}^{*}& 1\end{array}\right)\left(\begin{array}{cc}{a}^{\prime }/\left|a^{\prime }\right|& 0\\ 0& {a^{\prime }}^{*}/\left|a^{\prime }\right|\end{array}\right)\mathrm{with}\{\begin{array}{l}{a}^{\prime }=b{z}^{*}+a\\ z^{\prime }=\frac{az+b}{b^{*}z+a^{*}}\end{array}$$

(76)

$SU\left(1,1\right)$ is associated to group of holomorphic automorphisms of the Poincaré unit disk $D=\left\{z=x+iy\in C/\left|z\right|<1\right\}$ in the complex plane, by considering its action on the disk as $g(z)=\left(az+b\right)/\left(b^{*}z+a^{*}\right)$. The following measure on Unit disk:

$$d{\mu }_0\left(z,z^{*}\right)=\frac{1}{2\pi i}\frac{dz\wedge d{z}^{*}}{{\left(1-{\left|z\right|}^2\right)}^2}$$

(77)

is invariant under the action of $SU(1,1)$ captured by the fractional holomorphic transformation:

$$\frac{d{z}^{\prime }\wedge d{z^{\prime }}^{*}}{{\left(1-{\left|z^{\prime }\right|}^2\right)}^2}=\frac{dz\wedge d{z}^{*}}{{\left(1-{\left|z\right|}^2\right)}^2}$$

(78)

The complex unit disk admits a Kähler structure determined by potential function:

$$\mathsf{\Phi }\left(z^{\prime },z^{*}\right)=-\log \left(1-z^{\prime }{z}^{*}\right)$$

(79)

The invariant 2-form is:

$$\mathsf{\Omega }=\frac{1}{i}\frac{{\partial }^2\mathsf{\Phi }\left(z,z^{*}\right)}{\partial z\partial z^{*}}dz\wedge d{z}^{*}=\frac{1}{i}\frac{dz\wedge d{z}^{*}}{{\left(1-{\left|z\right|}^2\right)}^2}$$

(80)

which is closed $d\mathsf{\Omega }=0$. This group $SU(1,1)$ is isomorphic to the group $SL(2,R)$ as a real Lie group, and the Lie algebra $\mathrm{g}=\mathsf{𝖘}u\left(1,1\right)$ is given by:

$$g=\left\{\left(\begin{array}{cc}-ir& \eta \\ {\eta }^{*}& ir\end{array}\right)/r\in R,\eta \in C\right\}$$

(81)

with the bases $\left(u_1,u_2,u_3\right)\in \mathrm{g}$: $u_1=\frac{1}{2}\left(\begin{array}{cc}0& -i\\ i& 0\end{array}\right),u_2=\frac{1}{2}\left(\begin{array}{cc}0& 1\\ 1& 0\end{array}\right),u_3=\frac{1}{2}\left(\begin{array}{cc}-i& 0\\ 0& i\end{array}\right)$

with the commutation relation:

$$\left[u_3,u_2\right]=u_1,\left[u_3,u_1\right]=-u_2,\left[u_2,u_1\right]=-u_3$$

(82)

Dual base on the dual space of the Lie algebra is named $\left(u_1^{*},u_2^{*},u_3^{*}\right)\in {\mathrm{g}}^{*}$. The dual vector space ${\mathrm{g}}^{*}=\mathsf{𝖘}{u}^{*}(1,1)$ can be identified with the subspace of $\mathsf{𝖘}\mathsf{𝖑}(2,C)$ of the form:

$$g^{*}=\left\{\left(\begin{array}{cc}z& x+iy\\ -x+iy& -z\end{array}\right)=x\left(\begin{array}{cc}0& 1\\ -1& 0\end{array}\right)+y\left(\begin{array}{cc}0& i\\ i& 0\end{array}\right)+z\left(\begin{array}{cc}1& 0\\ 0& -1\end{array}\right)/x,y,z\in R\right\}$$

(83)

Coadjoint action of $g\in G$ on dual space of the Lie algebra $\xi \in {\mathrm{g}}^{*}$ is written $g.\xi$.

5.2. Coadjoint Orbit of SU(1,1) and Souriau Moment Map

We will use results of C. Cishahayo and S. de Bièvre [53] and B. Cahen [54,55] for computation of moment map of $SU(1,1)$. Let $r\in R^{*+}$, orbit $\mathrm{O}\left(r{u}_3^{*}\right)$ of $r{u}_3^{*}$ for the coadjoint action of $g\in G$ could be identified with the upper half sheet $x_3>0$ of $\left\{\xi =x_1{u}_1^{*}+x_2{u}_2^{*}+x_3{u}_3^{*}/-x_1^2-x_2^2+x_3^2=r^2\right\}$, the two-sheet hyperboloid. The stabilizer of $r{u}_3^{*}$ for the coadjoint action of $G$ is torus $K=\left\{\left(\begin{array}{cc}{e}^{i\theta }& 0\\ 0& e^{-i\theta }\end{array}\right),\theta \in R\right\}$. K induces rotations of the unit disk, and leaves 0 invariant. The stabilizer for the origin 0 of unit disk is maximal compact subgroup K of SU(1,1). We can observe [54] that $\mathrm{O}\mathrm{\left(}r{u}_3^{*}\right)=G/K$. On the other hand $\mathrm{O}\left(r{u}_3^{*}\right)=G/K$ is diffeomorphic to the unit disk $D=\left\{z\in C/\left|z\right|<1\right\}$, then by composition, the Souriau moment map is given by:

$$\begin{array}{l}J:D\to \mathrm{O}\left(r{u}_3^{*}\right)\\ z\mapsto J(z)=r\left(\frac{z+z^{*}}{\left(1-{\left|z\right|}^2\right)}{u}_1^{*}+\frac{z-z^{*}}{i\left(1-{\left|z\right|}^2\right)}{u}_2^{*}+\frac{1+{\left|z\right|}^2}{\left(1-{\left|z\right|}^2\right)}{u}_3^{*}\right)\end{array}$$

(84)

$J$ is linked to the natural action of $G$ on $D$ (by fractional linear transforms) but also the coadjoint action of $G$ on $\mathrm{O}\left(r{u}_3^{*}\right)=G/K$. $J^{-1}$ could be interpreted as the stereographic projection from the two-sphere $S^2$ onto $C\cup \infty$ [56]. In case $r=\frac{n}{2}$ where $n\in N^{+},n\ge 2$ then the coadjoint orbit is given by ${\mathrm{O}}_n=\mathrm{O}\left({\zeta }_n\right)$ with ${\xi }_n=\frac{n}{2}{u}_3^{*}\in {\mathrm{g}}^{*}$, with stabilizer of ${\xi }_n$ for coadjoint action the torus $K=\left\{\left(\begin{array}{cc}{e}^{i\theta }& 0\\ 0& e^{-i\theta }\end{array}\right),\theta \in R\right\}$ with Lie algebra $R{u}_3$. ${\mathrm{O}}_n=\mathrm{O}\left({\zeta }_n\right)$ is associated with a holomorphic discrete series representation ${\pi }_n$ of $G$ by the KKS (Kirillov-Kostant-Souriau) method of orbits.

$$\begin{array}{l}J:D\to {\mathrm{O}}_n\\ z\mapsto J(z)=\frac{n}{2}\left(\frac{z+z^{*}}{\left(1-{\left|z\right|}^2\right)}{u}_1^{*}+\frac{z-z^{*}}{i\left(1-{\left|z\right|}^2\right)}{u}_2^{*}+\frac{1+{\left|z\right|}^2}{\left(1-{\left|z\right|}^2\right)}{u}_3^{*}\right)\end{array}$$

(85)

Group $G$ act on $D$ by homography $g.z=\left(\begin{array}{cc}a& b\\ b^{*}& a^{*}\end{array}\right).z=\frac{az+b}{b^{*}z+a^{*}}$. This action corresponds with coadjoint action of $G$ on ${\mathrm{O}}_n$. The Kirillov-Kostant-Souriau 2-form of ${\mathrm{O}}_n$ is given by:

$${\mathsf{\Omega }}_n\left(\zeta \right)\left(X\left(\zeta \right),Y\left(\zeta \right)\right)=\langle \zeta ,\left[X,Y\right]\rangle ,X,Y\in \mathrm{g}\mathrm{and}\zeta \in {\mathrm{O}}_n$$

(86)

and is associated in the frame by $J$ with:

$${\omega }_n=\frac{in}{{\left(1-{\left|z\right|}^2\right)}^2}dz\wedge d{z}^{*}$$

(87)

with the corresponding Poisson Bracket:

$$\left\{f,g\right\}=i{\left(1-{\left|z\right|}^2\right)}^2\left(\frac{\partial f}{\partial z}\frac{\partial g}{\partial z^{*}}-\frac{\partial f}{\partial z^{*}}\frac{\partial g}{\partial z}\right)$$

(88)

It has been also observed that there are 3 basic observables generating the $SU(1,1)$ symmetry on classical level:

$$\{\begin{array}{l}D\to R\\ z\mapsto k_3(z)=\frac{1+{\left|z\right|}^2}{1-{\left|z\right|}^2}\end{array},\{\begin{array}{l}D\to R\\ z\mapsto k_1(z)=\frac{1}{i}\frac{z-z^{*}}{1-{\left|z\right|}^2}\end{array},\{\begin{array}{l}D\to R\\ z\mapsto k_2(z)=\frac{z+z^{*}}{1-{\left|z\right|}^2}\end{array}$$

(89)

with the Poisson commutation rule:

$$\left\{k_3,k_1\right\}=k_2,\left\{k_3,k_2\right\}=-k_1,\left\{k_1,k_2\right\}=-k_3$$

(90)

$\left(k_1,k_2,k_3\right)$ vector points to the upper sheet of the two-sheeted hyperboloid in $R^3$ given by $k_3^2-k_1^2-k_2^2=1$, whose the stereographic projection onto the open unit disk is:

$$\{\begin{array}{l}\left(k_1,k_2,k_3\right)\in H^{+}\to D\\ z=\frac{k_2+i{k}_1}{1+k_3}=\sqrt{\frac{k_3-1}{k_3+1}}{e}^{i\arg z}\end{array}$$

(91)

Under the action of $g\in G=SU(1,1)=\left\{\left(\begin{array}{cc}a& b\\ b^{*}& a^{*}\end{array}\right)/{\left|a\right|}^2-{\left|b\right|}^2=1,a,b\in C\right\}$:

$\left(\begin{array}{cc}{k}_{-}& k_3\\ k_3& k_{+}\end{array}\right)=\left(\begin{array}{cc}{k}_2+i{k}_1& k_3\\ k_3& k_2-i{k}_1\end{array}\right)=\frac{1}{1-{\left|z\right|}^2}\left(\begin{array}{cc}2z& 1+{\left|z\right|}^2\\ 1+{\left|z\right|}^2& 2z^{*}\end{array}\right)$ is transform in:

$$\left(\begin{array}{cc}{k}_{-}^{\prime }& k_3^{\prime }\\ k_3^{\prime }& k_{+}^{\prime }\end{array}\right)=\left(\begin{array}{cc}{k}_{-}\left(g^{-1}.z\right)& k_3\left(g^{-1}.z\right)\\ k_3\left(g^{-1}.z\right)& k_{+}\left(g^{-1}.z\right)\end{array}\right)=g^{-1}\left(\begin{array}{cc}{k}_{-}& k_3\\ k_3& k_{+}\end{array}\right){\left(g^{-1}\right)}^t$$

(92)

This transform can be viewed as the co-adjoint action of $SU(1,1)$ on the coadjoint orbit identified with $k_3^2-k_1^2-k_2^2=1$. We can also observe that the quotient $SU(1,1)/K$ is isomorphic to the upper sheet of the hyperboloid described by $k_3^2-k_1^2-k_2^2=1$, by the following parametrization $\left(\tau ,\phi \right)$, given by $\overrightarrow{n}=\left(\cosh \tau ,\sinh \tau \cos \phi ,\sinh \tau \sin \phi \right)$, and its stereographic projection onto the inside of the unit disk, parametrized by $\varsigma =\tanh \frac{\tau }{2}{e}^{-i\phi }$.

6. Covariant Gibbs Density by Souriau Thermodynamics for Poincaré Unit Disk

6.1. Fourier Transform, Laplace Transform and Lie Group Representation Theory

In Souriau Lie Group Thermododynamic, we have to consider Laplace Transform defined on coadjoint orbits to define Massieu Potential Function and Gibbs density. This problem has been solved in the domain of Kirillov Representation Theory. Representation theory studies abstract algebraic structures by representing their elements as linear transformations of vector spaces, and algebraic objects (Lie groups, Lie algebras) by describing its elements by matrices and the algebraic operations in terms of matrix addition and matrix multiplication, reducing problems of abstract algebra to problems in linear algebra. Representation theory generalizes Fourier analysis via harmonic analysis. The modern development of Fourier analysis during XXth century has explored the generalization of Fourier and Fourier-Plancherel formula for non-commutative harmonic analysis, applied to locally compact non-Abelian groups. This has been solved by geometric approaches based on “orbits methods” (Fourier-Plancherel formula for G is given by coadjoint representation of G in dual vector space of its Lie algebra) with many contributors (Dixmier, Kirillov, Bernat, Arnold, Berezin, Kostant, Souriau, Duflo, Guichardet, Torasso, Vergne, Paradan, etc.) [57,58,59,60,61,62,63,64,65,66,67,68].

For classical commutative harmonic analysis, we consider the following groups:

$$\begin{array}{c}G={{\rm T}}^n=R^n/Z^n\mathrm{for}\mathrm{Fourier}\mathrm{series},G=R^n\mathrm{for}\mathrm{Fourier}\mathrm{Transform}\\ \mathrm{G}\mathrm{group}\mathrm{character}(\mathrm{linked}\mathrm{to}{e}^{ikx}):\chi :G\to U\mathrm{with}U=\left\{z\in C/\left|z\right|=1\right\}\\ \widehat{G}=\left\{\chi /{\chi }_1.{\chi }_2(g)={\chi }_1(g){\chi }_2(g)\right\}\mathrm{and}\mathrm{Fourier}\mathrm{transform}\mathrm{is}\mathrm{given}\mathrm{by}:\\ \phi :G\to C\widehat{\phi }:\widehat{G}\to C\\ g\mapsto \phi \left(g\right)={\displaystyle \underset{\widehat{G}}{\int }\widehat{\phi }(\chi )\chi {(g)}^{-1}d\chi }\chi \mapsto \widehat{\phi }\left(\chi \right)={\displaystyle \underset{G}{\int }\phi (g)\chi (g)dg}\end{array}$$

(93)

For non-commutative harmonic analysis, Group unitary irreductible representation is $\mathrm{U}:G\to U\left(H\right)$ with H Hilbert space and character by ${\chi }_{\mathrm{U}}(g)=tr{\mathrm{U}}_g$. Fourier transform for non-commutative group is ${\mathrm{U}}_{\phi }={\displaystyle \underset{G}{\int }\phi (g){\mathrm{U}}_{g}dg}$ with character ${\chi }_{\mathrm{U}}(g)=tr{\mathrm{U}}_{\phi }$. If we describe group element with exponential map ${\mathrm{U}}_{\psi }={\displaystyle \underset{\mathrm{g}}{\int }\psi (X){\mathrm{U}}_{\exp (X)}dX}$, we have:

$$\begin{array}{l}{\mathrm{trU}}_{\psi }=\dim \tau .{\mu }_{G.f}\left(\stackrel{\wedge }{\psi .j^{-1}}\right)\\ \stackrel{\wedge }{\psi .j^{-1}}:\mathrm{g}\to {\mathrm{g}}^{*},\mathrm{Four}.\mathrm{Transf}.\end{array}\mathbf{with}\{\begin{array}{l}{\mu }_{G.f}:\mathrm{Liouville}\mathrm{meas}.\mathrm{on}\mathrm{O}=G.f,f\in {\mathrm{g}}^{*}\\ {\mu }_{G.f}\left(\stackrel{\wedge }{\psi .j^{-1}}\right):\mathrm{Integral}\mathrm{of}\stackrel{\wedge }{\psi .j^{-1}}\mathrm{wrt}{\mu }_{G.f}\end{array}$$

(94)

where

$$j\left(X\right)={\left(\det s\left(a{d}_X\right)\right)}^{1/2}\mathrm{with}s(x)={\displaystyle \sum _{n=0}^{\infty }\frac{1}{(2n+1)!}}{\left(\frac{x}{2}\right)}^{2n}=sh\left(\frac{x}{2}\right)/\left(\frac{x}{2}\right)$$

(95)

Kirillov Character formula is:

$${\chi }_U\left(\exp (X)\right)={\mathrm{trU}}_{\exp (X)}=j{\left(X\right)}^{-1}{\displaystyle \underset{\mathrm{O}}{\int }{e}^{i\langle f,X\rangle }d{\mu }_{\mathrm{O}}(f)}$$

(96)

$${\displaystyle \underset{\mathrm{O}}{\int }{e}^{i\langle f,X\rangle }d{\mu }_{\mathrm{O}}(f)}=j(X){\mathrm{trU}}_{\exp (X)}\mathrm{with}j\left(X\right)={\left(\det \left(\frac{e^{a{d}_X/2}-e^{-a{d}_X/2}}{a{d}_X/2}\right)\right)}^{1/2}$$

(97)

We will use Kirillov representation theory and his character formula to compute Souriau covariant Gibbs density in the unit Poincaré disk. For any Lie group $G$, a coadjoint orbit $\mathrm{O}\subset {\mathrm{g}}^{*}$ has a canonical symplectic form ${\omega }_0$ given by KKS 2-form. As seen, if $G$ is finite dimensional, the corresponding volume element defines a $G$-invariant measure supported on $\mathrm{O}$, which can be interpreted as a tempered distribution. The Fourier transform (where d is the half of the dimension of the orbit O):

$$\Im (x)={\displaystyle \underset{\mathrm{O}\subset {\mathrm{g}}^{*}}{\int }{e}^{-i\langle \lambda ,x\rangle }\frac{1}{d!}d{\omega }_{O^d}}\mathrm{with}\lambda \in {\mathrm{g}}^{*}\mathrm{and}x\in \mathrm{g}$$

(98)

is Ad $G$-invariant. When $\mathrm{O}\subset {\mathrm{g}}^{*}$ is an integral coadjoint orbit, Kirillov formula, given previously, expresses Fourier transform $\Im (x)$ by Kirillov character ${\chi }_{\mathrm{O}}$:

$$\Im (x)=j(x){\chi }_{\mathrm{O}}\left(e^x\right)\mathrm{where}j(x)={\det }^{1/2}\left(\frac{\sinh \left(ad\left(x/2\right)\right)}{ad\left(x/2\right)}\right)$$

(99)

${\chi }_{\mathrm{O}}$ is, as defined previously, the “Kirillov character” of a unitary representation associated to the orbit.

6.2. Souriau Covariant Gibbs Density in Poincaré Unit Disk for SU(1,1) Lie Group

In the following, we will give the full development to compute the Souriau covariant Gibbs density. As the Gibbs density is not defined for all geometric temperature, as observed by Souriau, we have used his approach by considering a one-parameter subgroup of the Lie group generated by exponential map from a one element of Lie algebra given by geometric temperature. The subset of Lie algebra where the Gibbs density is deduced from the contraints related to this one-parameter subgroup generation.

Considering the Lie group $SU(1,1)=\left\{\left(\begin{array}{cc}a& b\\ b^{*}& a^{*}\end{array}\right)/a,b\in C,{\left|a\right|}^2-{\left|b\right|}^2=1\right\}$ and its Lie algebra given by elements $su(1,1)=\left\{\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right)/r\in R,\eta \in C\right\}$. A basis for this Lie algebra $su(1,1)$ is $\left(u_1,u_2,u_3\right)\in \mathrm{g}$ with $u_1=\frac{i}{2}\left(\begin{array}{cc}1& 0\\ 0& -1\end{array}\right),u_2=-\frac{1}{2}\left(\begin{array}{cc}0& 1\\ 1& 0\end{array}\right)\mathrm{and}{u}_3=\frac{1}{2}\left(\begin{array}{cc}0& -i\\ i& 0\end{array}\right)$ with $\left[u_1,u_3\right]=-u_2,\left[u_1,u_2\right]=u_3,\left[u_2,u_3\right]=-u_1$.

The compact subgroup is generated by $u_1$, while $u_2$ and $u_3$ generate a hyperbolic subgroup. The dual space of the Lie algebra is given by $su{(1,1)}^{*}=\left\{\left(\begin{array}{cc}z& x+iy\\ -x+iy& -z\end{array}\right)/x,y,z\in R\right\}$ with the basis $\left(u_1^{*},u_2^{*},u_3^{*}\right)\in {\mathrm{g}}^{*}$ with $u_1^{*}=\left(\begin{array}{cc}1& 0\\ 0& -1\end{array}\right),u_2^{*}=\left(\begin{array}{cc}0& i\\ i& 0\end{array}\right)\mathrm{and}{u}_3^{*}=\left(\begin{array}{cc}0& 1\\ -1& 0\end{array}\right)$.

Let consider $D=\left\{z\in C/\left|z\right|<1\right\}$ be the open unit disk of Poincaré. For each $\rho >0$, the pair $\left(D,{\omega }_{\rho }\right)$ is a symplectic homogeneous manifold with ${\omega }_{\rho }=2i\rho \frac{dz\wedge d{z}^{*}}{{\left(1-{\left|z\right|}^2\right)}^2}$, where ${\omega }_{\rho }$ is invariant under the action: $\begin{array}{l}SU\left(1,1\right)\times D\to D\\ \left(g,z\right)\mapsto g.z=\frac{az+b}{b^{*}z+a^{*}}\end{array}$.

This action is transitive and is globally and strongly Hamiltonian. Its generators are the hamiltonian vector fields associated to the functions:

$$J_1(z,z^{*})=\rho \frac{1+{\left|z\right|}^2}{1-{\left|z\right|}^2},J_2(z,z^{*})=\frac{\rho }{i}\frac{z-z^{*}}{1-{\left|z\right|}^2},J_3(z,z^{*})=-\rho \frac{z+z^{*}}{1-{\left|z\right|}^2}$$

(100)

The associated moment map $J:D\to s{u}^{*}(1,1)$ defined by $J(z).u_i=J_i(z,z^{*})$, maps $D$ into a coadjoint orbit in $s{u}^{*}(1,1)$. Then, we can write the moment map as a matrix element of $s{u}^{*}(1,1)$:

$$\begin{array}{l}J(z)=J_1\left(z,z^{*}\right)u_1^{*}+J_2\left(z,z^{*}\right)u_2^{*}+J_3\left(z,z^{*}\right)u_3^{*}=\left(\begin{array}{cc}\rho \frac{1+{\left|z\right|}^2}{1-{\left|z\right|}^2}& \rho \frac{z-z^{*}}{1-{\left|z\right|}^2}-\rho \frac{z+z^{*}}{1-{\left|z\right|}^2}\\ \rho \frac{z-z^{*}}{1-{\left|z\right|}^2}+\rho \frac{z+z^{*}}{1-{\left|z\right|}^2}& -\rho \frac{1+{\left|z\right|}^2}{1-{\left|z\right|}^2}\end{array}\right)\\ J(z)=J_1\left(z,z^{*}\right)u_1^{*}+J_2\left(z,z^{*}\right)u_2^{*}+J_3\left(z,z^{*}\right)u_3^{*}=\rho \left(\begin{array}{cc}\frac{1+{\left|z\right|}^2}{1-{\left|z\right|}^2}& -2\frac{z^{*}}{1-{\left|z\right|}^2}\\ 2\frac{z}{1-{\left|z\right|}^2}& -\frac{1+{\left|z\right|}^2}{1-{\left|z\right|}^2}\end{array}\right)\in {\mathrm{g}}^{*}\end{array}$$

(101)

The moment map $J$ is a diffeomorphism of $D$ onto one sheet of the two-sheeted hyperboloid in $s{u}^{*}(1,1)$, determined by $J_1^2-J_2^2-J_3^2={\rho }^2,J_1\ge \rho \mathrm{with}{J}_1{u}_1^{*}+J_2{u}_2^{*}+J_3{u}_3^{*}\in s{u}^{*}(1,1)$. We note ${\mathrm{O}}_{\rho }^{+}$ the coadjoint orbit $A{d}_{SU(1,1)}^{*}$ of $SU\left(1,1\right)$, given by the upper sheet of the two-sheeted hyperboloid given by previous equation. The orbit method of Kostant-Kirillov-Souriau associates to each of these coadjoint orbits a representation of the discrete series of $SU\left(1,1\right)$, provided that $\rho$ is a half integer greater or equal than 1 ($\rho =\frac{k}{2},k\in N\mathrm{and}\rho \ge 1$). When explicitly executing the Kostant-Kirillov construction, the representation Hilbert spaces ${\mathrm{H}}_{\rho }$ are realized as closed reproducing kernel subspaces of $L^2\left(D,{\omega }_{\rho }\right)$. The Kostant-Kirillov-Souriau orbit method shows that to each coadjoint orbit of a connected Lie group is associated a unitary irreducible representation of G acting in a Hilbert space H.

Souriau has oberved that action of the full Galilean group on the space of motions of an isolated mechanical system is not related to any equilibrium Gibbs state (the open subset of the Lie algebra, associated to this Gibbs state is empty). The main Souriau idea was to define the Gibbs states for one-parameter subgroups of the Galilean group. We will use the same approach, in this case We will consider action of the Lie group $SU\left(1,1\right)$ on the symplectic manifold (M,ω) (Poincaré unit disk) and its momentum map $J$ are such that the open subset ${\mathsf{\Lambda }}_{\beta }=\left\{\beta \in \mathrm{g}/{\displaystyle \underset{D}{\int }{e}^{-\langle J(z),\beta \rangle }d\lambda (z)}<+\infty \right\}$ is not empty. This condition is not always satisfied when (M, ω) is a cotangent bundle, but of course it is satisfied when it is a compact manifold. The idea of Souriau is to consider a one parameter subgroup of $SU\left(1,1\right)$. To parametrize elements of $SU\left(1,1\right)$ is through its Lie algebra. In the neighborhood of the identity element, the elements of $g\in SU\left(1,1\right)$ can be written as the exponential of an element $\beta$ of its Lie algebra:

$$g=\exp \left(\epsilon \beta \right)\mathrm{with}\beta \in \mathrm{g}$$

(102)

The condition $g^{+}Mg=M\mathrm{for}M=\left(\begin{array}{cc}1& 0\\ 0& -1\end{array}\right)$ can be expanded for $\epsilon <<1$ and is equivalent to ${\beta }^{+}M+M\beta =0$ which then implies $\beta =\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right),r\in R,\eta \in C$. We can observe that $r$ and $\eta ={\eta }_R+i{\eta }_I$ contain 3 degrees of freedom, as required. Also because $\det g=1$, we get $Tr(\beta )=0$. We can then exponentiate $\beta$ with exponential map to get:

$$g=\exp \left(\epsilon \beta \right)={\displaystyle \sum _{k=0}^{\infty }\frac{{\left(\epsilon \beta \right)}^k}{k!}}=\left(\begin{array}{cc}{a}_{\epsilon }(\beta )& b_{\epsilon }(\beta )\\ b_{\epsilon }^{*}(\beta )& a_{\epsilon }^{*}(\beta )\end{array}\right)$$

(103)

If we make the remark that ${\beta }^2=\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right)\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right)=\left({\left|\eta \right|}^2-r^2\right)I$, we can developed the exponential map:

$$g=\exp \left(\epsilon \beta \right)=\left(\begin{array}{cc}\cosh \left(\epsilon R\right)+ir\frac{\sinh \left(\epsilon R\right)}{R}& \eta \frac{\sinh \left(\epsilon R\right)}{R}\\ {\eta }^{*}\frac{\sinh \left(\epsilon R\right)}{R}& \cosh \left(\epsilon R\right)-ir\frac{\sinh \left(\epsilon R\right)}{R}\end{array}\right)\mathrm{with}{R}^2={\left|\eta \right|}^2-r^2$$

(104)

We can observe that one condition is that ${\left|\eta \right|}^2-r^2>0$ then the subset to consider is ${\mathsf{\Lambda }}_{\beta }=\left\{\beta =\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right),r\in R,\eta \in C/{\left|\eta \right|}^2-r^2>0\right\}$ such that ${\displaystyle \underset{D}{\int }{e}^{-\langle J(z),\beta \rangle }d\lambda (z)}<+\infty$. The generalized Gibbs states of the full $SU(1,1)$ group do not exist. However, generalized Gibbs states for the one-parameter subgroups $\exp \left(\alpha \beta \right)$, $\beta \in {\mathsf{\Lambda }}_{\beta }$, of the $SU(1,1)$ group do exist. The generalized Gibbs state associated to $\beta$ remains invariant under the restriction of the action to the one-parameter subgroup of $SU\left(1,1\right)$ generated by $\exp \left(\epsilon \beta \right)$.

To go futher, we will develop the Souriau Gibbs density from the Souriau moment map $J(z)$ and the Souriau temperature $\beta \in {\mathsf{\Lambda }}_{\beta }$. If we note $b=\frac{1}{1-{\left|z\right|}^2}\left[\begin{array}{c}1\\ -z\end{array}\right]$, we can write the moment map:

$$J(z)=\rho \left(\begin{array}{cc}\frac{1+{\left|z\right|}^2}{1-{\left|z\right|}^2}& -2\frac{z^{*}}{1-{\left|z\right|}^2}\\ 2\frac{z}{1-{\left|z\right|}^2}& -\frac{1+{\left|z\right|}^2}{1-{\left|z\right|}^2}\end{array}\right)=\rho \left(2Mb{b}^{+}-Tr\left(Mb{b}^{+}\right)I\right)\mathrm{with}M=\left[\begin{array}{cc}1& 0\\ 0& -1\end{array}\right]$$

(105)

We can the write the covariant Gibbs density in the unit disk given by moment map of the Lie group $SU\left(1,1\right)$ and geometric temperature in its Lie algebra $\beta \in {\mathsf{\Lambda }}_{\beta }$:

$$p_{Gibbs}\left(z\right)=\frac{e^{-\langle J\left(z\right),\beta \rangle }}{{\displaystyle \underset{D}{\int }{e}^{-\langle J\left(z\right),\beta \rangle }d\lambda (z)}}\mathrm{where}d\lambda (z)=2i\rho \frac{dz\wedge d{z}^{*}}{{\left(1-{\left|z\right|}^2\right)}^2}$$

(106)

$$p_{Gibbs}\left(z\right)=\frac{e^{-\langle \rho \left(2\Im b{b}^{+}-Tr\left(\Im b{b}^{+}\right)I\right),\beta \rangle }}{{\displaystyle \underset{D}{\int }{e}^{-\langle J\left(z\right),\beta \rangle }d\lambda (z)}}=\frac{e^{-\langle \rho \left(\begin{array}{cc}\frac{1+{\left|z\right|}^2}{\left(1-{\left|z\right|}^2\right)}& \frac{-2z^{*}}{\left(1-{\left|z\right|}^2\right)}\\ \frac{2z}{\left(1-{\left|z\right|}^2\right)}& -\frac{1+{\left|z\right|}^2}{\left(1-{\left|z\right|}^2\right)}\end{array}\right),\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right)\rangle }}{{\displaystyle \underset{D}{\int }{e}^{-\langle J\left(z\right),\beta \rangle }d\lambda (z)}}$$

(107)

To write the Gibbs density with respect to its statistical moments, we have to express the density with respect to $Q=E\left[J(z)\right]$. Then, we have to invert the relation between $Q$ and $\beta$, to replace this last variable $\beta =\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right)\in {\mathsf{\Lambda }}_{\beta }$ by $\beta ={\mathsf{\Theta }}^{-1}\left(Q\right)\in \mathrm{g}$ where $Q=\frac{\partial \mathsf{\Phi }\left(\beta \right)}{\partial \beta }=\mathsf{\Theta }\left(\beta \right)\in {\mathrm{g}}^{*}$ with $\mathsf{\Phi }\left(\beta \right)=-\log {\displaystyle \underset{D}{\int }{e}^{-\langle J\left(z\right),\beta \rangle }d\lambda (z)}$, deduce from Legendre tranform. The mean moment map is given by:

$$Q=E\left[J(z)\right]=E\left[\rho \left(\begin{array}{cc}\frac{1+{\left|w\right|}^2}{\left(1-{\left|w\right|}^2\right)}& \frac{-2w^{*}}{\left(1-{\left|w\right|}^2\right)}\\ \frac{2w}{\left(1-{\left|w\right|}^2\right)}& -\frac{1+{\left|w\right|}^2}{\left(1-{\left|w\right|}^2\right)}\end{array}\right)\right]\mathrm{where}w\in D$$

(108)

This mean moment map can be obtained by Karcher mean computation on the one-sheet hyperboloid corresponding to the coadjoint orbit. For the dual pairing, we can observed that $J(z)=J_1\left(z,z^{*}\right)u_1^{*}+J_2\left(z,z^{*}\right)u_2^{*}+J_3\left(z,z^{*}\right)u_3^{*}\in {\mathrm{g}}^{*}$ with $J_1(z,z^{*})=\rho \frac{1+{\left|z\right|}^2}{1-{\left|z\right|}^2},J_2(z,z^{*})=\frac{\rho }{i}\frac{z-z^{*}}{1-{\left|z\right|}^2},J_3(z,z^{*})=-\rho \frac{z+z^{*}}{1-{\left|z\right|}^2}$ and $\beta ={\beta }_1{u}_1+{\beta }_2{u}_2+{\beta }_{3}u3\in {\mathrm{g}}^{*}$ with $\beta =2\left(r,-{\eta }_R,-{\eta }_I\right),\eta ={\eta }_R+i{\eta }_I$.

The integral of normalization in Gibbs density could be computed through Kirillov character formula by ${\chi }_m\left(\exp \left(\left(\begin{array}{cc}x& .\\ .& -x\end{array}\right)\right)\right)=j{(x)}^{-1}{\displaystyle \underset{{\mathrm{O}}_{m-1}^{+}}{\int }{e}^{-i\langle \left(\begin{array}{cc}x& .\\ .& -x\end{array}\right),\left(\begin{array}{cc}ir& \eta \\ {\eta }^{*}& -ir\end{array}\right)\rangle }{\omega }_{{\mathrm{O}}_{m-1}^{+}}}$ where

$$j(x)={\det }^{1/2}\left[\sinh \left(ad\left(\begin{array}{cc}x/2& \\ & -x/2\end{array}\right)\right)/ad\left(\begin{array}{cc}x/2& \\ & -x/2\end{array}\right)\right]=\frac{\sinh (x)}{x}$$

with following relation $\frac{e^{mx}}{1-e^{2x}}j(x)={\displaystyle \underset{D}{\int }{e}^{(m-1)x\frac{1+{\left|w\right|}^2}{1-{\left|w\right|}^2}}\frac{1}{{\left(1-{\left|w\right|}^2\right)}^2}dw\wedge d{w}^{*}}$.

Recently, Enrico De Micheli [69] has introduced a Laplace-type transform (the so-called Spherical Laplace Transform) with a connection to the Non-Euclidean Fourier Transform in the sense of Helgason, and the principal series of the unitary representation of SU(1,1).

6.3. Extension to SU (p,q) Unitary Group for Siegel Unit Disk

Mode details are given in Appendix B, on parameterization of SU(1,1) and extension to SU (p,q). To address computation of covariant Gibbs density for Siegel Unit Disk, we will consider in this section $SU(p,q)$ Unitary Group:

$$G=SU(p,q)\mathrm{and}K=S\left(U(p)\times U(q)\right)=\left\{\left(\begin{array}{cc}A& 0\\ 0& D\end{array}\right)/A\in U(p),D\in U(q),\det (A)\det (D)=1\right\}$$

(109)

We can use the following decomposition for $g\in G^C$:

$$g=\left(\begin{array}{cc}A& B\\ C& D\end{array}\right)\in G^C,g=\left(\begin{array}{cc}{I}_p& B{D}^{-1}\\ 0& I_q\end{array}\right)\left(\begin{array}{cc}A-B{D}^{-1}C& 0\\ 0& D\end{array}\right)\left(\begin{array}{cc}{I}_p& 0\\ D^{-1}C& I_q\end{array}\right)$$

(110)

and consider the action of $g\in G^C$ on Siegel Unit Disk $SD=\left\{Z\in M_{pq}\left(C\right)/I_p-Z{Z}^{+}>0\right\}$ given by:

$$g=\left(\begin{array}{cc}A& B\\ C& D\end{array}\right)\in G^C,g=\left(\begin{array}{cc}{I}_p& B{D}^{-1}\\ 0& I_q\end{array}\right)\left(\begin{array}{cc}A-B{D}^{-1}C& 0\\ 0& D\end{array}\right)\left(\begin{array}{cc}{I}_p& 0\\ D^{-1}C& I_q\end{array}\right)$$

(111)

Benjamin Cahen has study this case and introduced the moment map by identifing G-equivariantly ${\mathrm{g}}^{*}$ with $\mathrm{g}$ by means of the Killing form $\beta$ on ${\mathrm{g}}^C$:

$${\mathrm{g}}^{*}\mathrm{G}-\mathrm{equivariant}\mathrm{with}\mathrm{g}\mathrm{by}\mathrm{Killing}\mathrm{form}\beta \left(X,Y\right)=2(p+q)Tr\left(XY\right)$$

The set of all elements of $\mathrm{g}$ fixed by $K$ is $\mathsf{𝖍}$:

$$\begin{array}{l}\mathsf{𝖍}=\left\{\mathrm{element}\mathrm{of}G\mathrm{fixed}\mathrm{by}K\right\},{\xi }_0\in \mathsf{𝖍},{\xi }_0=i\lambda \left(\begin{array}{cc}-q{I}_p& 0\\ 0& p{I}_q\end{array}\right)\\ \Rightarrow \langle {\xi }_0,\left[Z,Z^{+}\right]\rangle =-2i\lambda {\left(p+q\right)}^{2}Tr\left(Z{Z}^{+}\right),\forall Z\in D\end{array}$$

(112)

Then, we the equivatiant moment map is given by:

$$\begin{array}{l}\forall X\in g^C,Z\in D,\psi \left(Z\right)=A{d}^{*}\left(\exp \left(-Z^{+}\right)\zeta \left(\exp Z^{+}\exp Z\right)\right){\xi }_0\\ \forall g\in G,Z\in D\mathrm{then}\psi \left(g.Z\right)=A{d}_g^{*}\psi (Z)\\ \psi \mathrm{is}\mathrm{a}\mathrm{diffeomorphism}\mathrm{from}\mathrm{S}D\mathrm{onto}\mathrm{orbit}O\left({\xi }_0\right)\end{array}$$

(113)

with:

$$\psi \left(Z\right)=i\lambda \left(\begin{array}{cc}{\left(I_p-Z{Z}^{+}\right)}^{-1}\left(-pZ{Z}^{+}-q{I}_p\right)& \left(p+q\right)Z{\left(I_q-Z^{+}Z\right)}^{-1}\\ -(p+q){\left(I_q-Z^{+}Z\right)}^{-1}{Z}^{+}& \left(p{I}_q+q{Z}^{+}Z\right){\left(I_q-Z^{+}Z\right)}^{-1}\end{array}\right)$$

(114)

$$\zeta \left(\exp Z^{+}\exp Z\right)=\left(\begin{array}{cc}{I}_p& Z{\left(I_q-Z^{+}Z\right)}^{-1}\\ 0& I_q\end{array}\right)$$

(115)

7. Lie Groups Thermodynamics for SE(2) Lie Group

After $SU\left(1,1\right)$ Lie group with null cohomology and then without Souriau one-cocycle, we will consider Souriau model for $SE(2)$ Lie group with non-null cohomology and then with introduction of Souriau one-cocycle [70].

We will consider first $SO(2)$ Lie group:

$$SO(2)=\left\{R_{\phi }=\left[\begin{array}{cc}\cos \phi & -\sin \phi \\ \sin \phi & \cos \phi \end{array}\right]/\phi \in R\right\}$$

(116)

A vector at the identity to $SO(2)$ is given by:

$${\frac{d{R}_{t\eta }}{dt}|}_{t=0}=-\eta \Im \mathrm{with}\Im =\left[\begin{array}{cc}0& 1\\ -1& 0\end{array}\right],{\Im }^T={\Im }^{-1}=-\Im$$

(117)

We consider the special Euclidean group $SE(2)=SO\left(2\right)\times R^2$.

$$SE(2)=\left\{\left[\begin{array}{cc}{R}_{\phi }& \tau \\ 0& 1\end{array}\right]/R_{\phi }\in SO\left(2\right),\tau \in R^2\right\}$$

(118)

the group operation is given by:

$$\begin{array}{l}\left[\begin{array}{cc}{R}_{{\phi }_1}& {\tau }_1\\ 0& 1\end{array}\right]\left[\begin{array}{cc}{R}_{{\phi }_2}& {\tau }_2\\ 0& 1\end{array}\right]=\left[\begin{array}{cc}{R}_{{\phi }_1}{R}_{{\phi }_2}& R_{{\phi }_1}{\tau }_2+{\tau }_1\\ 0& 1\end{array}\right]=\left[\begin{array}{cc}{R}_{{\phi }_1+{\phi }_2}& R_{{\phi }_1}{\tau }_2+{\tau }_1\\ 0& 1\end{array}\right]\\ \Rightarrow \left(R_{{}_1},{\tau }_1\right).\left(R_{{\phi }_2},{\tau }_2\right)=\left(R_{{\phi }_1+{\phi }_2},R_{{\phi }_1}{\tau }_2+{\tau }_1\right)\end{array}$$

(119)

$${\left[\begin{array}{cc}{R}_{{\phi }_1}& {\tau }_1\\ 0& 1\end{array}\right]}^{-1}=\left[\begin{array}{cc}{R}_{-{\phi }_1}& -R_{-{\phi }_1}{\tau }_1\\ 0& 1\end{array}\right]\Rightarrow {\left(R_{{\phi }_1},{\tau }_1\right)}^{-1}=\left(R_{-{\phi }_1},-R_{-{\phi }_1}{\tau }_1\right)$$

(120)

The Lie algebra $se\left(2\right)$ of $SE(2)$ has underlying vector space $R^3$ and Lie bracket:

$$\left(\xi ,u\right)\in se(2)=R\times R^2\Rightarrow \left[\begin{array}{cc}-\xi \Im & u\\ 0& 0\end{array}\right]\in se\left(2\right)$$

(121)

Lie bracket is given by:

$$\left[\left(\xi ,u\right),\left(\eta ,v\right)\right]=\left(0,\xi \Im v+\eta \Im u\right)$$

(122)

Adjoint action of $SE(2)$ is given by:

$$\begin{array}{l}A{d}_{\left(R_{\phi },\tau \right)}\left(\xi ,u\right)=\left[\begin{array}{cc}{R}_{\phi }& \tau \\ 0& 1\end{array}\right]\left[\begin{array}{cc}-\xi \Im & u\\ 0& 0\end{array}\right]\left[\begin{array}{cc}{R}_{-\phi }& -R_{-\phi }\tau \\ 0& 1\end{array}\right]=\left[\begin{array}{cc}-\xi \Im & \xi \Im \tau +R_{\phi }u\\ 0& 0\end{array}\right]\\ A{d}_{\left(R_{\phi },\tau \right)}\left(\xi ,u\right)=\left(\xi ,R_{\phi }u+\xi \Im \tau \right)\end{array}$$

(123)

Coadjoint action of $SE(2)$ is given by:

$$A{d}_{\left(R_{\phi },\tau \right)}^{*}\left(m,\rho \right)=\left(m+\Im R_{\phi }\rho .\tau ,R_{\phi }\rho \right)$$

(124)

The moment map $J:R^2\to s{e}^{*}\left(2\right)$ of $SE(2)$ is defined by:

$$J_{\left(\xi ,u\right)}(x)=J(x).\left(\xi ,u\right)$$

(125)

with the right action of $SE(2)$ on $R^2$:

$$x.\left(R\phi ,\tau \right)=R_{-\phi }\left(x-\tau \right)$$

(126)

the infinitesimal generator of $\left(\xi ,u\right)\in se(2)$ has the expression:

$${\left(\xi ,u\right)}_{R^2}(x)={\frac{d\left[x.\left(R_{t\xi },tu\right)\right]}{dt}|}_{t=0}={\frac{d\left[R_{-t\xi }\left(x-tu\right)\right]}{dt}|}_{t=0}=\xi \Im x-u$$

(127)

Let $J_{\left(\xi ,u\right)}(x):R^2\to s{e}^{*}\left(2\right)$ be the moment map of this action relative to the symplectic form, we can compute it from its definition:

$$\begin{array}{l}d{J}_{\left(\xi ,u\right)}(x).y=-2\omega \left({\left(\xi ,u\right)}_{R^2},y\right)\\ \mathrm{with}\omega \left({\left(\xi ,u\right)}_{R^2},y\right)=\omega \left(\xi \Im x-u,y\right)=\left(\xi \Im x-u\right).\Im y=\left(\xi x+\Im u\right).y\\ \Rightarrow d{J}_{\left(\xi ,u\right)}(x).y=-2\left(\xi x+\Im u\right).y\\ \Rightarrow J_{\left(\xi ,u\right)}(x)=-2\left(\frac{1}{2}\xi {\Vert x\Vert }^2+\Im u.x\right)=-2\left(\frac{1}{2}{\Vert x\Vert }^2,-\Im x\right).\left(\xi ,u\right)\\ J_{\left(\xi ,u\right)}(x)=J(x).\left(\xi ,u\right)\Rightarrow J(x)=-2\left(\frac{1}{2}{\Vert x\Vert }^2,-\Im x\right),x\in R^2\end{array}$$

(128)

We then compute the one-cocycle of $SE(2)$ from the moment map:

$$\begin{array}{l}\theta \left(\left(R_{\phi ,\tau }\right)\right)=J\left(0.\left(R_{\phi },\tau \right)\right)-A{d}_{\left(R_{\phi },\tau \right)}^{*}J(0)=J\left(-R_{-\phi }\tau \right)\\ \theta \left(\left(R_{\phi ,\tau }\right)\right)=-2\left(\frac{1}{2}{\Vert \tau \Vert }^2,\Im R_{-\phi }\tau \right)=-2\left(\frac{1}{2}{\Vert \tau \Vert }^2,R_{-\phi -\frac{\pi }{2}}\tau \right)\end{array}$$

(129)

Coadjoint orbit of $SE(2)$ are generated by:

$$\begin{array}{l}{\mathrm{O}}_{\left(m,\rho \right)}=\left\{A_{\left(R_{\phi ,\tau }\right)}^{*}\left(m,\rho \right)+\theta \left(\left(R_{\phi },\tau \right)\right)/\left(R_{\phi },\tau \right)\in SE\left(2\right)\right\}\\ {\mathrm{O}}_{\left(m,\rho \right)}=\left\{\left(x-R_{-\frac{\pi }{2}}\rho .\tau -{\Vert \tau \Vert }^2,R_{-\phi }\rho -2R_{-\phi -\frac{\pi }{2}}\tau \right)/\left(R_{\phi },\tau \right)\in SE\left(2\right)\right\}\end{array}$$

(130)

The Souriau Symplectic form in this case of non-null cohomology is given by:

$$\begin{array}{l}{\omega }_{\left(m,\rho \right)\left(m^{\prime },{\rho }^{\prime }\right)}\left(a{d}_{\left(\xi ,u\right)}^{*}\left(m^{\prime },{\rho }^{\prime }\right)-\left(0,2\Im u\right),a{d}_{\left(\eta ,v\right)}^{*}\left(m^{\prime },{\rho }^{\prime }\right)-\left(0,2\Im v\right)\right)={\rho }^{\prime }.\left(-\xi \Im v+\eta \Im u\right)+2u.\Im v\\ \mathrm{with}\left(m^{\prime },{\rho }^{\prime }\right)=\left(x-R_{-\frac{\pi }{2}}\rho .\tau -{\Vert \tau \Vert }^2,R_{-\phi }\rho -2R_{-\phi -\frac{\pi }{2}}\tau \right)\in {\mathrm{O}}_{\left(m,\rho \right)}\subset R^3\end{array}$$

(131)

With the expression of moment map, we can compute Souriau covariant Gibbs density of Maximum Entropy.

Considering the symplectic form $\omega \left(\zeta ,\upsilon \right)=\zeta .\Im \upsilon \mathrm{with}\Im =\left[\begin{array}{cc}0& 1\\ -1& 0\end{array}\right]$ on $R^2$, we have seen that the action of SE(2) is symplectic and admits the momentum map, $J(x)=-\left(\frac{1}{2}{\Vert x\Vert }^2,-\Im x\right),x\in R^2$.

Souriau Gibbs density is defined for generalized temperature $\beta \in \mathsf{\Omega }=\left\{\left(b,{\rm B}\right)\in se(2)/b<0,{\rm B}\in R^2\right\}$ and given by:

$$p_{Gibbs}\left(x\right)=\frac{e^{-\langle J\left(x\right),\beta \rangle }}{{\displaystyle \underset{R^2}{\int }{e}^{-\langle J\left(x\right),\beta \rangle }d\lambda (x)}}=\frac{e^{\frac{1}{2}b{\Vert x\Vert }^2-{\rm B}.\Im x}}{{\displaystyle \underset{R^2}{\int }{e}^{\frac{1}{2}b{\Vert x\Vert }^2-{\rm B}.\Im x}d\lambda (x)}}$$

(132)

The Massieu Potential could be computed:

$$\mathsf{\Phi }\left(\beta \right)=\log {\displaystyle \underset{R^2}{\int }{e}^{\frac{1}{2}b{\Vert x\Vert }^2-{\rm B}.\Im x}d\lambda (x)}=\log \left(-\frac{2\pi }{b}{e}^{-\frac{1}{2b}{\Vert B\Vert }^2}\right)$$

(133)

By derivation of Massieu potential, we can deduce expression of Heat:

$$\begin{array}{l}Q\in {\mathsf{\Omega }}^{*}=\left\{\left(m,M\right)\in s{e}^{*}(2)/m+\frac{{\Vert M\Vert }^2}{2}<0\right\}\\ Q=\frac{\partial \mathsf{\Phi }\left(\beta \right)}{\partial \beta }=\left(\frac{1}{b}-\frac{{\Vert {\rm B}\Vert }^2}{2b^2},\frac{1}{b}{\rm B}\right)=\mathsf{\Theta }\left(\beta \right)\end{array}$$

(134)

We can the inverse this relation to express generalized temperature with respect to the heat:

$$\beta ={\mathsf{\Theta }}^{-1}\left(Q\right)=\left({\left(m+\frac{1}{2}{\Vert M\Vert }^2\right)}^{-1},{\left(m+\frac{1}{2}{\Vert M\Vert }^2\right)}^{-1}M\right)$$

(135)

We can the express the Gibbs density with respect to the Heat Q which is the mean of moment map:

$$p_{Gibbs}\left(x\right)=\frac{e^{\frac{\frac{1}{2}{\Vert x\Vert }^2-M.\Im x}{\left(m+\frac{1}{2}{\Vert M\Vert }^2\right)}}}{{\displaystyle \underset{R^2}{\int }{e}^{\frac{\frac{1}{2}{\Vert x\Vert }^2-M.\Im x}{\left(m+\frac{1}{2}{\Vert M\Vert }^2\right)}}d\lambda (x)}}\mathrm{with}\left(m,M\right)=E\left(J(x)\right)=E\left[-2\left(\frac{1}{2}{\Vert x\Vert }^2,-\Im x\right)\right]=\left[-E\left({\Vert x\Vert }^2\right),2\Im E(x)\right]$$

(136)

So we can rewrite the Gibbs density:

$$p_{Gibbs}\left(x\right)=\frac{e^{\frac{\frac{1}{2}{\Vert x\Vert }^2+2E(x).Ix}{\left(-E\left({\Vert x\Vert }^2\right)+2{\Vert E(x)\Vert }^2\right)}}}{{\displaystyle \underset{R^2}{\int }{e}^{\frac{\frac{1}{2}{\Vert x\Vert }^2+2E(x).Ix}{\left(-E\left({\Vert x\Vert }^2\right)+2{\Vert E(x)\Vert }^2\right)}}d\lambda (x)}}$$

(137)

We can also provide a Fisher metric in dual Lie algebra as hessian of the Entropy:

$$S\left(Q\right)=\langle Q,\beta \rangle -\mathsf{\Phi }\left(\beta \right)=1+\log \left(2\pi \right)+\log \left(-m-\frac{{\Vert M\Vert }^2}{2}\right)$$

(138)

$$I_{Fisher}\left(Q\right)={\left(m+\frac{1}{2}{\Vert M\Vert }^2\right)}^{-1}\left[\begin{array}{cc}I& M^T\\ M^T& \frac{1}{2}{\Vert M\Vert }^2-m\end{array}\right]$$

(139)

and as $\left(m,M\right)=E\left(J(x)\right)=E\left[-2\left(\frac{1}{2}{\Vert x\Vert }^2,-\Im x\right)\right]=\left[-E\left({\Vert x\Vert }^2\right),2\Im E(x)\right]$, Fisher metric in dual space of Lie Algebra parameterization could be written:

$$I_{Fisher}\left(Q\right)={\left(2{\Vert E(x)\Vert }^2-E\left({\Vert x\Vert }^2\right)\right)}^{-1}\left[\begin{array}{cc}I& {\left(2\Im E(x)\right)}^T\\ 2\Im E(x)& 2{\Vert E(x)\Vert }^2+E\left({\Vert x\Vert }^2\right)\end{array}\right]$$

(140)

8. New Entropy Definition as Generalized Casimir Invariant Functions for Coadjoint and Adjoint Representation

In his paper written in 1974, Jean-Marie Souriau has observed that if we consider the heat expression $Q=\frac{d\mathsf{\Phi }}{d\beta }$, that we can write $\delta \mathsf{\Phi }-\langle Q,\delta \beta \rangle =0$. For each $\delta \beta$ tangent to the orbit, and so generated by an element $Z$ of the Lie algebra, if we consider the relation $\mathsf{\Phi }\left(A{d}_g(\beta )\right)=\mathsf{\Phi }\left(\beta \right)-\langle \theta \left(g^{-1}\right),\beta \rangle$ and we differentiate it at $g=e$ using the property that $\tilde{\mathsf{\Theta }}(X,Y)=-\langle d\theta (X),Y\rangle ,X,Y\in \mathrm{g}$, we obtain $\langle Q,\left[\beta ,Z\right]\rangle +\tilde{\mathsf{\Theta }}\left(\beta ,Z\right)=0$. Souriau has stopped by this last equation, the characterization of Group action on $Q=\frac{\partial \mathsf{\Phi }}{\partial \beta }$. Souriau has also observed that $S\left[Q\left(A{d}_g(\beta )\right)\right]=S\left[A{d}_g^{*}(Q)+\theta \left(g\right)\right]=S\left(Q\right)$. We propose to characterize more explicitly this invariance, by characterizing Entropy as an invariant Casimir function in coadjoint representation.

From last Souriau equation, if we use the identities $\beta =\frac{\partial S}{\partial Q}$, $a{d}_{\beta }Z=\left[\beta ,Z\right]$ and $\tilde{\mathsf{\Theta }}\left(\beta ,Z\right)=\langle \mathsf{\Theta }\left(\beta \right),Z\rangle$, then we can deduce that $\langle a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right),Z\rangle =0,\forall Z$. So, Entropy $S\left(Q\right)$ should verify $a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right)=0$, characterizes an invariant Casimir function in case of non-null cohomology, that we propose to write with Poisson brackets, ${\left\{S,H\right\}}_{\tilde{\mathsf{\Theta }}}\left(Q\right)=0$ where ${\left\{S,H\right\}}_{\tilde{\mathsf{\Theta }}}\left(Q\right)=\langle Q,\left[\frac{\partial S}{\partial Q},\frac{\partial H}{\partial Q}\right]\rangle +\tilde{\mathsf{\Theta }}\left(\frac{\partial S}{\partial Q},\frac{\partial H}{\partial Q}\right)=0$, $\forall H:{\mathrm{g}}^{*}\to R,Q\in {\mathrm{g}}^{*}$.

In a Poisson manifold, Casimir functions $S\in C^{\infty }({\mathrm{g}}^{*})$, in case of null cohomology, are functions whose Poisson brackets will all functions vanish, $\left\{S,H\right\}\left(Q\right)=0,\forall S\in C^{\infty }({\mathrm{g}}^{*}),Q\in {\mathrm{g}}^{*}$. In the dual of the Lie algebra of a connected Lie group $G$, the Casimir functions are the $A{d}^{*}$-invariant functions, because if $S,H\in C^{\infty }({\mathrm{g}}^{*})$ and $Q\in {\mathrm{g}}^{*}$, then $\left\{S,H\right\}\left(Q\right)=\langle Q,\left[\frac{\partial S}{\partial Q},\frac{\partial H}{\partial Q}\right]\rangle =\langle Q,a{d}_{\frac{\partial S}{\partial Q}}\frac{\partial H}{\partial Q}\rangle =\langle a{d}_{\frac{\partial S}{\partial Q}}^{*}Q,\frac{\partial H}{\partial Q}\rangle$ vanishes for all $H\in C^{\infty }({\mathrm{g}}^{*})$ if and only if $a{d}_{\frac{\partial S}{\partial Q}}^{*}Q=0$. A function is $S$ on ${\mathrm{g}}^{*}$ is $A{d}^{*}$-invariant if $g.S=S,\forall g\in G$ where Lie group $G$ acts on functions on ${\mathrm{g}}^{*}$ by $\left(g.S\right)\left(Q\right)=S\left(A{d}_g^{*}Q\right),Q\in {\mathrm{g}}^{*},S\in C^{\infty }\left({\mathrm{g}}^{*}\right),g\in G$, and where infinitesimal characterizations of $A{d}^{*}$-invariant functions on ${\mathrm{g}}^{*}$, ${\frac{d}{dt}S\left(A{d}_{\exp (tx)}^{*}Q\right)|}_{t=0}=\langle a{d}_x^{*}Q,\frac{\partial S}{\partial Q}\rangle =-\langle a{d}_{\frac{\partial S}{\partial Q}}^{*}Q,x\rangle$. The symplectic leaves of a Poisson manifold are contained in the connected components of the level sets of the Casimir functions and Casimir function is constant on a symplectic leaf. Coadjoint orbits lie on level sets of the Casimir functions, which are conserved quantities. Casimir functions Level sets are symplectic manifolds. Coadjoint motion of the moment map $Q(t)=A{d}_{g(t)}^{*}Q(0)$ for a solution curve $g(t)\in C\left(G\right)$ take place on the intersections of levels sets of the Hamiltonian and the Casimir functions. Alexis Arnaudon has studied stochastic coadjoint processes whose solutions lie on coadjoint orbits.

We have observed that ${\left\{S,H\right\}}_{\tilde{\mathsf{\Theta }}}\left(Q\right)=\langle Q,\left[\frac{\partial S}{\partial Q},\frac{\partial H}{\partial Q}\right]\rangle +\tilde{\mathsf{\Theta }}\left(\frac{\partial S}{\partial Q},\frac{\partial H}{\partial Q}\right)=0,\forall H:{\mathrm{g}}^{*}\to R,Q\in {\mathrm{g}}^{*}$, that shows that Souriau Entropy is a Casimir function in case with non-null cohomology when an additional cocycle should be taken into account. Indeed, infinitesimal variation is characterized by the following differentiation: ${\frac{d}{dt}S\left(Q\left(A{d}_{\exp (tx)}\beta \right)\right)|}_{t=0}={\frac{d}{dt}S\left(A{d}_{\exp (tx)}^{*}Q+\theta \left(\exp (tx)\right)\right)|}_{t=0}=-\langle a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right),x\rangle$. We recover extended Casimir equation in case of non-null cohomology verified by Entropy, $a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right)=0$, and then the generalized Casimir condition ${\left\{S,H\right\}}_{\tilde{\mathsf{\Theta }}}\left(Q\right)=0$. Hamiltonian motion on these affine coadjoint orbits is given by the solutions of the Lie-Poisson equations with cocycle.

The identification of Entropy as an Invariant Casimir Function in Coadjoint representation is also important in Information Theory, because classically Entropy is introduced axiomatically. With this new approach, we can build Entropy by constructing the Casimir Function associated to the Lie group and also in case of non-null cohomology. Igor V. Shirokov [71,72,73,74,75] has proposed a method for constructing invariants of the coadjoint representation of Lie groups with an arbitrary dimension and structure based on local symplectic coordinates on the coadjoint orbits. The idea of the method of constructing coadjoint invariants is to construct the canonical transition to the Darboux coordinates on the orbits of the dual Lie algebra ${\mathrm{g}}^{*}$ of maximal dimension dual to the Lie algebra $\mathrm{g}$ of the Lie group $G$. These relations provide invariants of the coadjoint representation of the Lie group $G$.

This geometric framework unifies several earlier works on the subject, including Souriau’s symplectic model of statistical mechanics, and approaches developed in Information Geometry and Quantum Information Geometry. This approach helps to identify the common geometric structures appearing in various domains from statistical mechanics to statistical learning. The emphasis is put on the role of the affine equivariance with respect to Lie group actions, as extension of the Fisher metric in presence of equivariance and the associated Lie-Poisson equations with cocycle (affine Lie-Poisson equations). The entropy of the Souriau model as a Casimir function can be used to apply a geometric model for energy preserving entropy production on Lie algebras. We can exploit the geometric framework of this new equation to build geometric numerical integrator schemes for some of the equations associated to Souriau’s model and its polysymplectic extension. This new equation is important because it introduce new structure of differential equations in case of non-null cohomology and for an arbitrary Hamiltonian $H:{\mathrm{g}}^{*}\to R$: $\frac{dQ}{dt}=a{d}_{\frac{\partial H}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H}{\partial Q}\right)$.

The equation $\frac{dQ}{dt}=a{d}_{\frac{\partial H}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H}{\partial Q}\right)$ is important because it allows extending stochastic perturbation of the Lie-Poisson equation with cocycle within the setting of stochastic Hamiltonian dynamics, which preserves the affine coadjoint orbits. We can extend model for stochastic geometric modeling in fluid dynamics via variational principles described in [32,76]. This extension results in the new Stratonovich differential equation for the stochastic process $dQ+\left[a{d}_{\frac{\partial H}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H}{\partial Q}\right)\right]dt+{\displaystyle \sum _{i=1}^N\left[a{d}_{\frac{\partial H_i}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H_i}{\partial Q}\right)\right]\circ d{W}_i\left(t\right)}=0$.

This new equation is also very usefull for geometric symplectic Lie group integrator for Lie-Poisson equations with cocycle that preserves the affine coadjoint orbits for general Hamiltonian. This equation is also very relevant in the framework of dynamics with Casimir dissipation/production, to formulate a dynamical geometric model for dissipation/production of this Casimir. This allows to extend the general Lie algebraic approach developed in [77,78] for Casimir dissipation, to take into account of a cocycle, and to a wider class of dissipation. Paper [17] will exploit this new Casimir equation in case of non-null cohomology.

This equation $\frac{dQ}{dt}=a{d}_{\frac{\partial H}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H}{\partial Q}\right)$ could be used also to make the link with 2nd principle of Thermodynamique, that will be deduced from positivity of Souriau-Fisher metric:

$$\begin{array}{l}S\left(Q\right)=\langle Q,\beta \rangle -\mathsf{\Phi }\left(\beta \right)\mathrm{with}\frac{dQ}{dt}=a{d}_{\frac{\partial H}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H}{\partial Q}\right)\\ \frac{dS}{dt}=\langle Q,\frac{d\beta }{dt}\rangle +\langle a{d}_{\frac{\partial H}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H}{\partial Q}\right),\beta \rangle -\frac{d\mathsf{\Phi }}{dt}=\langle Q,\frac{d\beta }{dt}\rangle +\langle a{d}_{\frac{\partial H}{\partial Q}}^{*}Q,\beta \rangle ++\langle \mathsf{\Theta }\left(\frac{\partial H}{\partial Q}\right),\beta \rangle -\frac{d\mathsf{\Phi }}{dt}\\ \frac{dS}{dt}=\langle Q,\frac{d\beta }{dt}\rangle +\langle Q,\left[\frac{\partial H}{\partial Q},\beta \right]\rangle +\tilde{\mathsf{\Theta }}\left(\frac{\partial H}{\partial Q},\beta \right)-\frac{d\mathsf{\Phi }}{dt}=\langle Q,\frac{d\beta }{dt}\rangle +{\tilde{\mathsf{\Theta }}}_{\beta }\left(\frac{\partial H}{\partial Q},\beta \right)-\langle \frac{\partial \mathsf{\Phi }}{\partial \beta },\frac{d\beta }{dt}\rangle \\ \frac{dS}{dt}=\langle Q,\frac{d\beta }{dt}\rangle +{\tilde{\mathsf{\Theta }}}_{\beta }\left(\frac{\partial H}{\partial Q},\beta \right)-\langle \frac{\partial \mathsf{\Phi }}{\partial \beta },\frac{d\beta }{dt}\rangle \mathrm{with}\frac{\partial \mathsf{\Phi }}{\partial \beta }=Q\\ \frac{dS}{dt}={\tilde{\mathsf{\Theta }}}_{\beta }\left(\frac{\partial H}{\partial Q},\beta \right)\ge 0,\forall H\left(\mathrm{link}\mathrm{to}\mathrm{positivity}\mathrm{of}\mathrm{Fisher}\mathrm{metric}\right)\\ \mathrm{if}H=S\underset{\frac{\partial S}{\partial Q}=Q}{\Rightarrow }\frac{dS}{dt}={\tilde{\mathsf{\Theta }}}_{\beta }\left(\beta ,\beta \right)=0\mathrm{because}\beta \in Ker{\tilde{\mathsf{\Theta }}}_{\beta }\end{array}$$

(141)

Entropy production is then linked with Souriau-Fisher structure, $dS={\tilde{\mathsf{\Theta }}}_{\beta }\left(\frac{\partial H}{\partial Q},\beta \right)dt$ with ${\tilde{\mathsf{\Theta }}}_{\beta }\left(\frac{\partial H}{\partial Q},\beta \right)=\tilde{\mathsf{\Theta }}\left(\frac{\partial H}{\partial Q},\beta \right)+\langle Q,\left[\frac{\partial H}{\partial Q},\beta \right]\rangle$ Souriau tensor related to Fisher metric.

8.1. Casimir Invariant and Generalized Casimir Invariant

Hendrik Brugt Gerhard Casimir, a Dutch physicist, studied what is called Casimir operators and Casimir invariants (H. Casimir and Van der Waerden studied the SU(2) group, the group of isospin/angular momentum, as the model of the algebraic approach to the study of the unitary representations of semi-simple compact Lie groups). Kirillov has explained that Casimir operators are in one-to-one correspondence with polynomial invariants characterizing orbits of the coadjoint representation. Solutions are not necessarily polynomials and the nonpolynomial solutions are called generalized Casimir invariants. For certain classes of Lie algebras, all invariants of the coadjoint representation are functions of polynomial ones. In physics, Hamiltonians and integrals of motion of classical integrable Hamiltonian systems are not polynomials in the momenta [71,72,73,74,75,79,80,81,82,83,84,85,86,87,88,89,90,91,92].

8.2. Souriau Entropy as Generalized Casimir Invariant in Coadjoint Representation

In Souriau Lie groups Thermodynamics, we will see that coadjoint orbits lie on level sets of the Entropy that could be considered as a Casimir invariant function:

$$\begin{array}{l}S:{\mathrm{g}}^{*}\to R\\ Q\mapsto S\left(Q\right)\end{array}$$

(142)

We will consider first the case of null-cohomology, Entropy as Casimir invariant function is a conserved quantity, because Casimir function has null Lie Poisson brackets functions [93,94]:

$$\begin{array}{l}\left\{S,H\right\}\left(Q\right)=\langle Q,\left[\frac{\partial S}{\partial Q},\frac{\partial H}{\partial Q}\right]\rangle =0,\forall H:{\mathrm{g}}^{*}\to R,Q\in {\mathrm{g}}^{*},\langle A,B\rangle =B\left(A,B\right)\mathrm{Cartan-Killing}\mathrm{form}\\ \mathrm{with}\partial \mathrm{S}\left(Q\right)={\frac{d}{d\epsilon }S\left(Q+\delta Q\right)|}_{\epsilon =0}=\langle \delta Q,\frac{\partial S}{\partial Q}\rangle \end{array}$$

(143)

We can observe that $\beta =\frac{\partial S}{\partial Q}$, then:

$$\langle Q,\left[\beta ,\frac{\partial H}{\partial Q}\right]\rangle =\langle Q,a{d}_{\beta }\frac{\partial H}{\partial Q}\rangle =0,\forall H:{\mathrm{g}}^{*}\to R,Q\in {\mathrm{g}}^{*},a{d}_{a}b=\left[a,b\right]$$

(144)

We can also write:

$$\langle Q,\left[\frac{\partial S}{\partial Q},\frac{\partial H}{\partial Q}\right]\rangle =\langle Q,a{d}_{\frac{\partial S}{\partial Q}}\frac{\partial H}{\partial Q}\rangle =\langle a{d}_{\frac{\partial S}{\partial Q}}^{*}Q,\frac{\partial H}{\partial Q}\rangle =0,\forall H:{\mathrm{g}}^{*}\to R$$

(145)

It means that $a{d}_{\frac{\partial S}{\partial Q}}^{*}Q=a{d}_{\beta }^{*}Q=0,\beta =\frac{\partial S}{\partial Q}$. We can remark that if we note ${\left(a{d}_{\frac{\partial S}{\partial Q}}^{*}Q\right)}_j=C_{ij}^{k}a{d}_{{\left(\frac{\partial S}{\partial Q}\right)}^i}^{*}{Q}_k=0$ with $C_{ij}^k$ the structure tensor, we observe that this equation is in fact the Casimir condition for invariant function in coadjoint representation as we will see hereafter. The restriction of the Lie-Poisson bracket to an orbit generates a symplectic structure on the orbit, called the KKS (Kirillov-Kostant-Souriau) structure, or the canonical symplectic structure. Casimir function is characterized as a quantity which commutes with each linear functional on the Poisson manifold, and then it is conserved by dynamics of any Hamiltonian.

Given a Hamiltonian $H:{\mathrm{g}}^{*}\to R$, the equation of motion for $Q\in {\mathrm{g}}^{*}$ is:

$$\frac{dQ}{dt}=\left\{Q,H\right\}=a{d}_{\frac{\partial H}{\partial Q}}^{*}Q\mathrm{with}H=S\Rightarrow \frac{dQ}{dt}=\left\{Q,S\right\}=a{d}_{\frac{\partial S}{\partial Q}}^{*}Q=0$$

(146)

In case of non-null cohomology, the Lie Poisson brackets functions are given by:

$$\begin{array}{l}{\left\{S,H\right\}}_{\tilde{\mathsf{\Theta }}}\left(Q\right)=\langle Q,\left[\frac{\partial S}{\partial Q},\frac{\partial H}{\partial Q}\right]\rangle +\tilde{\mathsf{\Theta }}\left(\frac{\partial S}{\partial Q},\frac{\partial H}{\partial Q}\right)=0,\forall H:{\mathrm{g}}^{*}\to R,Q\in {\mathrm{g}}^{*}\\ \mathrm{with}\tilde{\mathsf{\Theta }}(X,Y)=J_{\left[X,Y\right]}-\left\{J_X,J_Y\right\}\mathrm{where}{J}_X(x)=\langle J(x),X\rangle \\ \tilde{\mathsf{\Theta }}\left(X,Y\right):\mathrm{g}\times \mathrm{g}\to \Re \mathrm{with}\mathsf{\Theta }(X)=T_e\theta \left(X(e)\right)\\ \mathrm{X},\mathrm{Y}\mapsto \langle \mathsf{\Theta }(X),Y\rangle \end{array}$$

(147)

That we can develop in the following:

$$\begin{array}{l}{\left\{S,H\right\}}_{\tilde{\mathsf{\Theta }}}\left(Q\right)=\langle Q,\left[\frac{\partial S}{\partial Q},\frac{\partial H}{\partial Q}\right]\rangle +\langle \mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right),\frac{\partial H}{\partial Q}\rangle =0\\ {\left\{S,H\right\}}_{\tilde{\mathsf{\Theta }}}\left(Q\right)=\langle Q,a{d}_{\frac{\partial S}{\partial Q}}\frac{\partial H}{\partial Q}\rangle +\langle \mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right),\frac{\partial H}{\partial Q}\rangle =0\\ {\left\{S,H\right\}}_{\tilde{\mathsf{\Theta }}}\left(Q\right)=\langle a{d}_{\frac{\partial S}{\partial Q}}^{*}Q,\frac{\partial H}{\partial Q}\rangle +\langle \mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right),\frac{\partial H}{\partial Q}\rangle =0\\ \forall H,{\left\{S,H\right\}}_{\tilde{\mathsf{\Theta }}}\left(Q\right)=\langle a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right)+,\frac{\partial H}{\partial Q}\rangle =0\Rightarrow a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right)=0\end{array}$$

(148)

We have found the generalized Casimir equation for Entropy in the non-null cohomology case:

$${\left\{S,H\right\}}_{\tilde{\mathsf{\Theta }}}\left(Q\right)=0$$

(149)

That could be also written:

$$a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right)=0$$

(150)

This equation was observed by Souriau in his paper of 1974, where he has written that geometric temperature $\beta$ is a kernel of ${\tilde{\mathsf{\Theta }}}_{\beta }$, that is written:

$$\beta \in Ker{\tilde{\mathsf{\Theta }}}_{\beta }\Rightarrow \langle Q,\left[\beta ,Z\right]\rangle +\tilde{\mathsf{\Theta }}\left(\beta ,Z\right)=0$$

(151)

That we can develop to recover the Casimir equation:

$$\begin{array}{l}\Rightarrow \langle Q,a{d}_{\beta }Z\rangle +\tilde{\mathsf{\Theta }}\left(\beta ,Z\right)=0\Rightarrow \langle a{d}_{\beta }^{*}Q,Z\rangle +\tilde{\mathsf{\Theta }}\left(\beta ,Z\right)=0\\ \beta =\frac{\partial S}{\partial Q}\Rightarrow \langle a{d}_{\frac{\partial S}{\partial Q}}^{*}Q,Z\rangle +\tilde{\mathsf{\Theta }}\left(\frac{\partial S}{\partial Q},Z\right)=\langle a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right),Z\rangle =0,\forall Z\\ \Rightarrow a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right)=0\end{array}$$

(152)

Then the generalized Casimir Equation in non-null cohomogy is given by:

$${\left(a{d}_{\frac{\partial S}{\partial Q}}^{*}Q\right)}_j+\mathsf{\Theta }{\left(\frac{\partial S}{\partial Q}\right)}_j=C_{ij}^{k}a{d}_{{\left(\frac{\partial S}{\partial Q}\right)}^i}^{*}{Q}_k+{\mathsf{\Theta }}_j=0$$

(153)

Given a Hamiltonian $H:{\mathrm{g}}^{*}\to R$, the equation of motion for $Q\in {\mathrm{g}}^{*}$ is:

$$\frac{dQ}{dt}=a{d}_{\frac{\partial H}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial H}{\partial Q}\right)\mathrm{with}H=S\Rightarrow \frac{dQ}{dt}=a{d}_{\frac{\partial S}{\partial Q}}^{*}Q+\mathsf{\Theta }\left(\frac{\partial S}{\partial Q}\right)=0$$

(154)

Level sets of the Casimir Entropy function, on which the coadjoint orbits lie, are symplectic manifolds.

8.3. Souriau Entropy Invariance in Coadjoint Representation

If we note $\mathsf{𝕬}\mathsf{𝖓}\left({\mathrm{g}}^{*}\right)$ the space of analytic function on the dual space of the Lie agebra ${\mathrm{g}}^{*}$, a function $F^{*}\in \mathsf{𝕬}\mathsf{𝖓}\left({\mathrm{g}}^{*}\right)$ is a Casimir invariant if for any $g\in G,X\in {\mathrm{g}}^{*}$, we have $F^{*}\left(A{d}_g^{*}X\right)=F^{*}(X)$. We have observed previously that Souriau’s Entropy analytic function $S(Q)$ defined on dual space of the Lie algebra ${\mathrm{g}}^{*}$ by Legendre transform of Massieu Characteric analytic function $\mathsf{\Phi }(\beta )$ (minus logarithm of Laplace transform) defined on Lie algebra $\mathrm{g}$ was an invariant function under the affine coadjoint action $S\left[Q\left(A{d}_g(\beta )\right)\right]=S\left[A{d}_g^{*}(Q)+\theta \left(g\right)\right]=S\left(Q\right)$. In case of null-cohomology, Souriau cocycle cancels $\theta \left(g\right)=0$, and we recover Casimir invariant function in coadjoint representation $S\left[A{d}_g^{*}(Q)\right]=S\left(Q\right)$.

We can then observe that Souriau Entropy is an extended Casimir invariant function in case of non-null cohomogy. This characteristic of Souriau Entropy could be a new characterization of Entropy. In Souriau Lie groups Thermodynamics, Entropy $S(Q)$ is a generalized Casimir invariant function for coadjoint representation in case of non-null cohomology, and Massieu Characteristic function by Legendre duality is a generalized Casimir function for adjoint representation.

We will explain how to prove that Souriau Entropy is invariant under the action of the group, starting from its definition:

$$S(Q)=\langle Q,\beta \rangle -\mathsf{\Phi }(\beta )\mathrm{with}Q=\frac{\partial \mathsf{\Phi }(\beta )}{\partial \beta }\in {\mathrm{g}}^{*}\mathrm{and}\beta =\frac{\partial S(Q)}{\partial Q}\in \mathrm{g}$$

(155)

with

$$\mathsf{\Phi }(\beta )=-\log {\displaystyle \underset{M}{\int }{e}^{-\langle U(\xi ),\beta \rangle }d{\lambda }_{\omega }}\mathrm{and}U:M\to {\mathrm{g}}^{*}$$

(156)

Considering Souriau Entropy $S\left(Q\right)$ where the heat $Q=\frac{\partial \mathsf{\Phi }(\beta )}{\partial \beta }\in {\mathrm{g}}^{*}$ an element of the dual space of the Lie algebra is parameterized by $\beta \in \mathrm{g}$ an element of the Lie algebra, the Lie group $G$ acts through $g\in G$ by adjoint operator $A{d}_g$, the entropy is given by $S\left[Q\left(A{d}_g(\beta )\right)\right]$ with $Q\left(A{d}_g(\beta )\right)$ given by fundamental Souriau equation:

$$Q\left(A{d}_g(\beta )\right)=A{d}_g^{*}(Q)+\theta \left(g\right)$$

(157)

The invariance of Souriau Entropy is deduced from the following developments:

$$\begin{array}{l}\beta \in \mathrm{g}\to A{d}_g(\beta )\Rightarrow \mathsf{\Psi }(A{d}_g(\beta ))={\displaystyle \underset{M}{\int }{e}^{-\langle U,A{d}_g(\beta )\rangle }d{\lambda }_{\omega }}\\ \mathsf{\Psi }(A{d}_g(\beta ))={\displaystyle \underset{M}{\int }{e}^{-\langle A{d}_{g^{-1}}^{*}U,\beta \rangle }d{\lambda }_{\omega }}={\displaystyle \underset{M}{\int }{e}^{-\langle U\left(A{d}_{g^{-1}}\beta \right)-\theta \left(g^{-1}\right),\beta \rangle }d{\lambda }_{\omega }}\\ \mathsf{\Psi }(A{d}_g(\beta ))=e^{\langle \theta \left(g^{-1}\right),\beta \rangle }\mathsf{\Psi }\left(\beta \right)\\ \theta \left(g^{-1}\right)=-A{d}_{g^{-1}}^{*}\theta (g)\Rightarrow \mathsf{\Psi }(A{d}_g(\beta ))=e^{-\langle A{d}_{g^{-1}}^{*}\theta (g),\beta \rangle }\mathsf{\Psi }\left(\beta \right)\\ \mathsf{\Phi }\left(\beta \right)=-\log \mathsf{\Psi }(\beta )\Rightarrow \mathsf{\Phi }\left(A{d}_g(\beta )\right)=\mathsf{\Phi }\left(\beta \right)-\langle \theta \left(g^{-1}\right),\beta \rangle =\mathsf{\Phi }\left(\beta \right)+\langle A{d}_{g^{-1}}^{*}\theta (g),\beta \rangle \end{array}$$

(158)

Based on this expression of Massieu Characteristic function transform by action of the group, we can use Legendre transform to study how Souriau Entropy is changed:

$$\begin{array}{l}S(Q)=\langle Q,\beta \rangle -\mathsf{\Phi }(\beta )\Rightarrow S\left(Q\left(A{d}_g\beta \right)\right)=\langle Q\left(A{d}_g\beta \right),A{d}_g\beta \rangle -\mathsf{\Phi }\left(A{d}_g\beta \right)\\ \{\begin{array}{l}Q\left(A{d}_g(\beta )\right)=A{d}_g^{*}(Q)+\theta \left(g\right)\\ \mathsf{\Phi }\left(A{d}_g(\beta )\right)=-\log \mathsf{\Psi }(A{d}_g(\beta ))=-\langle \theta \left(g^{-1}\right),\beta \rangle +\mathsf{\Phi }\left(\beta \right)\end{array}\\ \Rightarrow S\left(Q\left(A{d}_g\beta \right)\right)=\langle A{d}_g^{*}(Q)+\theta \left(g\right),A{d}_g\beta \rangle +\langle \theta \left(g^{-1}\right),\beta \rangle -\mathsf{\Phi }\left(\beta \right)\\ \Rightarrow S\left(Q\left(A{d}_g\beta \right)\right)=\langle A{d}_g^{*}(Q)+\theta \left(g\right),A{d}_g\beta \rangle -\langle A{d}_{g^{-1}}^{*}\theta (g),\beta \rangle -\mathsf{\Phi }\left(\beta \right)\\ \Rightarrow S\left(Q\left(A{d}_g\beta \right)\right)=\langle A{d}_{g^{-1}}^{*}A{d}_g^{*}(Q)+A{d}_{g^{-1}}^{*}\theta \left(g\right),\beta \rangle -\langle A{d}_{g^{-1}}^{*}\theta (g),\beta \rangle -\mathsf{\Phi }\left(\beta \right)\\ A{d}_{g^{-1}}^{*}A{d}_g^{*}(Q)=Q\Rightarrow S\left(Q\left(A{d}_g\beta \right)\right)=\langle Q,\beta \rangle -\mathsf{\Phi }\left(\beta \right)=S\left(\beta \right)\end{array}$$

(159)

We finally prove that Souriau Entropy is invariant in coadjoint representation $S\left(A{d}_g^{*}(Q)+\theta \left(g\right)\right)=S\left(\beta \right)$ in general case of non-null cohomology, that we could write $S\left(A{d}_g^{\#}(Q)\right)=S\left(\beta \right)$, if we note affine coadjoint action $A{d}_g^{\#}(Q)=A{d}_g^{*}(Q)+\theta \left(g\right)$. This is also true in case of null-cohomology when the Souriau cocycle cancels $\theta \left(g\right)=0$, and we recover classical generalized Casimir invariant function definition on coadjoint representation for Entropy $S\left(A{d}_g^{*}(Q)\right)=S\left(\beta \right)$ generalized Casimir invariant function definition on adjoint representation for Massieu Characteristic function $\mathsf{\Phi }\left(A{d}_g(\beta )\right)=\mathsf{\Phi }\left(\beta \right)$.

8.4. Souriau Entropy Given by Casimir Invariant Functions Equations

Based on development given in the following we can state that:

As the Entropy $S$ is a generalized Casimir invariant function in the coadjoint representation, $S\left(A{d}_{e^{t\xi }}^{*}h\right)=S(h)$, then $S$ should be solution of the following differential equation:

$$C_{ij}^k{Q}_k\frac{\partial S\left(Q\right)}{\partial Q_j}=0,i,j,k=\dim \mathrm{g},\mathrm{with}\{\begin{array}{l}{C}_{ij}^k{Q}_k=C_{ij}(Q)=B_{ij}\\ B_Q\left(x,y\right)=B_{ij}{x}^i{y}^j=\langle Q,\left[x,y\right]\rangle \end{array}$$

(160)

where $C_{ij}^k$ is the structure tensor of the Lie algebra $\mathrm{g}$ in the basis $\left(e_1,e_2,\dots ,e_n\right)$, while $X_k$ are the coordinates in ${\mathrm{g}}^{*}$ in the basis $\left(e^1,e^2,\dots ,e^n\right)$ defined by $\langle e^j,e_i\rangle ={\delta }_{ij}$. The structure tensor s given by $\left[\varphi \left(e_i\right),\varphi \left(e_i\right)\right]=C_{ij}^k\varphi \left(e_k\right)$ with $\varphi \left(e_i\right)=C_{ij}^k{X}_k\frac{\partial }{\partial X_j},i=1,\dots ,n$.

8.5. Characterization of Generalized Casimir Invariant Functions in Coadjoint Representation

We will describe recent characterization of generalized Casimir invariant functions by Oleg L. Kurnyavko and Igor V. Shirokov [72,73,75] who have proposed Algebraic method for construction of Casimir invariants of Lie groups coadjoint representations (see Appendix C). Modern invariant theory based on geometric methods, which was credited classically as non-constructive, has some exception admitting a constructive solution related to the constructing invariants of Lie groups representations.

Let $T$ be a connected Lie group, $T(G)$ a representation of the group $G$ in the linear space $V$, $T_g$ the operators associated to the representation of the group $G$ on the linear space $V$, then the invariants are given by the following equation:

$$F\left(T_{g}x\right)=F(x),x\in V,g\in G,T_g\in T(G),F(x)\in C^{\infty }(V)$$

(161)

With the properties that:

$$T_e=I,T_{g_a{g}_b}=T_{g_a}{T}_{g_b},T_{g^{-1}}={\left(T_g\right)}^{-1}$$

(162)

Solution is given by the following differential equation:

$$-{\displaystyle \sum _{i,j}^{\dim V}{t}_{kj}^i{x}^j\frac{\partial F(x)}{\partial x^i}}=0\mathrm{with}{t}_{kj}^i={\frac{\partial {\left(T_g\right)}_j^i}{\partial g^k}|}_{g=e}\mathrm{and}k=1,\dots ,\dim G$$

(163)

$t_{kj}^i$ are elements of the matrices of the Lie algebra representation basis of $G$.

That we can write $t_k=-t_{kj}^i{x}^j\frac{\partial }{\partial x^i}$ and $t_{k}F(x)=0$.

If we consider the dual space $V^{*}$, the co-tangent representation is given by:

$$\langle T^{*}(g)X,T(g)x\rangle =\langle X,x\rangle$$

(164)

And co-represnetation invariants are given by:

$$t_k^{*}{F}^{*}(X)=0\mathrm{with}{t}_k^{*}=t_{kj}^i{X}_i\frac{\partial }{\partial X_j}$$

(165)

They have underlined the relationship between invariants of representations and conjugate representations, where the algebraic construction of Lie groups representations invariants are given by invariants of the conjugate representation with respect to the invariants of the original representation.

Shirokov Theorem 1. 

Let$F(x)$be a non-degenerate invariant of the representation$T(G)$, then conjugate representation invariant can be found by Legrendre tranform:

$$F^{*}(X)=x^i{X}_i-F(x)=\langle x,X\rangle -F(x)\mathrm{with}X=\frac{\partial F(x)}{\partial x}\mathrm{such}\mathrm{that}{X}_i=\frac{\partial F(x)}{\partial x^i}$$

(166)

and also the converse problem:

$$F(x)=x^i{X}_i-F^{*}(X)=\langle x,X\rangle -F^{*}(X)\mathrm{with}x=\frac{\partial F^{*}(X)}{\partial X}\mathrm{such}\mathrm{that}{x}^i=\frac{\partial F^{*}(X)}{\partial X_i}$$

(167)

Shirokov has considered $F(x)$ the representation invariant $T(G)$, and $F^{*}(X)$ the representation invariant $T^{*}(G)$ conjugate to $T(G)$, with the conditions:

$$-t_{kj}^i{x}^j\frac{\partial F(x)}{\partial x^i}=0\mathrm{and}{t}_{lj}^i{X}_i\frac{\partial F^{*}(X)}{\partial X_j}=0$$

(168)

$$\begin{array}{l}{t}_{lj}^i{X}_i\frac{\partial F^{*}(X)}{\partial X_j}=t_{lj}^i{X}_i\frac{\partial }{\partial X_j}\left[x^k(X)X_k-F\left(x(X)\right)\right]=t_{lj}^i{X}_i\frac{\partial x^k}{\partial X_j}{X}_k+t_{lj}^i{X}_i{x}^k\frac{\partial X_k}{\partial X_j}-t_{lj}^i{X}_i\frac{\partial F(x)}{\partial x^k}\frac{\partial x^k}{\partial X_j}\\ t_{lj}^i{X}_i\frac{\partial F^{*}(X)}{\partial X_j}=t_{lj}^i{X}_i\frac{\partial x^k}{\partial X_j}\frac{\partial F(x)}{\partial x^k}+t_{lj}^i\frac{\partial F(x)}{\partial x^i}{x}^k{\delta }_k^j-t_{lj}^i\frac{\partial F(x)}{\partial x^i}\frac{\partial F(x)}{\partial x^k}\frac{\partial x^k}{\partial X_j}\\ t_{lj}^i{X}_i\frac{\partial F^{*}(X)}{\partial X_j}=t_{lj}^i{x}_j\frac{\partial F(x)}{\partial x^i}=0\end{array}$$

(169)

Invariant Casimir Functions of the coadjoint representation has been studied for completely integrable Hamiltonian systems, as classical systems on the orbits of the coadjoint representation. Oleg L. Kurnyavko and Igor V. Shirokov have considered the relationship between invariants of representations of Lie groups and their conjugate dual representations.

Considering the coadjoint action given by:

$$\langle A{d}_g^{*}X,x\rangle =\langle X,A{d}_{g^{-1}}x\rangle ,g\in G,X\in {\mathrm{g}}^{*},x\in \mathrm{g}$$

(170)

Invariants of a coadjoint representation are called Casimir functions, with the property:

$$F^{*}\left(A{d}_g^{*}X\right)=F^{*}\left(X\right)$$

(171)

the infinitesimal invariance is given by the equations:

$$C_{ij}(X)\frac{\partial F^{*}\left(X\right)}{\partial X_j}=0\mathrm{with}{C}_{ij}(X)=C_{ij}^k{X}_k,i,j,k=\dim \mathrm{g}$$

(172)

The number of functionally independent invariants is given by the rank of the matrix $C_{ij}(X)$, called the index of the Lie algebra $\mathrm{g}$: $ind\mathrm{g}=\dim {\mathrm{g}}^{*}-\underset{X\in {\mathrm{g}}^{*}}{\sup }rank{C}_{ij}(X)$.

From these adjoint and coadjoint representation, Shirokov has introduced the following theorem:

Shirokov Theorem 2. 

Let$F\left(A{d}_{g}x\right)=F(x)$be a non-degenerate invariant of the adjoint representation$A{d}_G$, then conjugate representation invariant, invariant of coadjoint representation$A{d}_G^{*}$can be found by formula:

$$F^{*}(X)=x^i{X}_i-F(x)=\langle x,X\rangle -F(x)\mathrm{with}X=\frac{\partial F(x)}{\partial x}\mathrm{such}\mathrm{that}{X}_i=\frac{\partial F(x)}{\partial x^i}$$

(173)

and also the converse problem, let$F^{*}\left(A{d}_g^{*}X\right)=F^{*}\left(X\right)$, invariant of coadjoint representation$A{d}_G$ is given by:

$$F(x)=x^i{X}_i-F^{*}(X)=\langle x,X\rangle -F^{*}(X)\mathrm{with}x=\frac{\partial F^{*}(X)}{\partial X}\mathrm{such}\mathrm{that}{x}^i=\frac{\partial F^{*}(X)}{\partial X_i}$$

(174)

Nota:

$$C_{ij}^k{X}_k\frac{\partial F^{*}\left(X\right)}{\partial X_j}=0,i,j,k=\dim \mathrm{g},\mathrm{with}\{\begin{array}{l}{C}_{ij}^k{X}_k=C_{ij}(X)=B_{ij}\\ B_X\left(x,y\right)=B_{ij}{x}^i{y}^j=\langle X,\left[x,y\right]\rangle \end{array}$$

(175)

8.6. Constructing Generalized Casimir Invariant Functions in Coadjoint Representation

I. V. Shirokov has proposed a method for constructing invariants of the coadjoint representation of Lie groups with an arbitrary dimension and structure based on local symplectic coordinates on the coadjoint orbits. Oleg L. Kurnyavko and Igor V. Shirokov have also proposed a general method for constructing Casimir invariants.

We will give some other developments of Casimir Invariant Functions by A.T. Fomenko and V.V. Trofimov, related to Orbits of the coadjoint representation and the associated canonical symplectic structure.

The coadjoint orbit ${\mathrm{O}}_h$ passing through the point $h\in {\mathrm{g}}^{*}$ is given by

$${\mathrm{O}}_h=\left\{A{d}_g^{*}h/g\in G\right\}\mathrm{where}h\in {\mathrm{g}}^{*}$$

(176)

$$\begin{array}{c}{T}_h{\mathrm{O}}_h=\left\{a{d}_{\rho }^{*}h/\rho \in \mathrm{g}\right\}\subset {\mathrm{g}}^{*},h\in {\mathrm{g}}^{*}\\ v={\frac{d\left[A{d}_{{\exp }^{t\rho }}^{*}h\right]}{dt}|}_{t=0}\in T_h{\mathrm{O}}_h,\rho \in \mathrm{g}\end{array}$$

(177)

$$\begin{array}{l}\mathrm{Let}\left(e_1,\dots ,e_n\right)\mathrm{basis}\mathrm{of}\mathrm{g},\left(e^1,\dots ,e^n\right)\mathrm{basis}\mathrm{of}{\mathrm{g}}^{*},\mathrm{with}\langle e^i,e_j\rangle ={\delta }_{i,j}\\ h=h_i{e}^i\Rightarrow v^i={\frac{d\left[\langle h_i,A{d}_{{\exp }^{t\rho }}^{*}h\rangle \right]}{dt}|}_{t=0}={\frac{d\left[\langle A{d}_{{\exp }^{t\rho }}^{*}h,e_i\rangle \right]}{dt}|}_{t=0}\\ v^i={\frac{d\left[\langle h,A{d}_{{\exp }^{-t\rho }}{e}_i\rangle \right]}{dt}|}_{t=0}=\langle h,{\frac{d\left[A{d}_{{\exp }^{-t\rho }}{e}_i\right]}{dt}|}_{t=0}\rangle \\ v^i=\langle h,-\left[\rho ,e_i\right]\rangle =-\langle a{d}_{\rho }^{*}h,e_i\rangle =\langle v,e_i\rangle \Rightarrow v=-a{d}_{\rho }^{*}h\end{array}$$

(178)

Kirillov, Kostant and Souriau have introduced a KKS 2-form on co-adjoint co-orbits that then inherit a structure of homogeneous symplectic manifold:

$$\begin{array}{l}\xi ,\eta \in T_h{\mathrm{O}}_h=\left\{a{d}_{\chi }^{*}h/\rho \in \mathrm{g}\right\}\subset {\mathrm{g}}^{*},h\in g^{*}\\ {\omega }_h\left(\xi ,\eta \right)=\omega \left(a{d}_{{\xi }_1}^{*}h,a{d}_{{\eta }_1}^{*}h\right)=\langle h,\left[{\xi }_1,{\eta }_1\right]\rangle \mathrm{with}\xi =a{d}_{{\xi }_1}^{*}h\mathrm{and}\eta =a{d}_{{\eta }_1}^{*}h\end{array}$$

(179)

This KKS 2-form $\omega$ is invariant with respect to the coadjoint action ${\omega }_g\left(A{d}_f^{*}\xi ,A{d}_f^{*}\eta \right)={\omega }_h\left(\xi ,\eta \right)$:

$$\begin{array}{l}{\omega }_g\left(A{d}_f^{*}\xi ,A{d}_f^{*}\eta \right)={\omega }_g\left(A{d}_f^{*}a{d}_{{\xi }_1}^{*}h,A{d}_f^{*}a{d}_{{\eta }_1}^{*}h\right)\\ \mathrm{with}g=A{d}_f^{*}h,\xi =a{d}_{{\xi }_1}^{*}h,\eta =a{d}_{{\eta }_1}^{*}h\mathrm{and}f\in G,g,h\in {\mathrm{g}}^{*}\\ A{d}_f^{*}a{d}_{{\xi }_1}^{*}h=a{d}_{A{d}_f{\xi }_1}^{*}\left(A{d}_f^{*}h\right)\mathrm{and}A{d}_f^{*}a{d}_{{\eta }_1}^{*}h=a{d}_{A{d}_f{\eta }_1}^{*}\left(A{d}_f^{*}h\right)\\ {\omega }_g\left(A{d}_f^{*}\xi ,A{d}_f^{*}\eta \right)={\omega }_g\left(a{d}_{A{d}_f{\xi }_1}^{*}\left(A{d}_f^{*}h\right),a{d}_{A{d}_f{\eta }_1}^{*}\left(A{d}_f^{*}h\right)\right)\\ {\omega }_g\left(A{d}_f^{*}\xi ,A{d}_f^{*}\eta \right)={\omega }_g\left(a{d}_{A{d}_f{\xi }_1}^{*}g,a{d}_{A{d}_f{\eta }_1}^{*}g\right)=\langle g,\left[A{d}_f{\xi }_1,A{d}_f{\eta }_1\right]\rangle \\ {\omega }_g\left(A{d}_f^{*}\xi ,A{d}_f^{*}\eta \right)=\langle g,A{d}_f\left[{\xi }_1,{\eta }_1\right]\rangle =\langle A{d}_{f^{-1}}^{*}g,\left[{\xi }_1,{\eta }_1\right]\rangle \mathrm{with}h=A{d}_{f^{-1}}^{*}g\\ {\omega }_g\left(A{d}_f^{*}\xi ,A{d}_f^{*}\eta \right)=\langle h,\left[{\xi }_1,{\eta }_1\right]\rangle \\ {\omega }_g\left(A{d}_f^{*}\xi ,A{d}_f^{*}\eta \right)={\omega }_h\left(\xi ,\eta \right)\end{array}$$

(180)

The symplectic structure is given due to the property that $d\omega =0$, that could be proved making link with Jacobi identity.

$$\begin{array}{l}\mathrm{Let}gra{d}_{skew}m\mathrm{such}\mathrm{that}\omega \left(v,gra{d}_{skew}m\right)=v(m)={\displaystyle \sum _i{v}^i\frac{\partial m}{\partial x^i}}\mathrm{smooth}\mathrm{vector}\mathrm{field}\mathrm{on}M\\ \left\{m,n\right\}=\omega \left(gra{d}_{skew}m,gra{d}_{skew}n\right)={\displaystyle \sum _{i<j}{\omega }_{ij}}{\left(gra{d}_{skew}m\right)}^i{\left(gra{d}_{skew}n\right)}^j\\ \mathrm{with}{\left(gra{d}_{skew}m\right)}^i={\displaystyle \sum _j{\omega }^{ij}\frac{\partial m}{\partial x^j}}\Rightarrow \left\{m,n\right\}={\displaystyle \sum _{i<j}{\omega }^{ij}\frac{\partial m}{\partial x^i}\frac{\partial n}{\partial x^j}}\end{array}$$

(181)

Jacobi identity can be computed:

$$\begin{array}{l}\left\{m,\left\{n,p\right\}\right\}=-\left(gra{d}_{Skew}m\right)\left\{n,p\right\}=-L_{gra{d}_{Skew}m}\left\{n,p\right\}\mathrm{with}{L}_{\zeta }:\mathrm{Lie}\mathrm{derivative}\\ \mathrm{If}\xi =gra{d}_{Skew}m\\ L_{\xi }\left\{n,p\right\}=L_{\xi }\left({\omega }^{ij}\frac{\partial n}{\partial x^i}\frac{\partial p}{\partial x^j}\right)=L_{\xi }{\left(\omega \right)}^{ij}\frac{\partial n}{\partial x^i}\frac{\partial p}{\partial x^j}+{\omega }^{ij}\frac{\partial \left(\xi n\right)}{\partial x^i}\frac{\partial p}{\partial x^j}+{\omega }^{ij}\frac{\partial n}{\partial x^i}\frac{\partial \left(\xi p\right)}{\partial x^j}\\ L_{\xi }\left\{n,p\right\}=L_{\xi }{\left(\omega \right)}^{ij}\frac{\partial n}{\partial x^i}\frac{\partial p}{\partial x^j}+\left\{\xi n,p\right\}+\left\{n,\xi p\right\}=L_{\xi }{\left(\omega \right)}^{ij}\frac{\partial n}{\partial x^i}\frac{\partial p}{\partial x^j}-\left\{\left\{m,n\right\},p\right\}-\left\{n,\left\{m,p\right\}\right\}\\ \Rightarrow \left\{m,\left\{n,p\right\}\right\}+\left\{\left\{m,n\right\},p\right\}+\left\{n,\left\{m,p\right\}\right\}=L_{\xi }{\left(\omega \right)}^{ij}\frac{\partial n}{\partial x^i}\frac{\partial p}{\partial x^j}\end{array}$$

(182)

Using Elie Cartan formula $L_{\xi }\omega =i\left(\xi \right)d\omega +di\left(\xi \right)\omega$. If $\xi$ is a Hamiltonian vector field, $di\left(\xi \right)\omega =0$ and then $L_{\xi }\omega =i\left(\xi \right)d\omega$. If $d\omega =0$, then the Jacobi identity is satisfied $\left\{m,\left\{n,p\right\}\right\}+\left\{\left\{m,n\right\},p\right\}+\left\{n,\left\{m,p\right\}\right\}=0$ and conversely.

Let consider the Berezin Bracket:

$$\begin{array}{l}\left\{m,n\right\}=-C_{ij}^k{x}_k\frac{\partial m}{\partial x^i}\frac{\partial n}{\partial x^j}\mathrm{with}\left[e_i,e_j\right]=C_{ij}^k{e}_k\\ \mathrm{where}\left(e_1,e_2,\dots ,e_n\right)\mathrm{basis}\mathrm{of}\mathrm{Lie}\mathrm{algebra}\mathrm{g},\left(e^1,e^2,\dots ,e^n\right)\mathrm{basis}\mathrm{of}\mathrm{dual}\mathrm{Lie}\mathrm{algebra}{\mathrm{g}}^{*}\\ \mathrm{of}\mathrm{corresponding}\mathrm{coordinates}{x}^1,\dots ,x^n\mathrm{for}\mathrm{g},x_1,\dots ,x_n\mathrm{for}{\mathrm{g}}^{*}\end{array}$$

(183)

This Berezin Bracket is given by:

$$\begin{array}{l}{\left\{m,n\right\}}_x=d{m}_x\left(a{d}_{dn(x)}^{*}(x)\right)=\left(a{d}_{dn(x)}^{*}(x)\right)\left(d{m}_x\right)\\ {\left\{m,n\right\}}_x=\langle x,\left[d{n}_x,d{m}_x\right]\rangle =C_{ij}^k{x}_k\frac{\partial n}{\partial x^i}\frac{\partial m}{\partial x^j}\mathrm{with}d{n}_x=\frac{\partial n}{\partial x_i}{e}_i,d{m}_x=\frac{\partial m}{\partial x_j}{e}_j\end{array}$$

(184)

By developping Berezin Bracket $\left\{m,n\right\}=-C_{ij}^k{x}_k\frac{\partial m}{\partial x^i}\frac{\partial n}{\partial x^j}\mathrm{with}\left[e_i,e_j\right]=C_{ij}^k{e}_k$, we can prove that the bracket verify jacoby identy $\left\{m,\left\{n,p\right\}\right\}+\left\{\left\{m,n\right\},p\right\}+\left\{n,\left\{m,p\right\}\right\}=0$ and then $d\omega =0$.

We will see that differential equation for (semi-)invariants of the coadjoint representations could be established. We will note $\mathsf{𝕬}\mathsf{𝖓}\left({\mathrm{g}}^{*}\right)$ the space of analytic function on the dual space of the Lie agebra ${\mathrm{g}}^{*}$. A function $F^{*}\in \mathsf{𝕬}\mathsf{𝖓}\left({\mathrm{g}}^{*}\right)$ is an invariant if for any $g\in G,X\in {\mathrm{g}}^{*}$, we have $F^{*}\left(A{d}_g^{*}X\right)=F^{*}(X)$, and is semi-invariant if $F^{*}\left(A{d}_g^{*}X\right)=\chi (g)F^{*}(X)$ where $\chi (g)$ is a character of the Lie group $G$.

We have a representation of Lie algebras $\varphi :\mathrm{g}\to Vec\left(\mathsf{\Gamma }\right)$ defined on basis $\left(e_1,e_2,\dots ,e_n\right)$ in $\mathrm{g}$ where $Vec\left(\mathsf{\Gamma }\right)$ is the space of vector fields on $\mathsf{\Gamma }$ an open subset in ${\mathrm{g}}^{*}$, given by:

$$\varphi \left(e_i\right)=C_{ij}^k{X}_k\frac{\partial }{\partial X_j},i=1,\dots ,n$$

(185)

where $C_{ij}^k$ is the structure tensor of the Lie algebra $\mathrm{g}$ in the basis $\left(e_1,e_2,\dots ,e_n\right)$, while $X_k$ are the coordinates in ${\mathrm{g}}^{*}$ in the basis $\left(e^1,e^2,\dots ,e^n\right)$ defined by $\langle e^j,e_i\rangle ={\delta }_{ij}$. The representation is not dependent of the choice of the basis, with the property: $\left[\varphi \left(e_i\right),\varphi \left(e_i\right)\right]=C_{ij}^k\varphi \left(e_k\right)$.

We have the property, that:

$${\frac{d^n{F}^{*}\left(A{d}_{e^{t\xi }}^{*}h\right)}{d{t}^n}|}_{t=0}=\left[{\left(-\varphi \left(\xi \right)\right)}^n{F}^{*}\right]\left(h\right)$$

(186)

This result is obtained by the following development:

$$\begin{array}{l}{\frac{d{F}^{*}\left(A{d}_{e^{t\xi }}^{*}h\right)}{dt}|}_{t=0}=\frac{\partial F^{*}}{\partial X_i}(h){.\frac{d\langle A{d}_{e^{t\xi }}^{*}h,X_i\rangle }{dt}|}_{t=0}=\frac{\partial F^{*}}{\partial X_i}(h){.\frac{d\langle h,A{d}_{e^{-t\xi }}{e}_i\rangle }{dt}|}_{t=0}\\ {\frac{d\langle h,A{d}_{e^{-t\xi }}{e}_i\rangle }{dt}|}_{t=0}=\langle h,-\left[\xi ,e_i\right]\rangle =-\langle h,C_{ij}^k{\xi }^j{e}_k\rangle \mathrm{with}\left[\xi ,e_i\right]=\left[{\xi }^j{e}_j,e_i\right]=C_{ji}^k{\xi }^j{e}_k\\ {\frac{d\langle h,A{d}_{e^{-t\xi }}{e}_i\rangle }{dt}|}_{t=0}=\langle h_k{e}^k,-C_{ji}^k{\xi }^j{e}_k\rangle =-C_{ji}^k{\xi }^j{h}_k\\ {\frac{d{F}^{*}\left(A{d}_{e^{t\xi }}^{*}h\right)}{dt}|}_{t=0}=-C_{ji}^k{\xi }^j{h}_k\frac{\partial F^{*}}{\partial X_i}\left(\xi \right)=\left(-\varphi \left(\xi \right)F^{*}\right)(h)\end{array}$$

(187)

We use then Taylor expansion of $F^{*}\left(A{d}_{e^{t\xi }}^{*}h\right)$ given by:

$$F^{*}\left(A{d}_{e^{t\xi }}^{*}h\right)=F^{*}(h)+{\displaystyle \sum _{n=1}^{\infty }\frac{{\left(-\varphi (\xi )\right)}^n{F}^{*}}{n!}}(h).t^n$$

(188)

We can observe that $F^{*}$ is invariant if $F^{*}\left(A{d}_{e^{t\xi }}^{*}h\right)=F^{*}(h)$ and then ${\left(-\varphi (\xi )\right)}^n{F}^{*}=0$ or $\varphi (\xi )F^{*}=0$ that could be written $C_{ji}^k{\xi }^j{h}_k\frac{\partial F^{*}}{\partial X_i}\left(\xi \right)=0$.

If $F^{*}$ is semi-invariant of the coadjoint representation of group if and only if:

$$\varphi (e_i)F^{*}=-{\lambda }_i{F}^{*}\mathrm{with}{\lambda }_i=d\chi \left(e_i\right)(\mathrm{d}\chi :\mathrm{derivative}\mathrm{of}\chi \mathrm{at}\mathrm{the}\mathrm{group}G\mathrm{identity}\mathrm{element}$$

$$\begin{array}{l}{F}^{*}\left(A{d}_{e^{t\xi }}^{*}h\right)=\chi \left(e^{t\xi }\right)F^{*}(h)\mathrm{with}\chi \left(e^{t\xi }\right)=e^{t{\chi }_{*}\left(\xi \right)}\\ \left[{\left(-\varphi \left(\xi \right)\right)}^n{F}^{*}\right]\left(h\right)={\chi }_{*}\left(\xi \right)F^{*}(h)\\ \Rightarrow F^{*}\left(A{d}_{e^{t\xi }}^{*}h\right)=\left[1+{\displaystyle \sum _{n=1}^{\infty }\frac{{\left[{\chi }_{*}\left(\xi \right)\right]}^n}{n!}{t}^n}\right].F^{*}(h)\end{array}$$

(189)

9. Conclusion: Lie Groups Thermodynamics for Machine Learning

With Lie groups Thermodynamics, we have presented Souriau tools to extend Gibbs density for Lie groups [95,96,97,98,99,100,101,102,103,104,105,106,107]. We can make reference to other explorations of Lie Group Representation theory to built exponential families [108,109,110,111] or Information Geometry in Quantum Physics [112,113,114,115,116,117,118,119,120,121,122,123]. Gibbs density estimation is a basic tool in statistical macine learning. Classically, we can associate to any posterior distribution an effective generalized geometric temperature, given by an element of the dual space of the Lie algebra, relating it to the Gibbs prior distribution. Classification rules could be introduced by Gibbs measures defined on parameter sets and depending on the observed sample value. A Gibbs measure is a special kind of probability measure used in statistical mechanics to describe the state of a particle system driven by a given energy function at some given temperature. Gibbs measures will be realized as minimizers of the average loss value under entropy constraints. In this extension for Lie groups, an important tool is the log-Laplace transform related to the Massieu Characteristic Function in Thermodynamics (a re-parameterization of the free energy by Planck temperature preserving Legendre transform with respect to Entropy). As we want to deal with Lie group data for Machine Learning, we will consider tools very similar to those used in statistical mechanics to describe particle systems with many degrees of freedom. Classification rules could be described by Gibbs measures defined on parameter sets and depending on the observed sample value. Comparing any posterior distribution with a Gibbs prior distribution make it possible to provide a way to build an estimator which can be proved to reach adaptively at the best possible asymptotic error rate (by temperature selection of a Gibbs posterior distribution built within a single parametric model). Estimators derived from Gibbs posteriors show excellent performance in diverse tasks, such as classification, regression and ranking. The usual recommendation is to sample from a Gibbs posterior using MCMC (Markov chain Monte Carlo). With covariant Souriau Gibbs density, it is possible to extend MCMC and Gibbs sampler approach for Lie Groups Machine Learning.

More recently, the use of perturbation techniques has been proposed as an alternative to MCMC techniques for sampling. These results have been extended in conditional random fields loss, proving that the maximum in expectation with low-rank perturbations, provides an upperbound on the log partition (what we call Massieu characteristic function). New lower bounds on the partition function and new unbiased sequential sampler for the Gibbs distribution based on low-rank perturbations have been introduced. All these methods are based on sampling from the Gibbs distribution, upper-bounding the log partition function. All these results are synthetized in [124], where they also propose a new general method, with connections to the recently-proposed Fenchel-Young losses [125], using doubly stochastic scheme for minimization of these losses, for unsupervised and supervised learning. This is a generalization to the Gibbs distribution. Methods for learning parameters of a Gibbs distribution on data ${\left(y_i\right)}_{i=1,\dots ,n}$ are based on maximization of the likelihood:

$${\widehat{l}}_n\left(\theta \right)=\frac{1}{n}{\displaystyle \sum _{i=1}^n\log p_{Gibbs,\theta }\left(y_i\right)}=\frac{1}{n}{\displaystyle \sum _{i=1}^n\langle y_i,\theta \rangle }-\log \psi \left(\theta \right)$$

(190)

that is optimized by gradients methods using the empirical log-likelihood, given by:

$${\nabla }_{\theta }{\widehat{l}}_n\left(\theta \right)={\widehat{y}}_n-E_{Gibbs,\theta }\left[y\right]$$

(191)

For this method of moment-matching, the expectation of the Gibbs distribution is a challenge in some cases. This approach has been replaced by computing $p_{\theta }$, with a method called “perturb-and-MAP” to learn the parameters in this model as a proxy for log-likelihood. This minimization is equivalent to maximizing previous equation by substituting the log-partition $\log \psi \left(\theta \right)$ with:

$$\begin{array}{c}{F}_{\epsilon }(\theta )=E\left[F\left(\theta +\epsilon V\right)\right]=E\left[\underset{y\in C}{\max \langle y,\theta +\epsilon V\rangle }\right]\mathrm{with}\mathrm{a}\mathrm{random}\mathrm{noise}\mathrm{vector}\\ \epsilon V,\epsilon >0\end{array}$$

(192)

This approach could be linked with the use of Fenchel-Young losses [125]. In the perturbed model, the Fenchel-Young loss is given by:

$$L_{\epsilon }\left(\theta ;y\right)=F_{\epsilon }(\theta )+\epsilon \mathsf{\Omega }(y)-\langle \theta ,y\rangle =D_{\epsilon \mathsf{\Omega }}\left(y,{\widehat{y}}_{\epsilon }^{*}(\theta )\right)$$

(193)

with loss gradient $\nabla L_{\epsilon }\left(\theta ;y\right)=\nabla F_{\epsilon }(\theta )-y=y_{\epsilon }^{*}(\theta )-y$ where $y_{\epsilon }^{*}(\theta )=E_{p_{\theta }(y)}\left[y\right]=E\left[\arg \underset{y\in C}{\max }\langle y,\theta +\epsilon V\rangle \right]$ and $D_{\epsilon \mathsf{\Omega }}\left(y,{\widehat{y}}_{\epsilon }^{*}(\theta )\right)$ Bregman divergence associated to $\epsilon \mathsf{\Omega }$. As $F_{\epsilon }$ generalizes the log-sum-exp function on the simplex, its dual $\mathsf{\Omega }$ is a generalization of the negative entropy (which is the Fenchel dual of log-sum-exp).These connections have been studied in [126].

To conclude, we have seen that Lie group tools based on Representation Theory and Orbits Methods could be used with Souriau-Fisher Metric on Coadjoint Orbits as an extension of Fisher Metric for Lie group through homogeneous Symplectic Manifolds on Lie group Co-Adjoint Orbits.

We can then beneficiate of different tools based on Souriau Lie groups Thermodynamics and Kirillov Representation Theory, as illustrated in Figure 6, for:

• Supervised Machine Learning

⚬

Geodesic Natural Gradient on Lie Algebra: Extension of Neural Network Natural Gradient from Information Geometry on Lie Algebra for Lie Groups Machine Learning.

⚬

Souriau Maximum Entropy Density on Co-Adjoint Orbits: Covariant Maximum Entropy Probability Density for Lie groups defined with Souriau Moment Map, Co-Adjoint Orbits Method & Kirillov Representation Theory

⚬

Symplectic Integrator preserving Moment Map: Extension of Neural Network Natural Gradient to Geometric Integrators as Symplectic integrators that preserve moment map

• Non-Supervised Machine Learning

⚬

Souriau Exponential Map on Lie Algebra: Exponential Map for Geodesic Natural Gradient on Lie Algebra based on Souriau Algorithm for Matrix Characteristic Polynomial

⚬

Fréchet Geodesic Barycenter by Hermann Karcher Flow: Extension of Mean/Median on Lie group by Fréchet Definition of Geodesic Barycenter on Souriau-Fisher Metric Space, solved by Karcher Flow.

⚬

Mean-Shift on Lie groups with Souriau-Fisher Distance: Extension of Mean-Shift for Homogeneous Symplectic Manifold and Souriau-Fisher Metric Space.

 [There is nothing more in physical theories than symmetry groups except the mathematical construction which allows precisely to show that there is nothing more]    « Il n’y a rien de plus dans les théories physiques que les groupes de symétrie si ce n’est la construction mathématique qui permet précisément de montrer qu’il n’y a rien de plus ».

Jean-Marie Souriau (see Figure 7)

  La notion classique d’ensemble canonique de Gibbs est étendue au cas d’une variété symplectique sur laquelle un groupe de Lie possède une action symplectique (“groupe dynamique”). La définition rigoureuse donnée ici permet d’étendre un certain nombre de propriétés thermodynamiques classiques (la température est ici un élément de l’algèbre de Lie du groupe, la chaleur un élément de son dual), notamment des inégalités de convexité. Dans le cas de groupes non commutatifs, des propriétés particulières apparaissent: la symétrie est spontanément brisée, certaines relations de type cohomologique sont vérifiées dans l’algèbre de Lie du groupe [The classical notion of Gibbs’ canonical ensemble is extended to the case of a symplectic manifold on which a Lie group has a symplectic action (“dynamic group”). The rigorous definition given here makes it possible to extend a certain number of classical thermodynamic properties (the temperature here is an element of the Lie group algebra, heat an element of its dual), notably inequalities of convexity. In the case of non-commutative groups, particular properties appear: the symmetry is spontaneously broken, certain relations of cohomological type are verified in the Lie algebra of the group].

Jean-Marie Souriau, Mécanique Statistique, Groupes de Lie et Cosmologie, colloque CNRS n°237 – Géométrie Symplectique et physique mathématique