Abstract
The law of multiplicative error is presented for independent observations and correlated observations represented by the q-product, respectively. We obtain the standard log-normal distribution in the former case and the log-q-normal distribution in the latter case. Queirós’ q-log normal distribution is also reconsidered in the framework of the law of error. These results are presented with mathematical conditions to give rise to these distributions.
1. Introduction
In physics, especially in thermodynamics, statistical physics and quantum physics, fluctuation of a physical observable has been significant for describing many physical phenomena [1]. There are many theoretical ways to unify fluctuations, such as the Boltzmann equation, the maximum entropy principle, the Fokker-Planck equation, and so on. In every approach, fluctuation is considered as a variance of values of a physical observable. In repeated measurements of a physical observable, the most natural and simplest assumption is the “independence” of the measurements. This corresponds to the treatment in Boltzmann-Gibbs-Shannon statistics, i.e., every value of a physical quantity is observed independently in repeated measurements [2]. On the other hand, in generalized statistics, such as Tsallis statistics, a certain correlation as a generalized independence (e.g., the “q-product” in Tsallis statistics) is applied. In fact, starting from the q-product, Tsallis entropy is uniquely determined as the corresponding entropy [3]. In order to unify and determine probability distributions of physical values for each of the statistics, the most simple and powerful way is the reformulation of the “law of error” because the standard product as independence (which appears in the likelihood function) in Boltzmann-Gibbs-Shannon statistics is only replaced by the generalized product in generalized statistics. Note that the “error” in the law of error means “fluctuation” in physics.
The law of error is well known as the first derivation of the normal distribution by Carl F. Gauss, so that, nowadays, the normal distribution is also called Gaussian distribution [4,5]. Gauss’ contribution on this topic is not only his discovery of the important probability distribution, but it is also the first application of the likelihood function in his discovery, although it might be intuitive. Later, the likelihood function was fully understood by Ronald A. Fisher [6], the pioneer of modern statistics wherein the maximum likelihood estimation plays an important role [7]. Gauss’ derivation is now considered a typical application of the maximum likelihood method. Moreover, Gauss’ law of error has often been taken as an assumption of error in most of the fields related to measurement.
In the original Gauss’ law of error, an observed value is given by the addition of an error to the true value. We call this type of error “additive error”, which is the most fundamental and natural type in our understanding. An error is a difference between an observed value and the true value, so other types of error such as the ratio can be also considered. In this paper, a “multiplicative error”, given by the ratio of an observed value and the true value, is applied to the formulation of the law of error. As a result, a multiplicative error is found to follow a log-normal distribution, which is quite a natural derivation of a log-normal distribution with fruitful backgrounds in the sense that the mathematical condition to obtain a log-normal distribution is clearly presented. Moreover, the original law of error was recently generalized for the so-called q-statistics (i.e., Tsallis statistics [8,9]) by means of the q-product [10,11]. Tsallis statistics describes a strongly correlated system exhibiting power-law behavior, which results in the q-Gaussian distribution as the distribution of an additive error in q-statistics [12]. Along similar lines, the laws of error for other generalized statistics are also presented in [13,14]. The q-Gaussian distribution provides us not only with a one-parameter generalization of the standard Gaussian distribution (), but also with a nice unification of important probability distributions such as the Cauchy distribution (), the t-distribution () and Wigner semicircle distribution (). The q-Gaussian distribution was originally derived from the maximization of Tsallis entropy under the appropriate constraint [15,16], and Tsallis entropy is uniquely determined from the q-multinomial coefficient defined by means of the q-product [3]. Therefore, these mathematical results are consistent with each other, because every mathematical formulation in q-statistics originates in the fundamental nonlinear differential equation with the q-exponential function as its solution [17,18,19]. Thus, along these characterizations using the maximum likelihood method, a probability distribution for a multiplicative error in q-statistics is expected, that is, a log-q-normal distribution, with clear mathematical reasons for obtaining this distribution in the framework of the law of error. Note that this paper analytically derives the q-Gaussian distribution and the log-q-normal distribution from the maximum likelihood principle. Relevant important discussions about the numerical verification in q-statistics can be found in [20,21], which is not applicable in the present mathematical work.
This paper consists of five sections. Following this first section, the introduction, Section 2 presents the definition of additive error and multiplicative error for the discussion in this paper. Section 3 derives the law of error for these two types of error in the case of independent observations. Based on the previous sections, Section 4 discusses its generalization for the case of correlated observations represented by the q-product. The final section is devoted to the conclusion.
2. Additive Error and Multiplicative Error
A given observed value, , is assumed to have some kinds of error in it. In the original law of error, an additive error is considered in the sense:
where is the true value and is an additive error. On the other hand, in some fields, a multiplicative error is taken into consideration in the form:
where is a multiplicative error. An alternative expression for a multiplicative error, , is sometimes formulated as with , but for simplicity, we use Equation (2) throughout the paper. In case the true value in Equation (2), obviously, a multiplicative error, , is not employed. Due to the positivity of , the sign of x and coincide with each other. When a multiplicative error, , is considered, the only case is discussed without loss of generality. Then, Equation (2) is reformed to be
which has a similar structure to the additive error Equation (1). Therefore, the law of multiplicative error can be formulated in the same way as the case of additive error.
If the true value, , and both of these two kinds of errors, and , are considered, an observed value, x, is given in the form:
Throughout the paper, the term “observation” is often used, which means “random variable” in the mathematical sense.
Under these preparations, some mathematical definitions are given for our discussion.
Definition 1
Let be a random variable with value , respectively. Then, for random variables, defined by
with a constant , each value of is called an additive error and satisfies
Under the same situation as above, if
for random variables defined by
each value of is called a multiplicative error and satisfies
Note 2
Due to the positivity of , the sign of and coincide with each other. When a multiplicative error is considered, without loss of generality, only the case is discussed.
Note that, if both of these two errors are considered, each is given by
Usually, only observed values, , are given, and other values such as are not known in advance (of course!). Thus, under the assumption that observed values include one of the two kinds of error, the probability distribution of each error should be studied.
3. Law of Error for Independent Observations
In this section, let in Definition 1 be i.i.d. (independent, identically distributed) random variables which means independent and identical observations.
3.1. Additive Error
are i.i.d. random variables, so every has the same probability density function, . Then, we define the likelihood function for additive error in independent observations.
Definition 3
Then, we have the famous theorem which is often referred to as “Gauss’ law of error” [5].
Let be the probability density function (pdf, for short) for defined by Equation (5). The likelihood function, , for additive error is defined as a function of a variable, θ, such that
Theorem 4
If the function of θ for any fixed attains the maximum value at
then must be a Gaussian pdf:
In the proof of this theorem, the following lemma plays an essential role.
Lemma 5
Let φ be a continuous function from into itself and satisfying that for every and with . Then, there exists , such that
The proofs of Theorem 4 and Lemma 5 are found in [12].
3.2. Multiplicative Error
In the case of a multiplicative error, the random variables, and , and a constant, , are all positive, so that by taking the logarithm of both sides of (8), we have
which is a similar form to (5). The are also i.i.d. random variables, so every has the same probability density function.
Definition 6
By means of the random variables, , defined by (8), the new random variables, and , are defined by
Then, the likelihood function, , for multiplicative error is defined by
where is the pdf of .
Then, we obtain the law of multiplicative error in independent observations.
Theorem 7
If, for any fixed , the function attains the maximum value at
then must be a Gaussian pdf:
Note that
which means that Lemma 5 can be applied to the proof of the theorem, which is almost the same as that of Gauss’ law of error.
The pdf, , is for the random variable , so that the pdf, , for is easily obtained.
Corollary 8
The pdf, , for the random variable, , is given by the log-normal distribution:
5. Conclusions
Along the generalization of the law of additive error [12], the law of multiplicative error is presented in the case of independent and correlated observations, respectively. As a result, the standard log-normal distribution and log-q-normal distribution are determined with mathematical conditions to give rise to these distributions. Furthermore, Queirós’ q-log normal distribution is reconsidered in the framework of the law of error.
The law of error is a direct application of the maximum likelihood principle, so that the study on this topic can be applied not only in error analysis or assumptions in practical science such as engineering and experimental physics, but also in statistical inference and divergence theory in theoretical science such as mathematics and theoretical physics.
Acknowledgments
The author is grateful to Jan Naudts for his kind hospitality during the sabbatical stay in the University of Antwerp in 2013, where the present work was done. Comments by Tatsuaki Wada and Ben Anthonis after submission were helpful for improving the present paper. The author would also like to thank the anonymous referee for pointing out the references [20,21]. This work was supported by JSPS KAKENHI, Grant Number 25540106.
Conflict of Interest
The author declares no conflict of interest.
Appendix: Proof of Theorem 13
Proof.
By taking the derivative of the log-likelihood function in Equation (36) with respect to θ leads to
When the likelihood function attains the maximum value, so that
Let ρ be defined by
then Equation (51) can be rewritten as
With this, our problem is reduced to determining the function, ρ, satisfying Equation (53) under the constraint Equation (37). By means of Lemma 5, we have
for Thus,
that is,
From Equation (38) follows
so that Equation (55) becomes
The solution, f, satisfying Equation (58) can be obtained as a q-Gaussian pdf:
Figure 2.
e as a function of .
References
- Tolman, R.C. The Principles of Statistical Mechanics; Dover: New York, NY, USA, 1938. [Google Scholar]
- Lavenda, B.H. Statistical Physics: A Probabilistic Approach; Wiley: New York, NY, USA, 1991. [Google Scholar]
- Suyari, H. Mathematical structures derived from the q-multinomial coefficient in Tsallis statistics. Physica A 2006, 368, 63–82. [Google Scholar] [CrossRef]
- Gauss, C.F. Theoria Motus Corporum Coelestium in Sectionibus Conicis Solem Ambientium; Perthes: Hamburg, German, 1809; (translation with appendix by Davis, C.H. Theory of the Motion of the Heavenly Bodies Moving About the Sun in Conic Sections; Dover: New York, NY, 1963.). [Google Scholar]
- Hald, A. A History of Mathematical Statistics From 1750 to 1930; Wiley: New York, NY, USA, 1998. [Google Scholar]
- Fisher, A.R. On the mathematical foundations of theoretical statistics. Philos. Trans. Roy. Soc. A, 1922, 222, 309–368. [Google Scholar] [CrossRef]
- Casella, G.; Berger, R.L. Statistical Inference, 2nd ed.; Cengage Learning: Stamford, CA, USA, 2001. [Google Scholar]
- Tsallis, C. Possible generalization of Boltzmann-Gibbs statistics. J. Stat. Phys. 1988, 52, 479–487. [Google Scholar] [CrossRef]
- Tsallis, C. Introduction to Nonextensive Statistical Mechanics: Approaching a Complex World; Springer: New York, NY, USA, 2009. [Google Scholar]
- Nivanen, L.; le Mehaute, A.; Wang, Q.A. Generalized algebra within a nonextensive statistics. Rep. Math. Phys. 2003, 52, 437–444. [Google Scholar] [CrossRef]
- Borges, E.P. A possible deformed algebra and calculus inspired in nonextensive thermostatistics. Physica A 2004, 340, 95–101. [Google Scholar] [CrossRef]
- Suyari, H.; Tsukada, M. Law of error in Tsallis statistics. IEEE Trans. Inform. Theory 2005, 51, 753–757. [Google Scholar] [CrossRef]
- Wada, T.; Suyari, H. κ-generalization of Gauss’ law of error. Phys. Lett. A 2006, 348, 89–93. [Google Scholar] [CrossRef]
- Scarfone, A.M.; Suyari, H.; Wada, T. Gauss’ law of error revisited in the framework of Sharma-Taneja-Mittal information measure. Centr. Eur. J. Phys. 2009, 7, 414–420. [Google Scholar] [CrossRef]
- Tsallis, C.; Levy, S.V.F.; Souza, A.M.C.; Maynard, R. Statistical-mechanical foundation of the ubiquity of Lévy distributions in nature. Phys. Rev. Lett. 1995, 75, 3589–3593. [Google Scholar] [CrossRef] [PubMed]
- Prato, D.; Tsallis, C. Nonextensive foundation of Levy distributions. Phys. Rev. E 1999, 60, 2398–2401. [Google Scholar] [CrossRef]
- Tsallis, C. What are the numbers that experiments provide? Quimica Nova 1994, 17, 468. [Google Scholar]
- Tsallis, C. What should a statistical mechanics satisfy to reflect nature? Physica D 2004, 193, 3–34. [Google Scholar] [CrossRef]
- Suyari, H.; Wada, T. Scaling Property and the Generalized Entropy Uniquely Determined by a Fundamental Nonlinear Differential Equation. In Proceedings of the 2006 International Symposium on Information Theory and its Applications, COEX, Seoul, Korea, 29 October 2006.
- Hilhorst, H.J.; Schehr, G. A note on q-Gaussians and non-Gaussians in statistical mechanics. J. Stat. Mech. 2007, P06003. [Google Scholar] [CrossRef]
- Dauxois, T. Non-Gaussian distributions under scrutiny. J. Stat. Mech. 2007, N08001. [Google Scholar] [CrossRef]
- Tsallis, C.; Mendes, R.S.; Plastino, A.R. The role of constraints within generalized nonextensive statistics. Physica A 1998, 261, 534–554. [Google Scholar] [CrossRef]
- Tsallis, C. What should a statistical mechanics satisfy to reflect nature? Physica D 2004, 193, 3–34. [Google Scholar] [CrossRef]
- Naudts, J. Generalised Thermostatistics; Springer: London, UK, 2011. [Google Scholar]
- Queirós, S.M.D. Generalised cascades. Braz. J. Phys. 2009, 39, 448–452. [Google Scholar] [CrossRef]
- Queirós, S.M.D. On generalisations of the log-Normal distribution by means of a new product definition in the Kaypten process. Physica A 2012, 391, 3594–3606. [Google Scholar] [CrossRef]
© 2013 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).

