Skip Content
You are currently on the new version of our website. Access the old version .

Entropy, Volume 22, Issue 5

2020 May - 99 articles

Cover Story: This schematic illustrates the partition of a system’s states into internal states (blue) and hidden or external states (cyan) that are separated by a Markov blanket, comprising sensory (magenta) and active states (red). The upper panel shows this partition as it would be applied to action and perception in the brain. The ensuing self-organization of internal states then corresponds to perception, while action couples brain states back to external states. The lower panel shows the same dependencies but rearranged so that the internal states are associated with the intracellular states of a Bacillus, while the sensory states become the surface states or cell membrane overlying active states (e.g., the actin filaments of the cytoskeleton). View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (99)

  • Article
  • Open Access
5 Citations
4,660 Views
17 Pages

25 May 2020

Technological innovations are not enough by themselves to achieve social and environmental sustainability in companies. Sustainable development aims to determine the environmental impact of a product and the hidden price of products and services thro...

  • Article
  • Open Access
3 Citations
3,768 Views
29 Pages

25 May 2020

This paper mainly focuses on the problem of lossy compression storage based on the data value that represents the subjective assessment of users when the storage size is still not enough after the conventional lossless data compression. To this end,...

  • Article
  • Open Access
79 Citations
3,863 Views
24 Pages

25 May 2020

In this paper, we first study a new two parameter lifetime distribution. This distribution includes “monotone” and “non-monotone” hazard rate functions which are useful in lifetime data analysis and reliability. Some of its ma...

  • Article
  • Open Access
13 Citations
4,976 Views
15 Pages

24 May 2020

The investigation of the systemic importance of financial institutions (SIFIs) has become a hot topic in the field of financial risk management. By making full use of 5-min high-frequency data, and with the help of the method of entropy weight techni...

  • Article
  • Open Access
28 Citations
4,330 Views
23 Pages

24 May 2020

In theory, high key and high plaintext sensitivities are a must for a cryptosystem to resist the chosen/known plaintext and the differential attacks. High plaintext sensitivity can be achieved by ensuring that each encrypted result is plaintext-depen...

  • Article
  • Open Access
13 Citations
4,041 Views
25 Pages

23 May 2020

In the differential approach elaborated, we study the evolution of the parameters of Gaussian, mixed, continuous variable density matrices, whose dynamics are given by Hermitian Hamiltonians expressed as quadratic forms of the position and momentum o...

  • Article
  • Open Access
5 Citations
4,933 Views
11 Pages

23 May 2020

We study the dynamics of information processing in the continuum depth limit of deep feed-forward Neural Networks (NN) and find that it can be described in language similar to the Renormalization Group (RG). The association of concepts to patterns by...

  • Article
  • Open Access
8 Citations
4,092 Views
16 Pages

22 May 2020

The symmetric positive definite (SPD) matrix has attracted much attention in classification problems because of its remarkable performance, which is due to the underlying structure of the Riemannian manifold with non-negative curvature as well as the...

  • Article
  • Open Access
4,689 Views
14 Pages

A Method to Present and Analyze Ensembles of Information Sources

  • Nicholas M. Timme,
  • David Linsenbardt and
  • Christopher C. Lapish

21 May 2020

Information theory is a powerful tool for analyzing complex systems. In many areas of neuroscience, it is now possible to gather data from large ensembles of neural variables (e.g., data from many neurons, genes, or voxels). The individual variables...

  • Feature Paper
  • Article
  • Open Access
61 Citations
8,562 Views
31 Pages

Probabilistic Shaping for Finite Blocklengths: Distribution Matching and Sphere Shaping

  • Yunus Can Gültekin,
  • Tobias Fehenberger,
  • Alex Alvarado and
  • Frans M. J. Willems

21 May 2020

In this paper, we provide a systematic comparison of distribution matching (DM) and sphere shaping (SpSh) algorithms for short blocklength probabilistic amplitude shaping. For asymptotically large blocklengths, constant composition distribution match...

  • Article
  • Open Access
54 Citations
4,699 Views
10 Pages

A Dual Measure of Uncertainty: The Deng Extropy

  • Francesco Buono and
  • Maria Longobardi

21 May 2020

The extropy has recently been introduced as the dual concept of entropy. Moreover, in the context of the Dempster–Shafer evidence theory, Deng studied a new measure of discrimination, named the Deng entropy. In this paper, we define the Deng ex...

  • Article
  • Open Access
29 Citations
4,703 Views
14 Pages

21 May 2020

It has been reported that major earthquakes are preceded by Seismic Electric Signals (SES). Observations show that in the natural time analysis of an earthquake (EQ) catalog, an SES activity starts when the fluctuations of the order parameter of seis...

  • Article
  • Open Access
8 Citations
3,759 Views
12 Pages

21 May 2020

Determining the coupling between systems remains a topic of active research in the field of complex science. Identifying the proper causal influences in time series can already be very challenging in the trivariate case, particularly when the interac...

  • Article
  • Open Access
9 Citations
4,724 Views
29 Pages

Detecting Malware with Information Complexity

  • Nadia Alshahwan,
  • Earl T. Barr,
  • David Clark,
  • George Danezis and
  • Héctor D. Menéndez

20 May 2020

Malware concealment is the predominant strategy for malware propagation. Black hats create variants of malware based on polymorphism and metamorphism. Malware variants, by definition, share some information. Although the concealment strategy alters t...

  • Article
  • Open Access
22 Citations
5,204 Views
19 Pages

Two-Dimensional Permutation Vectors’ (PV) Code for Optical Code Division Multiple Access Systems

  • Hassan Yousif Ahmed,
  • Medien Zeghid,
  • Waqas A.Imtiaz,
  • Teena Sharma,
  • Abdellah Chehri and
  • Paul Fortier

20 May 2020

In this paper, we present a new algorithm to generate two-dimensional (2D) permutation vectors’ (PV) code for incoherent optical code division multiple access (OCDMA) system to suppress multiple access interference (MAI) and system complexity....

  • Article
  • Open Access
3 Citations
6,439 Views
15 Pages

Working Memory Training: Assessing the Efficiency of Mnemonic Strategies

  • Serena Di Santo,
  • Vanni De Luca,
  • Alessio Isaja and
  • Sara Andreetta

20 May 2020

Recently, there has been increasing interest in techniques for enhancing working memory (WM), casting a new light on the classical picture of a rigid system. One reason is that WM performance has been associated with intelligence and reasoning, while...

  • Article
  • Open Access
11 Citations
4,668 Views
16 Pages

20 May 2020

This study considers the problem of detecting a change in the conditional variance of time series with time-varying volatilities based on the cumulative sum (CUSUM) of squares test using the residuals from support vector regression (SVR)-generalized...

  • Article
  • Open Access
115 Citations
7,521 Views
19 Pages

20 May 2020

Advancements in wearable sensors technologies provide prominent effects in the daily life activities of humans. These wearable sensors are gaining more awareness in healthcare for the elderly to ensure their independent living and to improve their co...

  • Article
  • Open Access
61 Citations
7,408 Views
26 Pages

Machine Learning Based Automated Segmentation and Hybrid Feature Analysis for Diabetic Retinopathy Classification Using Fundus Image

  • Aqib Ali,
  • Salman Qadri,
  • Wali Khan Mashwani,
  • Wiyada Kumam,
  • Poom Kumam,
  • Samreen Naeem,
  • Atila Goktas,
  • Farrukh Jamal,
  • Christophe Chesneau and
  • Muhammad Sulaiman
  • + 1 author

19 May 2020

The object of this study was to demonstrate the ability of machine learning (ML) methods for the segmentation and classification of diabetic retinopathy (DR). Two-dimensional (2D) retinal fundus (RF) images were used. The datasets of DR—that is...

  • Feature Paper
  • Article
  • Open Access
10 Citations
5,293 Views
16 Pages

Taylor’s Law in Innovation Processes

  • Francesca Tria,
  • Irene Crimaldi,
  • Giacomo Aletti and
  • Vito D. P. Servedio

19 May 2020

Taylor’s law quantifies the scaling properties of the fluctuations of the number of innovations occurring in open systems. Urn-based modeling schemes have already proven to be effective in modeling this complex behaviour. Here, we present analy...

  • Article
  • Open Access
17 Citations
4,529 Views
15 Pages

Dynamical Complexity of the 2015 St. Patrick’s Day Magnetic Storm at Swarm Altitudes Using Entropy Measures

  • Constantinos Papadimitriou,
  • Georgios Balasis,
  • Adamantia Zoe Boutsi,
  • Ioannis A. Daglis,
  • Omiros Giannakis,
  • Anastasios Anastasiadis,
  • Paola De Michelis and
  • Giuseppe Consolini

19 May 2020

The continuously expanding toolbox of nonlinear time series analysis techniques has recently highlighted the importance of dynamical complexity to understand the behavior of the complex solar wind–magnetosphere–ionosphere–thermosphe...

  • Article
  • Open Access
2 Citations
3,092 Views
8 Pages

19 May 2020

We use Langevin dynamics simulations to study dense 2d systems of particles with both size and energy polydispersity. We compare two types of bidisperse systems which differ in the correlation between particle size and interaction parameters: in one...

  • Article
  • Open Access
6 Citations
5,527 Views
26 Pages

19 May 2020

Estimating the parameters of the autoregressive (AR) random process is a problem that has been well-studied. In many applications, only noisy measurements of AR process are available. The effect of the additive noise is that the system can be modeled...

  • Article
  • Open Access
13 Citations
3,946 Views
15 Pages

19 May 2020

Underwater quantumkey distribution (QKD) is tough but important formodern underwater communications in an insecure environment. It can guarantee secure underwater communication between submarines and enhance safety for critical network nodes. To enha...

  • Article
  • Open Access
10 Citations
3,347 Views
16 Pages

Analysis of the Stochastic Population Model with Random Parameters

  • Adeeb Noor,
  • Ahmed Barnawi,
  • Redhwan Nour,
  • Abdullah Assiri and
  • Mohamed El-Beltagy

18 May 2020

The population models allow for a better understanding of the dynamical interactions with the environment and hence can provide a way for understanding the population changes. They are helpful in studying the biological invasions, environmental conse...

  • Article
  • Open Access
20 Citations
6,284 Views
36 Pages

18 May 2020

The relative entropy and the chi-squared divergence are fundamental divergence measures in information theory and statistics. This paper is focused on a study of integral relations between the two divergences, the implications of these relations, the...

  • Feature Paper
  • Article
  • Open Access
29 Citations
7,977 Views
26 Pages

18 May 2020

It is crucial to ask how agents can achieve goals by generating action plans using only partial models of the world acquired through habituated sensory-motor experiences. Although many existing robotics studies use a forward model framework, there ar...

  • Article
  • Open Access
7 Citations
5,210 Views
14 Pages

18 May 2020

In this article, some practical software optimization methods for implementations of fractional order backward difference, sum, and differintegral operator based on Grünwald–Letnikov definition are presented. These numerical algorithms are...

  • Review
  • Open Access
8 Citations
3,692 Views
33 Pages

18 May 2020

The review is devoted to two important quantities characterizing many-body systems, order indices and the measure of entanglement production. Order indices describe the type of order distinguishing statistical systems. Contrary to the order parameter...

  • Article
  • Open Access
17 Citations
4,712 Views
17 Pages

17 May 2020

During recent years our society has often been exposed to coherent information waves of high amplitudes. These are waves of huge social energy. Often they are of destructive character, a kind of information tsunami. However, they can also carry posit...

  • Article
  • Open Access
12 Citations
5,463 Views
15 Pages

17 May 2020

This paper demonstrates a novel approach to training deep neural networks using a Mutual Information (MI)-driven, decaying Learning Rate (LR), Stochastic Gradient Descent (SGD) algorithm. MI between the output of the neural network and true outcomes...

  • Article
  • Open Access
6 Citations
3,946 Views
12 Pages

17 May 2020

Soft-matter systems when driven out of equilibrium often give rise to structures that usually lie in between the macroscopic scale of the material and microscopic scale of its constituents. In this paper we review three such systems, the two-dimensio...

  • Article
  • Open Access
5 Citations
3,888 Views
11 Pages

Storage of Energy in Constrained Non-Equilibrium Systems

  • Yirui Zhang,
  • Konrad Giżyński,
  • Anna Maciołek and
  • Robert Hołyst

16 May 2020

We study a quantity T defined as the energy U, stored in non-equilibrium steady states (NESS) over its value in equilibrium U 0 , Δ U = U U 0 divided by the heat flow J U going out of the system. A recent...

  • Article
  • Open Access
26 Citations
4,356 Views
28 Pages

Crystallization of Supercooled Liquids: Self-Consistency Correction of the Steady-State Nucleation Rate

  • Alexander S. Abyzov,
  • Jürn W. P. Schmelzer,
  • Vladimir M. Fokin and
  • Edgar D. Zanotto

16 May 2020

Crystal nucleation can be described by a set of kinetic equations that appropriately account for both the thermodynamic and kinetic factors governing this process. The mathematical analysis of this set of equations allows one to formulate analytical...

  • Article
  • Open Access
30 Citations
4,503 Views
17 Pages

15 May 2020

We study flow of substance in a channel of network which consists of nodes of network and edges which connect these nodes and form ways for motion of substance. The channel can have arbitrary number of arms and each arm can contain arbitrary number o...

  • Feature Paper
  • Article
  • Open Access
3 Citations
2,866 Views
14 Pages

15 May 2020

Despite the potential benefits of reducing system costs and improving spectral efficiency, it is challenging to implement cloud radio access network (C-RAN) systems due to the performance degradation caused by finite-capacity fronthaul links and inte...

  • Article
  • Open Access
17 Citations
2,897 Views
12 Pages

15 May 2020

This paper presents the algorithms for solving the inverse problems on models with the fractional derivative. The presented algorithm is based on the Real Ant Colony Optimization algorithm. In this paper, the examples of the algorithm application for...

  • Article
  • Open Access
14 Citations
6,251 Views
12 Pages

Complex Extreme Sea Levels Prediction Analysis: Karachi Coast Case Study

  • Faisal Ahmed Khan,
  • Tariq Masood Ali Khan,
  • Ali Najah Ahmed,
  • Haitham Abdulmohsin Afan,
  • Mohsen Sherif,
  • Ahmed Sefelnasr and
  • Ahmed El-Shafie

14 May 2020

In this study, the analysis of the extreme sea level was carried out by using 10 years (2007–2016) of hourly tide gauge data of Karachi port station along the Pakistan coast. Observations revealed that the magnitudes of the tides usually exceed...

  • Review
  • Open Access
52 Citations
8,843 Views
39 Pages

14 May 2020

We have developed a molecular mean-field theory—fourth-order Poisson–Nernst–Planck–Bikerman theory—for modeling ionic and water flows in biological ion channels by treating ions and water molecules of any volume and shap...

  • Article
  • Open Access
5 Citations
12,698 Views
35 Pages

14 May 2020

Herein we are not interested in merely using dynamical systems theory, graph theory, information theory, etc., to model the relationship between brain dynamics and networks, and various states and degrees of conscious processes. We are interested in...

  • Article
  • Open Access
30 Citations
7,229 Views
24 Pages

Modules or Mean-Fields?

  • Thomas Parr,
  • Noor Sajid and
  • Karl J. Friston

14 May 2020

The segregation of neural processing into distinct streams has been interpreted by some as evidence in favour of a modular view of brain function. This implies a set of specialised ‘modules’, each of which performs a specific kind of comp...

  • Article
  • Open Access
11 Citations
3,917 Views
15 Pages

13 May 2020

The velocities of space plasma particles often follow kappa distribution functions, which have characteristic high energy tails. The tails of these distributions are associated with low particle flux and, therefore, it is challenging to precisely res...

  • Article
  • Open Access
5 Citations
4,559 Views
18 Pages

13 May 2020

In this paper, we consider prediction and variable selection in the misspecified binary classification models under the high-dimensional scenario. We focus on two approaches to classification, which are computationally efficient, but lead to model mi...

  • Article
  • Open Access
3,219 Views
11 Pages

13 May 2020

Novel measures of symbol dominance (dC1 and dC2), symbol diversity (DC1 = N (1 − dC1) and DC2 = N (1 − dC2)), and information entropy (HC1 = log2 DC1 and HC2 = log2 DC2) are derived from Lorenz-consistent statistics that I had previously...

  • Feature Paper
  • Article
  • Open Access
42 Citations
4,829 Views
30 Pages

13 May 2020

When gradient descent (GD) is scaled to many parallel workers for large-scale machine learning applications, its per-iteration computation time is limited by straggling workers. Straggling workers can be tolerated by assigning redundant computations...

  • Article
  • Open Access
9 Citations
5,659 Views
17 Pages

13 May 2020

Due to various regulations (e.g., the Basel III Accord), banks need to keep a specified amount of capital to reduce the impact of their insolvency. This equity can be calculated using, e.g., the Internal Rating Approach, enabling institutions to deve...

  • Article
  • Open Access
14 Citations
4,437 Views
53 Pages

13 May 2020

Most of chaos-based cryptosystems utilize stationary dynamics of chaos for the permutation and diffusion, and many of those are successfully attacked. In this paper, novel models of the image permutation and diffusion are proposed, in which chaotic m...

of 2

Get Alerted

Add your email address to receive forthcoming issues of this journal.

XFacebookLinkedIn
Entropy - ISSN 1099-4300