Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
4.7
2.7
Journals
Entropy
Special Issues
Information Theory Applications in Signal Processing
entropy-logo
Submit to Entropy Review for Entropy Propose a Special Issue

Journal Menu

► Journal Menu

Journal Browser

► Journal Browser
share announcement

Information Theory Applications in Signal Processing

A special issue of Entropy (ISSN 1099-4300). This special issue belongs to the section "Information Theory, Probability and Statistics".

Deadline for manuscript submissions: closed (15 January 2019) | Viewed by 64878

Special Issue Editors

Prof. Dr. Sergio Cruces

E-Mail Website
Guest Editor
Departamento de Teoría de la Señal y Comunicaciones, Universidad de Sevilla, Camino de los Descubrimientos s/n, 41092 Seville, Spain
Interests: signal processing; information theory; machine learning; communications; audio
Special Issues, Collections and Topics in MDPI journals
Dr. Rubén Martín-Clemente

E-Mail Website
Guest Editor
Departamento de Teoría de la Señal y Comunicaciones, Universidad de Sevilla, Camino de los Descubrimientos s/n, 41092 Seville, Spain
Interests: digital signal processing; biomedical engineering; digital communications
Special Issues, Collections and Topics in MDPI journals
Dr. Wojciech Samek

E-Mail Website
Guest Editor
Fraunhofer Heinrich Hertz Institute HHI, 10587 Berlin, Germany
Interests: machine learning; interpretability; deep learning; artificial intelligence; robust signal processing

Special Issue Information

Dear Colleagues,

Information theory plays a fundamental role in the determination of theoretical performance limits for statistical estimation, detection, and compression. Its remarkable history of success during the last few decades has fueled research on information-guided principles for data analysis and signal processing. These dynamic and fast-growing fields have to cope with increasingly complex scenarios and novel applications in component analysis, machine learning, and communications. Hence, there is a need for specific information theoretic criteria and algorithms that work in each of the considered situations and attain a set of desired goals, for instance, an enhancement in the interpretability of the solutions, improvements in performance, robustness with respect to the model uncertainties and possible data perturbations, a reliable convergence for the algorithms and any other kind of theoretical guarantees.

In this Special Issue, we encourage researchers to present their original and recent developments in information theory for advanced methods in signal processing. Possible topics include, but are not limited to, the following:

  • Information criteria, divergence measures and algorithms for source separation, independent component analysis, matrix/tensor decompositions, data approximation and completion, low-rank and sparse based methods.
  • Applications in machine learning, including supervised and unsupervised methods, data representation, dimensionality reduction, feature extraction, Bayesian approaches and deep learning.
  • Applications in statistical signal processing, including parameter estimation, system identification, pattern classification, signal approximation and compressed sensing, signal analysis and restoration.
  • Applications in biomedical engineering, speech/audio processing, and communications.

Dr. Sergio Cruces
Dr. Rubén Martín-Clemente
Dr. Wojciech Samek
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Entropy is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Published Papers (18 papers)

Download All Papers
Order results
Result details
Show export options expand_more Show export options expand_less
Select all
Export citation of selected articles as:

Editorial

Jump to: Research

4 pages, 174 KiB  
Editorial
Information Theory Applications in Signal Processing
by Sergio Cruces, Rubén Martín-Clemente and Wojciech Samek
Entropy 2019, 21(7), 653; https://doi.org/10.3390/e21070653 - 03 Jul 2019
Cited by 7 | Viewed by 4196
Abstract
The birth of Information Theory, right after the pioneering work of Claude Shannon and his celebrated publication of the paper “A mathematical theory of Communication” [...] Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)

Research

Jump to: Editorial

17 pages, 989 KiB  
Article
Sum-Rate of Multi-User MIMO Systems with Multi-Cell Pilot Contamination in Correlated Rayleigh Fading Channel
by Menghan Wang and Dongming Wang
Entropy 2019, 21(6), 573; https://doi.org/10.3390/e21060573 - 06 Jun 2019
Cited by 4 | Viewed by 3405
Abstract
This paper presents some exact results on the sum-rate of multi-user multiple-input multiple-output (MU-MIMO) systems subject to multi-cell pilot contamination under correlated Rayleigh fading. With multi-cell multi-user channel estimator, we give the lower bound of the sum-rate. We derive the moment generating function [...] Read more.
This paper presents some exact results on the sum-rate of multi-user multiple-input multiple-output (MU-MIMO) systems subject to multi-cell pilot contamination under correlated Rayleigh fading. With multi-cell multi-user channel estimator, we give the lower bound of the sum-rate. We derive the moment generating function (MGF) of the sum-rate and then obtain the closed-form approximations of the mean and variance of the sum-rate. Then, with Gaussian approximation, we study the outage performance of the sum-rate. Furthermore, considering the number of antennas at base station becomes infinite, we investigate the asymptotic performance of the sum-rate. Theoretical results show that compared to MU-MIMO system with perfect channel estimation and no pilot contamination, the variance of the sum-rate of the considered system decreases very quickly as the number of antennas increases. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

17 pages, 7272 KiB  
Article
Analysis of TDMP Algorithm of LDPC Codes Based on Density Evolution and Gaussian Approximation
by Xiumin Wang, Hong Chang, Jun Li, Weilin Cao and Liang Shan
Entropy 2019, 21(5), 457; https://doi.org/10.3390/e21050457 - 01 May 2019
Cited by 4 | Viewed by 3632
Abstract
Based on density evolution analysis of the existing belief propagation (BP) algorithm, the Turbo Decoding Message Passing (TDMP) algorithm was analyzed from the perspective of density evolution and Gaussian approximation, and the theoretical analysis process of TDMP algorithm was given. When calculating the [...] Read more.
Based on density evolution analysis of the existing belief propagation (BP) algorithm, the Turbo Decoding Message Passing (TDMP) algorithm was analyzed from the perspective of density evolution and Gaussian approximation, and the theoretical analysis process of TDMP algorithm was given. When calculating the prior message of each layer of the TDMP algorithm, the check message of the previous iteration should be subtracted. Therefore, the result will not be convergent, if the TDMP algorithm is directly analyzed based on density evolution and Gaussian approximation. We researched the TDMP algorithm based on the symmetry conditions to obtain the convergent result. When using density evolution (DE) and Gaussian approximation to analyze the decoding convergence of the TDMP algorithm, we can provide a theoretical basis for proving the superiority of the algorithm. Then, based on the DE theory, we calculated the probability density function (PDF) of the check-to-variable information of TDMP and its simplified algorithm, and then gave it a calculation based on the process of the normalization factor. Simulation results show that the decoding convergence speed of the TDMP algorithm was faster and the iterations were smaller compared to the BP algorithm under the same conditions. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

17 pages, 514 KiB  
Article
M-ary Rank Classifier Combination: A Binary Linear Programming Problem
by Vincent Vigneron and Hichem Maaref
Entropy 2019, 21(5), 440; https://doi.org/10.3390/e21050440 - 26 Apr 2019
Cited by 1 | Viewed by 2734
Abstract
The goal of classifier combination can be briefly stated as combining the decisions of individual classifiers to obtain a better classifier. In this paper, we propose a method based on the combination of weak rank classifiers because rankings contain more information than unique [...] Read more.
The goal of classifier combination can be briefly stated as combining the decisions of individual classifiers to obtain a better classifier. In this paper, we propose a method based on the combination of weak rank classifiers because rankings contain more information than unique choices for a many-class problem. The problem of combining the decisions of more than one classifier with raw outputs in the form of candidate class rankings is considered and formulated as a general discrete optimization problem with an objective function based on the distance between the data and the consensus decision. This formulation uses certain performance statistics about the joint behavior of the ensemble of classifiers. Assuming that each classifier produces a ranking list of classes, an initial approach leads to a binary linear programming problem with a simple and global optimum solution. The consensus function can be considered as a mapping from a set of individual rankings to a combined ranking, leading to the most relevant decision. We also propose an information measure that quantifies the degree of consensus between the classifiers to assess the strength of the combination rule that is used. It is easy to implement and does not require any training. The main conclusion is that the classification rate is strongly improved by combining rank classifiers globally. The proposed algorithm is tested on real cytology image data to detect cervical cancer. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

20 pages, 5418 KiB  
Article
A New Dictionary Construction Based Multimodal Medical Image Fusion Framework
by Fuqiang Zhou, Xiaosong Li, Mingxuan Zhou, Yuanze Chen and Haishu Tan
Entropy 2019, 21(3), 267; https://doi.org/10.3390/e21030267 - 09 Mar 2019
Cited by 15 | Viewed by 3599
Abstract
Training a good dictionary is the key to a successful image fusion method of sparse representation based models. In this paper, we propose a novel dictionary learning scheme for medical image fusion. First, we reinforce the weak information of images by extracting and [...] Read more.
Training a good dictionary is the key to a successful image fusion method of sparse representation based models. In this paper, we propose a novel dictionary learning scheme for medical image fusion. First, we reinforce the weak information of images by extracting and adding their multi-layer details to generate the informative patches. Meanwhile, we introduce a simple and effective multi-scale sampling to implement a multi-scale representation of patches while reducing the computational cost. Second, we design a neighborhood energy metric and a multi-scale spatial frequency metric for clustering the image patches with a similar brightness and detail information into each respective patch group. Then, we train the energy sub-dictionary and detail sub-dictionary, respectively by K-SVD. Finally, we combine the sub-dictionaries to construct a final, complete, compact and informative dictionary. As a main contribution, the proposed online dictionary learning can not only obtain an informative as well as compact dictionary, but can also address the defects, such as superfluous patch issues and low computation efficiency, in traditional dictionary learning algorithms. The experimental results show that our algorithm is superior to some state-of-the-art dictionary learning based techniques in both subjective visual effects and objective evaluation criteria. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

17 pages, 2623 KiB  
Article
Efficient Low-PAR Waveform Design Method for Extended Target Estimation Based on Information Theory in Cognitive Radar
by Tianduo Hao, Chen Cui and Yang Gong
Entropy 2019, 21(3), 261; https://doi.org/10.3390/e21030261 - 07 Mar 2019
Cited by 9 | Viewed by 2497
Abstract
This paper addresses the waveform design problem of cognitive radar for extended target estimation in the presence of signal-dependent clutter, subject to a peak-to-average power ratio (PAR) constraint. Owing to this kind of constraint and the convolution operation of the waveform in the [...] Read more.
This paper addresses the waveform design problem of cognitive radar for extended target estimation in the presence of signal-dependent clutter, subject to a peak-to-average power ratio (PAR) constraint. Owing to this kind of constraint and the convolution operation of the waveform in the time domain, the formulated optimization problem for maximizing the mutual information (MI) between the target and the received signal is a complex non-convex problem. To this end, an efficient waveform design method based on minimization–maximization (MM) technique is proposed. First, by using the MM approach, the original non-convex problem is converted to a convex problem concerning the matrix variable. Then a trick is used for replacing the matrix variable with the vector variable by utilizing the properties of the Toeplitz matrix. Based on this, the optimization problem can be solved efficiently combined with the nearest neighbor method. Finally, an acceleration scheme is used to improve the convergence speed of the proposed method. The simulation results illustrate that the proposed method is superior to the existing methods in terms of estimation performance when designing the constrained waveform. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

35 pages, 1951 KiB  
Article
Informed Weighted Non-Negative Matrix Factorization Using αβ-Divergence Applied to Source Apportionment
by Gilles Delmaire, Mahmoud Omidvar, Matthieu Puigt, Frédéric Ledoux, Abdelhakim Limem, Gilles Roussel and Dominique Courcot
Entropy 2019, 21(3), 253; https://doi.org/10.3390/e21030253 - 06 Mar 2019
Cited by 6 | Viewed by 4354
Abstract
In this paper, we propose informed weighted non-negative matrix factorization (NMF) methods using an α β -divergence cost function. The available information comes from the exact knowledge/boundedness of some components of the factorization—which are used to structure the NMF parameterization—together with the row [...] Read more.
In this paper, we propose informed weighted non-negative matrix factorization (NMF) methods using an α β -divergence cost function. The available information comes from the exact knowledge/boundedness of some components of the factorization—which are used to structure the NMF parameterization—together with the row sum-to-one property of one matrix factor. In this contribution, we extend our previous work which partly involved some of these aspects to α β -divergence cost functions. We derive new update rules which are extendthe previous ones and take into account the available information. Experiments conducted for several operating conditions on realistic simulated mixtures of particulate matter sources show the relevance of these approaches. Results from a real dataset campaign are also presented and validated with expert knowledge. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

19 pages, 956 KiB  
Article
Centroid-Based Clustering with αβ-Divergences
by Auxiliadora Sarmiento, Irene Fondón, Iván Durán-Díaz and Sergio Cruces
Entropy 2019, 21(2), 196; https://doi.org/10.3390/e21020196 - 19 Feb 2019
Cited by 12 | Viewed by 3789
Abstract
Centroid-based clustering is a widely used technique within unsupervised learning algorithms in many research fields. The success of any centroid-based clustering relies on the choice of the similarity measure under use. In recent years, most studies focused on including several divergence measures in [...] Read more.
Centroid-based clustering is a widely used technique within unsupervised learning algorithms in many research fields. The success of any centroid-based clustering relies on the choice of the similarity measure under use. In recent years, most studies focused on including several divergence measures in the traditional hard k-means algorithm. In this article, we consider the problem of centroid-based clustering using the family of α β -divergences, which is governed by two parameters, α and β . We propose a new iterative algorithm, α β -k-means, giving closed-form solutions for the computation of the sided centroids. The algorithm can be fine-tuned by means of this pair of values, yielding a wide range of the most frequently used divergences. Moreover, it is guaranteed to converge to local minima for a wide range of values of the pair ( α , β ). Our theoretical contribution has been validated by several experiments performed with synthetic and real data and exploring the ( α , β ) plane. The numerical results obtained confirm the quality of the algorithm and its suitability to be used in several practical applications. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

8 pages, 255 KiB  
Article
New Construction of Maximum Distance Separable (MDS) Self-Dual Codes over Finite Fields
by Aixian Zhang and Zhe Ji
Entropy 2019, 21(2), 101; https://doi.org/10.3390/e21020101 - 22 Jan 2019
Cited by 1 | Viewed by 2777
Abstract
Maximum distance separable (MDS) self-dual codes have useful properties due to their optimality with respect to the Singleton bound and its self-duality. MDS self-dual codes are completely determined by the length n , so the problem of constructing q-ary MDS self-dual codes [...] Read more.
Maximum distance separable (MDS) self-dual codes have useful properties due to their optimality with respect to the Singleton bound and its self-duality. MDS self-dual codes are completely determined by the length n , so the problem of constructing q-ary MDS self-dual codes with various lengths is a very interesting topic. Recently X. Fang et al. using a method given in previous research, where several classes of new MDS self-dual codes were constructed through (extended) generalized Reed-Solomon codes, in this paper, based on the method given in we achieve several classes of MDS self-dual codes. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
11 pages, 918 KiB  
Article
Quaternion Entropy for Analysis of Gait Data
by Agnieszka Szczęsna
Entropy 2019, 21(1), 79; https://doi.org/10.3390/e21010079 - 17 Jan 2019
Cited by 12 | Viewed by 3772
Abstract
Nonlinear dynamical analysis is a powerful approach to understanding biological systems. One of the most used metrics of system complexities is the Kolmogorov entropy. Long input signals without noise are required for the calculation, which are very hard to obtain in real situations. [...] Read more.
Nonlinear dynamical analysis is a powerful approach to understanding biological systems. One of the most used metrics of system complexities is the Kolmogorov entropy. Long input signals without noise are required for the calculation, which are very hard to obtain in real situations. Techniques allowing the estimation of entropy directly from time signals are statistics like approximate and sample entropy. Based on that, the new measurement for quaternion signal is introduced. This work presents an example of application of a nonlinear time series analysis by using the new quaternion, approximate entropy to analyse human gait kinematic data. The quaternion entropy was applied to analyse the quaternion signal which represents the segments orientations in time during the human gait. The research was aimed at the assessment of the influence of both walking speed and ground slope on the gait control during treadmill walking. Gait data was obtained by the optical motion capture system. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

17 pages, 321 KiB  
Article
A New Efficient Expression for the Conditional Expectation of the Blind Adaptive Deconvolution Problem Valid for the Entire Range ofSignal-to-Noise Ratio
by Monika Pinchas
Entropy 2019, 21(1), 72; https://doi.org/10.3390/e21010072 - 15 Jan 2019
Cited by 7 | Viewed by 2861
Abstract
In the literature, we can find several blind adaptive deconvolution algorithms based on closed-form approximated expressions for the conditional expectation (the expectation of the source input given the equalized or deconvolutional output), involving the maximum entropy density approximation technique. The main drawback of [...] Read more.
In the literature, we can find several blind adaptive deconvolution algorithms based on closed-form approximated expressions for the conditional expectation (the expectation of the source input given the equalized or deconvolutional output), involving the maximum entropy density approximation technique. The main drawback of these algorithms is the heavy computational burden involved in calculating the expression for the conditional expectation. In addition, none of these techniques are applicable for signal-to-noise ratios lower than 7 dB. In this paper, I propose a new closed-form approximated expression for the conditional expectation based on a previously obtained expression where the equalized output probability density function is calculated via the approximated input probability density function which itself is approximated with the maximum entropy density approximation technique. This newly proposed expression has a reduced computational burden compared with the previously obtained expressions for the conditional expectation based on the maximum entropy approximation technique. The simulation results indicate that the newly proposed algorithm with the newly proposed Lagrange multipliers is suitable for signal-to-noise ratio values down to 0 dB and has an improved equalization performance from the residual inter-symbol-interference point of view compared to the previously obtained algorithms based on the conditional expectation obtained via the maximum entropy technique. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

20 pages, 3726 KiB  
Article
SINR- and MI-Based Maximin Robust Waveform Design
by Bin Wang, Xu Chen, Fengming Xin and Xin Song
Entropy 2019, 21(1), 33; https://doi.org/10.3390/e21010033 - 07 Jan 2019
Cited by 9 | Viewed by 3618
Abstract
Due to the uncertainties of radar target prior information in the actual scene, the waveform designed based on radar target prior information cannot meet the needs of detection and parameter estimation performance. In this paper, the optimal waveform design techniques under energy constraints [...] Read more.
Due to the uncertainties of radar target prior information in the actual scene, the waveform designed based on radar target prior information cannot meet the needs of detection and parameter estimation performance. In this paper, the optimal waveform design techniques under energy constraints for different tasks are considered. To improve the detection performance of radar systems, a novel waveform design method which can maximize the signal-to-interference-plus-noise ratio (SINR) for known and random extended targets is proposed. To improve the performance of parameter estimation, another waveform design method which can maximize the mutual information (MI) between the radar echo and the random-target spectrum response is also considered. Most of the previous waveform design researches assumed that the prior information of the target spectrum is completely known. However, in the actual scene, the real target spectrum cannot be accurately captured. To simulate this scenario, the real target spectrum was assumed to be within an uncertainty range where the upper and lower bounds are known. Then, the SINR- and MI-based maximin robust waveforms were designed, which could optimize the performance under the most unfavorable conditions. The simulation results show that the designed optimal waveforms based on these two criteria are different, which provides useful guidance for waveform energy allocation in different transmission tasks. However, under the constraint of limited energy, we also found that the performance improvement of SINR or MI in the worst case for single targets is less significant than that of multiple targets. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

16 pages, 2364 KiB  
Article
Computing the Partial Correlation of ICA Models for Non-Gaussian Graph Signal Processing
by Jordi Belda, Luis Vergara, Gonzalo Safont and Addisson Salazar
Entropy 2019, 21(1), 22; https://doi.org/10.3390/e21010022 - 29 Dec 2018
Cited by 17 | Viewed by 3162
Abstract
Conventional partial correlation coefficients (PCC) were extended to the non-Gaussian case, in particular to independent component analysis (ICA) models of the observed multivariate samples. Thus, the usual methods that define the pairwise connections of a graph from the precision matrix were correspondingly extended. [...] Read more.
Conventional partial correlation coefficients (PCC) were extended to the non-Gaussian case, in particular to independent component analysis (ICA) models of the observed multivariate samples. Thus, the usual methods that define the pairwise connections of a graph from the precision matrix were correspondingly extended. The basic concept involved replacing the implicit linear estimation of conventional PCC with a nonlinear estimation (conditional mean) assuming ICA. Thus, it is better eliminated the correlation between a given pair of nodes induced by the rest of nodes, and hence the specific connectivity weights can be better estimated. Some synthetic and real data examples illustrate the approach in a graph signal processing context. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

14 pages, 5525 KiB  
Article
Auditory Inspired Convolutional Neural Networks for Ship Type Classification with Raw Hydrophone Data
by Sheng Shen, Honghui Yang, Junhao Li, Guanghui Xu and Meiping Sheng
Entropy 2018, 20(12), 990; https://doi.org/10.3390/e20120990 - 19 Dec 2018
Cited by 39 | Viewed by 5043
Abstract
Detecting and classifying ships based on radiated noise provide practical guidelines for the reduction of underwater noise footprint of shipping. In this paper, the detection and classification are implemented by auditory inspired convolutional neural networks trained from raw underwater acoustic signal. The proposed [...] Read more.
Detecting and classifying ships based on radiated noise provide practical guidelines for the reduction of underwater noise footprint of shipping. In this paper, the detection and classification are implemented by auditory inspired convolutional neural networks trained from raw underwater acoustic signal. The proposed model includes three parts. The first part is performed by a multi-scale 1D time convolutional layer initialized by auditory filter banks. Signals are decomposed into frequency components by convolution operation. In the second part, the decomposed signals are converted into frequency domain by permute layer and energy pooling layer to form frequency distribution in auditory cortex. Then, 2D frequency convolutional layers are applied to discover spectro-temporal patterns, as well as preserve locality and reduce spectral variations in ship noise. In the third part, the whole model is optimized with an objective function of classification to obtain appropriate auditory filters and feature representations that are correlative with ship categories. The optimization reflects the plasticity of auditory system. Experiments on five ship types and background noise show that the proposed approach achieved an overall classification accuracy of 79.2%, which improved by 6% compared to conventional approaches. Auditory filter banks were adaptive in shape to improve accuracy of classification. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

18 pages, 2255 KiB  
Article
A Novel Image Encryption Scheme Based on Collatz Conjecture
by Dora M. Ballesteros, Jimmy Peña and Diego Renza
Entropy 2018, 20(12), 901; https://doi.org/10.3390/e20120901 - 25 Nov 2018
Cited by 15 | Viewed by 4947
Abstract
Image encryption methods aim to protect content privacy. Typically, they encompass scrambling and diffusion. Every pixel of the image is permuted (scrambling) and its value is transformed according to a key (diffusion). Although several methods have been proposed in the literature, some of [...] Read more.
Image encryption methods aim to protect content privacy. Typically, they encompass scrambling and diffusion. Every pixel of the image is permuted (scrambling) and its value is transformed according to a key (diffusion). Although several methods have been proposed in the literature, some of them have been cryptanalyzed. In this paper, we present a novel method that deviates the traditional schemes. We use variable length codes based on Collatz conjecture for transforming the content of the image into non-intelligible audio; therefore, scrambling and diffusion processes are performed simultaneously in a non-linear way. With our method, different ciphered audio is obtained every time, and it depends exclusively on the selected key (the size of the key space equal to 8 . 57 × 10 506 ). Several tests were performed in order to analyze randomness of the ciphered audio signals and the sensitivity of the key. Firstly, it was found that entropy and the level of disorder of ciphered audio signals are very close to the maximum value of randomness. Secondly, fractal behavior was detected into scatter plots of adjacent samples, altering completely the behavior of natural images. Finally, if the key was slightly modified, the image could not be recovered. With the above results, it was concluded that our method is very useful in image privacy protection applications. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

16 pages, 3419 KiB  
Article
Sparse Optimistic Based on Lasso-LSQR and Minimum Entropy De-Convolution with FARIMA for the Remaining Useful Life Prediction of Machinery
by Bo Wu, Yangde Gao, Songlin Feng and Theerasak Chanwimalueang
Entropy 2018, 20(10), 747; https://doi.org/10.3390/e20100747 - 29 Sep 2018
Cited by 16 | Viewed by 3021
Abstract
To reduce the maintenance cost and safeguard machinery operation, remaining useful life (RUL) prediction is very important for long term health monitoring. In this paper, we introduce a novel hybrid method to deal with the RUL prediction for health management. Firstly, the sparse [...] Read more.
To reduce the maintenance cost and safeguard machinery operation, remaining useful life (RUL) prediction is very important for long term health monitoring. In this paper, we introduce a novel hybrid method to deal with the RUL prediction for health management. Firstly, the sparse reconstruction algorithm of the optimized Lasso and the Least Square QR-factorization (Lasso-LSQR) is applied to compressed sensing (CS), which can realize the sparse optimization for long term health monitoring data. After the sparse signal is reconstructed, the minimum entropy de-convolution (MED) is used to identify the fault characteristics and to obtain significant fault information from the machinery operation. Health indicators with Skip-over, sample entropy and approximate entropy are then performed to track the degradation of the machinery process. The performance analysis of the Skip-over is superior to other indicators. Finally, Fractal Autoregressive Integrated Moving Average model (FARIMA) is employed to predict the Skip-over using the R/S method. The analysis results evidence that the novel hybrid method yields a good performance, and such method can achieve highly accurate RUL prediction and safeguard machinery operation for long term monitoring. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

15 pages, 948 KiB  
Article
Dynamic Rounds Chaotic Block Cipher Based on Keyword Abstract Extraction
by Juan Wang and Qun Ding
Entropy 2018, 20(9), 693; https://doi.org/10.3390/e20090693 - 11 Sep 2018
Cited by 12 | Viewed by 3819
Abstract
According to the keyword abstract extraction function in the Natural Language Processing and Information Retrieval Sharing Platform (NLPIR), the design method of a dynamic rounds chaotic block cipher is presented in this paper, which takes into account both the security and efficiency. The [...] Read more.
According to the keyword abstract extraction function in the Natural Language Processing and Information Retrieval Sharing Platform (NLPIR), the design method of a dynamic rounds chaotic block cipher is presented in this paper, which takes into account both the security and efficiency. The cipher combines chaotic theory with the Feistel structure block cipher, and uses the randomness of chaotic sequence and the nonlinearity of chaotic S-box to dynamically generate encrypted rounds, realizing more numbers of dynamic rounds encryption for the important information marked by NLPIR, while less numbers of dynamic rounds encryption for the non-important information that is not marked. Through linear and differential cryptographic analysis, ciphertext information entropy, “0–1” balance and National Institute of Science and Technology (NIST) tests and the comparison with other traditional and lightweight block ciphers, the results indicate that the dynamic variety of encrypted rounds can achieve different levels of encryption for different information, which can achieve the purpose of enhancing the anti-attack ability and reducing the number of encrypted rounds. Therefore, the dynamic rounds chaotic block cipher can guarantee the security of information transmission and realize the lightweight of the cryptographic algorithm. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

18 pages, 1335 KiB  
Article
Achievable Rate Region under Linear Beamforming for Dual-Hop Multiple-Access Relay Network
by Guiguo Feng, Wangmei Guo and Binyue Liu
Entropy 2018, 20(8), 547; https://doi.org/10.3390/e20080547 - 24 Jul 2018
Cited by 2 | Viewed by 2422
Abstract
Consider a network consisting of two independent single-antenna sources, a single-antenna destination and a helping multiple-antenna relay. This network is called a dual-hop multiple access relay network (MARN). In this network, sources transmit to the relay simultaneously in the first time slot. The [...] Read more.
Consider a network consisting of two independent single-antenna sources, a single-antenna destination and a helping multiple-antenna relay. This network is called a dual-hop multiple access relay network (MARN). In this network, sources transmit to the relay simultaneously in the first time slot. The relay retransmits the received sum-signal to the destination using a linear beamforming scheme in the second time slot. In this paper, we characterize the achievable rate region of MARN under linear beamforming. The achievable rate region characterization problem is first transformed to an equivalent “corner point” optimization problem with respect to linear beamforming matrix at the relay. Then, we present an efficient algorithm to solve it via only semi-definite programming (SDP). We further derive the mathematical close-forms of the maximum individual rates and the sum-rate. Finally, numerical results demonstrate the performance of the proposed schemes. Full article
(This article belongs to the Special Issue Information Theory Applications in Signal Processing)
►▼ Show Figures

Figure 1

Show export options expand_more Show export options expand_less
Select all
Export citation of selected articles as:
 
Displaying articles 1-18
Back to TopTop