Information Theory, Probability and Statistics
A section of Entropy (ISSN 1099-4300).
Section Information
In 1948 C. E. Shannon published his paper “A Mathematical Theory of Communication” in the Bell Systems Technical Journal. He showed how information could be quantified with absolute precision, and demonstrated the essential unity of all information media. In brief, he introduced four groundbreaking concepts that were influential enough to help change the world. Thus, his most eminent result was the concept that every communication channel had a speed limit, measured in binary digits per second. Additionally, he also realized that the content of the message was irrelevant to its transmission, since once data is represented digitally it could be regenerated and transmitted without error. On the other hand, the efficient representation of data, i.e. the source coding, was another question that Shannon opened for discussion. Finally, his paper also defined the amount of information that can be sent down a noisy channel in terms of transmit power and bandwidth, thus introducing the concept of entropy.
From that moment, this theory has been widely applied to numerous scenarios, such as statistical inference, natural language processing, cryptography, neurobiology, molecular engineering, ecology, medical physics, biomedical engineering, thermal physics, quantum computing, linguistics, plagiarism detection, pattern recognition and anomaly detection, among others. Indeed, in recent decades, it has played a key role in the invention of the compact disc, the feasibility of mobile phones, the development of the Internet, the study of linguistics and of human perception, the understanding of black holes, as well as in numerous other fields.
This section, focuses on original and new research results regarding this broad and deep mathematical theory, as well as in diverse applications. Thus, manuscripts on source coding, channel coding, algorithmic complexity theory, algorithmic information theory, information–theoretic security, and measures of information, as well as on their application to traditional as well as novel scenarios are solicited. Submissions addressing critical up-to-date reviews will also be welcome. Download Section Flyer
Prof. Dr. Raúl Alcaraz Martínez
Section Editor-in-Chief
Keywords
Information Theory:
- communications and communications networks;
- sequences;
- coding theory and techniques;
- network coding and lattice theory;
- quantum information theory;
- signal processing;
- Shannon theory;
- complexity and cryptography;
- data compression;
- multi-user, multi-variate and hyper dimensional information theory;
- coded modulation;
- computational complexity;
- information dynamics and measures ;
- theoretical computer science and artificial intelligence;
- information theoretic learning;
- information fusion;
- fractional order generalized information;
- emerging applications of information theory in economics, medicine, biology, industry, thermodynamics, education, chemistry, physics, cognitive science, and social science;
- application of information theory in wireless/multimedia applications;
- application of information theory in image processing, computer graphics and visualization
Statistics:
- machine learning and its applications;
- deep learning and its applications;
- learning and inference;
- pattern recognition;
- statistical learning and data mining;
- information algebra/geometry;
- stochastic processes;
- computational statistics;
- statistical modeling;
- natural language processing;
- emerging applications of statistical theory in economics, medicine, biology, industry, thermodynamics, education, chemistry, physics, cognitive science,and social science
Probability:
- detection and estimation theory;
- probability theory;
- communication combinatorial problems;
- decision-making theory;
- emerging applications of probability theory in economics, medicine, biology, industry, thermodynamics, education, chemistry, physics, cognitive science, and social science
Editorial Board
Topical Advisory Panel
Special Issues
Following special issues within this section are currently open for submissions:
- Privacy-Preserving Cryptography for Emerging Technologies: Applications and Challenges (Deadline: 15 June 2024)
- An Information-Theoretic Approach to Side-Channel Analysis (Deadline: 30 June 2024)
- Information-Theoretic Guided Methods for Information Network Mining and Its Applications (Deadline: 30 June 2024)
- Information Theory and Network Coding II (Deadline: 30 June 2024)
- Recent Advances in Statistical Inference for High Dimensional Data (Deadline: 30 June 2024)
- Information Theory for MIMO Systems (Deadline: 15 July 2024)
- Wireless Communications: Signal Processing Perspectives (Deadline: 17 July 2024)
- Information Theoretic Criteria: New Theoretical Developments and Applications, 2nd Edition (Deadline: 18 July 2024)
- Learning from Games and Contests (Deadline: 20 July 2024)
- Towards Ultra-Low-Latency Video Communications (Deadline: 20 July 2024)
- Information and Self-Organization III (Deadline: 21 July 2024)
- Information Theory for Distributed Systems (Deadline: 25 July 2024)
- Cryptography and Data Security Based on Information Theory (Deadline: 30 July 2024)
- Signal Processing and Tensor Techniques for Communication and Positioning Systems (Deadline: 31 July 2024)
- Application of Information Theory to Computer Vision and Image Processing II (Deadline: 31 July 2024)
- Information-Theoretic Methods in Data Analytics (Deadline: 17 August 2024)
- Coding for Aeronautical Telemetry (Deadline: 20 August 2024)
- Extremal and Additive Combinatorial Aspects in Information Theory (Deadline: 31 August 2024)
- Advanced New Physical Layer Technologies for Next-Generation Wireless Communications (Deadline: 31 August 2024)
- Intelligent Information Processing and Coding for B5G Communications (Deadline: 31 August 2024)
- Shannon Entropy: Mathematical View (Deadline: 31 August 2024)
- Information Theory and Coding for Image/Video Processing (Deadline: 1 September 2024)
- Discrete Math in Coding Theory (Deadline: 19 September 2024)
- Entropy in Computational Linguistics (Deadline: 30 September 2024)
- Mathematics in Information Theory and Modern Applications (Deadline: 30 September 2024)
- Integrated Sensing and Communications for Distributed Virtualized MIMO Networks (Deadline: 30 September 2024)
- Synergy and Redundancy Measures: Theory and Applications to Characterize Complex Systems and Shape Neural Network Representations (Deadline: 10 October 2024)
- Progress and Research Challenges to Catalyze B5G and 6G (Deadline: 15 October 2024)
- Information-Theoretic Cryptography and Security (Deadline: 20 October 2024)
- Information-Theoretic Criteria for Statistical Model Selection (Deadline: 30 October 2024)
- Physics-Informed Neural Networks (Deadline: 30 October 2024)
- The Random Walk Path of Pál Révész in Probability (Deadline: 15 November 2024)
- New Advances in Error-Correcting Codes (Deadline: 15 November 2024)
- Integrated Sensing and Communications (Deadline: 20 November 2024)
- Bayesian Learning and Its Applications in Genomics (Deadline: 29 November 2024)
- Applications of Information Theory to Machine Learning (Deadline: 30 November 2024)
- Statistical Methods for Modeling High-Dimensional and Complex Data: Second Edition (Deadline: 30 November 2024)
- Information Theory and Coding for Wireless Communications II (Deadline: 30 November 2024)
- Coding and Algorithms for DNA-Based Data Storage Systems (Deadline: 30 November 2024)
- Information-Theoretic Methods for Trustworthy Machine Learning (Deadline: 30 November 2024)
- Probabilistic Models for Dynamical Systems (Deadline: 1 December 2024)
- Information Theory for Data Science (Deadline: 15 December 2024)
- Advances in Bayesian Optimization and Deep Reinforcement Learning (Deadline: 16 December 2024)
- Delay-Doppler Domain Communications for Future Wireless Networks II (Deadline: 25 December 2024)
- Causal Graphical Models and Their Applications (Deadline: 31 December 2024)
- Number Theoretic Methods in Statistics: Theory and Applications (Deadline: 31 December 2024)
- Information Theory in Emerging Wireless Communication Systems and Networks, Second Edition (Deadline: 19 January 2025)
- Gaussian Fields and Their Application in Computational Engineering and Mathematical Physics (Deadline: 15 February 2025)
- Information Hiding and Secret Sharing for New Carriers and Their Security Evaluation Methods (Deadline: 20 February 2025)
- Information Theoretic Learning with Its Applications (Deadline: 28 February 2025)
- Types of Entropies and Divergences with Their Applications II (Deadline: 28 February 2025)
Topical Collections
Following topical collections within this section are currently open for submissions: