Applications of Information-Theoretic Concepts for Generative AI Systems
A special issue of Entropy (ISSN 1099-4300). This special issue belongs to the section "Information Theory, Probability and Statistics".
Deadline for manuscript submissions: 31 March 2026 | Viewed by 44
Special Issue Editors
Interests: bayesian data analysis; statistical signal processing; machine learning (for big data); information theory; source separation; computational mathematics and statistics; autonomous and intelligent systems; data mining and knowledge discovery; remote sensing; climatology; astronomy; systems biology; smart grid
Special Issues, Collections and Topics in MDPI journals
Interests: automated discovery; measurement; representation; voice intelligence; generative AI
Special Issues, Collections and Topics in MDPI journals
Special Issue Information
Dear Colleagues,
Generative Artificial Intelligence (GenAI) has rapidly transformed domains ranging from natural language processing and computer vision to computational creativity. However, its design, optimization, and evaluation present unique challenges—particularly in understanding and controlling uncertainty, bias, and interpretability. Information theory offers a rigorous mathematical framework for addressing these challenges, providing quantifiable entities such as entropy, mutual information, and transfer entropy to analyze, optimize, and interpret generative models.
This Special Issue aims to highlight contributions addressing theoretical advances, computational techniques, and practical applications of information-theoretic concepts in the development, evaluation, and deployment of generative AI systems. Topics of interest include but are not limited to information-theoretic training objectives, causal inference in generative models, rate–distortion theory for compression in AI pipelines, information bottleneck approaches, uncertainty quantification, and the use of transfer entropy for interpretability.
We invite contributions from academia and industry that span theory, algorithms, and real-world applications, fostering a multidisciplinary dialogue to advance the synergy between information theory and next-generation generative AI systems.
Dr. Deniz Gençağa
Dr. Rita Singh
Guest Editors
Manuscript Submission Information
Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.
Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Entropy is an international peer-reviewed open access monthly journal published by MDPI.
Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.
Keywords
- information-theoretic learning
- generative artificial intelligence
- deep generative models
- transformer architectures
- variational autoencoders (VAEs)
- generative adversarial networks (GANs)
- diffusion probabilistic models
- large language models (LLMs)
Benefits of Publishing in a Special Issue
- Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
- Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
- Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
- External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
- Reprint: MDPI Books provides the opportunity to republish successful Special Issues in book format, both online and in print.
Further information on MDPI's Special Issue policies can be found here.
