Basic Concepts, Identities and Inequalities - the Toolkit of Information Theory

Topsøe, Flemming

doi:10.3390/e3030162

Open AccessArticle

Basic Concepts, Identities and Inequalities - the Toolkit of Information Theory

by

Flemming Topsøe

Department of Mathematics, University of Copenhagen, Denmark

Entropy 2001, 3(3), 162-190; https://doi.org/10.3390/e3030162

Submission received: 12 September 2001 / Accepted: 18 September 2001 / Published: 30 September 2001

Download

Abstract

Basic concepts and results of that part of Information Theory which is often referred to as "Shannon Theory" are discussed with focus mainly on the discrete case. The paper is expository with some new proofs and extensions of results and concepts.

Keywords: entropy; divergence; mutual information; concavity; convexity; data reduction

Share and Cite

MDPI and ACS Style

Topsøe, F. Basic Concepts, Identities and Inequalities - the Toolkit of Information Theory. Entropy 2001, 3, 162-190. https://doi.org/10.3390/e3030162

AMA Style

Topsøe F. Basic Concepts, Identities and Inequalities - the Toolkit of Information Theory. Entropy. 2001; 3(3):162-190. https://doi.org/10.3390/e3030162

Chicago/Turabian Style

Topsøe, Flemming. 2001. "Basic Concepts, Identities and Inequalities - the Toolkit of Information Theory" Entropy 3, no. 3: 162-190. https://doi.org/10.3390/e3030162

APA Style

Topsøe, F. (2001). Basic Concepts, Identities and Inequalities - the Toolkit of Information Theory. Entropy, 3(3), 162-190. https://doi.org/10.3390/e3030162

Article Menu

Basic Concepts, Identities and Inequalities - the Toolkit of Information Theory

Abstract

Share and Cite

Article Metrics

Article Access Statistics

Further Information

Guidelines

MDPI Initiatives

Follow MDPI