Next Article in Journal
Non-Coding RNAs Extended Omnigenic Module of Cancers
Previous Article in Journal
Understanding Higher-Order Interactions in Information Space
Previous Article in Special Issue
The State-Dependent Channel with a Rate-Limited Cribbing Helper
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
Article

Contrast Information Dynamics: A Novel Information Measure for Cognitive Modelling

by
Steven T. Homer
1,*,†,
Nicholas Harley
1,*,† and
Geraint A. Wiggins
1,2,*
1
Computational Creativity Lab, Artificial Research Group, Vrije Universiteit Brussel, 1050 Etterbeek, Belgium
2
Cognitive Science Research Group, School of Electronic Engineering and Computer Science, Queen Mary University of London, London E1 4NS, UK
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Entropy 2024, 26(8), 638; https://doi.org/10.3390/e26080638 (registering DOI)
Submission received: 20 April 2024 / Revised: 12 July 2024 / Accepted: 24 July 2024 / Published: 27 July 2024
(This article belongs to the Collection Feature Papers in Information Theory)

Abstract

We present contrast information, a novel application of some specific cases of relative entropy, designed to be useful for the cognitive modelling of the sequential perception of continuous signals. We explain the relevance of entropy in the cognitive modelling of sequential phenomena such as music and language. Then, as a first step to demonstrating the utility of constrast information for this purpose, we empirically show that its discrete case correlates well with existing successful cognitive models in the literature. We explain some interesting properties of constrast information. Finally, we propose future work toward a cognitive architecture that uses it.
Keywords: information dynamics; cognitive modelling; information theory; information measure; continuous systems; coordinate invariance; specific information; predictive information; Markov process; Gaussian process information dynamics; cognitive modelling; information theory; information measure; continuous systems; coordinate invariance; specific information; predictive information; Markov process; Gaussian process

Share and Cite

MDPI and ACS Style

Homer, S.T.; Harley, N.; Wiggins, G.A. Contrast Information Dynamics: A Novel Information Measure for Cognitive Modelling. Entropy 2024, 26, 638. https://doi.org/10.3390/e26080638

AMA Style

Homer ST, Harley N, Wiggins GA. Contrast Information Dynamics: A Novel Information Measure for Cognitive Modelling. Entropy. 2024; 26(8):638. https://doi.org/10.3390/e26080638

Chicago/Turabian Style

Homer, Steven T., Nicholas Harley, and Geraint A. Wiggins. 2024. "Contrast Information Dynamics: A Novel Information Measure for Cognitive Modelling" Entropy 26, no. 8: 638. https://doi.org/10.3390/e26080638

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Article metric data becomes available approximately 24 hours after publication online.
Back to TopTop