Next Article in Journal
Decoherence, Anti-Decoherence, and Fisher Information
Next Article in Special Issue
TOLOMEO, a Novel Machine Learning Algorithm to Measure Information and Order in Correlated Networks and Predict Their State
Previous Article in Journal
Cluster-Delay Mean Square Consensus of Stochastic Multi-Agent Systems with Impulse Time Windows
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

External Stimuli on Neural Networks: Analytical and Numerical Approaches

Centro Brasileiro de Pesquisas Físicas and National Institute of Science and Technology for Complex Systems, Rua Xavier Sigaud 150, Urca, Rio de Janeiro 22290-180, Brazil
*
Author to whom correspondence should be addressed.
Entropy 2021, 23(8), 1034; https://doi.org/10.3390/e23081034
Submission received: 8 July 2021 / Revised: 3 August 2021 / Accepted: 5 August 2021 / Published: 11 August 2021
(This article belongs to the Special Issue Memory Storage Capacity in Recurrent Neural Networks)

Abstract

Based on the behavior of living beings, which react mostly to external stimuli, we introduce a neural-network model that uses external patterns as a fundamental tool for the process of recognition. In this proposal, external stimuli appear as an additional field, and basins of attraction, representing memories, arise in accordance with this new field. This is in contrast to the more-common attractor neural networks, where memories are attractors inside well-defined basins of attraction. We show that this procedure considerably increases the storage capabilities of the neural network; this property is illustrated by the standard Hopfield model, which reveals that the recognition capacity of our model may be enlarged, typically, by a factor 102. The primary challenge here consists in calibrating the influence of the external stimulus, in order to attenuate the noise generated by memories that are not correlated with the external pattern. The system is analyzed primarily through numerical simulations. However, since there is the possibility of performing analytical calculations for the Hopfield model, the agreement between these two approaches can be tested—matching results are indicated in some cases. We also show that the present proposal exhibits a crucial attribute of living beings, which concerns their ability to react promptly to changes in the external environment. Additionally, we illustrate that this new approach may significantly enlarge the recognition capacity of neural networks in various situations; with correlated and non-correlated memories, as well as diluted, symmetric, or asymmetric interactions (synapses). This demonstrates that it can be implemented easily on a wide diversity of models.
Keywords: neural networks; models of single neurons; artificial intelligence; nonlinear dynamical systems neural networks; models of single neurons; artificial intelligence; nonlinear dynamical systems

Share and Cite

MDPI and ACS Style

Curado, E.M.F.; Melgar, N.B.; Nobre, F.D. External Stimuli on Neural Networks: Analytical and Numerical Approaches. Entropy 2021, 23, 1034. https://doi.org/10.3390/e23081034

AMA Style

Curado EMF, Melgar NB, Nobre FD. External Stimuli on Neural Networks: Analytical and Numerical Approaches. Entropy. 2021; 23(8):1034. https://doi.org/10.3390/e23081034

Chicago/Turabian Style

Curado, Evaldo M. F., Nilo B. Melgar, and Fernando D. Nobre. 2021. "External Stimuli on Neural Networks: Analytical and Numerical Approaches" Entropy 23, no. 8: 1034. https://doi.org/10.3390/e23081034

APA Style

Curado, E. M. F., Melgar, N. B., & Nobre, F. D. (2021). External Stimuli on Neural Networks: Analytical and Numerical Approaches. Entropy, 23(8), 1034. https://doi.org/10.3390/e23081034

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop