1. Introduction
Neuroscience is a rapidly developing field, and researchers are constantly studying various aspects of brain activity and neural networks. Understanding the oscillatory and recurrent behaviors in neural networks is critical for advancements in various fields such as neuroscience, artificial intelligence, and complex system modeling.
John J. Hopfield, in papers [
1,
2], presented a model,
where
are from the real axis,
and
,
, denote the membrane potentials of neuron
i and their rates of change; and
p is the total number of neurons in the network. Moreover,
are rates of self-regulation or reset potentials for neurons
when they are isolated;
,
, are the activation functions for neurons
, which determine how the membrane potential influences other neurons;
,
are the weights of the connection between neurons
and
;
,
, are input functions representing external stimuli or inputs to neurons
.
Impulsive neural networks are specifically designed to handle sudden input data or changes in system dynamics. They are inspired by how biological neurons respond to stimuli, such as pain or temperature changes, by transmitting corresponding signals to the brain. Just as biological neurons can undergo sudden changes in their state, impulsive artificial neural networks are engineered to mimic this behavior and adapt to sudden changes or disturbances in the input. This unique design makes them particularly useful in scenarios where the input data are prone to sudden changes, such as in applied mathematics.
Recent studies have emphasized the exploration of chaotic and recurrent signals within neural networks [
3,
4,
5]. Recurrence types, such as periodicity, quasi-periodicity, and Poisson stable motions, originate in the theory of celestial dynamics and have been applied to various areas of applied mathematics. Currently, the theory of oscillations is widely developed in a chaotic sense, and more than the classical functions are needed to describe complex systems’ dynamics. Therefore, new models and solutions of models and new functions are required. This is why the unpredictable functions were introduced [
6].
The proof of the stability of unpredictable functions is based on the method of included intervals, which is a new and efficient instrument for verifying convergence. This method, which is a significant contribution to the field, extends to spaces of discontinuous functions based on the B-topology, further enhancing its applicability and relevance in the field of applied mathematics. It plays a crucial role in our understanding of the behavior of impulsive neural networks.
In numerous real-world scenarios, continuous processes within neural network systems are often subject to abrupt interruptions caused by impulsive events or impacts [
7,
8,
9,
10,
11]. This study investigates the dynamics of such discontinuous Hopfield neural networks, emphasizing the symmetrical nature of the model. By treating impact actions as the limits of continuous processes of short duration, we establish that the functional structure of impulsive equations mirrors that of the differential ones. The symmetrical property of the model facilitates a detailed examination of network states during sharp jumps, enabling the exploration of complex models of processes with impulses. The symmetry ensures that the mathematical model accurately captures the behavior of these processes, and the research follows the dynamical ideas of J. Hopfield [
1,
2]. This is why we maintain a structural symmetry between the impulsive and differential parts of the models [
5,
12].
In this article, we delve into the unpredictability and Poisson stability of impulsive Hopfield-type neural networks with variable coefficients, which is a novel area of study. We also explore sequences that characterize Poisson stability and unpredictability synchronized for external input and output solutions. This research adds to the existing body of knowledge and provides new insights into the behavior of impulsive neural networks.
Throughout the paper, , and denote the sets of natural numbers, integers, and real numbers, respectively. Introduce the norm
where —is the absolute value and p is a fixed natural number; is a vector, such that . Consequently, , means the norm for the matrix , .
We investigate, in this paper, the existence and stability of unpredictable solutions of symmetrical impulsive discontinuous Hopfield-type neural networks of the form
where
,
,
correspond to the membrane potential of the unit
i,
, and
p is the number of neurons in the network. The sequence
of discontinuity moments is increasing, such that
as
Similarly to the differential part of the model, the coefficients , and in the impulsive equation are constants of self-regulation for the units or reset of potentials. When the units are isolating, the constants , , , denote the weights for connection between units j and i, while and are activation vectors, and the sequences , , are external impulses for the network. One can see that the impulsive part of the model possesses the same structure as the differential part. This is why we refer to the model as symmetrical one.
Suppose impact actions are considered as limits of continuous ones. In that case, the jump presentations must admit the functional structure of the differential equation. Hence, considering neural networks with impulses mimicking the structure of continuous rates is of great interest. In our research, we have proposed a neural network with newly structured impacts, completely imitating the rates. Our proposal makes excellent sense for applications, as impacts are limitations of their rate counterparts. Consequently, the issues which motivated J. Hopfield are now valid for the model under investigation in all of its parts. Since the impulsive actions are compatible with the differential equation in this study, it covers all similar neural networks considered previously.
The symmetry is completely or partially ignored in the literature [
7,
8,
9,
10,
11,
13,
14,
15,
16,
17], but the arguments above prove that it must be considered if one wants to conduct effective research on this topic. It has to be mentioned that ignorance on this topic is either due to the theoretical difficulties of impulsive systems or the absence of biological and engineering arguments for novelty. We are applying the experience accumulated in the books [
18,
19] for discontinuous dynamics. Moreover, we are the first to introduce the symmetry in [
12], where mathematical and biological arguments have been formulated. The first types are based on the limiting processes, which are standardized to obtain discrete analogs of continuous models, and the second one appeals to the founders’ original ideas, such as those presented by J. Hopfield [
1,
2]. We provide the initial explanation for the model in the hope that neuroscience specialists will accept and adapt our suggestions further. The symmetry will open up new possibilities for productive application of the methods introduced and developed within the last few years for various types of impulsive systems [
20,
21,
22] and networks [
23,
24,
25]. Another interesting opportunity involves combining methods for discontinuous dynamics with those for synchronization [
26,
27].
We assume that , , , are continuous functions and the coefficients , , and are real numbers.
The present paper continues what was initiated in the article [
12], where impulsive neural networks of the following form were studied:
It deserves to be emphasized that
constancy dominates in coefficients of the model. Precisely, rates of self-regulation
, activation functions
,
, connection weights
, and
are real constants. This is not surprising, since traditionally, the networks have fixed connection weights or coefficients. However, there are extensions and variations of the Hopfield model that introduce variable coefficients. These modifications can allow for more flexible and adaptive behavior [
28,
29,
30,
31,
32,
33,
34,
35,
36]. The dynamics of networks will still involve updating neuron states iteratively until the network reaches a stable state or settles into a limit cycle. It is clear that with variable coefficients, the convergence properties and stability of network states may change dynamically as the coefficients are adjusted. Networks with variable components can be applied to tasks where the underlying relationships or patterns are not fixed and may change over time, for example, in pattern recognition tasks where the importance of features varies depending on context, or in adaptive control systems where the network needs to learn and adjust to changing environments.
Another reason for the study of the system (
2) besides the model (
3) is the theoretical challenges connected to sophisticated dynamics of unpredictability, which now is more saturated in the model’s interiors. We must analyze the role of unpredictable components and consider sufficiency of the unpredictability combined with Poisson stability. That is, we must not simply involve variable coefficients to make the research align more closely with the applications and increase its mathematical merits; we must also create more wide-reaching structural possibilities.
2. Preliminaries
In what follows, we will use the vector form of the model because of its effectiveness in representing mathematical concepts and the proof of the main statements. For this purpose, throughout the paper we shall denote
,
as
matrix functions, as follows,
Moreover,
and
as
matrix-sequences
and,
,
,
are
vector functions and
is
vector sequence, of the following vector form:
Thus, using the suggested notations, the symmetric discontinuous Hopfield-type neural networks (
2) can be written as follows:
where
,
,
.
2.1. Poisson Stable and Unpredictable Continuous and Discontinuous Functions
Let us provide the basic definitions and useful lemmas.
Definition 1 ([
37])
. A sequence in is called Poisson stable, provided that it is bounded and there exists a sequence and of positive integers which satisfies as on bounded intervals of integers. Definition 2 ([
37])
. A uniformly continuous and bounded function is Poisson stable if there exists a sequence which diverges to infinity, such that as uniformly on compact subsets of . Consider sequences of real numbers , with indices . They are assumed to strictly increase with regard to the indices. Sequence is unbounded in both directions. Moreover, it satisfies with positive numbers , . We provide the description of a Poisson couple in the following definition.
Definition 3 ([
12])
. A couple of sequences , , is called a Poisson couple if there exists a sequence , , which diverges to infinity, such thatuniformly on each bounded interval of integers k. Definition 4 ([
18])
. A sequence , is said to be part of the property if there exists a positive real number w and integer p which satisfy for all . Lemma 1 ([
12])
. Assume that sequences , , satisfy the following conditions- (i)
sequence admits the property;
- (ii)
, where ;
then is a Poisson couple.
Definition 5 ([
18])
. Two piecewise continuous functions and from are said to be —equivalent on a bounded interval J if the points of discontinuity of the functions and in J can be respectively numerated and , , such that for each , and for each , except those between and for each i. In the case that
F and
G are
—equivalent on
J, we also say that the functions are in
—neighborhoods of each other. The topology defined with the aid of such neighborhoods is called the
B-topology [
18].
Let us consider the set of conditional uniform continuous vector functions , , . The functions are continuous except at a countable set of moments where they exhibit left continuity. The sets of discontinuity points are unbounded from both sides and do not have finite accumulation points. There is no requirement for the discontinuity moments to be common across functions in
We will use the following concepts, such as conditional uniform continuity and
−topology from [
18], which create a framework for understanding the Poisson stable behavior of discontinuous functions.
Definition 6 ([
12])
. An element of with discontinuity moments , is said to be a discontinuous Poisson stable function, if there exists a sequence of real numbers such that , is a Poisson couple and as on each bounded interval of real numbers in B topology. The sequence in the last definition is called the Poisson or convergence sequence.
As one can see from the Definition 6 for discontinuous Poisson stability, we need a convergence sequence , which is common for both the function convergence and discontinuity points , which are connected as Poisson couple .
Then, we write to denote the interval , if and interval , if .
Definition 7 ([
12])
. A discontinuous Poisson stable function of with discontinuity moments and convergence sequence is said to be discontinuous unpredictable, provided that , , is a Poisson couple, and there exist positive numbers and sequences of real numbers and of integers, both of which diverges to infinity such that interval does not contain discontinuity points of and , and on the interval. The divergence estimated by is said to be separation property, and is the divergence sequence.
In what follows, we shall say that is a discontinuous unpredictable function with Poisson couple and divergence sequence .
2.2. The “Diagonal” Poisson Stability of the Linear Homogenous Impulsive System
Let us denote by
the transition matrix, [
18], of the system associated with (
4),
where
.
It is assumed, in the paper, that
- (C1)
with constants and .
Also, the following assertion is needed for the proof of the Poisson stability in the paper.
Lemma 2. Assume that the following conditions are valid
The entries of matrix are continuously Poisson stable with the sequence of convergence ,
The sequence is Poisson stable with a convergence sequence , ;
The convergence sequence and discontinuity moments make a Poisson couple ;
The condition is fulfilled.
Then, for arbitrary interval and positive number ε, there exists a natural k, such that for all and , the following inequality holds Proof. Due to these conditions, there exists a number k, such that for it is true that and implies that where for all
Moreover, it is true that
Consequently, if
denotes the number of points
in the interval
and
□
3. Main Results
We will study the problem of the existence and uniqueness of discontinuous unpredictable oscillations for system (
4).
In this article, the following symbols will be employed:
| | |
| | |
Lemma 3. A bounded vector function is a solution of system (4) if and only if it is a solution of the following integral equations:for all . Consider the subset of —dimensional discontinuous Poisson stable functions , with the set of discontinuity moments , , and the common convergence sequence , . In the set, determines the norm . Moreover, for all , where H is a positive fixed number, and the convergence sequence and discontinuity moments , make a Poisson couple .
The following conditions are needed:
- (C2)
the coefficients of matrices , and the input , are continuous Poisson stable and the sequence of convergence , is common for all their coordinates;
- (C3)
the sequences , , , are Poisson stable with a common convergence sequence , ;
- (C4)
there exist positive numbers and , such that , , for all ;
- (C5)
- (C6)
;
- (C7)
.
Let us introduce the following integral operator
in the space
, such that
for all
.
Lemma 4. If , then .
Proof. For a function
and we have found that
So, based on condition , it is true that .
Let us check that the Poisson stability of is valid.
According to the method of included intervals introduced in [
38], we fix a positive number
and
and will prove that
on
for sufficiently large
n. Then, we choose real numbers
,
and
to satisfy the inequalities
and
To prove convergence, we first introduce the following difference
For
we find that
where
and
, with
and
, respectively.
Taking into account the Poisson sequence and discontinuity moments , we make use of the Poisson couple , as well as applying conditions (C2) and (C3), one can make the number n sufficiently large, such that , , , , , and , for all , .
So, according to the above inequalities, we have found that
Consider the difference in (
15) separately for intervals
and
to obtain that
where
and
Let us continue with the estimation of the constants
and
Firstly, we find that (
10) implies
Applying Lemma 2 and estimations (
11)–(
14), (
16) and (
17), one can verify that
Thus, we have determined that , for . Therefore, uniformly in B-topology as on each bounded interval. □
Lemma 5. The operator is contractive.
Proof. For elements
and
of the set
, we have found that
Therefore, the inequality . Thus, the operator is contractive by means of condition . □
Theorem 1. If conditions (C1)–(C7) are fulfilled, then impulsive system (4) has a unique globally exponentially stable discontinuous Poisson stable solution. Proof. To demonstrate the completeness of
, we begin by considering a Cauchy sequence
,
, contained within
, which converges to the limit function
on
. Then, we fix a closed and bounded interval
We write
to denote the discontinuity points of both
and
, and
, the discontinuity points of
and
within interval
I. Then, we choose
n to be sufficiently large that
. Due to the convergence of
, it follows that
and
for a sufficiently large
r. Since the sequence
, for a sufficiently large
n for
, while
,
. Thus, for a sufficiently large
r and
n, it is true that
for all
. That is,
in
B-topology as
on
I. The completeness of
is proved.
When we apply the contraction mapping theorem, due to Lemmas 4 and 5, there exists a unique solution
of the system (
4).
Finally, we will study the asymptotic stability of the oscillation
. It is true that [
18],
for all
Let
be another solution of system (
4). One can write
for all
Making use of the relation
we find that
Thus, it can be confirmed that
Now, applying the Gronwall–Bellman Lemma for discontinuous functions [
18], one can determine that
From the last inequality, it follows that
for
.
Consequently, condition
implies that
is an exponentially stable solution of (
4). □
From now on, we shall need the following condition.
- (C8)
The vector function
in system (
4) satisfies condition
, and there exist positive numbers
and sequence
, which diverge to infinity, such that
for each
and
.
The unpredictability of the solution for the system (
4) is established by the next theorem.
Theorem 2. If conditions (C1)–(C8) are valid, then system (4) has a unique exponentially stable unpredictable solution. Proof. In accordance with the Theorem 1, system (
4) has a unique exponentially stable Poisson stable solution
. So, to prove this theorem, we need only to show that the solution of (
4) satisfies the separation property.
Corresponding to Definition 7, the interval does not admit discontinuity points of functions , . That is why studies of unpredictability ignore the presence of a discontinuity moments.
We have determined that
and
Therefore, it is true that
To check the unpredictability of the solution, we choose a positive number
and
, such that the following inequalities
and
are satisfied.
Next, we fix the numbers and .
Then, we denote
and consider the two alternatives:
If
holds, we find that
for
If
is true, then from (
22), it follows that
for
Applying (
20)–(
24) and due to the condition (
C8), one can find that
for
. Thus, we determine that
for
. In accordance with the inequalities obtained in cases
and
, we see that the solution
is discontinuous and unpredictable with
and the divergence sequence
.
So, we have obtained the unpredictability of the solution
of the system (
4). □
4. An Example
We consider an example of a Hopfield neural network where the coefficients besides the inputs are Poisson stable functions and the inputs are unpredictable ones. Given that periodic, quasi-periodic, and almost-periodic functions fall within the class of Poisson stable functions, we opt for quasi-periodic coefficients as Poisson stable components in the example.
Construction of an unpredictable sequence as the solution of the logistic equation
can be found in [
6]. It was proved that for each
, there exists an unpredictable solution
,
of (
26), which belongs to the interval
.
There is an example of an unpredictable function in [
6],
where
is a piecewise constant function defined on the real axis through the equation
for
It is worth noting that
is bounded on the whole real axis, such that
Let us consider the symmetrical impulsive Hopfield-type neural networks
where
the self regulation
,
,
, the synaptic connection weights
,
,
,
,
,
,
,
,
are quasi periodic, and the external inputs
,
, and
are unpredictable functions. The set of discontinuity moments of the system
is defined by the sequence
,
. The impulsive rates are equal to
,
,
, and the instantaneous synaptic connection weights
,
,
,
,
,
,
,
,
are also quasi-periodic sequences, and the external impulsive inputs are equal to
,
,
. The activation functions are presented by
and impact activations
.
Moreover, the functions
and
are bounded; that is, there exist positive numbers
,
and Lipschitz conditions are met, i.e.,
and
. By verifying that the coefficients of the system satisfy
and
, one can find that the condition
is valid. Moreover, one can check that the conditions
–
are satisfied. Thus, according to the Theorem 2, there exists a unique asymptotically stable discontinuous unpredictable solution,
, of the system (
27).
It is worth noting that the simulation of a unpredictable solution is not possible, since the initial value is unknown. That is why we will simulate a solution
which approaches the unpredictable solution
as time increases. Instead of the curve describing the almost periodic solution, one can take the graph of
, as shown in
Figure 1 and
Figure 2. The graphs of coordinates and trajectory of the function with the initial values
.