1. Introduction
The large-scale neural network models in computational neuroscience have become familiar. The classical description of these (excitatory-inhibitory) neural network models is based on the deterministic/stochastic system. One of the most common models is known as the noisy leaky integrate-and-fire (NLIF) neuron model in which the behavior of the whole population of neurons is encoded in a stochastic differential equation (SDE) for the time evolution of membrane potential of a single neuron representative of the network. The dynamics of a single neuron is given by ([
1,
2,
3,
4,
5,
6])
where
represents the membrane potential of a single neuron and
is the time relaxation of the membrane potential in the absence of any communication. The communication of a single neuron with the network is modeled by the synaptic input current,
The form of
is a stochastic process, given by ([
7])
Here, each spike is treated as a delta function, and if a spike occurs at time
it is denoted by
The terms
and
in above equation represent the time of
mth-spike receiving from
nth-presynaptic neuron for excitatory and inhibitory neurons, respectively. Moreover, the terms
and
are the total number of presynaptic neurons, where
and
are the strength of the synapses for excitatory and inhibitory neurons, respectively. Since the above form of synaptic input current is the discrete Poisson process, it becomes very difficult for further investigation. In addition, the researchers have used the diffusion approximation in which the synaptic input current
is approximated by a continuous in time Ornstein-Uhlenbeck-type stochastic process as given by
Initially, it is assumed that every neuron generates spikes according to a stationary Poisson process with constant probability of generating a spike per unit time and it is also assumed that all these processes are independent between neurons, because of these assumptions, the mean value of the current, indicated by , is given by and its variance, Here, we have to depict the likelihood of firing per unit time of the Poissonian spike train r and it is thus recognized as the firing rate, which should be computed as where is the mean firing rate of the network. On the other side, is the standard Brownian motion in above equation.
The next important factor in the modeling is that the neurons generate a spike only when its membrane potential arrives at a certain voltage, known as threshold and instantly reset toward a resetting potential and sends a signal over the network.
Comprising the continuous form of
in SDE model (1), we obtain
where
We suppose that the voltage of a neuron arrives at threshold level at time
, i.e.,
and after that the voltage arrives suddenly at resting potential, i.e.,
Furthermore, one can write the associated FPE with source term by using Ito’s rule [
8], for the evolution of probability density function
of finding neurons at a voltage
with time (
)
where
and
is the mean firing rate of the network which is computed as the flux of neuron at the firing voltage. The source term of the Equation (2) comes from the fact that when the neurons generate spikes and send the signals over the network, their voltage immediately reset to the reset potential
At the relaxation time, no neuron have the firing voltage, for this reason, the initial and boundary conditions are given by
We can easily verify the conservation of the total number of neurons in above equation. For this purpose, we need to describe the mean firing rate for the network. Since the mean firing rate is the flux of neurons at , the value of is given by Integrating (3) across the voltage domain and using the above boundary conditions, we obtain the required condition.
Equation (2) represents the evolution of probability density function and therefore
If we translate the new voltage variable by considering then we have and diffusion coefficient is of the form
In [
8], the authors provide theoretical and numerical analysis using finite difference approximation. For the references of mathematical aspects of nonlinear NLIF models, we refer [
9,
10,
11,
12,
13]. We are concern about finding the value of the unknown
using alternative approach. The problem (2)–(4) cannot be solved analytically, because of its complexity arising from nonlinearity and having a source term [
14,
15,
16]. Therefore, numerical methods are generally used, for example, finite difference method (FDM) is used to find the approximate solution of the governing equation [
8]. However, FDM has some disadvantages, for instance, the singularity in the delta source term, as in the above mentioned equation, makes the solution divergent. In order to use the FDM appropriately, the governing equation must be modified, due to the fact that the procedure becomes complicated.
Hence, in the present work, we propose a formulation based on finite element approximation to find the solution of governing equation. FEM is one of the powerful numerical methods for the solutions of problems that describe the real-life situations. Moreover, the characteristics of FEM tackle the singularity problem in an effective manner [
17,
18,
19,
20,
21,
22,
23,
24,
25,
26,
27]. The applicability of FEM regarding this model problem is demonstrated in the final section.
Description of the present paper is as follows: We consider the NLIF model described by Equations (2) and (3). In
Section 2, we develop the numerical approximation based on the finite element approach. The analysis for the stability is provided in
Section 3. We report some numerical examples from [
8] and discuss the solution behavior graphically in
Section 4. In the last section, we conclude the work done in this research article.
Preliminaries
Here, we state some basic definitions and auxiliary results, which will be used throughout the manuscript. As we are studying a nonlinear version of the FPE, we start with the notion of weak solution.
Definition 1. We say that a pair of non-negative functionswithis a weak solution of (2) and (3) if for any test functionsuch that, we have Here, the space
, refers to the space of functions such that
is integrable in
, while
corresponds to the space of bounded functions in
. The set of infinitely differentiable functions in
is denoted by
used as test functions in the notion of weak solution. The blow-up of solution and a priori estimates are given in [
8]. We here just state the results.
Theorem 1. (Blow-up) Assume that the drift and diffusion coefficients satisfyfor alland all, and let us consider the average-excitatory network where. Choose. If the initial data is concentrated enough around, in the sense thatis close enough to, then there are no global-in-time weak solutions to (2)–(4). Lemma 1 (A priori estimates).
Assumeon the drift and diffusion coefficients and thatis a global-in-time solution of (2)–(4) in the sense of Definition 1 fast decaying at, then the following a priori estimates hold for all:
IfthenMoreover, if in addition a is constant, then
In a latest work [
8], it was demonstrated that the problem (2)–(4) can produce a finite time blow-up solution for excitatory networks
when the initial data is concentrated near sufficient to the threshold voltage. This result was obtained by giving no information about the behavior at the blow-up time. In a recent work [
12], we state the theorem gives a characterization of this blow-up time when it occurs for
Theorem 2. Letbe a non-negativefunction such thatand There exist a classical solution of (2)–(4) in the time interval with
The maximal existence time can be characterized as Moreover, whenwe have thatwhile forthere exist classical solutions which blow up at a finite timeand consequently have diverging mean firing rate as
We now state the main result on steady states from [
8].
Theorem 3. Let,with.
Under either the conditionsand, or the condition, then there exists at least one steady state solution to (2)–(4).
If bothandhold, then there are at least two steady states to solution to (2)–(4).
There is no steady state to (2)–(4) under the high connectivity condition’
2. Finite Element Approximation
We construct the numerical approximation of the problem given in (2) and (3) in two ways: First we use FEM for space discretization that provides a system of ordinary differential equations, which is then solved by Euler’s backward difference for time. Spatial discretization involves the construction of a weak formulation of problem over a given domain
with specified boundary conditions at
and
Weak formulation of the problem (2) and (3) is obtained by multiplying the equation with some test function
and integrating over
,
In the present study, the mean firing rate
is approximated by using backward FDM. Performing the integration by parts in above equation, we get the following equation:
This resulting integral (8) is called weak formulation because it allows approximate function with less continuity (or differentiability) than the strong form given in Equation (2). Once we obtained the weak formulation, next step is to discretize the weak form for the easy representation and to capture the local effects more precisely. Weak form discretization consists of dividing the entire domain into set of elements, then developing the finite element model by seeking the approximation of a solution over a typical element. This discretization is tackled by taking
n non-overlapping elements say
for
with step size
h given by:
The unknown function
must be approximated in a manner so that continuity or differentiability demands by weak formulation can be met. Since the weak formulation contains the first order derivative of
any function with non-zero first derivative would be a candidate for approximation. Thus, semi discretization consists of finding
where
are the nodal values and
are the basis functions given by
There are many choices of weight function
to be used. Particular choice for the weight function
in Galerkin approach is the same as the choice of basis function
Thus, substituting weight function
and approximation for the solution defined by Equation (10) in weak formulation obtained in Equation (9) leads to the following equation:
On simplification of the above, we get as follows
Solving Equation (12), we get the system of ordinary differential equations for
which can be expressed in matrix notation given by
where
By assembling the contribution from all elements, we get the following system for the global nodal vector
on the entire domain
where
f is the column vector with all entries are zero except at reset potential
Ordinary differential Equation (14) requires implicit and stable time-stepping method to avoid extremely small time-step. Firstly we discretize the time domain
into
m subintervals with time step
We use the Euler’s backward difference in time and get the following system from Equation (14):
this algebraic system (15) can be solved for
4. Numerical Experiments
In this section, we present some numerical examples to demonstrate the behavior of the solutions of the nonlinear NLIF model. The performance of the developed scheme is tested by comparing our results with the existing scheme in the literature. Consider the system (2) and (3) with initial data as follows
where change in mean
and variance
describe different scenario of a solution. We notice that the behavior of the solution depends upon the value of excitatory (
) and inhibitory
average network. First we take constant diffusion coefficient
and find the effect on solution with change in value of
In
Figure 1a, we find that after some time the solution
goes to steady state by taking excitatory case i.e.,
small enough.
The approximate solution
for
at different time levels
is plotted in
Figure 1 with a reset potential
From
Figure 1a, we see that height of impulse decreases as time increases and after some time it reaches a steady state. In
Figure 1b, we perform numerical approximation based upon FEM and compare the results obtained in [
8] at a final time
The evolution of firing rate
with the time
, is plotted in
Figure 2. We find that firing rate has different range with change in
excitatory case as well as the inhibitory case
In
Figure 2a, we consider the case when the initial data is centered at
with
We observe that the solution reaches a steady state. We also take the cases when the initial data is centered at
and different values of
to find different phenomena based on these values in
Figure 2.
The errors for the approximate solution simulated in
Figure 1,
Figure 3 and
Figure 4 are plotted in
Figure 5,
Figure 6 and
Figure 7 respectively. Numerical values of these errors and CPU time (MATLAB and Statistics Toolbox Release 2013a, The MathWorks, Inc., Natick, MA, United States) of the two methods are shown in
Table 1 and
Table 2.
Errors of the numerical solution
are calculated in different norms
norms which are defined as follows
where
is the numerical solution at finest grid
For the numerical experiments, we find the errors with the finest grid being
Our test outcomes show that the error defined above is sure a monotone decreasing function as
N increases i.e.,
In
Figure 3a, we performed numerical approximation based upon FEM and compared the results obtained in [
8] at a time
The evolution of firing rate
with the time
, is plotted in
Figure 3b, which describes the blow-up situation when the initial data is concentrated around
with
Table 3 and
Table 4 gives the different error values at the final time
for the same data that is graphically represented in
Figure 6.
From
Figure 4a, it is clear that when initial data is concentrated enough near the threshold point
solution blows up at a finite time
which is earlier than the phenomena described in
Figure 3b. This happens because initial data is concentrated enough near the threshold point i.e.,
with
small enough. For different error values and CPU time for the data graphically represented in
Figure 4, see
Table 5 and
Table 6.
In
Figure 8, we treat the cases for
type activity dependence noise.
Figure 8a shows that by taking
and
solution goes to steady state. This further indicates that solution goes to a steady state earlier than the solution behavior provided in
Figure 8b by taking
.
Figure 8c shows blow-up situation of a solution by taking
and
. From
Figure 8d, we find that by reducing the noise factor
, solution goes to steady state.
The behavior of the solution by taking noise factor
for both the cases of excitatory and inhibitory are represented in
Figure 9. From
Figure 10a, we find that solution blows up in a finite time and right figure indicate the situation of steady state by reducing the noise factor.