Next Article in Journal
On Casimir and Helmholtz Fluctuation-Induced Forces in Micro- and Nano-Systems: Survey of Some Basic Results
Previous Article in Journal
Finite-Time Dynamics of an Entanglement Engine: Current, Fluctuations and Kinetic Uncertainty Relations
Previous Article in Special Issue
Adaptive MCMC for Bayesian Variable Selection in Generalised Linear Models and Survival Models
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Semiparametric Bayesian Approach to Heterogeneous Spatial Autoregressive Models

School of Economics, Hangzhou Dianzi University, Hangzhou 310018, China
*
Author to whom correspondence should be addressed.
Entropy 2024, 26(6), 498; https://doi.org/10.3390/e26060498
Submission received: 15 April 2024 / Revised: 1 June 2024 / Accepted: 5 June 2024 / Published: 7 June 2024

Abstract

:
Many semiparametric spatial autoregressive (SSAR) models have been used to analyze spatial data in a variety of applications; however, it is a common phenomenon that heteroscedasticity often occurs in spatial data analysis. Therefore, when considering SSAR models in this paper, it is allowed that the variance parameters of the models can depend on the explanatory variable, and these are called heterogeneous semiparametric spatial autoregressive models. In order to estimate the model parameters, a Bayesian estimation method is proposed for heterogeneous SSAR models based on B-spline approximations of the nonparametric function. Then, we develop an efficient Markov chain Monte Carlo sampling algorithm on the basis of the Gibbs sampler and Metropolis–Hastings algorithm that can be used to generate posterior samples from posterior distributions and perform posterior inference. Finally, some simulation studies and real data analysis of Boston housing data have demonstrated the excellent performance of the proposed Bayesian method.

1. Introduction

In recent decades, spatial data analysis based on spatial autoregressive (SAR) models has become a very important and popular research direction in the academic research of econometricians and statisticians. Among them, in-depth research has been conducted on inference theories and methods based on linear SAR models and their extensions, including estimation, variable selection, hypothesis testing, etc., and a large amount of literature has also been produced, such as [1,2,3]. Specifically, there are many in-depth research achievements on linear SAR models, such as [4,5,6,7]. However, in spatial data analysis, there is often a nonlinear relationship between response variables and covariates. Therefore, in order to explore this complex phenomenon, some semiparametric SAR models have been proposed in recent years and have been thoroughly studied. For example, based on partially linear spatial autoregressive models, Su and Jin [8] proposed a profile quasi-maximum likelihood estimation method and established asymptotic theoretical properties of the obtained estimators. By using the spline approximations and instrumental variables estimation method, Du et al. [9] developed an estimation method for partially linear additive spatial autoregressive models, and derived asymptotic theoretical properties of the obtained estimators. For partially linear single-index spatial autoregressive models, Cheng and Chen [10] developed an estimation method and established consistency and asymptotic normality of the estimators under some mild assumptions. Other related research results on semiparametric SAR models can also be found in [11,12]. Previous research on various spatial autoregressive models was mainly based on the assumption of homoscedasticity, which assumes that the variance of model errors is constant. As is well known, heteroscedasticity is a common phenomenon in spatial data analysis. Therefore, using statistical inference methods under the assumption of homogeneity may lead to erroneous inference, as seen in Lin and Lee [13]. Therefore, it is necessary to study heterogeneous spatial autoregressive models. Especially in recent years, many researchers have conducted in-depth research on spatial autoregressive models where the error variance is heteroscedasticity. For example, SAR models with heteroscedasticity was studied by Dai et al. [14] for Bayesian local influence analysis. However, existing literature on heterogeneous spatial autoregressive models assume that the variance term is fixed and does not perform regression modeling analysis like the mean. In addition, in many application fields, such as econometrics, the assumption of equal variance may not be suitable for modeling data that exhibit heteroscedasticity. Therefore, we propose a new model, called a heterogeneous semiparametric spatial autoregressive model, in which the variance parameters are allowed to be modeled by using some covariates.
In addition, many estimation methods have recently been developed for SAR models from both frequentist and Bayesian perspectives. Specifically, due to the rapid development of advanced computing technology in the era of big data, Bayesian statistical analysis of SAR models and various other statistical models has received increasing attention, and large quantities of related research achievements have emerged in recent years. For example, within the framework of longitudinal data and for the generalized partial linear mixed models, Tang and Duan [15] studied an effective semiparametric Bayesian method. By using spline approximation, Xu and Zhang [16] introduced a Bayesian method for the partially linear model with heteroscedasticity based on the variance modelling technique. Based on the assumption that the response variables and random effects follow multivariate skew-normal distributions, a new spatial dynamic panel data model was proposed by Ju et al. [17] and a Bayesian local influence analysis method was developed to simultaneously evaluate the impact of small perturbations on the data, priors, and sampling distributions. Pfarrhofer and Piribauer [18] studied Bayesian variable selection for high-dimensional spatial autoregressive models based on two shrinkage priors. Wang and Tang [19] made Bayesian statistical inference based on a quantile regression model with nonignorable missing covariates. To capture the linear and nonlinear relationships between explanatory variables and their responses to spatially relevant data, Chen and Chen [20] developed a Bayesian sampling-based method based on the partially linear single-index spatial autoregressive models, in which it includes an efficient MCMC approach and explores the joint posterior distributions by using a Gibbs sampler. Within the framework of longitudinal data, Zhang et al. [21] proposed semiparametric mixed-effects double regression models for analysis based on spline approximation technology, in which they jointly modeled the mean and variance of the mixed-effects as a function of covariates. To our knowledge, there is not much work on semiparametric Bayesian methods for heterogeneous spatial autoregressive models due to their complex spatial correlation structures. Therefore, based on a hybrid effective algorithm that combines a Gibbs sampler and the Metropolis–Hastings algorithm and has the advantages of both algorithms, this paper develops a Bayesian method for heterogeneous semiparametric spatial autoregressive models based on variance modeling.
The outline of the paper is as follows. A new heterogeneous SSAR model is introduced in Section 2. In Section 3, we derive the full conditional distributions for implementing the sampling-based method, and develop a Bayesian method to obtain estimates by using a Gibbs sampler and the Metropolis–Hastings algorithm. Section 4 presents some simulation studies to illustrate the proposed methodology. As an application example, Section 5 analyzes the Boston house price data by using the proposed method. A brief conclusion and discussion is given in Section 6.

2. Heterogeneous Semiparametric Spatial Autoregressive Models

As is well known, the form of classical semiparametric spatial autoregressive models is as follows:
Y = ρ W Y + X β + g ( U ) + ε ,
where Y = ( y 1 , y 2 , , y n ) T is an n-dimensional response variable, | ρ | < 1 is an unknown spatial lag parameter that reflects spatial autocorrelation between neighbors, and W is a known spatial weight matrix with zero diagonal elements. In the mean model, X = ( x 1 , x 2 , , x n ) T is an n × p explanatory variable matrix where the ith row is x i T = ( x i 1 , , x i p ) and β = ( β 1 , , β p ) T is a p-dimensional unknown regression coefficient to be estimated; moreover, g ( · ) is an arbitrary unknown smooth function in the mean model, which needs to be estimated; U = ( u 1 , u 2 , , u n ) T is an n-dimensional vector whose ith row u i is an univariate observed covariate; ε is an n-dimensional vector that represents the regression errors of an independent and identically distributed regression disturbances with zero mean and finite variance σ 2 .
In addition, according to Xu and Zhang [16], this paper considers the heterogeneity of the variance in the model and assumes that the variance parameters are related to other explanatory variables; thus, we establish a regression model for the variance parameters, namely
σ i 2 = h ( z i T γ ) ,
where z i T = ( z i 1 , , z i q ) is an explanatory variable vector related to the variance of ε i and γ = ( γ 1 , , γ q ) T is a q-dimensional unknown regression coefficient to be estimated in the variance model. Some elements in z i may coincide with some elements in x i . In addition, for the identifiability of the models and considering that the variance is positive, h ( · ) is a known monotonic positive function. For example, exponential functions are often used to model the variance. So, heterogeneous SSAR models are considered in this paper as follows:
Y = ρ W Y + X β + g ( U ) + ε , ε N ( 0 , Σ ) , Σ = d i a g ( σ 1 2 , σ 2 2 , , σ n 2 ) σ i 2 = exp ( z i T γ ) , i = 1 , 2 , , n .

3. Bayesian Inference

3.1. B-Splines for the Nonparametric Function

From model (3), we obtain the log-likelihood function
n ( ρ , β , γ | Y , X , Z , U ) = n 2 l n ( 2 π ) 1 2 i = 1 n z i T γ + l n | A | 1 2 e T Σ 1 e ,
where e = A Y X β g ( U ) , A = I n ρ W , and I n is an ( n × n ) identity matrix.
There are now a large number of nonparametric techniques for handling nonparametric functions g ( · ) in (3), such as the smoothing splines and the kernel methods. This paper considers B-spline approximation to transform g ( · ) into a linear function composed of a set of basis functions. It can be summarized as follows: { s i } , i = 1 , , n performs a partition on the interval [0, 1], which is called as the internal knots and satisfies 0 = s 0 < s 1 < < s k n < s k n + 1 = 1 . This results in K = K n + l normalized B-spline basis functions of order l, which form the basis of a linear spline space. The main reason for using B-splines here is because they have advantages such as bounded support and numerical stability. As well as we know, selection of knots is usually an important aspect that cannot be ignored in the implementation process of B-splines. In this paper, our main focus is inference on the parameters in the mean model and the variance model. Therefore, by following the idea of Zhang et al. [21], the number of internal knots is selected as the integer part of n 1 / 5 . Thus, π T ( u ) α is used to approximate g ( u ) , in which π ( u ) = ( B 1 ( u ) , , B K ( u ) ) T is a basis function vector and α R K . In this way, we can linearize the nonparametric function g ( · ) in (3) as follows:
g ( u i ) π T ( u i ) α .
Thus, based on (5), we can rewritten the likelihood function (4) as follows:
n ( ρ , β , γ | Y , X , Z , U ) = n 2 l n ( 2 π ) 1 2 i = 1 n z i T γ + l n | A | 1 2 ( A Y X β B α ) T Σ 1 ( A Y X β B α ) ,
where B = ( π ( u 1 ) , π ( u 2 ) , , π ( u n ) ) T .

3.2. Prior Selection of Parameters

This paper will use a Bayesian approach to estimate unknown parameters ρ , β , α and γ . Thus, to obtain Bayesian estimation, the prior distributions of unknown parameters to be estimated in the model should be given first. For the convenience of algorithm implementation, normal prior distributions are often chosen as β N ( β 0 , b β ) , α N ( α 0 , τ 2 I K ) , γ N ( γ 0 , B γ ) , and ρ U ( 1 , 1 ) , in which β 0 , α 0 , γ 0 and b β , B γ are known hyperparameter vectors or matrices. Moreover, the prior distribution of τ 2 is the I G ( a τ , b τ ) , and its density function is
p ( τ 2 | a τ , b τ ) ( τ 2 ) a τ 1 exp b τ / τ 2 ,
in which a τ and b τ are assumed to be positive constants and known. In this paper, we mainly focus on the case where the prior distribution of model parameters is a normal distribution. However, the proposed computational algorithm is also applicable to other specific prior distributions.

3.3. Posterior Inference

Let θ = ( β , α , γ , ρ ) and then we aim to estimate the unknown parameters of θ . Based on the proposed model (3) and Gibbs sampling, the specific sampling process is carried out according to the following steps by sampling from joint posterior distribution p ( θ | Y , X , Z , U ) .
Step 1. The initial values of parameters are set as θ ( 0 ) = ( β ( 0 ) , α ( 0 ) , γ ( 0 ) , ρ ( 0 ) ) .
Step 2. Compute Σ ( l ) = diag { exp ( z i T γ ( l ) ) } and A ( l ) = I n ρ ( l ) W on the basis of θ ( l ) = ( β ( l ) , α ( l ) , γ ( l ) , ρ ( l ) ) .
Step 3. Based on θ ( l ) = ( β ( l ) , α ( l ) , γ ( l ) , ρ ( l ) ) , sample θ ( l + 1 ) = ( β ( l + l ) , α ( l + 1 ) , γ ( l + l ) , ρ ( l + l ) ) as follows:
  • Sampling τ 2 ( l + 1 ) from the conditional distribution below:
p ( τ 2 | α ( l ) ) ( τ 2 ) K 2 a τ 1 exp ( α ( l ) α 0 ) T ( α ( l ) α 0 ) + 2 b τ 2 τ 2 .
  • Sampling α ( l + 1 ) from the conditional distribution below:
    p ( α | Y , X , Z , U , γ ( l ) , ρ ( l ) ) N ( μ ˜ α , Σ ˜ α ) ,
    where μ ˜ α = Σ ˜ α ( τ 2 ( l + 1 ) I K α 0 + B T Σ ( l ) 1 ( A ( l ) Y X β ( l ) ) ) and Σ ˜ α = ( τ 2 ( l + 1 ) I K + B T Σ ( l ) 1 B ) 1 .
  • Sampling β ( l + 1 ) from the conditional distribution below:
    p ( β | Y , X , Z , U , α ( l + 1 ) , γ ( l ) , ρ ( l ) ) N ( μ ˜ β , Σ ˜ β ) ,
    where μ ˜ β = Σ ˜ β ( b β 1 β 0 + X T Σ ( l ) 1 ( A ( l ) Y B α ( l + 1 ) ) ) and Σ ˜ β = ( b β 1 + X T Σ ( l ) 1 X ) 1 .
  • Sampling γ ( l + 1 ) from the conditional distribution below:
    p ( γ | Y , X , Z , U , β ( l + 1 ) , α ( l + 1 ) , ρ ( l ) ) | Σ | 1 2 exp { 1 2 e ( l , l + 1 ) , T Σ 1 e ( l , l + 1 )           1 2 ( γ γ 0 ) T B γ 1 ( γ γ 0 ) } .
    where e ( l , l + 1 ) = A ( l ) Y X β ( l + 1 ) B α ( l + 1 ) .
  • Sampling ρ ( l + 1 ) from the conditional distribution below:
    p ( ρ | Y , X , Z , U , β ( l + 1 ) , α ( l + 1 ) , γ ( l + 1 ) ) | A | exp 1 2 e ( l + 1 ) T Σ ( l + 1 ) 1 e ( l + 1 ) .
    where e ( l + 1 ) = A ( l + 1 ) Y X β ( l + 1 ) B α ( l + 1 ) .
Step 4. Repeating Steps 2 and 3.
According to the steps of the above algorithm, we can easily obtain the sample sequences ( β ( t ) , α ( t ) , γ ( t ) , ρ ( t ) ) , t = 1 , 2 , . It is easy to find that the fully conditional distributions p ( τ 2 | α ( l ) ) , p ( β | Y , X , Z , U , α ( l ) , γ ( l ) , ρ ( l ) ) and p ( α | Y , X , Z , U , β ( l + 1 ) , γ ( l ) , ρ ( l ) ) are Inverse Gamma and normal distributions, respectively, and extracting observations from these familiar standard distributions is fast and easy. Unfortunately, fully conditional distributions p ( γ | Y , X , Z , U , β ( l + 1 ) , α ( l + 1 ) , ρ ( l ) ) and p ( ρ | Y , X , Z , U , β ( l + 1 ) , α ( l + 1 ) , γ ( l + 1 ) ) are nonstandard distributions and appear quite complex, making it quite difficult to extract random numbers from these conditional distributions. To solve the problem of difficult sampling of these posterior distributions, the Metropolis–Hastings algorithm is used. In order to sample from (10) by Metropolis–Hastings algorithm, the normal distribution N ( 0 , σ γ 2 Ω γ 1 ) is chosen as the proposal distribution, in which we should choose a suitable σ γ 2 so that the average acceptance rate is approximately between 0.25 and 0.45 (Gelman et al. [22]), and take
Ω γ = 1 2 i = 1 n e i 2 exp { z i T γ } z i z i T + B γ 1 .
The process of implementing the Metropolis–Hastings algorithm is as follows: assuming that the current value is γ ( l ) at the ( l + 1 ) th iteration, we should generate a new candidate value γ * from N ( γ ( l ) , σ γ 2 Ω γ 1 ) and then decide whether to accept it based on the following probability:
min 1 , p ( γ * | Y , X , Z , U , β ( l + 1 ) , α ( l + 1 ) , ρ ( l ) ) p ( γ ( l ) | Y , X , Z , U , β ( l + 1 ) , α ( l + 1 ) , ρ ( l ) ) .
In addition, according to [18], the Bayesian estimate of ρ is obtained based on a Metropolis-within-Gibbs step and by using sampling observations from (11).
Based on the observation results generated by the above calculation algorithm, the Bayesian estimation of the unknown parameter ( β , α , γ , ρ ) can be obtained. Specifically, it is assumed that the observation value { ( β ( j ) , α ( j ) , γ ( j ) , ρ ( j ) ) : j = 1 , 2 , , J } of ( β , α , γ , ρ ) generated from the joint conditional distribution p ( β , α , γ , ρ | Y , X , Z , U ) is obtained by using the hybrid algorithm proposed earlier. Then define Bayesian estimators of the unknown parameters ( β , α , γ , ρ ) as follows:
β ^ = 1 J j = 1 J β ( j ) , α ^ = 1 J j = 1 J α ( j ) , γ ^ = 1 J j = 1 J γ ( j ) , ρ ^ = 1 J j = 1 J ρ ( j ) .
Similar to Geyer [23], it is not difficult to prove that ( β ^ , α ^ , γ ^ , ρ ^ ) are consistent estimates of their corresponding posterior means. In addition, we use the “leave-one-out” technique to obtain Bayesian estimates of posterior covariance matrices. For example, the specific formula of the estimator for Var ( β | θ β , Y , X , Z , U ) can be expressed as follows:
Var ^ ( β | θ β , Y , X , Z , U ) = ( J 1 ) 1 j = 1 J ( β ( j ) β ^ ) ( β ( j ) β ^ ) T ,
in which θ β denotes the parameter θ excluding β . A similar approach can be used to obtain the estimators of Var ( α | θ α , Y , X , Z , U ) , Var ( ρ | θ ρ , Y , X , Z , U ) , and Var ( γ | θ γ , Y , X , Z , U ) .

4. Simulation Study

This section conducts a simulation study to evaluate the performance of the proposed Bayesian method under different sample sizes, spatial parameter values, and prior information selections. According to Lee [24] and Xie et al. [7], let n = R × m and W = I R H m be the weight matrix, in which ⊗ represents the Kronecker product and H m = ( l m l m T I m ) / ( m 1 ) , l m is an m-dimensional vector with all component elements being 1. In order to investigate whether the proposed Bayesian estimation method is sensitive to the selection of prior distributions, we consider three hyperparameter values in the prior distributions of unknown parameters β , α , γ , ρ :
Type I: β 0 = ( 1 , 0.5 , 0.5 ) T , b β = 0.25 × I 3 , γ 0 = ( 1 , 0.5 , 0.5 ) T , B γ = 0.25 × I 3 , α 0 = ( 0 , , 0 ) T , a τ = 1 , b τ = 1 . This situation can be considered as having good prior information.
Type II: β 0 = ( 0 , 0 , 0 ) T , b β = I 3 , γ 0 = ( 0 , 0 , 0 ) T , B γ = I 3 , α 0 = ( 0 , , 0 ) T , a τ = 1 , b τ = 1 . This hyperparameter situation is considered to have no prior information.
Type III: β 0 = 3 × ( 1 , 0.5 , 0.5 ) T , b β = 10 × I 3 , γ 0 = 3 × ( 1 , 0.5 , 0.5 ) T , B γ = 10 × I 3 , α 0 = ( 0 , , 0 ) T , a τ = 1 , b τ = 1 . This can be seen as a situation where the previous information was inaccurate.
In this section, R is selected as 25, 50, 75 and m is set to 4, and thus, n is to be 100, 200, 300. Furthermore, we generate X and Z, respectively, from the multivariate normal distribution with zero mean vector and covariance matrix Σ 0 = ( c i j ) where c i j = 0 . 5 | i j | , i = 1 , , p ( q ) , j = 1 , , p ( q ) . Moreover, to reflect the different spatial dependencies between response variables, spatial parameters ρ = 0.5 , 0 , 0.5 are selected to represent different spatial dependencies; β = ( 1 , 0.5 , 0.5 ) T , g ( u i ) = 0.5 sin ( 2 π u i ) where u i follows a uniform distribution U ( 0 , 1 ) ,and the structure of the variance model is log ( σ i 2 ) = z i T γ with γ = ( 1 , 0.5 , 0.5 ) T .
Based on the various parameter setting environments and generated datasets mentioned above, we use the hybrid MCMC algorithm based on 100 replications to evaluate Bayesian estimations of unknown parameters under different sample sizes. Checking whether the MCMC sampler converges in algorithm implementation is an important thing. Therefore, here the estimated potential scale reduction (EPSR) value is used to diagnose whether the MCMC algorithm converges for each dataset [25]. It can be easily observed that in all the runs we are considering, the EPSR value is very close to 1 and less than 1.1 after 3000 iterations. Therefore, after discarding the first 3000 burn-in iterations, collect the observation results of the following J = 2000 for statistical inference. In addition, to evaluate the performance of the nonparametric function estimation, the square root of average square errors ( R A S E ) are used here as the criterion for evaluation,
RASE ( g ^ ( u ) ) = E 1 n i = 1 n g ^ ( u i ) g ( u i ) 2 1 2 .
The simulation results are listed in Table 1, Table 2, Table 3 and Table 4. Moreover, in order to directly examine the accuracy of the estimation of function g ( u ) , we plot the true value of function g ( u ) and its estimated curve under different cases. To save space, we only list some nonparametric estimation curve results with different spatial parameters in Figure 1, Figure 2 and Figure 3. Figure 1, Figure 2 and Figure 3 depict the real sine curve and its estimated curve based on B-spline approximation. It is easy to observe that all estimated curves are close to the true curve, which indicates that the estimation of g ( · ) using B-splines in the mean model performs well.
In Table 1, Table 2 and Table 3, “Bias” represents the absolute difference between the true and mean values estimated by Bayesian estimation of parameters based on 100 replicates, and “SD” denotes standard deviation of the Bayesian estimates, while “RMS” is the root mean square between the estimated and true values based on 100 replicates. From Table 1, Table 2 and Table 3, we can see that (i) From the Bias, RMS and SD values of Bayesian estimation, it can be seen that regardless of the prior information input, Bayesian estimation is quite accurate; and for different prior distributions, the proposed estimation method performs well, indicating that Bayesian estimation is not sensitive to prior information input. (ii) Bayesian estimation improves as the sample size increases; (iii)The Bayesian estimation results obtained based on different spatial parameters are similar. (iv) In the same situation, the RMS and SD values of the mean parameters are smaller than that of the variance parameters, which is consistent with the fact that lower order moments are easier to estimate than higher order moments. Furthermore, from Figure 1, Figure 2 and Figure 3, it can be seen that under the considered parameter settings, the estimated function curve is very close to its corresponding true curve, which is consistent with the phenomenon found in Table 4. In summary, the above simulation research results indicate that applying the Bayesian estimation method proposed in this paper to heterogeneous SSAR models is effective.

5. Real Data Analysis

Boston housing price data are a commonly used example, and many authors have conducted in-depth analysis based on different statistical models, such as [26,27], and so on. This section will also use the Bayesian estimation method proposed in this paper to analyze these data. This dataset can be easily obtained from R’s spdep library, which includes 14 variables and 506 observations. A detailed explanation of the variables involved in the dataset is presented in Table 5.
In addition, following the variable selection results of Xie et al. [7], we take MEDV as the response variable of the model (represented by Y) and the important explanatory variables selected by Xie et al. [7] as the X- variables: CRIM (denoted by X 1 ), ZN (denoted by X 2 ),NOX (denoted by X 3 ), RM(denoted by X 4 ), DIS (denoted by X 5 ), RAD (denoted by X 6 ),TAX (denoted by X 7 ), PTRATIO(denoted by X 8 ), and B (denoted by X 9 ). In order to facilitate data modeling and analysis, all variables were centralized and the index variable was set to u = L S T A T .
In addition, the Euclidean distances calculated using longitude and latitude as [27,28] are used to generate the space weight matrix W = ( w i j ) , where
w i j = m a x 1 d i j d 0 , 0 ,
d i j is the Euclidean distance, and d 0 takes a value of 0.05 as the threshold distance. Thus, the spatial weight matrix contains 19.1% non-zero elements. Then, here we consider the heterogeneous SSAR model as follows:
Y i = ρ j = 1 n w i j Y j + k = 1 9 X i k β k + g ( u i ) + ε i , σ i 2 = exp k = 1 3 Z i k γ k , i = 1 , 2 , , 506 .
where three explanatory variables Z 1 = X 4 , Z 2 = X 5 , Z 3 = X 6 are selected in the variance model. Thus, the hybrid algorithm proposed earlier is applied to obtain Bayesian estimates of β ’s, γ ’s, and ρ ’s, in which a B-spline with K = 3 and noninformative prior information are used. In order to check the convergence of the algorithm, Figure 4 shows the relationship between the EPSR values of all unknown parameters and iterations, indicating that the algorithm converges after approximately 3000 iterations due to the EPSR values of all unknown parameters being less than 1.1 in approximately 3000 iterations. The Bayesian estimates (EST) of β ’s, γ ’s and ρ ’s and their standard deviation estimates (SD), 95% credible intervals (CI) are calculated. Results are given in Table 6. Figure 5 displays the Bayesian estimate of the nonparametric function g ( u ) , which also confirms a significant nonlinear relationship between housing prices and the variable u. Some useful conclusions can be obtained from the results of the table, which are basically consistent with the research results of other authors. For example, the regression parameter corresponding to X 1 in the mean model is estimated to be negative, indicating that housing prices will decrease as the per capita crime rate in urban areas increases. The estimated coefficient of X 4 in the mean model is 0.3899, indicating that as the average number of rooms per dwelling increases, housing prices will also increase. β ^ 5 is negative, indicating that the greater the weighted distances to five Boston employment centres, the lower the housing price will be. The regression parameter corresponding to X 8 in the mean model is estimated to be negative, indicating that housing prices will decrease as the pupil–teacher ratio by town increases. The regression parameter corresponding to Z 2 in the variance model is estimated to be negative, indicating that as the weighted distances to five Boston employment centres increases, the fluctuation of housing prices will also decrease. In addition, based on the estimation of γ , we can obtain the estimated value of σ i 2 and present the scatter plot of σ ^ i 2 in Figure 6, indicating that heteroscedasticity modeling for this dataset is reasonable.

6. Conclusions and Discussion

Heteroscedasticity is a common phenomenon in spatial data modeling and analysis. Therefore, this paper proposes heterogeneous SSAR models, where the variance parameter is modeled as a function of the explanatory variable. Like mean regression modeling, the variance component may also depend on various explanatory variables of interest, so estimating the joint models of the mean and variance becomes the basis for avoiding modeling bias and reducing model complexity. Then, based on the nonparametric components approximated by B-splines, we propose a complete Bayesian analysis of a heterogeneous semiparametric spatial autoregressive models. Based on the Gibbs sampler and Metropolis–Hastings algorithm, an effective MCMC sampling algorithm was developed for posterior inference by generating posterior samples from the posterior distributions. Simulation studies and real data analysis based on Boston housing data are used to illustrate the proposed method. The results show that the proposed Bayesian method has high efficiency and fast computational speed.
In addition, there are several interesting questions worth further research in the future. For example, (i) it is interesting to consider variable selection for the parametric component in the context of heterogeneous spatial autoregressive model; (ii) the model proposed in the paper is also a worthwhile issue to study when there are missing response variables.

Author Contributions

Conceptualization, D.X. and S.K.; methodology, D.X. and S.K.; software, T.L. and S.K.; data curation, T.L. and S.K.; formal analysis, T.L. and D.X.; writing—original draft, T.L. and D.X. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by Zhejiang Provincial Natural Science Foundation of China under Grant No. LY23A010013.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Cliff, A.; Ord, J.K. Spatial Autocorrelation; Pion: London, UK, 1973. [Google Scholar]
  2. Anselin, L. Spatial Econometrics: Methods and Models; Kluwer Academic Publishers: Dordrecht, The Netherlands, 1988. [Google Scholar]
  3. Anselin, L.; Bera, A.K. Spatial Dependence in Linear Regression Models with an Introduction to Spatial Econometrics; Ullah, A., Giles, D.E.A., Eds.; Handbook of Applied Economics Statistics; Marcel Dekker: New York, NY, USA, 1998. [Google Scholar]
  4. Jin, F.; Lee, L.F. GEL estimation and tests of spatial autoregressive models. J. Econom. 2019, 208, 585–612. [Google Scholar] [CrossRef]
  5. Liu, X.; Chen, J.B.; Cheng, S.L. A penalized quasi-maximum likelihood method for variable selection in the spatial autoregressive model. Spat. Stat. 2018, 25, 86–104. [Google Scholar] [CrossRef]
  6. Xie, L.; Wang, X.R.; Cheng, W.H.; Tang, T. Variable selection for spatial autoregressive models. Commun. Stat. Theory Methods 2021, 50, 1325–1340. [Google Scholar] [CrossRef]
  7. Xie, T.F.; Cao, R.Y.; Du, J. Variable selection for spatial autoregressive models with a diverging number of parameters. Stat. Pap. 2020, 61, 1125–1145. [Google Scholar] [CrossRef]
  8. Su, L.J.; Jin, S.N. Profile quasi-maximum likelihood estimation of partially linear spatial autoregressive models. J. Econom. 2010, 157, 18–33. [Google Scholar] [CrossRef]
  9. Du, J.; Sun, X.Q.; Cao, R.Y.; Zhang, Z.Z. Statistical inference for partially linear additive spatial autoregressive models. Spat. Stat. 2018, 25, 52–67. [Google Scholar] [CrossRef]
  10. Cheng, S.L.; Chen, J.B. Estimation of partially linear single-index spatial autoregressive model. Stat. Pap. 2021, 62, 485–531. [Google Scholar] [CrossRef]
  11. Wei, C.H.; Guo, S.; Zhai, S.F. Statistical inference of partially linear varying coefficient spatial autoregressive models. Econ. Model. 2017, 64, 553–559. [Google Scholar] [CrossRef]
  12. Hu, Y.P.; Wu, S.Y.; Feng, S.Y.; Jin, J.L. Estimation in Partial Functional Linear Spatial Autoregressive Model. Mathematics 2020, 8, 1680. [Google Scholar] [CrossRef]
  13. Lin, X.; Lee, L.F. GMM estimation of spatial autoregressive models with unknown heteroskedasticity. J. Econom. 2010, 157, 34–52. [Google Scholar] [CrossRef]
  14. Dai, X.W.; Jin, L.B.; Tian, M.Z.; Shi, L. Bayesian Local Influence for Spatial Autoregressive Models with Heteroscedasticity. Stat. Pap. 2019, 60, 1423–1446. [Google Scholar] [CrossRef]
  15. Tang, N.S.; Duan, X.D. A semiparametric Bayesian approach to generalized partial linear mixed models for longitudinal data. Comput. Stat. Data Anal. 2012, 56, 4348–4365. [Google Scholar] [CrossRef]
  16. Xu, D.K.; Zhang, Z.Z. A semiparametric Bayesian approach to joint mean and variance models. Stat. Probab. Lett. 2013, 83, 1624–1631. [Google Scholar] [CrossRef]
  17. Ju, Y.Y.; Tang, N.S.; Li, X.X. Bayesian local influence analysis of skew-normal spatial dynamic panel data models. J. Stat. Comput. Simul. 2018, 88, 2342–2364. [Google Scholar] [CrossRef]
  18. Pfarrhofer, M.; Piribauer, P. Flexible shrinkage in high-dimensional Bayesian spatial autoregressive models. Spat. Stat. 2019, 29, 109–128. [Google Scholar] [CrossRef]
  19. Wang, Z.Q.; Tang, N.S. Bayesian Quantile Regression with Mixed Discrete and Nonignorable Missing Covariates. Bayesian Anal. 2020, 15, 579–604. [Google Scholar] [CrossRef]
  20. Chen, Z.Y.; Chen, J.B. Bayesian analysis of partially linear, single-index, spatial autoregressive models. Comput. Stat. 2022, 37, 327–353. [Google Scholar] [CrossRef]
  21. Zhang, D.; Wu, L.C.; Ye, K.Y.; Wang, M. Bayesian quantile semiparametric mixed-effects double regression models. Stat. Theory Relat. Fields 2021, 5, 303–315. [Google Scholar] [CrossRef]
  22. Gelman, A.; Roberts, G.O.; Gilks, W.R. Efficient metropolis jumping rules. In Bayesian Statistics; Oxford University Press: New York, NY, USA, 1996; Volume 5. [Google Scholar]
  23. Geyer, C.J. Practical Markov Chain Monte Carlo. Stat. Sci. 1992, 7, 473–511. [Google Scholar] [CrossRef]
  24. Lee, L.F. Asymptotic distributions of quasi-maximum likelihood estimators for spatial autoregressive models. Econometrica 2004, 72, 1899–1925. [Google Scholar] [CrossRef]
  25. Gelman, A. Inference and Monitoring Convergence in Markov Chain Monte Carlo in Practice; Chapman and Hall: London, UK, 1996. [Google Scholar]
  26. Pace, R.K.; Gilley, O.W. Using the spatial configuration of the data to improve estimation. J. Real Estate Financ. Econ. 1997, 14, 330–340. [Google Scholar] [CrossRef]
  27. Sun, Y.; Zhang, Y.; Huang, J.Z. Estimation of a semiparametric varying-coefficient mixed regressive spatial autoregressive model. Econom. Stat. 2019, 9, 140–155. [Google Scholar] [CrossRef]
  28. Luo, G.; Wu, M. Variable selection for semiparametric varying-coefficient spatial autoregressive models with a diverging number of parameters. Commun. Stat. Theory Methods 2021, 50, 2062–2079. [Google Scholar] [CrossRef]
Figure 1. When m = 4 ,   R = 25 , t   p y e = I , the curve plot of the estimated function and its true values of g ( u ) based on different ρ ’s (the corresponding spatial parameters from left to right are ρ = 0.5 , 0 , 0.5 ).
Figure 1. When m = 4 ,   R = 25 , t   p y e = I , the curve plot of the estimated function and its true values of g ( u ) based on different ρ ’s (the corresponding spatial parameters from left to right are ρ = 0.5 , 0 , 0.5 ).
Entropy 26 00498 g001
Figure 2. When m = 4 ,   R = 50 ,   t p y e = I , the curve plot of the estimated function and its true values of g ( u ) based on different ρ ’s (the corresponding spatial parameters from left to right are ρ = 0.5 , 0 , 0.5 ).
Figure 2. When m = 4 ,   R = 50 ,   t p y e = I , the curve plot of the estimated function and its true values of g ( u ) based on different ρ ’s (the corresponding spatial parameters from left to right are ρ = 0.5 , 0 , 0.5 ).
Entropy 26 00498 g002
Figure 3. When m = 4 ,   R = 75 ,   t p y e = I , the curve plot of the estimated function and its true values of g ( u ) based on different ρ ’s (the corresponding spatial parameters from left to right are ρ = 0.5 , 0 , 0.5 ).
Figure 3. When m = 4 ,   R = 75 ,   t p y e = I , the curve plot of the estimated function and its true values of g ( u ) based on different ρ ’s (the corresponding spatial parameters from left to right are ρ = 0.5 , 0 , 0.5 ).
Entropy 26 00498 g003
Figure 4. EPSR values for all parameters in Boston data analysis.
Figure 4. EPSR values for all parameters in Boston data analysis.
Entropy 26 00498 g004
Figure 5. The solid curve is the estimated function of g ^ ( u ) .
Figure 5. The solid curve is the estimated function of g ^ ( u ) .
Entropy 26 00498 g005
Figure 6. The scatter plot of σ ^ i 2 .
Figure 6. The scatter plot of σ ^ i 2 .
Entropy 26 00498 g006
Table 1. Bayesian estimation results of unknown parameters under different sample sizes and prior information when ρ = 0.5 .
Table 1. Bayesian estimation results of unknown parameters under different sample sizes and prior information when ρ = 0.5 .
Type nPara.BiasRMSSD
I100 β 1 0.00450.09110.0910
β 2 0.00840.10040.1000
β 3 0.00790.09260.0922
γ 1 0.00530.14800.1480
γ 2 0.01260.14590.1454
γ 3 0.02150.15400.1524
ρ 0.06330.09750.0741
200 β 1 0.00310.07100.0709
β 2 0.00620.06740.0672
β 3 0.00140.06960.0695
γ 1 0.02520.12150.1188
γ 2 0.00930.12940.1290
γ 3 0.00750.10800.1078
ρ 0.01490.05570.0536
300 β 1 0.00730.05540.0550
β 2 0.00750.05680.0563
β 3 0.00910.05970.0590
γ 1 0.00490.08410.0840
γ 2 0.00510.10740.1073
γ 3 0.00470.08850.0884
ρ 0.00900.04480.0439
II100 β 1 0.01530.09870.0975
β 2 0.02840.11220.1085
β 3 0.02820.10830.1045
γ 1 0.02230.17190.1704
γ 2 0.06560.18660.1747
γ 3 0.05400.18640.1784
ρ 0.05320.09790.0822
200 β 1 0.00570.06850.0683
β 2 0.00250.07680.0768
β 3 0.00220.07270.0727
γ 1 0.00040.11740.1174
γ 2 0.01220.14010.1396
γ 3 0.00080.12020.1202
ρ 0.03200.06220.0533
300 β 1 0.00100.06580.0658
β 2 0.00360.06250.0624
β 3 0.00420.05930.0591
γ 1 0.00180.10850.1085
γ 2 0.00770.11700.1167
γ 3 0.00830.08640.0860
ρ 0.01580.04390.0409
III100 β 1 0.00010.09940.0994
β 2 0.01170.11060.1099
β 3 0.02000.10730.1054
γ 1 0.03300.17880.1758
γ 2 0.00590.18550.1854
γ 3 0.02180.18820.1869
ρ 0.05530.09860.0816
200 β 1 0.00130.06860.0686
β 2 0.01000.07800.0773
β 3 0.00620.07310.0729
γ 1 0.02170.12080.1189
γ 2 0.03670.14650.1418
γ 3 0.01350.12460.1238
ρ 0.03290.06240.0531
300 β 1 0.00520.06630.0661
β 2 0.00140.06270.0627
β 3 0.00140.05930.0593
γ 1 0.01210.11090.1102
γ 2 0.02330.12050.1182
γ 3 0.01600.08780.0863
ρ 0.01600.04400.0410
Table 2. Bayesian estimation results of unknown parameters under different sample sizes and prior information when ρ = 0 .
Table 2. Bayesian estimation results of unknown parameters under different sample sizes and prior information when ρ = 0 .
TypenPara.BiasRMSSD
I100 β 1 0.00170.10250.1025
β 2 0.00650.10310.1029
β 3 0.01920.09550.0936
γ 1 0.01140.16890.1685
γ 2 0.00890.17850.1783
γ 3 0.00200.15730.1573
ρ 0.00920.09340.0929
200 β 1 0.00740.06230.0618
β 2 0.00020.08330.0833
β 3 0.00420.06650.0663
γ 1 0.00010.09950.0995
γ 2 0.00500.11960.1195
γ 3 0.01770.10820.1067
ρ 0.00430.07020.0701
300 β 1 0.00380.05510.0549
β 2 0.00930.05900.0582
β 3 0.01020.04420.0430
γ 1 0.00040.09040.0904
γ 2 0.00610.10700.1068
γ 3 0.00310.09770.0977
ρ 0.00040.05400.0540
II100 β 1 0.01800.10010.0985
β 2 0.00270.12050.1205
β 3 0.01110.11390.1134
γ 1 0.04560.18270.1770
γ 2 0.05960.20490.1960
γ 3 0.03970.18520.1809
ρ 0.01250.09750.0967
200 β 1 0.00000.05670.0567
β 2 0.00410.07630.0762
β 3 0.00440.05980.0597
γ 1 0.01010.12190.1215
γ 2 0.00280.15990.1598
γ 3 0.00410.13520.1351
ρ 0.00120.06800.0680
300 β 1 0.00430.05250.0523
β 2 0.00040.06010.0601
β 3 0.00180.05030.0503
γ 1 0.00790.09100.0907
γ 2 0.00190.11300.1130
γ 3 0.00210.10010.1000
ρ 0.00320.06630.0662
III100 β 1 0.00160.09910.0991
β 2 0.01570.12370.1227
β 3 0.00130.11350.1135
γ 1 0.00910.18380.1836
γ 2 0.00250.20740.2074
γ 3 0.00440.18880.1888
ρ 0.01170.09640.0957
200 β 1 0.00700.05730.0569
β 2 0.00330.07680.0767
β 3 0.00030.06040.0604
γ 1 0.01420.12290.1220
γ 2 0.02810.16580.1634
γ 3 0.00960.13870.1384
ρ 0.00170.06790.0679
300 β 1 0.00020.05230.0523
β 2 0.00530.06050.0603
β 3 0.00440.05060.0504
γ 1 0.00670.09230.0921
γ 2 0.01790.11560.1142
γ 3 0.00710.10210.1018
ρ 0.00350.06590.0658
Table 3. Bayesian estimation results of unknown parameters under different sample sizes and prior information when ρ = 0.5 .
Table 3. Bayesian estimation results of unknown parameters under different sample sizes and prior information when ρ = 0.5 .
TypenPara.BiasRMSSD
I100 β 1 0.01840.10060.0989
β 2 0.00870.11270.1123
β 3 0.00510.10000.0999
γ 1 0.00180.17110.1710
γ 2 0.01830.16430.1633
γ 3 0.01070.16990.1695
ρ 0.03640.11970.1141
200 β 1 0.01240.07430.0733
β 2 0.01840.07860.0764
β 3 0.00220.07740.0773
γ 1 0.01820.12690.1256
γ 2 0.00910.12360.1233
γ 3 0.00240.12470.1247
ρ 0.00770.07070.0703
300 β 1 0.00780.05920.0587
β 2 0.00670.06180.0614
β 3 0.00160.05490.0549
γ 1 0.00260.10080.1008
γ 2 0.00740.11210.1119
γ 3 0.00210.10440.1044
ρ 0.00990.05960.0588
II100 β 1 0.00230.11560.1156
β 2 0.00720.10830.1080
β 3 0.00730.09580.0955
γ 1 0.05190.17880.1711
γ 2 0.04470.18850.1831
γ 3 0.01730.17590.1751
ρ 0.01030.10740.1069
200 β 1 0.00130.07560.0756
β 2 0.01520.08880.0875
β 3 0.00860.07400.0735
γ 1 0.02960.10970.1056
γ 2 0.03520.13590.1313
γ 3 0.02750.11900.1158
ρ 0.00390.06930.0692
300 β 1 0.00050.05200.0520
β 2 0.00820.06680.0663
β 3 0.00590.06270.0625
γ 1 0.02240.10460.1022
γ 2 0.02300.10920.1068
γ 3 0.01570.09890.0977
ρ 0.00590.06620.0660
III100 β 1 0.01430.10800.1071
β 2 0.01060.11980.1194
β 3 0.01100.11070.1101
γ 1 0.00320.19550.1954
γ 2 0.00740.21990.2198
γ 3 0.01430.22130.2208
ρ 0.03210.12080.1165
200 β 1 0.00410.06910.0690
β 2 0.00020.08240.0824
β 3 0.00160.07920.0791
γ 1 0.01160.11090.1103
γ 2 0.01170.13960.1391
γ 3 0.00750.12690.1267
ρ 0.01310.07980.0787
300 β 1 0.01230.06080.0595
β 2 0.00330.06550.0654
β 3 0.00080.05530.0553
γ 1 0.00550.09960.0994
γ 2 0.00420.13840.1383
γ 3 0.02470.09880.0956
ρ 0.00370.05240.0522
Table 4. The estimate for the nonparametric components based on RASE.
Table 4. The estimate for the nonparametric components based on RASE.
ρ n Type = I Type = II Type = III
0.51000.04560.05070.0490
2000.03020.03810.0379
3000.02300.02060.0204
01000.05570.06160.0608
2000.03560.03790.0378
3000.02210.02510.0250
−0.51000.04290.06300.0534
2000.03420.03160.0355
3000.02680.02510.0214
Table 5. Detailed description of relevant variables involved in Boston housing data.
Table 5. Detailed description of relevant variables involved in Boston housing data.
Related VariablesDetailed Description
CRIMPer capita crime rate by town
ZNProportion of residential land zoned for lots over 25,000 sq.ft.
INDUSProportion of non-retail business acres per town
CHASCharles River dummy variable (= 1 if tract bounds river; 0 otherwise)
NOXNitric oxide concentration (parts per 10 million)
RMAverage number of rooms per dwelling
AGEProportion of owner-occupied units built prior to 1940
DISWeighted distances to five Boston employment centres
RADIndex of accessibility to radial highways
TAXFull-value property-tax rate per $10,000
PTRATIOPupil–teacher ratio by town
B 1000 ( B k 0.63 ) 2 where Bk is the proportion of blacks by town
LSTAT% lower status of the population
MEDVMedian value of owner-occupied homes in USD 1000’s
Table 6. Bayesian estimation results in Boston data analysis.
Table 6. Bayesian estimation results in Boston data analysis.
ParameterESTSDCI
β 1 −0.13350.1098(−0.3460, 0.0835)
β 2 0.03860.0507(−0.0614, 0.1397)
β 3 −0.08390.0850(−0.2541, 0.0803)
β 4 0.38990.0931(0.2034, 0.5633)
β 5 −0.15910.0693(−0.3043, −0.0305)
β 6 0.24030.1182(0.0122, 0.4697)
β 7 −0.21430.0914(−0.3908, −0.0346)
β 8 −0.12880.0530(−0.2366, −0.0259)
β 9 0.10580.07521(−0.0437, 0.2515)
γ 1 0.21320.1602(−0.1234, 0.5461)
γ 2 −0.30000.1937(−0.7381, 0.0715)
γ 3 0.64840.1974(0.2865, 1.0527)
ρ 0.15530.0910(−0.0335, 0.3302)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Liu, T.; Xu, D.; Ke, S. A Semiparametric Bayesian Approach to Heterogeneous Spatial Autoregressive Models. Entropy 2024, 26, 498. https://doi.org/10.3390/e26060498

AMA Style

Liu T, Xu D, Ke S. A Semiparametric Bayesian Approach to Heterogeneous Spatial Autoregressive Models. Entropy. 2024; 26(6):498. https://doi.org/10.3390/e26060498

Chicago/Turabian Style

Liu, Ting, Dengke Xu, and Shiqi Ke. 2024. "A Semiparametric Bayesian Approach to Heterogeneous Spatial Autoregressive Models" Entropy 26, no. 6: 498. https://doi.org/10.3390/e26060498

APA Style

Liu, T., Xu, D., & Ke, S. (2024). A Semiparametric Bayesian Approach to Heterogeneous Spatial Autoregressive Models. Entropy, 26(6), 498. https://doi.org/10.3390/e26060498

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop