Next Article in Journal / Special Issue
Bivariate Log-Symmetric Regression Models Applied to Newborn Data
Previous Article in Journal
Existence of Positive Solutions for Singular Difference Equations with Nonlinear Boundary Conditions
Previous Article in Special Issue
A New Extension of the Exponentiated Weibull–Poisson Family Using the Gamma-Exponentiated Weibull Distribution: Development and Applications
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Empirical Likelihood for Composite Quantile Regression Models with Missing Response Data

1
School of Science, Xi’an Polytechnic University, Xi’an 710048, China
2
Xi’an International, Science and Technology Cooperation Base for Big Data Analysis and Algorithms, Xi’an 710048, China
3
School of Economics and Finance, Xi’an Jiaotong University, Xi’an 710061, China
4
System Behavior and Management Laboratory of Xi’an Jiaotong University, Philosophy and Social Sciences Laboratory of the Ministry of Education in China, Xi’an 710061, China
*
Author to whom correspondence should be addressed.
Symmetry 2024, 16(10), 1314; https://doi.org/10.3390/sym16101314
Submission received: 28 August 2024 / Revised: 27 September 2024 / Accepted: 3 October 2024 / Published: 5 October 2024

Abstract

:
Under the assumption of missing response data, empirical likelihood inference is studied via composite quantile regression. Firstly, three empirical likelihood ratios of composite quantile regression are given and proved to be asymptotically χ 2 . Secondly, without an estimation of the asymptotic covariance, confidence intervals are constructed for the regression coefficients. Thirdly, three estimators are presented for the regression parameters to obtain its asymptotic distribution. The finite sample performance is assessed through simulation studies, and the symmetry confidence intervals of the parametric are constructed. Finally, the effectiveness of the proposed methods is illustrated by analyzing a real-world data set.

1. Introduction

It is a common occurrence in opinion polls, biostatistics, and a multitude of scientific experiments for data to be missing. Consequently, numerous papers on the statistical analysis of missing data have been published (see [1,2,3,4,5,6]), and some different kinds of methods have been proposed, including imputation methods [7], complete-case (CC) analysis methods [8], likelihood-based methods [9], and inverse probability weighted methods (IPW) [10], to handle the missing data problem. The imputation method under MAR is the most popular and effective of these methods for dealing with missing data. This method uses an appropriate value to replace the missing data point. For missing response data, there are some famous imputation methods such as semi-parametric imputation [11], kernel regression imputation [12], linear regression imputation [13], and so on.
On the other hand, as an indispensable and adaptable instrument in the domain of statistical investigation, quantile regression (QR) has not only elegant mathematical properties and promising performance but also the ability to directly estimate the effects of the covariates at different quantiles, in addition to the center of the distribution, which is a limitation of traditional least squares regression (LSR) methods. Therefore, QR is less sensitive and more robust to outliers. However, since the estimation efficiency of quantile regression is easily affected by specific quantile values, a new quantile regression called composite quantile regression (CQR) was introduced by Zou and Yuan [14] for the estimation of the unknown parameters of a linear model. Recently, a linear model with missing covariates was proposed by Yang and Liu [15]; it uses the CQR method and IPW method. Penalized weighted composite quantile regression was considered by Jin [16] for partially linear varying coefficient models with missing covariates. Zou [17] discussed heteroscedastic partially linear varying-coefficient models with missing censoring indicators using the CQR method.
Furthermore, the empirical likelihood (EL) method, as outlined by Owen [18], was employed for the purpose of constructing confidence intervals. This method offers a number of advantages over traditional normal approximation techniques. For instance, the confidence intervals or regions, which are defined by their shape and orientation, are produced by the empirical likelihood method. The obtained confidence intervals or regions have many attractive features such as a range-preserving property, the circumvention of asymptotic variance estimation, a flexible shape, and so on. Recently, many papers have studied the empirical likelihood inferences for quantile regression models. For instance, Whang [19] proposed a smoothed empirical likelihood method and provided estimates of the parameters of quantile regression models, constructing confidence regions for the model parameters. More analogous works can be found in [3,20,21,22].
As mentioned above, although [15,16] discussed the estimation of composite quantile regression with missing covariates, the authors considered neither the empirical likelihood of the composite quantile regression nor response data missing at random. Ref. [6] studied smoothed empirical likelihood for quantile regression models with response data missing at random, but it did not consider the composite quantile regression model. In addition, in spite of [17] having investigated composite quantile regression for heteroscedastic partially linear varying-coefficient models with missing censoring indicators, the authors considered censoring indicators missing rather than the response data missing at random; furthermore, they also does not study the empirical likelihood of the composite quantile regression model. Thus, it has seldom been considered in the literature on empirical likelihood for composite quantile regression models with missing response data so far. In this paper, we focus on empirical likelihood inferences of composite quantile regression models with missing response data and establish some theoretical results.
The highlights of this article are as follows: Firstly, three empirical likelihood ratios of composite quantile regression are given and proved to be asymptotically distributed according to the chi-squared law. Secondly, without the estimation of the asymptotic covariance, the confidence intervals for the regression coefficients are constructed. Thirdly, a class of estimators for the regression parameters is presented to derive their asymptotic distribution.
The rest of this paper is organized as follows. In Section 2, we will construct three EL ratios and estimators for the regression parameters of a QR model with missing response data. In Section 3, we will derive some asymptotic properties of the proposed procedure. In Section 4, we will undertake a series of simulation studies to evaluate the performance of the proposed method. An application to a real-world data set is used to illustrate the effectiveness of our approach in Section 5. The discussion and conclusions are presented in Section 6. The proofs of the asymptotic results are provided in Appendix A.

2. Empirical Likelihood for Composite Quantile Regression with Missing Response Data

Consider the classic linear model
Y i = X i T β + ε i , i = 1 , 2 , , n ,
where Y i is the response, β is a d × 1 vector of unknown regression coefficients, X i is a d × 1 vector of covariates, and the error ε i is a random error satisfying
P ( ε i < b k | X i ) = τ k ,
where b k is the τ k of ε i , τ k = k K + 1 ( k = 1 , 2 , , K ), and K is the number of quantiles. For the above model, we focus on the case where X is observed completely in a sample of size n and some Y values may be missing. In other words, we obtain an incomplete sample { X i ; Y i ; δ i } , 1 i n from model (1), where δ i = 0 if Y i is missing, and δ i = 1 otherwise, and all X i are observed. Throughout this paper, we assume that Y is missing at random (MAR). The MAR assumption implies that δ and Y are conditionally independent given X. That is, P ( δ = 1 | X ; Y ) = P ( δ = 1 | X ) . MAR is reasonable in many practical situations and is a common assumption for statistical analysis with missing data [8].

2.1. Complete-Case Linear Composite Quantile Regression Empirical Likelihood

By model (1), the complete data CQR estimator β ^ C Q of β solves
( b ^ 1 , , b ^ K , β ^ C Q ) = arg min b 1 , , b K , β k = 1 K i = 1 n ρ τ ( Y i X i T β b k ) δ i ,
where ρ τ ( u ) = u ( τ I ( u < 0 ) ) is the quantile loss function. It is easy to show that
E δ i τ k I ( Y i X i T β b k ) | X i = 0 ,
where I ( · ) is the function of the indicator. By Equation (3) and the EL method idea, the auxiliary random vector is defined as follows:
η i c ( β ) = k = 1 K δ i X i τ k I ( Y i X i T β b k ) ,
when β is the true value of the parameter. It can be shown that E { η i c ( β ) } = 0 by Equation (3). An empirical log-likelihood ratio function for β can be defined based on η i c ( β ) . However, because the quantiles b k are unknown, η i c ( β ) cannot be directly used to make inferences for β . Therefore, we replace b k , k = 1 , , K , with their estimators b ^ k from (2); thus,
η ^ i c ( β ) = k = 1 K δ i X i τ k I ( Y i X i T β b ^ k ) ,
by the simple calculation of
η ^ i c ( β ) = η i c ( β ) + k = 1 K δ i X i I ( ε i b k ) I ( ε i b ^ k ) .
Similar to the proof of Theorem 1 in [14], we have b ^ k b k = O p ( n 1 / 2 ) . Hence, it is easy to show that
E I ( ε i b k ) I ( ε i b ^ k ) = P ( ε i b k ) P ( ε i b ^ k ) = o ( 1 ) .
Then, by E { η i c ( β ) } = 0 , we can obtain E { η ^ i c ( β ) } = o ( 1 ) , i.e., the auxiliary random vector is asymptotically unbiased; therefore, the complete-case composite quantile empirical log-likelihood (CCQEL) for β is defined as
R ^ C c ( β ) = 2 max i = 1 n log ( n p i ) : p i 0 , i = 1 n p i = 1 , i n p i η ^ i c ( β ) = 0 .
Then, the empirical likelihood estimation of the linear composite quantile under complete data can be defined as β ^ C C Q E L :
β ^ C C Q E L = arg min β R ^ C c ( β ) .

2.2. Weighted Composite Quantile Empirical Likelihood

In accordance with the method in Section 2.1, a weighted composite quantile empirical log-likelihood ratio function for β can be defined as follows:
R ^ C w * ( β ) = 2 max i = 1 n log ( n p i ) : p i 0 , i = 1 n p i = 1 , i n p i η ^ i w * ( β ) = 0 ,
where
η ^ i w * ( β ) = k = 1 K δ i p ( X i ) X i τ k I ( Y i X i T β b ^ k ) ,
and p ( x ) = P ( δ = 1 | X = x ) is referred to as the selection probability function. It should be noted that the selection probability p ( x ) in (6) is assumed to be known. A kernel smoothing method can be used to estimate the selection probability if it is unknown. The estimate for p ( x ) can be defined as follows:
p ^ ( x ) = i = 0 n δ i K ( ( X i x ) / h n ) i = 0 n K ( ( X i x ) / h n ) ,
where K ( · ) represents a kernel function, and h = h n denotes a sequence of positive numbers that tend to zero, which controls the amount of smoothing used in the estimations. Therefore, a weighted composite quantile empirical log-likelihood, say R ^ C w ( β ) , can be obtained by replacing p ( X i ) with its estimator p ^ ( X i ) . That is,
R ^ C w ( β ) = 2 max i = 1 n log ( n p i ) : p i 0 , i = 1 n p i = 1 , i n p i η ^ i w ( β ) = 0 ,
where η ^ i w ( β ) = k = 1 K δ i p ^ ( X i ) X i τ k I ( Y i X i T β b ^ k ) . Then, the empirical likelihood estimation of the linear weighted composite quantile can be defined as β ^ W C Q E L :
β ^ W C Q E L = arg min β R ^ C w ( β ) .

2.3. Imputation Composite Quantile Empirical Likelihood

For estimations of the CCQEL and the WCQEL, the information contained in sample data is not fully utilized because only the information of the observed data is used in constructing the EL ratio; the coverage accuracy of the confidence region is reduced when there are many missing values. To solve the problem, X i T β ^ C Q is imputed if Y i is missing. The following introduces auxiliary random data:
η ^ i I ( β ) = k = 1 K X i τ k I ( Y ^ i X i T β b ^ k ) ,
where Y ^ i = δ i Y i p ^ ( X i ) + ( 1 δ i p ^ ( X i ) ) X i T β ^ C Q . Thus, an imputation composite quantile empirical log-likelihood (ICQEL) ratio is defined as
R ^ C I ( β ) = 2 max i = 1 n log ( n p i ) : p i 0 , i = 1 n p i = 1 , i = 1 n p i η ^ i I ( β ) = 0 ,
The ratio is more appropriate than the quantile weighted empirical likelihood ratio, as it makes optimal use of the information contained in the data. In addition, the empirical likelihood estimation of the linear imputation composite quantile of β can be defined as β ^ I C Q E L :
β ^ I C Q E L = arg min β R ^ C I ( β ) .

3. Asymptotic Properties

Let r 2 be an integer. Denote as f ( · | x ) and F ( · | x ) , for the conditional density and conditional distribution functions of ε on conditional X i = x , we denote g ( x ) as the density function of X. Let c be a positive constant that is not dependent on n and may assume a different value in each instance. The following conditions are necessary for the results to be valid:
(C1) { ( Y i , X i ) : i = 1 , 2 , , n } are independent and identically distributed random vectors.
(C2) Both p ( x ) and g ( x ) have bounded partial derivatives up to order r almost surely, and inf x p ( x ) > 0 .
(C3) This condition is made up of the following two aspects:
(a) K ( · ) is bounded; it is compactly supported on [ 1 , 1 ] .
(b) K ( · ) is a kernel function of order r, and there are positive constants, denoted by C 1 and C 2 , and a positive real number, denoted by ρ , such that the following inequality holds:
C 1 I [ | | u | | ρ ] K ( u ) C 2 I [ | | u | | ρ ] .
(C4) P ( | | X | | > M n = o ( n 1 / 2 ) , where M n > 0 , and when n , M n .
(C5) The positive bandwidth parameter h satisfies n h 2 r 0 .
(C6) X i has a bounded support, and matrices A and B are nonsingular, where B and A are defined in Theorem 2.
(C7) The conditional distribution of Y given X = x is absolutely continuous with a density function f ( · ) strictly bounded away from zero and infinity at the τ k conditional quantiles, k = 1 , 2 , , K .
In this section, the asymptotic distributions of the CQEL ratios and the estimators proposed in Section 2.1, Section 2.2 and Section 2.3 will be considered. Firstly, the asymptotic distributions are established for R ^ C c ( β ) , R ^ C w ( β ) , and R ^ C I ( β ) .
Theorem 1.
Suppose that Conditions C 1 C 7 hold. If β is the true parameter, then
R ^ ( β ) L χ d 2 ,
where R ^ ( β ) is desirable as R ^ C c ( β ) , R ^ C w ( β ) , or R ^ C I ( β ) ; χ d 2 is the chi square distribution with degrees of freedom d; and L indicates the convergence in distribution.
Let χ d 2 ( 1 α ) be the 1 α quantile of the χ d 2 for 0 < α < 1 . Using Theorem 1, we are able to derive an approximate 1 α confidence region for β, which is defined by
R α ( β ˜ ) = { β ˜ | R ^ ( β ˜ ) χ d 2 ( 1 α ) } .
Theorem 1 can also be used to test the hypothesis H 0 : β = β 0 . One could reject H 0 at level α if R ^ ( β 0 ) > χ d 2 ( 1 α ) .
In order to compare the EL method with the asymptotic normal method, the following theorem gives the asymptotic normality of β ^ C Q and β ^ C Q E L , where β ^ C Q E L is desirable as β ^ C C Q E L , β ^ C W Q E L , or β ^ I C Q E L .
Theorem 2.
Suppose that Conditions C 1 C 7 hold. Then,
n ( β ^ C Q E L β ^ C Q ) = o p ( 1 ) ,
n ( β ^ β ) L N ( 0 , D ) ,
where A = E { π ( X ) f ( 0 | X ) X X T } , B = k = 1 K k = 1 K min ( τ k , τ k ) τ k τ k E { π ( X ) X X T } , D = A 1 B A 1 , f ( · | x ) is the conditional density of ε when X = x , and β ^ is desirable as β ^ C Q , β ^ C C Q E L , β ^ C W Q E L , or β ^ I C Q E L ; it has π ( x ) = p ( x ) when β ^ is desirable as β ^ C Q and β ^ C C Q E L ; it has π ( x ) = 1 / p ( x ) when β ^ is desirable as β ^ C W Q E L ; and it has π ( x ) = 1 when β ^ = β ^ I C Q E L .
To construct the confidence region for β ^ , it is necessary to estimate the asymptotic covariance matrix D using D ^ = A ^ 1 B ^ A ^ 1 , where A ^ = 1 n h i = 1 n δ i K h ( Y i X i T β ^ ) X i X i T , and B ^ = τ ( 1 τ ) n i = 1 n δ i X i X i T . We can prove that D ^ is a consistent estimator of D . Thus, by Theorem 2, we have
n D ^ 1 / 2 ( β ^ β ) L N ( 0 , I d ) ,
So, there is
n ( β ^ β ) T D ^ 1 ( β ^ β ) L χ d 2 .
Accordingly, the confidence regions of β ^ can be constructed using (8).

4. Simulation Study

In order to study the finite sample performance of the proposed method, we performed some simulations. The following two models are considered:
1. Homoscedastic model: Y i = X i β + ε i , i = 1 , 2 , , n ;
2. Heteroscedastic model: Y i = X i β + ξ X i ε i , i = 1 , 2 , , n .
Here, the variable X was simulated from the N ( 0 , 1 ) , and ε i i i d N ( 0 , 0.5 ) , i = 1 , 2 , , n . We consider the case where ξ = 0.5 and β = 1.5 . In the simulation study, for the convenience of calculation, the composite level was chosen K = 9 , so the quantiles were taken as ( τ 1 , τ 2 , , τ 9 ) = ( 0.1 , 0.2 , , 0.9 ) . Consider the following three selection probability functions:
(a) p 1 ( x ) = 0.8 + 0.2 | x 1 | , if | x 1 | 1 , 0.95 , others ,
(b) p 2 ( x ) = 0.9 0.2 | x 1 | , if | x 1 | 4.5 , 0.10 , others ,
(c) p 3 ( x ) = 0.6 , x R .
Approximately, 0.09 , 0.26, and 0.40 are the average missing rates corresponding to the three cases.
The kernel function was taken to be
K ( x ) = 0.75 ( 1 x 2 ) , i f | x | 1 , 0 , others ,
In total, 2000 Monte Carlo random samples of size n = 100 , 150 , and 200 were generated, and the cross-validation method was used to select the optimal bandwidths h o p t . Consider the confidence intervals of β on model 1 and model 2. Then, five method, including imputed quantile empirical likelihood (IQEL) in [6], composite QR empirical likelihood without missing data (NCQEL), imputed composite quantile empirical likelihood (ICQEL), and the normal approximation in Theorem 2, were used. In the following, for convenience of expression, the normal approximation confidence intervals for β ^ I C Q E L and β ^ C Q are denoted as NA ( β ^ I C Q E L ) and NA ( β ^ C Q ) , respectively. Then, the corresponding empirical coverage probabilities and their average lengths of confidence intervals were computed with a nominal level 1 α = 0.95 and K = 9 . Table 1, Table 2, Table 3 and Table 4 show the results.
The results in Table 1, Table 2, Table 3 and Table 4 show that (1) for case 1, when n = 200 , the average length of the confidence intervals for β in model 1 obtained by the ICQEL method was 0.9389, while the average length of the confidence intervals for β in model 1 obtained by the IQEL method was 0.9346. So, the ICQEL method gives higher coverage probabilities but slightly longer intervals compared to the other two methods. For cases 2 and 3, in the sense that the confidence intervals of ICQEL have higher coverage probabilities and uniformly shorter average lengths, ICQEL performs better than the other two methods. This indicates that when the missing rate is large, CQR imputation is necessary. (2) Both IQEL and ICQEL have slightly longer interval lengths but higher coverage probabilities than NA ( β ^ I C Q E L ) and NA ( β ^ C Q ). In addition, the confidence intervals obtained by NA ( β ^ I C Q E L ) and NA ( β ^ C Q ) have nearly equal lengths and coverage probabilities in the same case. (3) For every given missing rate, as the sample size n increases, all the interval lengths decrease and the empirical coverage probabilities increase. Observably, the missing rate also affects the interval length and coverage probability. Generally, for every fixed sample size, the coverage probability decreases and the interval length increases as the missing rate increases. However, for the ICQEL and IQEL methods, the two values do not exhibit a significant change because the QR imputation is used in the two methods. Moreover, it is evident that the other methods for the heteroscedastic model, ICQEL, continue to demonstrate superior performance.

5. A Real-World Example

The data originally obtained from Engel [23] are analyzed in this section in order to verify the results attained in this paper, using a real example of a declining share of personal income concerning food expenditure. The data set comprises 235 budget surveys of 19th-century European working-class households and has no missing data. Engel data can be accessed directly from the R package. In order to illustrate our method using the data set, we deleted some of the response values at random to create artificial missing data. Assume that in these data, 20 % of the response values are missing. The following linear QR model
Y i = β 0 ( τ ) + β 1 ( τ ) X i + ε i , i = 1 , 2 , , 235 ,
was considered, where X is the centered annual household income in Belgian francs, and Y is the household’s centered annual food expenditure.
Now, based on the proposed ICQLE and NCQEL methods, the 95 % confidence intervals and the estimators of β are presented, and the quantiles are taken as ( τ 1 , τ 2 , τ 3 ) = ( 0.25 , 0.5 , 0.75 ) with K = 3 . The quantile in the IQEL method is taken as τ = 0.5 . The results are presented in Table 5. From an examination of Table 5, it can be observed that the confidence interval obtained by the IQEL method has a longer confidence interval than that obtained by the ICQEL method. The confidence intervals obtained by ICQEL and NCQEL are basically close to each other. The results are in good agreement with the simulation results.

6. Conclusions and Discussions

In this paper, a CQEL method is proposed for analysis for a QR model with missing response data. Three empirical likelihood ratios of CQR, including the CCQEL ratio, WCQEL ratio, and ICQEL ratio, for the regression parameter were proposed, and it was proved that they are asymptotically χ 2 distributed. Also, three CQEL estimators for the regression parameter were constructed such that the three estimators were asymptotically normal. The benefits of the CQEL method were demonstrated through a simulation study and an analysis of a real-world data set.
While this paper focuses on the empirical likelihood estimation of composite quantile regression, other areas of empirical likelihood estimation could also be explored, such as modal composite quantile regression or expectation quantile regression with missing data. Furthermore, missing data are frequently not missing at random, and the composite quantile under missing at non-random can be considered at a later stage.

Author Contributions

Methodology, S.L.; software, Y.Z.; formal analysis, S.L.; investigation, S.L. and Y.Z.; writing—original draft, S.L.; writing—review and editing, C.-y.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundations of China (No. 12271420), the Natural Science Foundation of Shaanxi Province of China (2024JC-YBMS-007), and the Planning Project of Yulin Science and Technology Bureau of Shaanxi Province of China (CXY-2021-117).

Data Availability Statement

Data are contained within the article.

Acknowledgments

The authors are grateful to all the reviewers for their constructive comments and suggestions that led to significant improvements to the original manuscript.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A

The following Lemmas are instrumental in proving the theorems given in Section 3.
Lemma A1.
Assume that Conditions C 1 C 7 hold. Then,
b ^ k b k = O p ( n 1 / 2 ) ,
where i = 1 , 2 , , n .
Proof. 
Similar to the proof of the theorem in [14], this lemma can be easily derived. □
Lemma A2.
Suppose that the regularity Conditions C 1 C 7 hold. If β is the true parameter in (1), we have that
1 n i = 1 n η ^ i ( β ) L N ( 0 , B ) ,
and
E ( η ^ i ( β ) / β ) = A + o ( 1 ) ,
which are all true where η ^ i ( β ) takes η ^ i c ( β ) , η ^ i w ( β ) , or η ^ i I ( β ) ; A = E { π ( X ) f ( 0 | X ) X X T } ; and B = k = 1 K k = 1 K min ( τ k , τ k ) τ k τ k E { π ( X ) X X T } ; and when π ( x ) = p ( x ) , η ^ i ( β ) takes η ^ i c ( β ) ; when π ( x ) = 1 / p ( x ) , η ^ i ( β ) takes η ^ i w ( β ) ; and when π ( x ) = 1 , η ^ i ( β ) = η ^ i I ( β ) .
Proof. 
First is the proof when η ^ i ( β ) = η ^ i c ( β ) and equalities (A1) and (A2) both hold, i = 1 , 2 , , n . Let M i k = I ( ε i < b k ) I ( ε i < b ^ k ) . The following formula can be obtained by simple calculation:
1 n i = 1 n η ^ i c ( β ) = 1 n i = 1 n k = 1 K δ i X i ( τ k I ( ε i < b k ) ) + 1 n i = 1 n k = 1 K M i k δ i X i = 1 n i = 1 n A i 1 + 1 n i = 1 n A i 2 ,
where A i 1 = k = 1 K δ i X i ( τ k I ( ε i < b k ) ) , and A i 2 = k = 1 K M i k δ i X i . A simple calculation is available as follows:
E ( A i 1 ) = E k = 1 K δ i X i τ k I ( ε i < b k ) = 0 .
We have
V a r ( A i 1 ) = V a r k = 1 K δ i X i τ k I ( ε i < b k ) = E k = 1 K δ i X i τ k I ( ε i < b k ) k = 1 K δ i X i τ k I ( ε i < b k ) T = E k = 1 K k = 1 K δ i X i X i T τ k I ( ε i < b k ) τ k I ( ε i < b k ) .
In addition, there are E ( I ( ε i < b k ) ) = τ k , E ( I ( ε i < b k ) ) = τ k , and E ( I ( ε i < b k ) I ( ε i < b k ) = m i n { τ k , τ k } . Hence, we obtain that
E τ k I ( ε i < b k ) τ k I ( ε i < b k ) = E τ k τ k τ k I ( ε i < b k ) I ( ε i < b k ) τ k + I ( ε i < b k ) I ( ε i < b k ) = min ( τ k , τ k ) τ k τ k ,
We have
V a r ( A i 1 ) = k = 1 K k = 1 K min ( τ k , τ k ) τ k τ k E ( p ( x ) XX T ) .
From the central limit theorem,
1 n i = 1 n A i 1 L N ( 0 , B ) .
Next, we prove
1 n i = 1 n A i 2 = o p ( 1 ) ,
Let k = 1 K M i k = ξ i , A i 2 , j be the jth component of A i 2 , and X i j be the jth component of X i ; by Lemma A.2 of [24], we have that
max s n | i = 1 s X i j | = O p ( n 1 / 2 ) .
Furthermore, in accordance with Lemma A1, we have that
M i k = I ( ε i < b k ) I ( ε i < b k ) = O p ( n 1 / 2 ) .
According to Abel’s inequality, using formulas (A6) and (A7), we have that
| 1 n i = 1 n A i 2 , j | = 1 n | i = 1 n ξ i δ i X i j | max 1 i n | ξ i | max 1 i s | i = 1 n δ i X i j | = o p ( 1 ) .
Hence, we have
1 n i = 1 n A i 2 = o p ( 1 ) .
According to formulas (A4), (A5), and (A8), it is proved that Equation (A1) holds. On the other hand, using the above idea of the proof, we can prove that Equation (A2) holds. Secondly, it is proved that Equations (A1) and (A2) hold when η ^ i ( β ) = η ^ i w ( β ) , i = 1 , 2 , , n . Note that
ψ i k ( Y i , X i , β ) = τ k I ( Y i X i T β b ^ k ) .
because
1 n i = 1 n η ^ i w ( β ) = 1 n i = 1 n k = 1 K δ i p ^ ( X i ) X i [ τ k I ( Y i X i T β b ^ k ) ] = 1 n i = 1 n k = 1 K δ i p ( X i ) X i ψ i k ( Y i , X i , β ) + 1 n i = 1 n k = 1 K δ i p ( X i ) p ^ ( X i ) p ^ ( X i ) p ( X i ) X i ψ i k ( Y i , X i , β ) = 1 n i = 1 n k = 1 K δ i p ( X i ) X i ( τ k I ( ε i < b k ) ) + 1 n i = 1 n k = 1 K M i k δ i p ( X i ) X i + 1 n i = 1 n k = 1 K δ i p ( X i ) p ^ ( X i ) p ^ ( X i ) p ( X i ) X i ( τ k I ( ε i < b k ) ) + 1 n i = 1 n k = 1 K δ i p ( X i ) p ^ ( X i ) p ^ ( X i ) p ( X i ) X i M i k = 1 n i = 1 n B i 1 + 1 n i = 1 n B i 2 + 1 n i = 1 n B i 3 + 1 n i = 1 n B i 4 ,
where
B i 1 = k = 1 K δ i p ( X i ) X i ( τ k I ( ε i < b k ) ) , B i 2 = k = 1 K δ i p ( X i ) X i M i k , B i 3 = k = 1 K δ i p ( X i ) p ^ ( X i ) p ^ ( X i ) p ( X i ) X i ( τ k I ( ε i < b k ) ) , B i 4 = k = 1 K δ i p ( X i ) p ^ ( X i ) p ^ ( X i ) p ( X i ) X i M i k .
A simple calculation is available as follows:
E ( B i 1 ) = E k = 1 K δ i p ( X i ) X i τ k I ( ε i < b k ) = 0 ,
We have that
V a r ( B i 1 ) = V a r k = 1 K δ i p ( X i ) X i τ k I ( ε i < b k ) = E k = 1 K δ i p ( X i ) X i τ k I ( ε i < b k ) k = 1 K δ i p ( X i ) X i ( τ k I ( ε i < b k ) ) T = E k = 1 K k = 1 K δ i p 2 ( X i ) X i X i T τ k I ( ε i < b k ) τ k I ( ε i < b k ) .
In addition, there are E ( I ( ε i < b k ) ) = τ k , E ( I ( ε i < b k ) ) = τ k , and E ( I ( ε i < b k ) I ( ε i < b k ) = m i n { τ k , τ k } . Hence, we have
E τ k I ( ε i < b k ) τ k I ( ε i < b k ) = E τ k τ k τ k I ( ε i < b k ) I ( ε i < b k ) τ k + I ( ε i < b k ) I ( ε i < b k ) = min τ k , τ k τ k τ k .
Hence, We obtain the following formula:
V a r ( B i 1 ) = k = 1 K k = 1 K min ( τ k , τ k ) τ k τ k E 1 p ( x ) X X T .
From the central limit theorem,
1 n i = 1 n B i 1 L N ( 0 , B ) .
It is not difficult to prove 1 n i = 1 n B i 2 = o p ( 1 ) from the above idea of 1 n i = 1 n A i 2 = o p ( 1 ) . By referencing the proof of Theorem 3 of [25], and by Conditions C 2 , C 3 , and C 5 , we have
1 n i = 1 n δ i p ^ ( X i ) p ( X i ) X i τ k I ( ε i < b k ) = O p ( 1 ) .
Because s u p x | p ^ ( x ) p ( x ) | = o p ( 1 ) , by (A12), we have 1 n i = 1 n B i 3 = o p ( 1 ) , which is similar to the proof of 1 n i = 1 n B i 4 = o p ( 1 ) . So, we can prove that Equation (A1) holds by (A10) and (A11). In addition, using the above proof idea, we can prove that (A2) holds.
Last, it is proved that Equations (A1) and (A2) all hold when η ^ i ( β ) = η ^ i I ( β ) , i = 1 , 2 , , n . Calculations yield
X i T β Y ^ i = δ i p ^ ( X i ) X i T β Y i + 1 δ i p ^ ( X i ) X i T β β ^ Q .
It is easy to prove that we have
1 n i = 1 n ( 1 δ i p ^ ( X i ) ) X i = o p ( 1 ) ,
and
β ^ Q β = A 1 1 n i = 1 n η ^ i ( β ) + o p ( n 1 / 2 ) = O p ( n 1 / 2 ) .
Therefore, it is possible to obtain
X i I ( X i T β Y ^ i > 0 ) τ = X i I ( X i T β Y i > 0 ) τ = X i ψ i ( Y i , X i , β ) .
Then, we can prove that (A1) and (A2) all hold using the above proof idea, ending the lemma proof. □
Lemma A3.
Suppose that regularity Conditions C 1 C 7 hold. If β is the true parameter in (1), we have that
1 n i = 1 n η ^ i ( β ) η ^ i T ( β ) P B ,
where η ^ i ( β ) takes η ^ i c ( β ) , η ^ i w ( β ) , or η ^ i I ( β ) , and
B = k = 1 K k = 1 K min ( τ k , τ k ) τ k τ k E π ( X ) X X T ,
and when π ( x ) = p ( x ) , η ^ i ( β ) takes η ^ i c ( β ) ; when π ( x ) = 1 / p ( x ) , η ^ i ( β ) takes η ^ i w ( β ) ; and when π ( x ) = 1 , η ^ i ( β ) = Z i I ( β ) .
Proof. 
(a) This proves the conclusion when η ^ i ( β ) = η ^ i c ( β ) , where i = 1 , 2 , , n . A simple calculation is available as follows:
1 n i = 1 n η ^ i c ( β ) η ^ i c T ( β ) = 1 n i = 1 n A i 1 A i 1 T + 1 n i = 1 n A i 1 A i 2 T + 1 n i = 1 n A i 2 A i 1 T + 1 n i = 1 n A i 2 A i 2 T = B 1 + B 2 + B 3 + B 4 ,
It can be obtained from the law of large numbers that B 1 P B . We prove B 2 P 0 . Let us define the matrix B 2 , k s as the ( k , s ) component of the matrix B 2 . Similarly, let us define the matrix A i j , r as the rth component of the matrix A i j , where j = 1 , 2 . Subsequently, the Cauchy–Schwarz inequality is employed to derive the following result:
| B 2 , k s | 1 n i = 1 n A i 1 , k 2 1 / 2 1 n i = 1 n A i 2 , r 2 1 / 2 .
From Lemmas A1 and A2, we can see that n 1 i = 1 n A i 1 , k 2 = O p ( 1 ) and n 1 i = 1 n A i 2 , r 2 = o p ( 1 ) . Hence, B 2 P 0 . Using a similar argument, we can prove B i P 0 , i = 3 , 4 . So, we prove that Equation (A14) holds.
(b) This proves the conclusion when η ^ i ( β ) = η ^ i w ( β ) , where i = 1 , 2 , , n . This is because
1 n i = 1 n η ^ i w ( β ) η ^ i w T ( β ) = 1 n i = 1 n B i 1 B i 1 T + o p ( 1 ) = C 1 + o p ( 1 ) ,
where
B i 1 = k = 1 K δ i p ( X i ) X i ( τ k I ( ε i < b k ) ) .
In accordance with the law of large numbers, it can be inferred that
B 1 P B .
(c) By (A13) and using the methods in (a) and (b), we can prove Equation (A14) when η ^ i ( β ) = η ^ i I ( β ) , i = 1 , 2 , , n . □
Proof the Theorem 1.
The Lagrange multiplier method allows us to represent R ^ ( β ) in the following way:
R ^ ( β ) = 2 i = 1 n log 1 + λ T ( β ) η ^ i ( β ) ,
where λ ( β ) is a d × 1 vector and satisfies the solution of the following equation:
i = 1 n η ^ i ( β ) 1 + λ T ( β ) η ^ i ( β ) ) = 0 .
Using the method of proving (A17) from Lemma A2 and reference [18], we can obtain
λ ( β ) = η ^ i ( β ) η ^ i T ( β ) 1 i = 1 n η ^ i ( β ) + o p ( n 1 / 2 ) .
Then, Taylor expansion is applied to (A16), and by Lemmas A2 and (A18), we have
R ^ ( β ) = 2 i = 1 n λ T ( β ) η ^ i ( β ) λ T ( β ) η ^ i ( β ) 2 / 2 + o p ( 1 ) .
and by Equation (A17), we can obtain
0 = i = 1 n η ^ i ( β ) 1 + λ T ( β ) η ^ i ( β ) = i = 1 n η ^ i ( β ) i = 1 n η ^ i ( β ) η ^ i T ( β ) λ ( β ) + i = 1 n η ^ i ( β ) ( λ T ( β ) η ^ i ( β ) ) 2 1 + λ T ( β ) η ^ i ( β ) .
By Lemmas A2 and (A18), we can obtain
i = 1 n λ T ( β ) η ^ i ( β ) 2 = i = 1 n λ T ( β ) η ^ i ( β ) + o p ( 1 ) .
Then, by (A19), we have
R ^ ( β ) = 1 n i = 1 n η ^ i T ( β ) 1 n i = 1 n η ^ i ( β ) η ^ i T ( β ) 1 1 n i = 1 n η ^ i ( β ) + o p ( 1 ) .
The proof of Theorem 1 is derived from the combination of Lemmas A2 and A3. □
Proof the Theorem 2.
First, by the Taylor expansion, we have
1 n i = 1 n η ^ i ( β ^ ) = 1 n i = 1 n η ^ i ( β ) + 1 n i = 1 n η ^ i ( β ) ( β ^ β ) + o p ( n 1 / 2 ) = D n + A ( β ^ β ) + o p ( n 1 / 2 ) ,
where D n = 1 n i = 1 n η ^ i ( β ) . Second, using an argument similar to that in [26] of (28)–(30) and Lemma A2, β ^ C Q E L β ^ = o p ( n 1 / 2 ) . Lastly, this, together with Lemmas A2, (A19), and (A20), proves Theorem 2. □

References

  1. Liu, H.; Yang, H.; Peng, C. Weighted composite quantile regression for single index model with missing covariates at random. Comput. Stat. 2019, 34, 1711–1740. [Google Scholar] [CrossRef]
  2. Chen, X.; Alan, T.K.; Zhou, Y. Efficient quantile regression analysis with missing observations. J. Am. Stat. 2015, 110, 723–741. [Google Scholar] [CrossRef]
  3. Luo, S.H.; Yan, Y.X.; Zhang, C.Y. Two-Stage estimation of partially linear varying coefffcient quantile regression model with missing data. Mathematics 2024, 12, 578. [Google Scholar] [CrossRef]
  4. Xue, L.G.; Zhu, L.X. Empirical likelihood in a partially linear single-index model with censored response data. Comput. Stat. Data Anal. 2024, 193, 107912. [Google Scholar] [CrossRef]
  5. Luo, S.H.; Zhang, C.Y.; Wang, M.H. Composite quantile regression for varying coefficient models with response data missing at random. Symmetry 2019, 11, 1065. [Google Scholar] [CrossRef]
  6. Luo, S.H.; Mei, C.L.; Zhang, C.Y. Smoothed empirical likelihood for quantile regression models with response data missing at random. AStA-Adv. Stat. Anal. 2017, 15, 95–116. [Google Scholar] [CrossRef]
  7. Aerts, M.; Claeskens, G.; Hens, N.; Molenberghs, G. Local multiple imputation. Biometrika 2002, 89, 375–388. [Google Scholar] [CrossRef]
  8. Little, R.J.A.; Rubin, D.B. Statistical Analysis with Missing Data; John Wiley & Sons: Hoboken, NJ, USA, 2014. [Google Scholar]
  9. Schafer, J.; Graham, J. Missing data: Our view of the state of the art. Psychol. Methods 2002, 2, 147–177. [Google Scholar] [CrossRef]
  10. Robins, J.M.; Rotnitzky, A.; Zhao, L.P. Analysis of semiparametric regression models for repeated outcomes in the presence of missing data. J. Am. Stat. Assoc. 1995, 90, 106–121. [Google Scholar] [CrossRef]
  11. Wang, Q.; Linton, O.; Ärdle, W.H. Semiparametric regression analysis with missing response at random. J. Am. Stat. Assoc. 2004, 99, 334–345. [Google Scholar] [CrossRef]
  12. Wang, Q.; Rao, N.K. Empirical likelihood-based inference under imputation for missing response data. Ann. Stat. 2002, 30, 896–924. [Google Scholar]
  13. Xue, L.G. Empirical likelihood for linear models with missing responses. J. Multivar. Anal. 2009, 100, 1353–1366. [Google Scholar] [CrossRef]
  14. Zou, H.; Yuan, M. Composite quantile regression and the oracle model selection theory. Ann. Stat. 2008, 36, 1108–1126. [Google Scholar] [CrossRef]
  15. Yang, H.; Liu, H.L. Penalized weighted composite quantile estimators with missing covariates. Stat. Pap. 2016, 57, 69–88. [Google Scholar] [CrossRef]
  16. Jin, J.; Ma, T.; Dai, J.; Liu, S. Penalized weighted composite quantile regression for partially linear varying coefficient models with missing covariates. Comput. Stat. 2020, 36, 541–575. [Google Scholar] [CrossRef]
  17. Zou, Y.Y.; Fan, G.L.; Zhang, R.Q. Composite quantile regression for heteroscedastic partially linear varying-coefficient models with missing censoring indicators. J. Stat. Comput. Simul. 2023, 93, 341–365. [Google Scholar] [CrossRef]
  18. Owen, A.B. Empirical likelihood ratio confidence regions. Ann. Stat. 1990, 18, 90–120. [Google Scholar] [CrossRef]
  19. Whang, Y.J. Smoothed empirical likelihood methods for quantile regression models. Econom. Theory 2006, 22, 173–205. [Google Scholar] [CrossRef]
  20. Zhao, P.X.; Lin, X.S.; Lin, L. Empirical likelihood for composite quantile regression modeling. J. Appl. Math. Comput. 2015, 48, 321–333. [Google Scholar] [CrossRef]
  21. Wang, J.F.; Jiang, W.J.; Xu, F.Y.; Fu, W.X. Weighted composite quantile regression with censoring indicators missing at random. Commun. Stat.-Theory Methods 2021, 50, 2900–2917. [Google Scholar] [CrossRef]
  22. Sun, J.; Ma, Y.Y. Empirical likelihood weighted composite quantile regression with partially missing covariates. J. Nonparametric Stat. 2017, 29, 137–150. [Google Scholar] [CrossRef]
  23. Engel, E. Die productions and consumtionsver haltnisse des konigreichs sachsen. Stat. Burdes 1857, 8, 1–54. [Google Scholar]
  24. Zhao, P.X.; Xue, L.G. Empirical likelihood inferences for semiparametric varying coefficient partially linear models with longitudinal data. Commun. Stat.-Theory Methods 2010, 39, 1898–1914. [Google Scholar] [CrossRef]
  25. Wong, H.; Guo, S.; Chen, M. On locally weighted estimation and hypothesis testing of varying-coefficient models with missing covariates. J. Stat. Plan. Inference 2009, 139, 2933–2951. [Google Scholar] [CrossRef]
  26. Otsu, T. Conditional empirical likelihood estimation and inference for quantile regression models. J. Econom. 2008, 142, 508–538. [Google Scholar] [CrossRef]
Table 1. Average lengths of the confidence intervals for β in model 1, calculated for different forms of the selection probability function p ( x ) and different values of sample size n, with a nominal level of 0.95 .
Table 1. Average lengths of the confidence intervals for β in model 1, calculated for different forms of the selection probability function p ( x ) and different values of sample size n, with a nominal level of 0.95 .
QEL     NA
p ( x ) n IQELICQELNA ( β ^ ICQEL )NA ( β ^ CQ )NCQEL
p 1 ( x ) 1000.91710.91990.91820.90120.9201
1500.92850.92980.92810.91210.9299
2000.93460.93790.93540.92430.9379
p 2 ( x ) 1000.90250.90460.90240.89980.9047
1500.91420.91580.91360.90320.9157
2000.92380.92980.92360.91980.9299
p 3 ( x ) 1000.91380.91980.91280.90160.9196
1500.92790.93120.92680.91890.9314
2000.93540.94160.93390.92960.9418
Table 2. Emprical coverage probabilities of the intervals for β in model 1, calculated for different forms of the selection probability function p ( x ) and different values of the sample sizes n, with a nominal level of 0.95.
Table 2. Emprical coverage probabilities of the intervals for β in model 1, calculated for different forms of the selection probability function p ( x ) and different values of the sample sizes n, with a nominal level of 0.95.
QEL     NA
p ( x ) n IQELICQELNA ( β ^ ICQEL )NA ( β ^ CQ )NCQEL
p 1 ( x ) 1000.28910.29420.28120.28980.2940
1500.26780.26980.26590.26450.2699
2000.22640.23140.22450.22140.2315
p 2 ( x ) 1000.34520.32460.33580.33890.3244
1500.33450.31870.32980.33010.3186
2000.32540.29780.31870.31980.2975
p 3 ( x ) 1000.31650.30560.31270.31570.3056
1500.31060.29860.30970.31020.2985
2000.29970.28560.28980.29840.2855
Table 3. Average lengths of the confidence intervals for β in model 2 for different forms of the selection probability function p ( x ) and different values of sample size n under the nominal level of 0.95 .
Table 3. Average lengths of the confidence intervals for β in model 2 for different forms of the selection probability function p ( x ) and different values of sample size n under the nominal level of 0.95 .
QEL     NA
p ( x ) n IQELICQELNA ( β ^ ICQEL )NA ( β ^ CQ )NCQEL
p 1 ( x ) 1000.91130.92510.91030.90980.9252
1500.92410.93120.92980.92140.9312
2000.93020.93890.93150.92990.9388
p 2 ( x ) 1000.91220.92980.92880.91190.9299
1500.92140.93840.93810.92070.9385
2000.93060.94760.94510.93020.9477
p 3 ( x ) 1000.92440.92850.92420.92310.9288
1500.93490.93640.93480.93160.9364
2000.94030.94780.94050.93990.9479
Table 4. Emprical coverage probabilities of the intervals for β in model 1 for different forms of the selection probability function p ( x ) and different values of the sample sizes n under the nominal level of 0.95.
Table 4. Emprical coverage probabilities of the intervals for β in model 1 for different forms of the selection probability function p ( x ) and different values of the sample sizes n under the nominal level of 0.95.
QEL     NA
p ( x ) n IQELICQELNA ( β ^ ICQEL )NA ( β ^ CQ )NCQEL
p 1 ( x ) 1000.28790.29120.28760.28960.2911
1500.27980.28220.27880.27990.2822
2000.26140.26980.26120.26160.2697
p 2 ( x ) 1000.31240.30560.30870.31340.3055
1500.30450.30020.30120.30550.3002
2000.29780.29450.29680.29980.2944
p 3 ( x ) 1000.30150.30020.30110.30140.3003
1500.29780.29680.29710.29790.2967
2000.28680.28540.28610.28670.2853
Table 5. The confidence intervals and estimators of β based on IQEL, ICQEL, and NCQEL in the Engel data analysis.
Table 5. The confidence intervals and estimators of β based on IQEL, ICQEL, and NCQEL in the Engel data analysis.
Estimators  Confidence Intervals
β IQELICQELNCQELIQELICQELNCQEL
β 0 101.01101.02101.04(74.60, 112.21)(76.25, 106.46)(76.46, 106.51)
β 1 0.49930.49960.4995(0.4656, 0.5875)(0.4724, 0.5648)(0.4727, 0.5649)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Luo, S.; Zheng, Y.; Zhang, C.-y. Empirical Likelihood for Composite Quantile Regression Models with Missing Response Data. Symmetry 2024, 16, 1314. https://doi.org/10.3390/sym16101314

AMA Style

Luo S, Zheng Y, Zhang C-y. Empirical Likelihood for Composite Quantile Regression Models with Missing Response Data. Symmetry. 2024; 16(10):1314. https://doi.org/10.3390/sym16101314

Chicago/Turabian Style

Luo, Shuanghua, Yu Zheng, and Cheng-yi Zhang. 2024. "Empirical Likelihood for Composite Quantile Regression Models with Missing Response Data" Symmetry 16, no. 10: 1314. https://doi.org/10.3390/sym16101314

APA Style

Luo, S., Zheng, Y., & Zhang, C. -y. (2024). Empirical Likelihood for Composite Quantile Regression Models with Missing Response Data. Symmetry, 16(10), 1314. https://doi.org/10.3390/sym16101314

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop