Next Article in Journal
Jatropha Suppliers as Contributors to the Sustainability of the Production of Bioelectricity in Ecuador
Previous Article in Journal
Spatial Pattern of Carbon Sequestration and Urban Sustainability: Analysis of Land-Use and Carbon Emission in Guang’an, China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Sustainability in Chinese Higher Educational Institutions’ Social Science Research: A Performance Interface toward Efficiency

Department of Economics and Management, Southeast University, Nanjing 210096, China
*
Author to whom correspondence should be addressed.
Sustainability 2017, 9(11), 1952; https://doi.org/10.3390/su9111952
Submission received: 18 September 2017 / Revised: 23 October 2017 / Accepted: 25 October 2017 / Published: 26 October 2017

Abstract

:
Sustainability issues in higher educational institutions’ (HEIs) research, especially in the social science field, have attracted increasing levels of attention in higher education administration in recent decades as HEIs are confronted with a growing pressure worldwide to increase the efficiency of their research activities under a limited volume and relatively equitable division of public funding resources. This paper introduces a theoretical analysis framework based on a data envelopment analysis, separating the social science research process into a foundation stage and a construction stage, and then projecting each HEI into certain quadrants to form several clusters according to their overall and stage efficiencies and corresponding Malmquist Productivity Indices. Furthermore, the interfaces are formed in each cluster as feasible potential improvement directions. The empirical results in detail are demonstrated from a data set of Chinese HEIs in Jiangsu Province over the Twelfth Five-Year period as offering a closer approximation to the “China social science research best practice”.

1. Introduction

During the past 40 years there have been significant progresses in higher educational institutions (HEIs) as economic and social reforms deepen in China. Sustainable development is a strategic response to these nationwide changes in which HEIs not only increasingly act as the engine of economic and social reforms but also play a crucial role in shaping the competitiveness of countries, and we should promote the sustainability of HEIs through primary teaching and research activities [1] from the view of HEIs’ performance efficiencies. The implementation of the Action Plan for Invigorating Education (http://www.moe.edu.cn/), according to which a considerable amount of public funding has been assigned to HEIs, has raised the relevance of HEIs’ expenditures high in the agenda of public administration; besides this, local and central governments also emphasize education to improve regional attraction in the inner provinces. In recent years, the Ministry of Education of China has allocated funding to projects based on performance criteria in order to improve their research ability and accountability sustainably. This funding system based on performance is known as the base of university research activities, which is used to provide fair and transparent dialogue between governing bodies, funding providers, and HEIs. These abovementioned pragmatic factors stimulate HEIs to manage their resources—such as researchers and public project funding—more effectively to pursue sustainable development.
HEIs, especially the public ones, retain their certain key characteristics—“the lack of profit motive, goal diversity and uncertainty, diffuse decision-making, and poorly understood production technology” [2]. These attributes make it hard to provide an undisputed production function to express an HEI’s research process. In many cases, the immature marketization and incomplete real-time data system of social science research also lead to the basic problems inherent in the definition of a production function or the lack of exact quantitate data. One non-parametric frontier technique developed by Charnes, Cooper [3], called data envelopment analysis (DEA), has become a standard tool for evaluating efficiencies without exact production functions [4]. Previous studies have widely applied DEA to analyze the efficiency of HEIs in different countries or provinces, and can be classified into two broad branches. The first evaluates efficiencies by covering all activities provided by HEIs generally [5,6,7,8,9,10,11,12], whereas the second narrows evaluation down to a particular activity, teaching, or research [13,14,15,16].
This study on research activities concentrates on Jiangsu Province in order to reduce the impacts caused by different regional economic development and education support policies. Moreover, past studies mostly focus on nature science or integrate nature science and social science together with little concern about social science individually. It is therefore very important that this gap should be addressed. This paper aims at the social science field solely focusing on the HEIs with a relative comparable development level from the view of accomplishments in provincial and local government projects. Furthermore, in order to explore the internal linking activities, the impact of component inefficiency, and the overall dynamic development, we quote the multi-period two-stage DEA model proposed by Kao and Hwang [17] and MPIs (Malmquist Productivity Indices) [18] to evaluate performance via calculating the efficiencies and efficiency variances of different HEIs in different periods as well as stages; we then project the HEIs to construct clusters based on the respective overall and stage efficiencies, and form an interface inside each cluster to present an improvement direction for sustainable betterment.
The rest of the paper is organized as follows. Section 2—“The social science research context in HEIs”—is used to introduce the basic context and is illustrated by detailed research project data. Then, in Section 3, the theoretical framework and model are proposed to provide a description of the methodology. The special sample and the corresponding results are presented and discussed in Section 4. Finally, some conclusions and future research directions are drawn based on the preceding discussion.

2. The Social Science Research Context in HEIs

In general, an HEI should undertake two major tasks—teaching and research—to fulfill its economic and social responsibility and spread ethical values. In detail, the fundamental task of higher education is teaching, which grants students academic degrees in various majors, and then to help them find jobs; the next high-level task is research, which promotes knowledge innovation to realize scientific advancement and socioeconomic development [19]. With the rapid growth of enrolled students from 1,659,415 in 2011 to 1,715,749 in 2015 (http://www.stats.gov.cn), Jiangsu Province is regarded as one of the most developed provinces in China in terms of higher education. According to the data in the Humanities and Social Science Research Management System of the National Ordinary Institutions of Higher Learning (Jiangsu Province), at the end of 2015 there were about 157 HEIs, including 46 public regular HEIs, 60 public junior HEIs, and 51 Private and Chinese–foreign cooperatively-run HEIs. These HEIs have heterogeneous characteristics in terms of the proportion of teaching and research; funding support received from the central, provincial, and local government; and major setting. Most public HEIs are government-owned with financial support mainly from the national, provincial, and local government [20]. The funding of national and ministerial projects, provincial and local government projects, and others has an absolute volume growth and steady proportions at about 31%, 16%, and 51%, respectively (Table 1); at the same time, the according achievements like published works, published papers and research, and consulting reports, remain a relatively constant proportion, too (Table 2). In addition, since the funding of market projects should be distributed based on economic benefit instead of general research performance, we analyze social science research performance, concentrating on the implementation of the provincial and local government projects which mainly aim to improve research ability.
As elsewhere around the world, the science research production process is rather complex in China, and many studies put nature science and social science together without considering their essential differences [5,8]. Johnes and Li [21] applied DEA to analyze the relative research efficiency of 109 Chinese universities from 2003 to 2004 and the conclusions showed that the efficiencies were higher in comprehensive universities compared to specialist universities; the same results were also found for universities located in the coastal region compared with those in the western region. Liang, Li [22] developed a model which realistically considers the university production process, where outputs from the second stage can be fed back to the first stage, then applied this model to a set of Chinese universities. In this paper, we deconstruct the social science research process in HEIs into two-stage networks, taking the individual components and the data structure in the Humanities and Social Science Research Management System of the National Ordinary Institutions of Higher Learning (Jiangsu Province) into account, which can provide a mechanism where we can determine the inefficient stage exactly and prescribe specific improvement measures. In detail, the first stage is called the foundation stage, and the second is called the construction stage. The main purpose of the foundation stage is to get funding for more projects, while that of the construction stage is to create more achievements, which are also treated as the final results of the social science research. The two-stage research system is shown in Figure 1.

3. The Proposed Model

In order to promote sustainable research development, we should assess the research performances with a reasonable methodology and a set of factual performance indicators. This paper takes the provincial and local government projects as the target by which to judge the social science research performance of HEIs in order to provide a general intuitive apprehension and a reference for resource allocation.
Data envelopment analysis is a popular non-parametric linear programming methodology for estimating the relative efficiencies of a homogeneous set of DMUs (Decision-Making Units), based on the inputs that each DMU consumes and the outputs that it produces. The DEA model is now regarded as a popular method for solving multi-input (-output) decision-making problems under multi-criteria conditions [4].
In this section we demonstrate our proposed theoretical framework. First, we explain the basic theoretical framework and the overall analysis approach, and then we present the three steps in detail with models and specific purposes.

3.1. Theoretical Framework

The theoretical framework of the present paper is composed of two successive steps: Step 1 is efficiency measurement with DEA, and Step 2 is projecting the DMUs into the appropriate zones according to their stage efficiencies and then constructing interfaces of each zone. We first calculate the dynamic overall and stage efficiencies and MPIs with the multi-period two-stage model under the general research evaluation criteria. Then we formulate four quadrants (zones), namely the developing zone, the prudent zone, the innovative zone, and the progressive zone. Based on the calculation results, we project the DMUs into certain zones where some clusters may form and then construct an interface for each cluster as an improvement direction. Figure 2 displays the simplified theoretical framework.

3.2. Model

3.2.1. The Multi-Period Two-Stage DEA Model

DEA proposed by Charnes, Cooper [3] is regarded as an approach to determining the best performance and ranking all the DMUs according to certain criteria in the presence of multiple inputs and outputs. In general, assume that there are m inputs and s outputs for n DMUs (here, DMUs refers to HEIs) in the social science research process. Figure 3 shows the basic process in detail.
For the jth ( j = 1 , , n ) HEI, its inputs and outputs are denoted by X i j , i = 1 , , m and Y r j , r = 1 , , s , respectively. Similarly to previous studies which employed an input-oriented DEA model to analyze the performance of HEIs [22,23], we also regard that HEIs in Jiangsu Province have a larger degree of control over their inputs and adopt input orientation. Considering the time span only covering the Twelfth Five-Year period, we assume that the context is under constant returns to scale (CRS), and that the optimal efficiency for the kth HEI can be calculated through the basic linear programming formulation.
The basic input-oriented CCR (Charnes, Cooper, and Rhodes) model [3] is
E k = max r = 1 s μ r y r k     s . t . r = 1 s μ r y r j i = 1 m ν i x i j 0 i = 1 m ν i x i k = 1 μ r , ν i ε
where ν i and μ r are virtual multipliers and ε is a small non-Archimedean number imposed upon the two virtual multipliers to avoid ignoring any factors in the efficiencies measurement [24]. During the loop-computing process, where every HEI is free to choose its own input–output weights in order to maximize its relative performance efficiency, the results can provide an assessment of the relative efficiency of each HEI in a [0, 1] value, and the overall efficiency is
e o = r = 1 s u r y r j i = 1 m v i x i j .
The classic CCR model treats the production process as a black box without consideration of the internal process. With the help of specific systems in which the production process is featured as a multistage link, a lot of studies have been conducted; among these, some typical studies use a two-stage process to detect the realistic individual stage efficiencies and specific inefficient stages [22,23,25,26], which coincides with Section 2, and the basic process is shown in Figure 4. Similarly, for the jth ( j = 1 , , n ) HEI, its inputs, intermediate variables, and outputs are represented by X i j , i = 1 , , m , Z f j , f = 1 , , g , and Y r j , r = 1 , , s , respectively. The model employed here is a centralized DEA, which has an essence of the same factor with the same multiplier no matter how and where it is used [27,28].
The basic two-stage centralized model is
E k S = max r = 1 s u r y r k s . t . i = 1 m v i x i k = 1 r = 1 s u r y r j i = 1 m v i x i j 0 , f = 1 g w f z f j i = 1 m v i x i j 0 , r = 1 s u r y r j f = 1 g w r z f j 0 , u r , v i , w f ε , r = 1 , , s , i = 1 , , m , f = 1 , , g .
Model (2) calculates the overall efficiency of the two-stage process. The first inequality is used to ensure that the system efficiency is equal to or less than 1, and the second and third inequalities are adopted to guarantee that the two-stage efficiencies are equal to or less than 1. In addition, the first inequality constraint is redundant since it is the sum of the second and third inequality constraints. Assume that the above model (2) yields a unique solution; we then obtain the efficiencies for the first and second stages, namely
e o 1 = f = 1 g w f z f j i = 1 m v i x i j and e o 2 = r = 1 s u r y r j f = 1 g w f z f j .
The system efficiency is the product of e o 1 and e o 2 . The nonuniqueness value of each stage will be further addressed later.
In order to further probe the performance of HEIs, we explore the possibility of calculating the relative dynamic efficiencies among the HEIs in several continuous years, with the same production frontier. Comparing with general two-stage models, which measure the overall performance of a production system composed of two stages (processes) in a specified period, this paper takes the individual periods into account and adopts the multi-period two-stage DEA model developed by Kao and Hwang [17], which is able to measure the overall and period efficiencies at the same time with an assumption of constant technology. Suppose the panel data covers q periods and each DMUj endures the same two-stage production system in different years. Let X i j ( p ) , Z f j ( p ) , and Y r j ( p ) represent the inputs, intermediate variables, and outputs of DMUj in period p, respectively, and let the totals of DMUj of all periods be X i j = p = 1 q X i j ( p ) , Z f j = p = 1 q Z f j ( p ) , and Y r j = p = 1 q Y r j ( p ) .
For this purpose, the overall multi-period efficiencies analysis and according models are described as follows.
E k S = max r = 1 s u r Y r k s . t . i = 1 m v i X i k = 1
  • System constraints:
    r = 1 s u r Y r j i = 1 m v i X i j 0 , j = 1 , , n r = 1 s u r Y r j ( p ) i = 1 m v i X i j ( p ) 0 , p = 1 , , q , j = 1 , , n
  • Stage 1 constraints:
    f = 1 g w f Z f j i = 1 m v i X i j 0 , j = 1 , , n f = 1 g w f Z f j ( p ) i = 1 m v i X i j ( p ) 0 , p = 1 , , q , j = 1 , , n
  • Stage 2 constraints:
    r = 1 s u r Y r j f = 1 g w r Z f j 0 , j = 1 , , n r = 1 s u r Y r j ( p ) f = 1 g w r Z f j ( p ) 0 , p = 1 , , q , j = 1 , , n
    u r , v i , w f ε , r = 1 , , s , i = 1 , , m , f = 1 , , g
The system and stage constraints show that the aggregate outputs should be less than or equal to the aggregate inputs. Suppose we get the optimal value to model (4) uniquely, then the system efficiency ( E k S ) of q periods of DMUk is:
E k S = r = 1 s u r Y r j / i = 1 m v i X i j
Liang, Cook [28] and Kao and Hwang [17] developed a procedure for testing uniqueness using game theory concepts. It is well known that, generally, as time goes on the performance keeps metabolizing with a relative expansion of the national funding, so we assume a common basis that the year is prior to the stage. In detail, the efficiency of the first year is given the first priority, and the priority decreases year by year. Meanwhile Stage 2 is prior to Stage 1 after identifying the system efficiency of each year. This setting can partly offset the uncontrollable context and environmental influence and make efficiencies among different HEIs more comparable. According to this criterion, the efficiency of period 1 can be calculated while holding the system efficiency of E k S . That is,
E k S ( 1 ) = max r = 1 s u r Y r k ( 1 )    s . t . i = 1 m v i X i k ( 1 ) = 1 r = 1 s u r Y r k = E k S i = 1 m v i X i k f = 1 g w f Z f j ( p ) i = 1 m v i X i j ( p ) 0 , p = 1 , , q , j = 1 , , n r = 1 s u r Y r j ( p ) f = 1 g w r Z f j ( p ) 0 , p = 1 , , q , j = 1 , , n u r , v i , w f ε , r = 1 , , s , i = 1 , , m , f = 1 , , g .
The efficiency ( E k S ( 1 ) ) of DMUk is
E k S ( 1 ) = r = 1 s u r Y r j ( 1 ) / i = 1 m v i X r j ( 1 ) .
In a similar way, the efficiency of period 2 can be calculated while holding the efficiency of the system ( E k S ) and of period 1 ( E k S ( 1 ) ).
E k S ( 2 ) = max r = 1 s u r Y r k ( 2 ) s . t . i = 1 m v i X i k ( 2 ) = 1 r = 1 s u r Y r k = E k s i = 1 m v i X i k r = 1 s u r Y r j ( 1 ) = E k S ( 1 ) i = 1 m v i X r j ( 1 ) f = 1 g w f Z f j ( p ) i = 1 m v i X i j ( p ) 0 , p = 2 , , q , j = 1 , , n r = 1 s u r Y r j ( p ) f = 1 g w r Z f j ( p ) 0 , p = 2 , , q , j = 1 , , n u r , v i , w f ε , r = 1 , , s , i = 1 , , m , f = 1 , , g .
The efficiency of period 2 of DMUk ( E k S ( 2 ) ) is
E k S ( 2 ) = r = 1 s u r Y r j ( 2 ) / i = 1 m v i X r j ( 2 ) .
By the same token that the overall system efficiency and system efficiency of period 1 to period (t-1) are uniquely determined, each system efficiency of each period ( E k S ( t ) ) can be calculated.
E k S ( t ) = max r = 1 s u r Y r k ( t ) s . t . i = 1 m v i X i k ( t ) = 1     r = 1 s u r Y r k = E k s i = 1 m v i X i k
r = 1 s u r Y r j ( 1 ) = E k S ( 1 ) i = 1 m v i X r j ( 1 ) r = 1 s u r Y r j ( 2 ) = E k S ( 2 ) i = 1 m v i X r j ( 2 )       r = 1 s u r Y r j ( t 1 ) = E k S ( t 1 ) i = 1 m v i X r j ( t 1 ) f = 1 g w f Z f j ( p ) i = 1 m v i X i j ( p ) 0 , p = 2 , , q , j = 1 , , n r = 1 s u r Y r j ( p ) f = 1 g w r Z f j ( p ) 0 , p = 2 , , q , j = 1 , , n u r , v i , w f ε , r = 1 , , s , i = 1 , , m , f = 1 , , g .
Then the according stage efficiency can be obtained from the following model on the premise of Stage 2 prior to Stage 1 for each period [17,28]. Take the period t as an example.
E k Ι Ι ( t ) = max r = 1 s u r Y r k ( t ) s . t . i = 1 m v i Z f k ( t ) = 1 r = 1 s u r Y r k = E k s i = 1 m v i X i k r = 1 s u r Y r j ( t ) = E k s ( t ) i = 1 m v i X r j ( t ) f = 1 g w f Z f j ( p ) i = 1 m v i X i j ( p ) 0 , p = 1 , , q , j = 1 , , n r = 1 s u r Y r j ( p ) f = 1 g w r Z f j ( p ) 0 , p = 1 , , q , j = 1 , , n u r , v i , w f ε , r = 1 , , s , i = 1 , , m , f = 1 , , g .
The efficiency of Stage 2 of period t of DMUk ( E k Ι Ι ( t ) ) is
E k Ι Ι ( t ) = r = 1 s u r Y r j ( t ) / f = 1 g v i Z f j ( t ) .
Under the general relationship of system efficiency and stage efficiencies of a relational model ([17], the efficiency of Stage 1 of period t of DMUk ( E k Ι ( t ) ) is
E k Ι ( t ) = E k S ( t ) / E k Ι Ι ( t ) .

3.2.2. Malmquist Productivity Index

When panel data are available, the efficiencies of each period and stage can be uniquely calculated, and we can then trace the efficiency changes over time with the Malmquist Productivity Index (MPI). Similar to the multi-period efficiency calculation setting with all q periods used to construct the efficiency frontier, we measure the efficiencies and MPIs which have a property of circularity [29] with the global technology of all q periods [30]. Considering that a different frontier facet makes the efficiencies less comparable, we adopt the global common-weight MPIs [17,31,32,33] to conduct further analysis.
We can calculate the efficiency of any period from the above models, for example, E k S ( t ) , E k S ( h ) , and the according MPI between periods t and h is as follows:
M P I k S ( t , h ) = E k S ( h ) / E k S ( t ) .
By the same token, changes in performance for Stage 1 (and Stage 2) between period t and h can be measured from the ratio of E k Ι ( h ) (or E k Ι Ι ( h ) ) to E k Ι ( t ) (or E k Ι Ι ( t ) ).
M P I k Ι ( t , h ) = E k Ι ( h ) / E k Ι ( t )   ( M P I k Ι Ι ( t , h ) = E k Ι Ι ( h ) / E k Ι Ι ( t ) ) .
It is obvious that MPI values higher than 1 indicate productivity improvements, whereas low values less than 1 correspond to productivity decay in the given period.

3.2.3. Clustering the DMUs into Four Quadrants and Constructing Interfaces

The aforementioned models are used to calculate the system and stage efficiencies in each year, and MPIs of certain periods, of each DMU with consideration of the decision-maker's preferences. The position of each DMU is dependent upon its stage efficiencies in a certain year and MPIs of two years. Therefore, we can project each DMU into a specific quadrant in light of its stage efficiencies and get a dynamic piecewise linear model according to MPIs in this period. Based on the two stage efficiencies, we divide the two-dimensional plane into four quadrants with 0.5 (just an example) as the boundary, namely, the developing zone, the prudent zone, the innovative zone, and the progressive zone, as shown in Figure 5.
In detail: The developing zone (Ι) refers to HEIs that have low efficiencies in Stage 1 and Stage 2, and these HEIs must acquire more project funding and produce more achievements to reach breakthrough. The prudent zone (II) includes HEIs that have high efficiency in Stage 1 and low efficiency in Stage 2. These HEIs are mature organizations with relatively little need for applying for projects and seeking funding support, but they need to promote more achievements. The innovative zone (III) consists of HEIs with low efficiency in Stage 1 and high efficiency in Stage 2. These HEIs have potential to produce achievements, but may need more project investment to strengthen Stage 1. Finally, the progressive zone (IV) refers to HEIs with high efficiency in both Stage 1 and Stage 2, and they have an overall relatively perfect performance.

4. Application Analysis and Results

4.1. Sample

From Section 2, we can get a general understanding of HEIs in Jiangsu Province during the Twelfth Five-Year period. In this section, we probe into the performance of 18 representative homogeneous HEIs, all of which are public comprehensive universities with relatively high research performance in Jiangsu Province. This study provides an advantage especially in offering a closer approximation to “China social science research best practice” due to the prominent research ability of Jiangsu Province in China. The primary data source for this research is the Humanities and Social Science Research Management System of the National Ordinary Institutions of Higher Learning (Jiangsu Province), whose data are provided by each HEI and verified by the Education Department of Jiangsu Province annually. As mentioned earlier in Section 2, we choose the data concentrating on provincial and local government research projects. Considering the production and technology level and feasible unique solutions for some lower priority years, this study just focuses on the most recent three years of the Twelfth Five-Year period, so the data used in this part consists of a panel of 18 HEIs’ annual data from 2013 to 2015.

4.2. Variables and Data

In essence, the performance measurement depends on the given states of the social science research and the choice of the variables. Different approaches to determining the input and output variables for measuring the efficiency of HEIs have been discussed in the literature [9,34]. According to the basic development guidelines of higher education in China, every year, HEIs apply for projects, and only some of them can be approved. Once approval is given, the HEI will get project funding or subsidies and is responsible for producing some creative achievements based on approved projects. The inputs, intermediate variables, and outputs are all closely related to the research process, and capable of representing the consumption and achievement. This paper is a synthetical and deconstructive attempt, to the best of our practical experience, theoretical knowledge, and the most effective use of existing data, striving to truthfully reflect the research process. In the foundation stage, the inputs—staff, expenditure, and equipment—are applied to produce intermediate products [35], i.e., the newly approved projects and the completed projects for the year. These intermediate products are the critical elements that the HEIs’ research relies on in order to produce the final outputs, i.e., published works, published papers and research, and consulting reports [15,36].
Considering the practical situations, we only choose people with a graduate degree or above to represent the input for the provision of the research work, since they more readily engage in research collaboration and co-authorship. The total expenditures over the year act as basic resources for science research. Meanwhile, the research equipment is shared by many production activities and hardly allotted at a reasonable use rate in terms of different activities, so we remove this variable. In view of the research and consulting reports having a certain phase-out rate in the process of application, this paper converts it with a utilization rate [36]. In addition, the weight coefficients of the published works are almost all equal to zero when we initially compute the model with those variables, which shows that the published works as composite achievements make no difference to the simulation results, so we delete this variable in the following section.
Consulting the general rules of variable choice [37], some existing relative studies [9,19,38,39], and the abovementioned analysis, this paper adopts two outputs, two intermediate variables and two inputs to support the multi-period two-stage DEA model. The inputs (X1, X2), intermediate variables (Z1, Z2), outputs (Y1, Y2), and the summary statistics of them for the 18 HEIs over the period from 2013 to 2015 are shown in Table 3.
Table 4 shows the data aggregation of inputs, intermediate variables, and outputs of the 18 HEIs in the three years (2013–2015).

4.3. Overall Efficiency and Performance Interface

A preliminary investigation can be made from the data contained in Table 4, and the overall research performance interfaces among universities can be easily captured and demonstrated. The overall system efficiencies and two stage efficiencies of the 18 HEIs can be calculated via Models (4) and (5); the results are shown in the right part of Table 5 with a comparison of “Basic two-stage centralized model” via Model (2) [17]. Compared with the basic two-stage centralized model, the Multi-period model takes the performance of each year into consideration, and the according results are shown in the right part of Table 5. From the left parts of Table 5, it is obvious that only one university is efficient in an overall sense, while two universities are efficient in Stage 1, and four in Stage 2. The efficiency scores in the right part are relatively smaller than those in the left part and all the three-year system and stage efficiencies are less than 1 due to stronger constraints, while the rankings of the 18 universities under the two models change slightly. In an overall sense, the efficiency of Stage 1 is a little bit higher than that of Stage 2, as shown in the last two columns of Table 5.
We project the DMUs according to their stage efficiencies shown in Table 5 and form several clusters; the corresponding interface is then constructed. These clusters and the resulting distributions are shown in Figure 6, where the two stage efficiencies determine each HEI’s location, which is an overall static performance indicator. The node colors here show the different clusters in terms of the overall stage efficiencies, taking 0.5 as an efficiency boundary and labeled by the red dotted lines. In general, YZU and NTU (located in the prudent zone) have better practices than others in Stage 1, while SCU (located in the innovative zone) surpasses others in Stage 2. The blue curve identifies an interface of these HEIs in an overall sense, and it can provide a potential direction for performance improvement.

4.4. Yearly Efficiencies and Performance Interfaces

A detailed investigation can be made from the yearly data in a similar way to Section 4.3. Table 6 shows the detailed system and stage efficiencies of each DMU obtained from Models (4)–(14). The values in the last three rows of Table 6 are the average efficiencies and MPIs of the 18 HEIs for the three years. The average yearly system efficiencies—0.0823 for 2013, 0.0835 for 2014, and 0.0.3515 for 2015—indicate that year 2015 has the best performance, even though we set this year as the least priority. There are four stage best-practices in this three-year period, i.e., SCU in 2015, CUMT in 2013, JSNU in 2015, and YZU in 2014, and they also rank at the top in the Table 5. The efficiencies in Table 6 show the sources of inefficiency for each HEI in the three-year period. For example, YZU, as the best performance HEI, has an overall efficiency of 0.3633, as shown in the right part of Table 5. Table 6 indicates that the inefficient part (1–0.3633) is caused by its relatively unsatisfactory performances in 2013 (with an efficiency score of 0.3519) and 2014 (with an efficiency score of 0.2864), which are the result of unsatisfactory performances in different stages.
In order to assess the changes of each DMU over time, the detailed results for the Malmquist Productivity Index through models (15)–(16) are reported in Table 6, exhibited with all components, including system and process MPIs of each DMU in a certain intertemporal period, and the neighboring and start–stop efficiency comparisons. The average system MPI from 2013 to 2015—7.0417—indicates that the general social science research performance of the 18 HEIs has improved substantially in this period. The average system MPIs for 2013–2014 (1.2983) and 2014–2015 (5.3466) further indicate that this improvement is due to the progress in these two segmented intervals.
Similarly, we project every DMU into a specific quadrant according to its yearly stage efficiencies using the data of Table 6. After connecting them in time order, the efficiency changes can be traced by a piecewise line. Based on the yearly stage efficiency locations, we divide these 18 HEIs into four clusters as shown in Figure 7. HEIs in cluster A have a relatively high efficiency in Stage 2 but low in Stage 1, while HEIs in cluster B are completely on the contrary with a relatively high efficiency in Stage 1 but low in Stage 2. The stage efficiencies of HEIs in cluster C show a wavy shape, and the HEIs in cluster D have rapid progress. For example, the isolated HHU hovers between the developing zone and the innovative zone by a main pull of efficiency variance in Stage 2, and composes the cluster A on its own. JNU, NJUPT, JUST, SEU, NJUST, and UJS construct cluster B, hovering between the developing zone and the prudent zone, by main pulls of efficiency variance in Stage 1. These HEIs have a common trait in that they both have relatively low efficiencies in two stages and make little progress in this period. JSNU, CUMT, YZU, NJUE, NUAA, and NJU construct cluster C with a trend of radical shifting through different zones by main pulls of efficiency variance in two stages. SCU, NJNU, NJFU, USTS, and NTU form cluster D, moving from other zones to the progressive zone directly by obvious pulls of the two stages.
We can construct a performance interface for each cluster according to its DMUs’ footholds, shown by the green curves in Figure 7, which indicate the improvement direction of a better sustainable performance, but not necessarily the efficient zones. A cluster may or may not involve an efficient DMU but at each cluster there is an interface formed by several DMUs that are the better performers compared with others. The interface shows the best practices that are possible for each inefficient DMU to follow through stage improvements. The DMUs far away from the interface are more inefficient, but it costs too much effort and time to push them toward the interface. Besides this, these interfaces can provide important information for both the HEI itself and the related education administrative departments. For example, the HEI in cluster A should do its best to step forward in the foundation stage and be endowed with more funding support or projects in order to jump into the progressive zone. As to the HEIs in cluster B, in order to get closer to the progressive zone, they should strive to move forward in the construction stage and be given more innovation guides to make full use of their existing resources. The HEIs in cluster C have a great efficiency variance with footprints of three quadrants, and ought to be supported with persistent policies in order to develop their social science research efficiently and directly settle in the progressive zone. The HEIs in cluster D show perfect efficiency trends which have great improvements and can be set as pilots for others.

5. Concluding Remarks

For the sustainable promotion of higher education, governments have been spending large amounts of resources through project support [16], and a great number of studies have been conducted in order to assess the utilization efficiency of these resources. The main purpose of this paper is to address a gap in the emerging field of sustainability development in social science research by HEIs in China, through taking into account the internal structure and dynamic efficiency variance to detect existent relatively inefficient stages during the Twelfth Five-Year period. Since HEIs in Jiangsu Province bear a large degree of responsibility in social science research and take the lead in reasonably allocating public funding, this study provides a closer approximation to the “China social science research best practice”. This paper evaluates efficiencies in a representative sample of universities in Jiangsu Province, and, to assess the variance of the global common-weight MPIs, we project these HEIs into different clusters and construct efficiency interfaces. Meanwhile, this paper also expands the uniqueness solutions of the multi-period two-stage DEA model [17] and demonstrates this in the application part, taking the periods and stages into account with different priorities. For HEIs, this analysis will enlighten them in the rational disposal of higher educational resources in order to realize sustainable development. Besides this, the related administrative departments and practitioners can adopt the efficiency evaluation and clustering tool to group all HEIs as well, and then provide a specific improvement direction for each group and cooperation among groups according to the constructed interfaces. Based on the projection quadrants and interface locations, an HEI itself can determine the internal deficiencies and inter-cluster improvement path and strive for sustainable development.
The present analysis is subject to some limitations. First, the results present in this study are based solely on the data in the Humanities and Social Science Research Management System of the National Ordinary Institutions of Higher Learning (Jiangsu Province), and, therefore, the quality of statistical information may affect the reliability of the application results. Nevertheless, the logging and reviewing data are guided by the Education Department of Jiangsu Province, which reduces the risk of poor data quality. Second, the variables used here are confined to the database, and there may be other variables that could better encapsulate the research process which are, however, not presented in the body of the Humanities and Social Science Research Management System of the National Ordinary Institutions of Higher Learning (Jiangsu Province), which is the only database recording the realistic development of HEIs in Jiangsu Province by taking into account the time span of the analysis and all the HEIs involved. Third, our efficiency and interface analysis solely focus on provincial and local government research project accomplishment to reflect social research ability, so the application results and the improvement measures are restrictive but pertinent.
We propose two directions on the basis of these remarks. One possibility is to consider other variables which may be related to the research process; the quality of them may enhance credibility but should be supported by first-hand data provided by each HEI. The extension of this research on a national scale could also promote the sustainable development of social science and provide feasible access for the HEIs.

Acknowledgments

The authors thank Cherng George Ding and two anonymous reviewers in virtue of 77th Annual of Management, Atlanta, 2017. Their constructive and insightful comments have improved the quality of this paper significantly. We gratefully acknowledge financial support from the National Natural Science Foundation of China (Nos. 71173036, 71473037), Research Fund for the Doctoral Program of Research Innovation of Jiangsu Province (No. KYLX16_0173).

Author Contributions

Xianmei Wang and Hanhui Hu built the conceptual framework, the according DEA Model, and performed the research together. Xianmei Wang studied the target institutes, analyzed the data, and wrote the manuscript. Xianmei Wang revised the manuscript under the suggestion of Hanhui Hu. All authors have read and approved the final manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Evangelinos, K.I.; Jones, N.; Panoriou, E.M. Challenges and opportunities for sustainability in regional universities: A case study in Mytilene, Greece. J. Clean. Prod. 2009, 17, 1154–1161. [Google Scholar] [CrossRef]
  2. Lindsay, A.W. Institutional performance in higher education: The efficiency dimension. Rev. Educ. Res. 1982, 52, 175–199. [Google Scholar] [CrossRef]
  3. Charnes, A.; Cooper, W.W.; Rhodes, E. Measuring the efficiency of decision making units. Eur. J. Oper. Res. 1978, 2, 429–444. [Google Scholar] [CrossRef]
  4. Cook, W.D.; Seiford, L.M. Data envelopment analysis (DEA)–Thirty years on. Eur. J. Oper. Res. 2009, 192, 1–17. [Google Scholar] [CrossRef]
  5. Avkiran, N.K. Investigating technical and scale efficiencies of Australian universities through data envelopment analysis. Socio-Econ. Plan. Sci. 2001, 35, 57–80. [Google Scholar] [CrossRef]
  6. Athanassopoulos, A.D.; Shale, E. Assessing the comparative efficiency of higher education institutions in the UK by the means of data envelopment analysis. Educ. Econ. 1997, 5, 117–134. [Google Scholar] [CrossRef]
  7. Johnes, J. Data envelopment analysis and its application to the measurement of efficiency in higher education. Econ. Educ. Rev. 2006, 25, 273–288. [Google Scholar] [CrossRef]
  8. Abbott, M.; Doucouliagos, C. The efficiency of Australian universities: A data envelopment analysis. Econ. Educ. Rev. 2003, 22, 89–97. [Google Scholar] [CrossRef]
  9. Thanassoulis, E.; Kortelainen, M.; Johnes, G.; Johnes, J. Costs and efficiency of higher education institutions in England: A DEA analysis. J. Oper. Res. Soc. 2011, 62, 1282–1297. [Google Scholar] [CrossRef] [Green Version]
  10. Singh, S.; Ranjan, P. Efficiency analysis of non-homogeneous parallel sub-unit systems for the performance measurement of higher education. Ann. Oper. Res. 2017, 1–26. [Google Scholar] [CrossRef]
  11. Wolszczak-Derlacz, J.; Parteka, A. Efficiency of European public higher education institutions: A two-stage multicountry approach. Scientometrics 2011, 89, 887–917. [Google Scholar] [CrossRef] [PubMed]
  12. Andersson, C.; Antelius, J.; Månsson, J.; Sund, K. Technical efficiency and productivity for higher education institutions in Sweden. Scand. J. Educ. Res. 2017, 61, 1–19. [Google Scholar] [CrossRef]
  13. Thanassoulis, E.; Dey, P.K.; Petridis, K.; Goniadis, I.; Georgiou, A.C. Evaluating higher education teaching performance using combined analytic hierarchy process and data envelopment analysis. J. Oper. Res. Soc. 2017, 68, 431–445. [Google Scholar] [CrossRef]
  14. Munoz, D.A. Assessing the research efficiency of higher education institutions in Chile: A data envelopment analysis approach. Int. J. Educ. Manag. 2016, 30, 809–825. [Google Scholar] [CrossRef]
  15. Lee, B.L.; Worthington, A.C. A network DEA quantity and quality-orientated production model: An application to Australian university research services. Omega 2016, 60, 26–33. [Google Scholar] [CrossRef]
  16. Sagarra, M.; Molinero, C.M.; Agasisti, T. Exploring the Efficiency of Mexican Universities: Integrating Data Envelopment Analysis and Multidimensional Scaling. Omega 2014, 55, 1324–1325. [Google Scholar] [CrossRef]
  17. Kao, C.; Hwang, S.-N. Multi-period efficiency and Malmquist productivity index in two-stage production systems. Eur. J. Oper. Res. 2014, 232, 512–521. [Google Scholar] [CrossRef]
  18. Caves, D.W.; Christensen, L.R.; Diewert, W.E. The Economic Theory of Index Numbers and the Measurement of Input, Output, and Productivity. Econometrica 1982, 50, 1393–1414. [Google Scholar] [CrossRef]
  19. Beasley, J.E. Determining teaching and research efficiencies. J. Oper. Res. Soc. 1995, 46, 441–452. [Google Scholar] [CrossRef]
  20. Lee, B.L. Efficiency of research performance of Australian Universities: A reappraisal using a bootstrap truncated regression approach. Econ. Anal. Policy 2011, 41, 195–203. [Google Scholar] [CrossRef]
  21. Johnes, J.; Li, Y. Measuring the research performance of Chinese higher education institutions using data envelopment analysis. China Econ. Rev. 2008, 19, 679–696. [Google Scholar] [CrossRef]
  22. Liang, L.; Li, Z.-Q.; Cook, W.D.; Zhu, J. Data envelopment analysis efficiency in two-stage networks with feedback. IIE Trans. 2011, 43, 309–322. [Google Scholar] [CrossRef]
  23. Kao, C.; Hung, H.-T. Efficiency analysis of university departments: An empirical study. Omega 2008, 36, 653–664. [Google Scholar] [CrossRef]
  24. Charnes, A.; Cooper, W.W. Preface to topics in data envelopment analysis. Ann. Oper. Res. 1984, 2, 59–94. [Google Scholar] [CrossRef]
  25. Chen, Y.; Cook, W.D.; Li, N.; Zhu, J. Additive efficiency decomposition in two-stage DEA. Eur. J. Oper. Res. 2009, 196, 1170–1176. [Google Scholar] [CrossRef]
  26. Seiford, L.M.; Zhu, J. Profitability and marketability of the top 55 US commercial banks. Manag. Sci. 1999, 45, 1270–1288. [Google Scholar] [CrossRef]
  27. Kao, C.; Hwang, S.-N. Efficiency decomposition in two-stage data envelopment analysis: An application to non-life insurance companies in Taiwan. Eur. J. Oper. Res. 2008, 185, 418–429. [Google Scholar] [CrossRef]
  28. Liang, L.; Cook, W.D.; Zhu, J. DEA models for two-stage processes: Game approach and efficiency decomposition. Nav. Res. Logist. 2008, 55, 643–653. [Google Scholar] [CrossRef]
  29. Pastor, J.T.; Lovell, C.K. Circularity of the Malmquist productivity index. Econ. Theory 2007, 33, 591–599. [Google Scholar] [CrossRef]
  30. Pastor, J.T.; Lovell, C.K. A global Malmquist productivity index. Econ. Lett. 2005, 88, 266–271. [Google Scholar] [CrossRef]
  31. Kao, C. Malmquist productivity index based on common-weights DEA: The case of Taiwan forests after reorganization. Omega 2010, 38, 484–491. [Google Scholar] [CrossRef]
  32. Kao, C.; Hung, H.-T. Data envelopment analysis with common weights: The compromise solution approach. J. Oper. Res. Soc. 2005, 56, 1196–1203. [Google Scholar] [CrossRef]
  33. Sueyoshi, T.; Aoki, S. A use of a nonparametric statistic for DEA frontier shift: The Kruskal and Wallis rank test. Omega 2001, 29, 1–18. [Google Scholar] [CrossRef]
  34. Johnes, J. Measuring teaching efficiency in higher education: An application of data envelopment analysis to economics graduates from UK Universities 1993. Eur. J. Oper. Res. 2006, 174, 443–456. [Google Scholar] [CrossRef]
  35. Saaty, T.L.; Vargas, L.G. Models, Methods, Concepts & Applications of the Analytic Hierarchy Process; Springer: New York, NY, USA, 2012. [Google Scholar]
  36. Wang, X.; Hu, H. Sustainable Evaluation of Social Science Research in Higher Education Institutions Based on Data Envelopment Analysis. Sustainability 2017, 9, 644. [Google Scholar] [CrossRef]
  37. Cooper, W.; Seiford, L.; Tone, K.; Zhu, J. Some models and measures for evaluating performances with DEA: past accomplishments and future prospects. J. Prod. Anal. 2007, 28, 151–163. [Google Scholar] [CrossRef]
  38. Avkiran, N.K. Opening the black box of efficiency analysis: An illustration with UAE banks. Omega 2009, 37, 930–941. [Google Scholar] [CrossRef]
  39. Zhu, J. Quantitative Models for Performance Evaluation and Benchmarking: Data Envelopment Analysis with Spreadsheets; Springer: Berlin, Germany, 2014; Volume 213. [Google Scholar]
Figure 1. A two-stage research system.
Figure 1. A two-stage research system.
Sustainability 09 01952 g001
Figure 2. The simplified theoretical framework. MPIs: Malmquist Productivity Indices; DMUs: Decision-Making Units; DEA: Data Envelopment Analysis.
Figure 2. The simplified theoretical framework. MPIs: Malmquist Productivity Indices; DMUs: Decision-Making Units; DEA: Data Envelopment Analysis.
Sustainability 09 01952 g002
Figure 3. The basic process. DMUj denotes the jth HEI; Xij denotes the ith input of DMUj; Yrj denotes the rth output of DMUj.
Figure 3. The basic process. DMUj denotes the jth HEI; Xij denotes the ith input of DMUj; Yrj denotes the rth output of DMUj.
Sustainability 09 01952 g003
Figure 4. The basic two-stage process. Zfj denotes the fth intermediate variable of DMUj.
Figure 4. The basic two-stage process. Zfj denotes the fth intermediate variable of DMUj.
Sustainability 09 01952 g004
Figure 5. The four performance quadrants.
Figure 5. The four performance quadrants.
Sustainability 09 01952 g005
Figure 6. The overall performance distribution and their interface.
Figure 6. The overall performance distribution and their interface.
Sustainability 09 01952 g006
Figure 7. The performance interfaces of each cluster.
Figure 7. The performance interfaces of each cluster.
Sustainability 09 01952 g007
Table 1. Statement of different project sources of funding of higher educational institutions (HEIs) in Jiangsu, 2011–2015 (Hundreds Yuan).
Table 1. Statement of different project sources of funding of higher educational institutions (HEIs) in Jiangsu, 2011–2015 (Hundreds Yuan).
YearTotalNational and Ministerial ProjectsProvincial and Local Government ProjectsOthers
20113,041,486.3942,132.2442,252.751,657,101.34
%100.00%30.98%14.54%54.48%
20123,563,611.51,073,472548,751.561,941,387.93
%100.00%30.13%15.40%54.48%
20134,116,724.31,325,320.4637,562.352,153,841.59
%100.00%32.20%15.49%52.31%
20144,325,654.781,359,643.5769,491.252,196,519.99
%100.00%31.43%17.79%50.78%
20154,334,898.21,397,557.4874,739.42,062,601.4
%100.00%32.24%20.18%47.58%
Average3,876,475.021,219,625.10654,559.462,002,290.45
%100.00%31.46%16.89%51.65%
Data source: Humanities and Social Science Research Management System of the National Ordinary Institutions of Higher Learning (Jiangsu Province) (similarly hereinafter).
Table 2. Statement of different sources of achievements of HEIs in Jiangsu, 2011–2015.
Table 2. Statement of different sources of achievements of HEIs in Jiangsu, 2011–2015.
YearTypesTotalNational and Ministerial ProjectsProvincial and Local Government ProjectsOthers
2011Published Works646211245190
%100.00%32.67%37.92%29.41%
Published Papers10184328836763220
%100.00%32.28%36.10%31.62%
Research and consulting reports2582365170
%100.00%8.92%25.19%65.89%
2012Published Works808251292265
%100.00%31.06%36.14%32.80%
Published Papers12662382246524188
%100.00%30.18%36.74%33.07%
Research and consulting reports52340132351
%100.00%7.65%25.24%67.11%
2013Published Works842340261241
%100.00%40.38%31.00%28.62%
Published Papers14,341448252014658
%100.00%31.25%36.27%32.48%
Research and consulting reports63848222368
%100.00%7.52%34.80%57.69%
2014Published Works948382337229
%100.00%40.30%35.55%24.16%
Published Papers16,107521264914404
%100.00%32.35%40.30%27.34%
Research and consulting reports101482321611
%100.00%8.09%31.65%60.25%
2015Published Works644292217135
%100.00%45.34%33.70%20.97%
Published Papers16,922496273804580
%100.00%29.32%43.62%27.07%
Research and consulting reports118152368761
%100.00%4.40%31.16%64.44%
AveragePublished Works777.6295.2270.4212
%100%37.96%34.77%27.26%
Published Papers14,043.24353.254804210
%100%31.00%39.02%29.98%
Research and consulting reports722.849221.6452
%100%6.78%30.66%62.56%
Table 3. Some statistics for the 18 HEIs in Jiangsu Province.
Table 3. Some statistics for the 18 HEIs in Jiangsu Province.
VariablesDefinitionsMeanStd.Dev.MinMax
Y1Published papers110.7466.8137.00384.00
Y2Adopted Research and consulting reports11.4415.731.0080.00
Z1The funding of newly approved projects (Million Yuan)74.0732.6813.00149.00
Z2The amount of accomplished projects20.6933.360.76180.39
X1Total researchers (graduate degrees or above)18.6943.980.2074.90
X2Total expenditure in the current year (Million Yuan)17.5428.610.68169.00
Table 4. Three-year data aggregation of inputs, intermediate variables, and outputs of the 18 HEIs.
Table 4. Three-year data aggregation of inputs, intermediate variables, and outputs of the 18 HEIs.
HEIY1Y2Z1 (Million Yuan)Z2X1X2 (Million Yuan)
NJU23974224153.8160.50118.71
SCU8484931366.9523.7066.95
SEU39469382184.15139.90154.48
NUAA2484410725.7332.1015.84
NJUST14897535.8740.4027.85
JUST188317217.3675.1013.74
CUMT1973427728.9249.6025.17
NJUPT2441523323.05106.7024.34
HHU665194234299.3294.90259.40
JNU3681926730.71143.0022.83
NJFU166613625.547.1013.16
UJS178613420.4243.2018.56
NTU471834630.943.6025.99
NJNU3731525462.1339.1072.99
JSNU4323224636.9095.1026.92
NJUE254815436.8934.7029.13
USTS3422828923.8818.7021.99
YZU225515714.951.708.96
Average332.2234.33222.2262.0856.0656.61
Table 5. Three-year efficiencies for 18 HEIs in Jiangsu.
Table 5. Three-year efficiencies for 18 HEIs in Jiangsu.
HEIBasic Two-Stage Centralized ModelMulti-Period Model
ESEΙEΙΙESEΙEΙΙ
NJU0.1901 [17]0.67590.28130.0360 [16]0.44280.0814
SCU0.5193 [8]0.51931.00000.1314 [4]0.17100.7684
SEU0.1353 [18]0.61440.22020.0251 [18]0.40260.0623
NUAA0.8372 [3]0.83721.00000.1518 [3]0.58850.2579
NJUST0.2142 [15]0.60750.35260.0317 [17]0.45010.0705
JUST0.5449 [7]0.74520.73120.0750 [9]0.48200.1556
CUMT0.4116 [10]0.59220.69500.0739 [10]0.46880.1576
NJUPT0.4046 [11]0.54920.73670.0562 [11]0.37080.1515
HHU0.2423 [14]0.63920.37900.0437 [14]0.39130.1116
JNU0.6425 [6]0.76690.83770.0869 [8]0.49260.1765
NJFU0.5023 [9]1.00000.50230.0992 [6]0.28130.3525
UJS0.3820 [12]0.58930.64830.0562 [11]0.41800.1343
NTU0.9885 [2]0.99570.99280.2989 [2]0.70840.4220
NJNU0.2036 [16]0.42170.48280.0404 [15]0.09900.4079
JSNU0.6677 [4]0.73130.91310.0915 [7]0.50850.1800
NJUE0.3472 [13]0.62910.55200.0523 [13]0.46750.1119
USTS0.6592 [5]0.65921.00000.0997 [5]0.32810.3038
YZU1.0000 [1]1.00001.00000.3633 [1]0.82140.4424
Average0.49400.69850.68470.10070.43850.2416
Table 6. Period efficiencies and MPIs for 18 HEIs in Jiangsu.
Table 6. Period efficiencies and MPIs for 18 HEIs in Jiangsu.
HEIYearPeriod [t-h]PeriodProcess ΙProcess ΙΙ
ES(p)MPIS(p)EΙ(p)MPIΙ(p)EΙΙ(p)MPIΙΙ(p)
NJU2013[13-14]0.02811.04780.69930.42710.04032.4531
2014[14-15]0.02955.54930.29871.04250.09875.3231
2015[13-15]0.16375.81440.31140.44530.525613.0580
SCU2013[13-14]0.06292.04600.10131.95870.62081.0446
2014[14-15]0.12874.62650.19852.99980.64851.5420
2015[13-15]0.59549.46610.59535.87571.00001.6108
SEU2013[13-14]0.01951.03130.29101.73320.06703.3808
2014[14-15]0.02013.88940.50430.72940.22640.9385
2015[13-15]0.07824.01120.36781.26420.21253.1729
NUAA2013[13-14]0.12151.28780.71240.67910.17061.8962
2014[14-15]0.15652.30380.48381.22850.32341.8753
2015[13-15]0.36052.96670.59430.83430.60653.5559
NJUST2013[13-14]0.01851.99180.48950.61980.03783.2139
2014[14-15]0.03691.69650.30342.39490.12150.7084
2015[13-15]0.06253.37910.72661.48420.08612.2769
JUST2013[13-14]0.05421.04550.32331.90790.16750.5480
2014[14-15]0.05664.08710.61690.96250.09184.2476
2015[13-15]0.23144.27290.59381.83640.38992.3277
CUMT2013[13-14]0.09960.21261.00000.17230.09961.2339
2014[14-15]0.02123.83720.17235.79890.12296.6145
2015[13-15]0.08130.81580.99910.99910.81328.1616
NJUPT2013[13-14]0.05270.49320.39460.81170.13350.6076
2014[14-15]0.026010.82940.32032.18400.08114.9577
2015[13-15]0.28155.34140.69961.77280.40233.0124
HHU2013[13-14]0.02002.84150.038411.79040.52080.2410
2014[14-15]0.05696.75140.45290.87890.12557.6813
2015[13-15]0.383819.18420.398110.36260.96421.8512
JNU2013[13-14]0.07770.77260.42431.36370.18300.5666
2014[14-15]0.06003.99290.57870.84100.10374.7476
2015[13-15]0.23953.08480.48671.14690.49222.6899
NJFU2013[13-14]0.06221.61640.25631.28150.24251.2613
2014[14-15]0.10054.51340.32852.55590.30591.7668
2015[13-15]0.45357.29530.83963.27540.54052.2284
UJS2013[13-14]0.02002.39410.42770.90420.07071.7532
2014[14-15]0.04795.68530.38671.66340.12393.4190
2015[13-15]0.272413.61130.64331.50400.42365.9941
NTU2013[13-14]0.26300.84270.75430.69290.34861.2163
2014[14-15]0.22162.69480.52261.85420.42401.4533
2015[13-15]0.59722.27100.96901.28470.61621.7676
NJNU2013[13-14]0.02741.57130.10650.83750.25701.8763
2014[14-15]0.04309.91490.08927.12960.48231.3908
2015[13-15]0.426315.57940.63575.97070.67082.6096
JSNU2013[13-14]0.03971.56060.57690.10770.068814.4929
2014[14-15]0.061911.56160.062111.52120.99651.0035
2015[13-15]0.715718.04350.71571.24061.000014.5433
NJUE2013[13-14]0.07500.65350.13921.88550.53890.3466
2014[14-15]0.04908.33790.26253.80460.18682.1910
2015[13-15]0.40885.44890.99887.17360.40920.7594
USTS2013[13-14]0.08721.14640.24851.56270.35100.7336
2014[14-15]0.10003.93310.38841.42790.25752.7546
2015[13-15]0.39334.50880.55462.23130.70922.0207
YZU2013[13-14]0.35190.81400.49472.02140.71130.4027
2014[14-15]0.28642.03471.00000.99780.28642.0383
2015[13-15]0.58281.65630.99782.01690.58390.8209
Average2013[13-14]0.08231.29830.41551.70870.25722.0705
2014[14-15]0.08355.34660.38722.77860.27823.0363
2015[13-15]0.35157.04170.67372.81770.58034.0256

Share and Cite

MDPI and ACS Style

Wang, X.; Hu, H. Sustainability in Chinese Higher Educational Institutions’ Social Science Research: A Performance Interface toward Efficiency. Sustainability 2017, 9, 1952. https://doi.org/10.3390/su9111952

AMA Style

Wang X, Hu H. Sustainability in Chinese Higher Educational Institutions’ Social Science Research: A Performance Interface toward Efficiency. Sustainability. 2017; 9(11):1952. https://doi.org/10.3390/su9111952

Chicago/Turabian Style

Wang, Xianmei, and Hanhui Hu. 2017. "Sustainability in Chinese Higher Educational Institutions’ Social Science Research: A Performance Interface toward Efficiency" Sustainability 9, no. 11: 1952. https://doi.org/10.3390/su9111952

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop