1. Introduction
The emergence and development of an aging population is an inevitable product of social progress. In China, the data of the sixth national population census in 2010 showed that the population aged 65 and above accounted for 8.87% of the total. It is predicted that China will enter a “deep aging” society around 2035, when the proportion of the elderly aged 65 and above will exceed 21%. The rapid growth of the elderly population has stimulated the development of the elderly care industry. Among them, home health care is the most popular.
Home health care (HHC) refers to the medical center assigning professional caregivers to the elderly’s homes to provide them with diversified services, such as day care, rehabilitation therapy, chronic disease treatment, and medication guidance. The service objects are the elderly who need long-term or regular medical testing, postoperative recovery, and basic life care. With the improvement of people’s living standards, the requirements for the elderly are also higher. Many developed countries have better pension systems; however, in China, the development of the home health care industry is relatively slow. Most of the institutions charge too much and the system is not perfect, and cannot completely cover all the elderly.
According to the National Health Commission, the pattern of elderly care in China is “9073”. About 90% of the elderly choose to live at home, about 7% choose to rely on communities for elderly care, and 3% choose institutions for elderly care. In order to solve the pension problem, the Chinese government has explored a new home health care model according to the national conditions.
The home health care services can meet the needs of most elderly people, who can receive services without leaving home. Compared with community care and institutional care, home health care can emotionally comfort the elderly, and cost less. In the process of health service, the elderly need to make an appointment for door-to-door service in the system in advance and inform them of their needs. At the same time, the medical center will arrange an appropriate caregiver to provide health services according to their needs. When patients have multiple needs, the medical center will meet the needs of patients by improving the skill level of the caregiver, or arranging multiple caregivers to serve them at the same time. However, there are some basic requirements, such as drug delivery and report delivery, which can be achieved without a senior caregiver. The synchronous access of the caregiver undoubtedly increases the total operating cost. The medical center only needs to arrange personnel without medical certificates to drive to complete the delivery, which also reduces the stay time. However, few studies have considered caregiver and vehicle services separately, but this is very common in actual service systems.
In addition, relevant research shows that the travel time of the caregiver accounts for 18–26% of the total working time; unreasonable route arrangement will lead to an increase in travel time and will increase costs. At the same time, the working time difference between the caregivers directly affects the overall work efficiency. The purpose is to integrate effective resources under the background of scarce medical resources, so as to meet the needs of the elderly home health care service as far as possible, and to improve the quality of life. Therefore, on the basis of considering the work balance of the caregiver, this paper studies the collaboration of vehicle and caregiver; reasonable arrangement of service path is a kind of scientific problem with a strong practical background and important theoretical research value. The new home health care routing and scheduling problem (HHCRSP) model is built to minimize the total operating cost and maximize the work balance of the caregiver, which increases the complexity of the problem. In order to improve the work balance of the caregiver—namely to reduce the working time difference—the dispatch of caregivers and vehicles may increase when the medical center formulates the scheduling plan, thus increasing the total cost and forming a certain degree of inconsistency. That is why we are dealing with a bi-objective model in this work.
Specifically, the contributions of our study are as follows.
First of all, we introduce and model a new home health care routing and scheduling problem with the consideration of synchronous services. To our knowledge, most of the research considers the synchronous access between caregivers; there is little between caregivers and vehicles. In the objective function, the impact of caregiver and vehicle on the total cost is considered, respectively. The arrival time constraint (14) and matching constraint (15–16) are introduced for the synchronous access of caregiver and vehicle.
Second, our mathematical model addresses the diverse needs of patients, and the care center provides multiple visits to patients. We believe that our model better reflects the real situation and solves the actual problem.
Third, to solve this complex problem, we propose an improved non-dominated sorting genetic algorithm with elite strategy (INSGA-II). We improve initialization to improve the quality of the initial solution. New local search operators are embedded to improve the probability of finding the optimal solution. We design new crossover and mutation operators to improve the search space and find a better solution.
Finally, we analyze the sensitivity of synchronous parameters, problem properties, and the performance of the algorithm. Through a large number of experiments, the rationality of the model and the effectiveness of the algorithm are verified.
The remainder of this paper is organized as follows.
Section 2 reviews the relevant literature.
Section 3 describes and formulates the proposed problem.
Section 4 describes the proposed INSGA-II.
Section 5 presents the problem properties and the results of the performance of the proposed solution methods. Finally,
Section 6 concludes the paper.
2. Literature Review
In recent years, the pension problem has caused continuous hot debate; thus, the home health care routing and scheduling problem (HHCRSP) has attracted a large number of scholars. The HHCRSP is defined as an extension of the vehicle routing problem with time windows (VRPTW). In the home health care scheduling problem, travel time [
1] and travel cost [
2,
3] are regarded as the most common objective functions. Relevant research shows that the travel time of the caregiver accounts for the total working time, and the service path is not properly arranged, which reveals that unreasonable arrangement will lead to an increase in travel time [
4]. The classic HHCRSP problem involves patient needs, patient preferences, and the control of service time for special patients, which makes the problem more complicated. For example, medical centers need to consider patient preferences when formulating service plans, such as gender, age, and other factors of the caregiver [
5]. Ahmet Kandakoglu et al. [
6] studied the factors that affect the emotion of the caregiver, such as the advance or delay of the visit time. Gang Du et al. [
7] considered that there are some uncertain special patients who temporarily cancel or increase the emergency service, which affects the service process of other patients on this route.
In home health care, the medical center will assign a matched skill level and experienced caregiver to provide door-to-door service according to the actual situation, such as the patient’s health status or pathological severity. Generally, medical centers will train caregivers according to different standards to save costs. The medical center will match patients with caregivers according to certain criteria, such as the difficulty coefficient of service demand, or the skill level of the caregiver. Caregivers with a high skill level can serve patients with any needs, while caregivers with a low skill level can only serve patients with corresponding needs, which belongs to flexible matching [
8]. Some scholars studied the allocation of caregivers with multiple skills, and designed different algorithms to solve the problem [
9,
10,
11,
12]. In view of the complexity of nursing procedures during the actual visit, which require the synchronization of multiple caregivers, Patrick Eveborn et al. [
13] first proposed the situation of synchronization visits by caregiver. Synchronization access mainly depends on time constraints, including simultaneous access, cross overlap, maximum interval, and minimum interval [
14]. S. R. AitHaddadene et al. [
15] studied the scheduling problem of home health care with time windows, synchronization constraints, and priority constraints. Wenheng Liu et al. [
16] considered the factors that affect the formulation of the final service plan, such as synchronous access, skill demand, lunch break, etc. Most of the above scholars considered the impact of external factors on the final scheduling scheme, while ignoring the importance of caregiver satisfaction. At present, few scholars use the workload difference of caregivers to measure their work balance.
In daily life, in addition to the typical HHC service, the medical center also adds some basic services such as drug delivery and report delivery, which can reduce the unnecessary movement of patients. Because there is a certain service time difference between typical HHC services and new HHC services, it is easy to waste resources if not properly arranged. However, the current research mainly distinguishes different services based on the skill level of the caregiver, which has simplified the difficulty of the problem to a certain extent, but has not fundamentally solved the problem. Shi et al. [
17] considered the uncertainty of patients’ demands in the service process of the caregiver, and believed that the amount of drug consumption could only be known after the end of diagnosis and treatment. Fathollahi Fard et al. [
18] put forward the green HHC problem for the first time. They considered the carbon emissions generated by different vehicles in the delivery service process, and designed four heuristic algorithms to solve the transportation cost and carbon emissions problems. The above scholars considered that the caregiver would take a vehicle to the patient’s location to provide medical care and delivery services. However, they did not consider collaborative access, nor did they distinguish between HHC services and HDV services. Although this method simplifies the connection between different services, home health care (HHC) takes longer than delivery, which greatly increases the vehicle’s stay time, parking rate, and fixed cost of the caregiver.
So far, scholars have done a lot of research on HHCRSP. If all necessary participants and constraint information are taken into account in the current HHC scheduling decision, the decision will be the optimal one. In other words, this inevitably leads to the vacancy in algorithm solving. Exact methods and heuristic methods are the most commonly used methods for solving combinatorial optimization problems. For small-scale problems, the exact methods can obtain the optimal solutions, but with the gradual expansion of the scale, their computation time is heavily restricted [
19]. Therefore, more and more scholars prefer to use heuristic methods to find the best scheme [
20,
21,
22]. The problem of home health care scheduling needs to consider the strong timeliness of patient services and the rationality of the matching of skills; it belongs to the extension of the vehicle routing problem (VRP). Tang et al. [
23] showed that the vehicle routing problem belongs to the NP-hard problem. Thus, the home health care scheduling problem also belongs to the NP-hard problem. Therefore, scholars tried to apply heuristic algorithms to the solution of the HHCRSP, and achieved a series of results [
24,
25]. Mahyar Mirabnejad et al. [
26] considered that the time spent in the sample transfer process would have a certain impact on the results, so they built a model aimed at minimizing the sample transfer time, and designed two heuristic algorithms to solve the model. Fariba et al. [
27] proposed a green home health care scheduling problem; a novel grey flexible linear programming model is developed to cope with the uncertain nature of costs and capacity parameters, and two heuristic algorithms are designed to solve the problem. However, with the complexity of the model, the difficulty coefficient of the solution gradually increases, and the existing algorithm has difficulty achieving further optimization. Therefore, scholars at home and abroad are trying to find a new, better algorithm to solve HHCRSP. The NSGA-II algorithm is an intelligent optimization algorithm proposed by Deb et al. [
28] on the basis of the NSGA algorithm in 2002. It has the characteristics of fast running speed and good convergence. In recent years, the NSGA-II has been widely used to solve the VRP, and has made certain achievements [
29,
30]. Moreover, the NSGA-II algorithm has been proven to be a relatively mature algorithm for solving multi-objective models [
24]. Therefore, according to the characteristics of the HHCRSP, this paper aims to improve the NSGA-II algorithm to achieve an efficient solution for the HHCRSP.
To sum up, most HHCRSP studies usually consider the goal of minimizing cost or distance, ignoring the workload balance and skill matching problems in the actual service process, which results in a large deviation from the actual situation. The existing research distinguishes the home health care service and home delivery service by using the skill level of the caregiver, which simplifies the combination of problems to a certain extent. However, in the actual situation, the home health care service time far exceeds the delivery time, and the delivery vehicles have a large idle time. Therefore, this paper introduces the home delivery route separately, and considers the skills matching problem and the home delivery problem on the basis of the traditional home health care scheduling problem. The HHCRSP model is built to minimize the total operating cost and maximize the work balance of the caregiver, which increases the complexity of the problem. An improved NSGA-II algorithm is designed according to the characteristics of the HHCRSP.
4. Materials and Methods
Combined with the model presented in
Section 3, when the scale of the problem becomes larger and larger, it is difficult for the accurate algorithm to obtain the optimal solution in an effective time. The heuristic method has the ability to jump out of the local optimal and search for the global optimal solution. In this paper, the HDV service is introduced on the basis of the traditional home health care scheduling problem, which makes the problem more complex and constrained. Therefore, we select a heuristic algorithm to solve the HHCRSP problem:
The Non-Dominated Sorting Genetic Algorithm (NSGA-II), proposed by Deb et al. in 2002. Considering that the NSGA-II has the advantages of few parameters and good distribution [
32], it has been applied by many scholars to solve combinatorial optimization problems. As far as we know, there are few scholars addressing the NSGA-II to solve the multi-objective routing problems in an HHC environment. However, there are some shortcomings. Generally speaking, the initial population of the NSGA-II adopts the strategy of random initialization, which cannot guarantee the quality of the initial population. It is difficult to improve the diversity of solutions in the original genetic operator. In this paper, we improved the initial population and genetic operator, and introduced the population cooperation process, which is described as follows.
4.1. Encoding
Since the model involves the visit order and service type of patients, and the nodes of caregivers and patients are discrete points, we adopt a two-stage non-negative integer coding method; each chromosome represents an individual. The first part of the code represents HHC service and the second part represents HDV service. For a medical center with N patients, k caregiver, and v vehicles, the patient code is , the caregiver code is , and the vehicle code is . 0 indicates the medical center. Each value represents a gene, and the gene order represents the access order of the caregiver. According to the constraints of caregiver working time limit, patient service time window, caregiver-patient skill matching, vehicle distance restriction, and so on. Use 0 to separate the paths into different sets. The first gene of each path represents the number of the caregiver or vehicle, and other genes are patient numbers. A new route will be constructed when caregiver exceeds the required working hours.
This paper takes a medical center with 7 patients, 3 caregivers and 2 vehicles, as an example, in which patients 1–3 need HHC services and patients 4–7 need synchronous services. Set the patients who need synchronous services to add a virtual patient with codes of 8, 9, 10 and 11; that is, numbers 1–11 represent patients, 12–14 represent caregivers, and 15–16 represent transport vehicles. The codes are shown in
Figure 2. There are three HHC service paths and two HDV service paths. (0, 13, 1, 3, 0) indicates that the path of caregiver 12 is 0-1-3-0; (0, 14, 9, 10, 0) means that the path of delivery vehicle 14 is 0-9-10-0, and so on.
4.2. Generation of Initial Solutions
In order to improve the solution of the algorithm, this paper uses heuristic rules to generate the initial solution, and improves it on this basis. In this paper, we designed two populations to evolve simultaneously. Among them, the two populations are recorded as population A and population B, where population A is initialized by heuristic rules and population B is initialized randomly.
The heuristic rules are as follows. For HHC services, first, patients are classified according to skill needs and represented by , where n represents the skill type. Select a caregiver from at random. Then, select a patient i according to the skill level of the caregiver, in which patient i is randomly selected from the corresponding type of patient set as the service object. At this time, the path is represented as . Select nearby unserved points and insert them into the current line in time sequence to ensure that the total time and skill type meet the requirements. If the working time of the caregiver exceeds the specified time limit, the next line will be reconstructed until all patients are assigned. For the HDV path, select a vehicle from at random. Among then, the HDV’s visit order according to the patient’s HHC service time window. When no patient meets the requirements of the current line, or the length of the transportation path reaches the limit, the next line is reconstructed. Based on this initial solution generation method, it can not only meet the needs of matching skills, but also solve problems such as time constraints and synchronous services.
4.3. Genetic Operations
Some of the good individual solutions may disappear during the process of evolution. Therefore, in order to maintain the diversity of the population and avoid falling into the local optimal state, this paper carried out chromosome crossover and mutation operations.
The crossover operations corresponding to population A and population B are recorded as crossover A and crossover B, respectively, and the corresponding mutation operations are recorded as mutation A and mutation B. In this paper, two populations adopt the same crossover mode.
4.3.1. Crossover
Cross operation is prone to the loss and redundancy of gene information. To solve this problem, a new crossover operator is used in this paper. We have comprehensively considered skills matching, patient service order, time window, and distance constraints, which can not only solve a series of constraint problems, but also improve the diversity of solutions on the basis of the original chromosomes. In this paper, the random number (0, 1) is used to determine whether the HHC route or the HDV route should be cross operated. Assuming that the random number is 0, take the HHC path for example, and the crossing steps are as follows.
Step 1: The two parental chromosomes involved in the crossover operation are recorded as and , and the crossover probability is recorded as .
Step 2: Randomly generate an integer , where c represents the total path number of HHC. We determine the location of chromosome for cross operation based on m.
Step 3: The selected cross area in is placed in the first line in , and the remaining patients are reassigned according to the coding rules to generate a new service path. Then, we get the offspring chromosome. Similarly, we can obtain .
When
, the specific cross process is shown in
Figure 3.
4.3.2. Mutation
In this paper, we consider that the HHCRSP problem has strict constraints on the time window. At the same time, in order to further improve individual performance and increase population diversity, we design a variety of mutation operators. A chromosome was randomly selected and denoted as , and the mutation probability was denoted as . The HHC or HDV path mutation operation was determined by random number (0, 1). Assume that the random number is 0. Take the HHC service path as an example.
Randomly generate , where . If , then select insertion mutation, exchangeable mutation otherwise.
Insertion mutation: generate two numbers x and y randomly, where
,
c is the number of HHC total paths and
. The position of mutation operation is determined by
x and
y. Delete the designated gene in path
y randomly and insert it into the designated position in path
x. If the new path formed meets the time and skill constraints, new chromosomes will be generated. Otherwise, the original chromosome will be retained until the end of the mutation operation. When
, the specific variation process is shown in
Figure 4:
Exchangeable mutation: a position is randomly assigned within the selected path
x and
y for exchange. If the new path meets the time window and skill constraints, a new chromosome
will be generated, otherwise the original chromosome will be retained. When
, the specific variation process is shown in
Figure 5:
Insertion mutation: select a node randomly and delete it, then reinsert the node into the path. If the new path meets the constraints, the new individual will replace the old.
4.4. Local Search
In the problem, we design three local search operators for HHC and HDV. During a local search, a random search method is selected.
Randomly delete two or more patients on a line and reassign them to meet the constraints;
Randomly select two HHC lines to exchange the specified segments;
For HHC or HDV service, randomly exchange two caregivers with the same skills or vehicles with the same service.
4.5. Population Cooperation
In order to improve the quality of the solution and strengthen the information exchange between populations, some scholars improved the deficiency of the population evolution by exchanging the genetic information carried by excellent individuals [
33]. After genetic operation and local search, completed, respectively, by population A and population B, non-dominated sorting is conducted. Exchange the first 50% of the individuals to form a new population A and population B for the next iteration.
4.6. Algorithm Framework
The flowchart of INSGA-II proposed is given in
Figure 6.
6. Conclusions and Future Work
This paper studies the HHCRSP, considering the limitation of caregiver’s skill level, working time, visiting time and vehicle mileage. The problem is formulated as a multi-objective mathematical model to minimize the total cost and maximize the work balance. Then we develop an INSGA-II; the proposed INSGA-II has three main ideals: (1) Two populations are designed to evolve simultaneously, and initial solutions are generated by heuristic rules and random methods, respectively. (2) The optimal individual updating strategy is designed to solve the multi-objective decision model. (3) A variety of local search operators are designed. In order to evaluate the improved performance of the INSGA-II, a large number of calculations and tests were carried out for the problems studied, using 18 examples. The results show that the improved initial generation strategy is effective. In addition, the NSGA-II is compared with the MOEAD and the MOPSO, which also verifies the rationality and effectiveness of the model and algorithm proposed in this paper.
This paper comprehensively considers the benefits and rights of the research subject, and effectively balances the interests of both the medical center and caregiver. It is helpful to the sustainable development of the home health care system, and can provide theoretical guidance for the medical center to formulate plans for caregivers and vehicles, which is of great practical significance. Although this paper has conducted a detailed study on the problem of home health care scheduling, further exploration is still necessary in order to promote the development of the home health care system. A set of new assumptions and innovations can be introduced into the present model for future studies. For example, in order to improve the effectiveness of the optimized route in the real traffic network, Liu et al. [
39] considered the differences in vehicle speeds in different road conditions and different time periods—such as morning peak and evening peak—and constructed the speed function. In this paper, we mainly study the synchronous visits of caregivers and vehicles, where the vehicles move at a constant speed. Considering the practical problems of the health service system, we will try to use the real-time network to update vehicle speed and calculate travel time. Additionally, in future research we can develop new algorithms to compare the results of this study, such as hybrid heuristics [
40] and metaheuristics [
41], and adaptive algorithms [
42].