1. Introduction
Remote patient monitoring (RPM), defined as “the recording and transmission of patient biometrics, vital signs and/or disease-related data to a healthcare provider using information and communications technology [
1]”, has been increasingly adopted in diabetes management [
2]. This trend has recently been boosted by the COVID-19 pandemic, giving rise to increasing demand for RPM as a result of medical urgency, technology advances, and expanded reimbursements and policy support for RPM [
3]. An examination of Medicare claims data revealed that the utilization of general RPM among Medicare beneficiaries increased by 555% from February 2020 to September 2021 [
4]. About 43% of adults in the United States reported the use of telehealth including RPM during COVID-19 [
5].
The growing use of RPM, however, does not necessarily mean that all patients with diabetes have the motivation to participate in RPM and potentially benefit from it. Although some patients might appreciate the convenience of digital health technologies for disease monitoring (e.g., saving travel time and costs), others might perceive using these technologies as a burden and would avoid them because of a lack of understanding of the technology or a preference for physical over virtual encounters with healthcare providers [
6]. Understanding how these factors influence RPM participation among patients with diabetes can be useful to develop targeted interventions to engage patients more effectively while increasing program reach and retention.
Patient retention in RPM requires consistent and continuous effort throughout the intervention period. The long duration of RPM in diabetes management has made effective retention of program participants a significant challenge [
7,
8]. A systematic review of clinical interventions based on remote monitoring and coaching of diabetes management revealed that attrition rates ranged from 9% to 21% [
9]. The overall attrition rates in app-based, remote digital health interventions targeting diverse chronic conditions were even higher [
8,
9,
10].
Despite the documented effectiveness of RPM in diabetes management [
11,
12], few studies have examined the willingness of patients to participate in or complete RPM. One recent study investigated the most common reasons for continuous glucose monitoring attrition in 2663 youth with type 1 diabetes [
13]. The findings suggested that those who discontinued the monitoring tended to be older, have had longer disease duration or higher A1C, and self-identify as non-Hispanic Black. The most common reasons cited for attrition were problems with device adhesion, disliking a device on the body, insurance problems, pain with device use, and system mistrust due to inaccurate readings. While these findings are important for understanding factors linked to attrition in glucose monitoring for youths with type 1 diabetes, it remains unclear whether these findings can be extended to older patients or patients with type 2 diabetes.
Part of the challenges in identifying factors associated with program enrollment or attrition in RPM for diabetes management concerns the lack of comprehensive data. Collecting quantitative or qualitative data from patients who declined to participate in RPM or who decided to quit before program completion is understandably more difficult, which poses a significant challenge in assessing the reach and impact of RPM in diabetes management [
14]. This study used mixed methods to assess program enrollment and attrition in a large RPM program serving patients with type 2 diabetes (T2D).
2. Materials and Methods
2.1. Study Setting and Sample
Data used in this study came from the Remote Interventions Improving Specialty Complex Care (RIISCC) program implemented at Nebraska Medicine, the top rated hospital in the State of Nebraska, from 2014 to 2018. While the quantitative data from this program have been previously analyzed for research purpose, the qualitative data from this program have never been used for research. Funded by a Health Care Innovation Award from the Centers for Medicare & Medicaid Services, RIISCC aimed to improve clinical outcomes and reduce healthcare costs for patients with T2D discharged from Nebraska Medicine—including patients with comorbidities such as congestive heart failure, hypertension, and acute myocardial infarction. Patients with T2D who had a recent hospital admission for any reason were recruited to the program no later than one month after hospital discharge. Specifically, inclusion criteria included: (1) diagnosis of T2D; (2) 19 years of age or older (legal age in Nebraska); (3) able to use glucometer (or provided with and taught to use a meter compatible with the equipment provided) and take insulin and/or other prescribed medications; (4) not pregnant; (5) not having a history of substance use disorder; (6) English-speaking and able to read English (by herself/himself or with help from others); (7) discharge planned to home; and (8) able to express a basic understanding of and successfully use RPM equipment. During the program period, the clinical team in RIISCC contacted a total of 1993 eligible patients and shared with them information about the program. RIISCC was exempt from IRB approval since it was set up as a hospital-based quality improvement program. To protect the privacy of participating patients, all program data had been anonymized before they were used for this study.
After a patient was enrolled, a medical assistant would visit the patient at their home to set up the RPM equipment (Cardiocom, Medtronic Inc., Minneapolis, MN, USA) including a cellular base unit, blood pressure cuff, blood glucose meter, weight scale, and necessary cords, as partially indicated by
Figure 1. During the home visit, the medical assistant would teach the patient how to use the equipment and upload data for monitoring. This was then followed by a 3-month intervention involving daily remote monitoring of blood pressure, weight, and glucose, and a weekly phone call from an assigned nurse. Participating patients were expected to take the biometric measurement on a daily basis during the intervention and had access to their nurse coaches via email or phone as needed. Ten nurse coaches (all female) provided services including medication adherence assessments, nutritional counseling, and diabetes self-management coaching and education. The nurse coaches would call patients whenever the uploaded data triggered a medical alert or emergency. Primary care providers were provided with patient data uploaded throughout the 3-month intervention via electronic health records. At the end of the intervention, patients were seen at a local community health center where they returned the RPM equipment and received diabetic retinopathy screening, hemoglobin A1C (HbA1c) testing, a virtual nutritional counseling session, and a feet exam from a certified diabetes educator (assisted by an on-site medical assistant) [
12]. A simple courtesy telephone call was made on a monthly basis for an additional 9 months after participants had concluded the program.
Financial incentives were used in RIISCC to promote program retention. Enrolled patients who successfully completed the program would receive gift cards with a total value of USD 50, distributed as: (1) USD 10 gift card 7 days after first upload, (2) USD 10 gift card for continuous monitoring 30 days after first upload, (3) USD 10 gift card for continuous monitoring 60 days after first upload, and (4) USD 10 gift card for completing the 90-day intervention and having their HbA1c test done at their assigned community health center or clinic, as well as a USD 10 gift card for returning their RPM equipment.
2.2. Measures
2.2.1. Quantitative Data
The quantitative data in RIISCC contained information on three health outcomes including HbA1c, high blood pressure (>140/90 mmHg or not), and bodyweight in pounds. Data for these measures were collected at both baseline and the end of the intervention for patients who completed the intervention, allowing for an assessment of changes in these health outcomes.
The Patient Activation Measure-13 (PAM-13) [
15] was used to denote the degree of patient activation at both baseline and the end of three months of RPM. PAM-13 is a uni-dimensional, interval level, Guttman-like scale consisting of 13-item questions used to measure patient knowledge, skills, and confidence for self-management of chronic conditions. Subsequent work on this scale further differentiated patients into four levels of activation based on the scoring of their responses: Level 1—the patient does not yet believe they are active or have an important role in managing their health (<47.0); Level 2—the patient lacks confidence and knowledge to take action to manage their health (47.1–55.1); Level 3—the patient is beginning to take action to manage their health (55.2–67.0); and Level 4—the patient is maintaining actions of managing their health over time (≥67.1) [
16].
Demographic data included age at baseline in years, sex (male, female), and race (non-Hispanic White vs. racial and ethnic minorities). RIISCC also tracked the number of uploads of biometric data by each enrolled patient, an indicator of patient engagement in the program [
17].
2.2.2. Qualitative Data
In an effort to qualitatively identify factors affecting program reach, retention, and effectiveness, the RIISCC team trained and supported a Clinical Research Outreach Coordinator (CROC) to interview a convenience sample of 36 patients with T2D over the phone in January 2017, including 15 patients who completed the 3-month RPM, 10 patients who were enrolled but chose to withdraw from the program with no completion, and 11 eligible patients who declined to participate in the program.
Figure 2 illustrates the data components, sample sizes, and the linkage between the quantitative and qualitative data used in the study.
These semi-structured interviews were conducted in English, with each interview typically lasting between 10 and 15 min. Before starting each telephone interview, the CROC explained to the patient the purpose of the interview, its expected length, the needed recording of the interview, and a modest incentive (USD 20) offered to compensate the patient for their time. After receiving a clear approval from the patient, the CROC then proceeded with the interview and its recording.
The evaluation team in RIISCC initially drafted the questions for interviews in each of the three groups of patients before finalizing them with input from the rest of the RIISCC team.
Table 1 listed the questions used in the interviews. Although the interviews with patients who had completed the program focused on patient feedback on their experience in the program, the core of the interviews with the other two groups of patients revolved around why they chose to withdraw from the program before completion or to decline to participate in the program, and the potential strategies to retain or motivate their participation.
2.3. Data Analysis
The quantitative analysis in this study started with a comparative analysis of explanatory variables across the three groups of patients including those who completed the 3-month RPM intervention (the Completed group), those who participated in the intervention but chose to quit the intervention before its completion (the Withdraw group), and those who declined to participate in the intervention (the Declined group). Of note, no data other than age, sex, race, and health insurance status was collected for the Declined group.
Chi-squared tests, independent sample t-tests or one-way ANOVA (only used for the age comparison across three groups) were used to denote whether the differences across groups were statistically significant. Among the Completed group, paired t-tests or chi-square tests were estimated to assess if the changes in health outcomes between the baseline and the end of the intervention were statistically significant. This was followed by a logistic regression to identify factors associated with sample attrition among all enrolled patients (the Withdraw group vs. the Completed group). All analyses were conducted using Stata version 14. Two-tailed p values of less than 0.05 were considered statistically significant.
For the qualitative data analysis, all interviews with patients were recorded, fully transcribed verbatim, and compared to the recording for accuracy. The study team evaluated the data using inductive thematic analysis to develop a codebook [
18]. The study team assessed saturation of the data by examining the scope of the topics covered and the extent to which additional interviews might yield new insights before deciding to stop participant recruitment. The qualitative data from each of the three patient groups (Completed, Withdraw, or Declined) were coded separately. Initial codes were grouped into two overarching themes: positive and negative perception of the RPM program. Using the codebook, a paired analysis of the data was conducted by two researchers. To evaluate the consistency between the two researchers in their coding, the Cohen’s kappa statistic was estimated, which yielded an interrater reliability of 0.937, suggesting strong consistency between the two researchers [
19].
4. Discussion
Based on both quantitative and qualitative data analysis, this study assessed program enrollment and attrition of a large RPM program implemented in Nebraska from 2014 to 2018. Although the quantitative data illustrated the magnitude of these issues, the qualitative feedback from the patients highlighted patient perceptions of the program and provided further insights into the factors associated with program enrollment and attrition. The current study went beyond several previous evaluation studies of the same program focused on effectiveness based solely on the quantitative data from the patients who completed the 3-month RPM and coaching [
17,
20,
21], and more comprehensively evaluated program impact by also looking into program reach and attrition using a mixed-methods approach [
22].
Despite the documented effectiveness of telemedicine in diabetes management [
11], non-participation in telemedicine programs remained high among patients with T2D. One recent study of telemedicine utilization among patients with diabetes in California during the period of COVID-19 lockdown revealed that 57% of these patients declined to use telemedicine for diabetes management [
23]. This contrasted with the 13% non-participation rate in the RIISCC program where only high-risk patients with T2D recently discharged from the hospital were recruited. Qualitative feedback from these patients identified hectic schedules and fulfilling other duties in life as the most important reason for non-participation. Similar findings were also reported in two large clinical trials based on telemedicine interventions whereby participants cited being busy as one of the top reasons for non-participation [
24]. This partially explained our observation that female patients were more likely to decline to participate in the RIISCC program; if female patients were more occupied with family duties such as child education, cleaning, and cooking, they might find it difficult to participate in the telemonitoring program. It is also likely that some female patients might have already been constantly monitoring their health on a regular basis themselves, which reduced their motivation for participation, as mentioned by one of the patients in our study.
Besides non-participation, program attrition can also threaten the reach and impact of telemonitoring programs. The attrition rate in home-based telemonitoring programs for chronic disease management can be as high as 55% [
10]. About 16% of patients with T2D enrolled in the RIISCC program withdrew from the intervention without completion. Age at baseline was negatively associated with the odds of attrition. This finding was corroborated by a previous study based on an analysis of data from 100,000 patients [
8]. Younger patients might have more commitments in life (e.g., jobs, childcare or education, travel) that could distract them from finishing the telemonitoring program.
The finding that poor baseline health, as indicated by HbA1c and blood pressure, was associated with higher odds of program withdrawal deserves attention. It is plausible that patients with poor baseline health might be more likely to encounter certain barriers to RPM participation such as social determinants of health, patient-provider discordance, or lack of cultural tailoring. These issues disproportionately hamper diabetes management among racial and ethnic minority patients. There was evidence that some of the commonly cited reasons for non or incomplete participation in home telemonitoring for diabetes management among Black and Hispanic patients included disinterest, perceived inconvenience, or lack of perceived benefit of these programs [
25]. It may also be that patients with poor baseline health have more severe comorbidities or a more complicated health history, which may lead to program withdrawal due to disease management fatigue or competing priorities in managing multiple chronic conditions. While the nurse coaches in RIISCC had experience in diabetes management, it might be beyond their clinical expertise to advise patients with complex or severe comorbidities. This explains why one patient expressed a preference for talking to a nurse practitioner. Future telemonitoring programs can increase program retention by paying special attention to the needs of patients with high HbA1c or blood pressure at the baseline.
Overall, the RIISCC program was effective, as indicated by substantial, positive changes in HbA1c and patient activation in diabetes management from the baseline to the end of the program and by the positive feedback regarding program staff and remote monitoring equipment from the patients who completed the intervention. The general perception of the program by patients in the Withdrawal group was also positive. Despite these findings, one negative change in health outcome during the RPM program was the increased prevalence of hypertension from the baseline to the end of the intervention. Since patients in the RIISCC were all recently discharged from hospital, the consistent monitoring and control of blood pressure during the hospital stay could have contributed to the relatively lower blood pressure at the baseline. As the RPM program focused mostly on the management of blood glucose, the monitoring and control of blood pressure might not receive similar attention during the program. Findings from our study call for more attention to hypertension management in future RPM programs serving patients with T2D.
One overarching theme cutting across all three groups of patients in this study concerns the technology used in the RIISCC program. According to the Technology Acceptance Model [
26], patients’ intention to use a new technology for disease management, including various technologies in RPM, is a function of two factors: perceived usefulness and perceived ease of use. The monitoring equipment used in the RIISCC program were developed more than 10 years ago, and might look cumbersome and not as user-friendly when compared to the current prevailing technology. This was reflected by related feedback from patients from both the Withdrawal and Completed groups, where some concerns over the quality and accuracy of the monitoring equipment were expressed. For patients who were already experienced and knowledgeable about self-monitoring and management of glucose levels, they presumably will not have much motivation to participate in a telemonitoring program unless their perceived unique benefits of participation outweigh perceived costs. This is especially important as many patients in the study singled out being busy in life had made it difficult for them to commit to program participation. With constant advancements in digital technology such as the increasing use and development of wearable, non-invasive blood glucose and blood pressure monitoring [
27,
28], remote monitoring of diabetes and hypertension will become more efficient, affordable, and user-friendly over time, which will lead to better program reach, retention, and impact.
Limitations of the Study
Several limitations of this study merit comments. First, the RIISCC program was established as a quality improvement initiative, not a clinical trial, which has limited both the breadth and depth of the data used in this study. For example, there were no comparison groups or data on patient socioeconomic status such as marital status, education, and employment status, which may have impacted our findings. Moreover, the lack of quantitative data on patients who declined to participate from the beginning restricted our capacity in identifying factors contributing to non-participation from a statistical perspective. Second, the modest duration of telephone interviews with patients limits the richness and depth of the qualitative data. Thirdly, part of the variations in patient outcomes during the intervention, including drop-offs, might be related to the performance of the nurse coaches. A more comprehensive program evaluation would benefit from assessing disparities in staff performance and how they might have contributed to related differences in program outcomes. It would help if future program evaluation also incorporated perspectives from nurse coaches and primary care providers to assess program outcomes. Finally, the use of financial incentives in the RIISCC program should have helped with program recruitment and retention, which implies that the participation and retention rates could presumably become worse when no incentives are offered. Caution should be taken before generalizing findings from this study to other situations. Despite these limitations, this study represents a rare effort in adopting a mixed-methods approach to simultaneously evaluate program enrollment, retention, and effectiveness of a large telemonitoring program serving patients with T2D.