Next Article in Journal
Immunogenicity and Protectivity of Sputnik V Vaccine in hACE2-Transgenic Mice against Homologous and Heterologous SARS-CoV-2 Lineages Including Far-Distanced Omicron BA.5
Previous Article in Journal
Clustering Analysis Identified Distinct Clinical Phenotypes among Hemodialysis Patients in Their Immunological Response to the BNT162b2 mRNA Vaccine against SARS-CoV-2
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Mobile Phone Text Message Reminders to Improve Vaccination Uptake: A Systematic Review and Meta-Analysis

by
Gail Erika Louw
1,†,
Ameer Steven-Jorg Hohlfeld
2,†,
Robyn Kalan
1 and
Mark Emmanuel Engel
1,3,*
1
Cape Heart Institute, Department of Medicine, Faculty of Health Sciences, University of Cape Town, Cape Town 7925, South Africa
2
Health Systems Research Unit, South African Medical Research Council, Tygerberg 7501, South Africa
3
South African Cochrane Centre, South African Medical Research Council, Tygerberg 7501, South Africa
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Vaccines 2024, 12(10), 1151; https://doi.org/10.3390/vaccines12101151
Submission received: 20 August 2024 / Revised: 27 September 2024 / Accepted: 5 October 2024 / Published: 8 October 2024

Abstract

:
Introduction: Mobile phone text message reminders (MPTMRs) have been implemented globally to promote vaccination uptake and recall rates. This systematic review evaluated the effectiveness of MPTMRs on vaccination recall rates. Methods: We included randomized controlled trials of caregivers of children, adolescents, or adults who received MPTMRs for improving vaccine uptake and recall visits. We searched the Cochrane Central Register of Controlled Trials (CENTRAL), PubMed, and Scopus to identify relevant studies published up to 24 January 2024. We used Cochrane’s Risk of Bias tool to assess the included studies and reported the results as risk ratios with 95% confidence intervals, using a random effects model. Results: We identified 25 studies for inclusion. All studies were assessed as having a low risk of bias. The evidence supports MPTMRs for improving vaccination uptake compared to usual care (RR = 1.09 [95%CI: 1.06, 1.13], I2 = 76%). Intervention characteristics, country setting, country economic status, and vaccination type had no bearing on the effectiveness of the intervention. Conclusions: MPTMRs have a positive effect, albeit relatively small, on vaccination uptake. These findings may assist public health practitioners, policymakers, and vaccine researchers in evidence-based decision making that focuses on MPTMRs and their impact on vaccination coverage.

1. Introduction

Vaccine-preventable diseases remain a global public health concern despite vaccine availability and vaccine access. Increasing vaccination coverage has been prioritized by the World Health Organization (WHO) to decrease the occurrence of morbidity and mortality from vaccine-preventable diseases. Researchers define vaccination coverage generally as the proportion of individuals who have received a specific vaccine within a defined population [1]. Recent reports demonstrated a significant decrease in global vaccination coverage due to the negative impact of the coronavirus disease 2019 (COVID-19) pandemic on critical health services [2,3]. The WHO/UNICEF estimates of national immunization coverage reported that 25 million children were unvaccinated or incompletely vaccinated, with a reduction in vaccination coverage from 86% in 2019 to 81% in 2021 [2]. These findings have a significant impact on achieving sustainable development goals that focus on promoting and ensuring health and well-being at all ages through vaccination [4].
Timely vaccination and up-to-date vaccination schedules are essential factors that promote maintaining immunity and limiting vaccine-preventable deaths [1,5]. To facilitate the development of country-specific vaccination schedules and promote the on-time administration of vaccines, the WHO has provided guidance on defined vaccination schedules and intervals [6,7]. Figure 1 represents the interplay among factors that can influence vaccination uptake that would facilitate a decrease in vaccine-preventable deaths. It presents the implications of adherence/non-adherence on vaccine-preventable deaths. Maintaining the decline in vaccine-preventable deaths is dependent on vaccination uptake, defined as the “number of individuals that have received a specified vaccine dose(s)” [1]. This, in turn, depends on the scheduling and on-time attendance of the vaccination appointment [8,9,10]. These appointments are often missed and lead to either missed or late vaccinations, resulting in lower vaccination uptake, which could lead to an increase in vaccine-preventable deaths (Figure 1). Various studies have reported that socio-demographic factors such as age and educational level affect adherence to vaccination appointments [11,12].
Similarly, reports have shown that socio-economic status affects vaccination uptake, with low-income households demonstrating lower adherence to vaccination appointments, resulting in lower vaccination coverage [13,14]. Some studies also reported that lack of basic knowledge of the caregiver or adult on the importance of vaccinations, poor service delivery, religious beliefs, and access to health facilities are factors that negatively affect adherence to vaccination schedules and subsequently vaccination coverage [15,16,17,18]. Given these factors, exploring accessible, innovative technologies that can be implemented on a global scale is essential to improve vaccination coverage both regionally and globally.
In 2012, the WHO launched the Global Vaccine Action Plan (GVAP) 2011–2020, with the vision to facilitate an increase in global vaccination coverage [19]. This plan was guided by six principles, including (1) country ownership, (2) shared responsibility and partnership, (3) equity, (4) integration, (5) financial sustainability, and (6) innovative research and development [19]. The goal of GVAP was to achieve 90% national and 80% district level vaccination coverage of DTP3 by 2020 [19]. National vaccination coverage goal of 90% was achieved in 125 countries, while only 57 countries reported a 80% coverage in the three doses of the combined diphtheria, tetanus toxoid, and pertussis (DPT3) vaccine on a district level [20]. Although GVAP did not meet all its goals, it laid the foundation for a solid framework for the Immunization Agenda 2030, which aims to (1) reduce the number of unvaccinated children by 50%, (2) achieve 90% coverage for childhood vaccinations, and (3) achieve 500 introductions of new or under-utilized vaccines in low- and middle-income countries [21]. This framework includes the following seven strategic priorities (1) immunization programs for primary health care and universal health coverage, (2) commitment and demand, (3) coverage and equity, (4) life-course and integration, (5) outbreaks and emergencies, (6) supply and sustainability, and (7) research and innovation [21].
It is evident that improving vaccination coverage would require a substantial sustained global, national, and regional effort and innovative strategies to implement and optimize health systems in target populations. A recent study demonstrated that modifiable factors, such as a lack of maternal knowledge on childhood vaccinations, schedules, and side effects as well as maternal attitude toward vaccination, negatively impacted vaccination uptake in Africa [22]. For this reason, innovative strategies and interventions, such as mobile health and digital health, in addition to mobile phone technology and social media platforms, are being developed to decrease vaccine misinformation and hesitancy and increase vaccination coverage [23,24,25]. Various studies have shown the efficacy of text message reminders either alone or in combination with other interventions, such as postcards, auto dialer calls, and letters, in improving vaccination coverage in defined target populations for various diseases and in different clinical and country settings [26,27,28]. This indicates that text message reminders and recall have the potential to facilitate behavior changes, leading to adherence to vaccination schedules by reminding caregivers of infants, adolescents, and adults of scheduled vaccination appointments and providing the required encouragement to ensure timely attendance to improve vaccination uptake.
A recent systematic review demonstrated that personalized text message reminders for COVID-19 vaccination appointments increased vaccination uptake [29]. However, limited published studies exist that synthesize all available scientific evidence assessing the effectiveness of mobile phone text message reminders (MPTMRs) on vaccination coverage, irrespective of geographic location, population, or disease. This systematic review sought to assess the most recent and best scientific evidence evaluating the efficacy of MPTMRs as an intervention to improve vaccination uptake.

2. Materials and Methods

The findings in this systematic review and meta-analysis were reported according to the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) guidelines [30] and guidelines outlined in the Cochrane Handbook of Systematic Reviews for Interventions [31]. No formal institutional review board approval was required for this study since it does not involve human participants.

2.1. Review Question

What is the effectiveness of mobile phone text message reminders (MPTMRs) in improving vaccination recall in children, adolescents, and adults?

2.2. Study Outcome

This study assessed vaccination recall as the outcome including subgroup analysis based on the nature of the intervention, country’s economic status, study setting, and vaccination type.

2.3. Eligibility Criteria and Search Strategy

The study eligibility criteria for inclusion were pre-defined (Table S1). Briefly, studies were eligible if they were randomized controlled trials (RCTs) of caregivers of children, adolescents, or adults who received MPTMRs as an intervention. The intervention needed to include information provided by short messaging service (SMS), Telegram, WhatsApp, Facebook Messenger, or any multimedia application that uses an instantaneous alert delivered to caregivers of infants, children, adolescents, or adults (including women that were pregnant or breastfeeding) that required a follow-up dose(s) in a routine vaccination schedule or booster vaccinations for any vaccine-preventable disease. Our comparator interventions included usual care, which encompassed, but was not limited to, written appointment reminders on appointment cards or immunization cards, verbal reminders of the next appointment, autodial telephone reminders, text messages with health education content, and no appointment reminders at the health care facilities. Studies were excluded if it did not include a comparator group or if the comparator group was not usual care.
A comprehensive strategy was developed and applied to search and subsequently identify relevant studies (Table S2). This search strategy included key words such as “SMS” and “text reminder” in addition to medical subject heading (MeSH) terms in various combinations such as “immunization”. The search strategy was independently adapted and modified accordingly for searches in PubMed, Cochrane Central Register of Controlled Trials (CENTRAL), and Scopus performed by two investigators (GL and AH). The reference lists of relevant publications identified through the database search were assessed to identify additional studies for full-text eligibility assessment. We screened all studies published until 24 January 2024.

2.4. Study Identification and Selection

The database search was independently conducted by two authors (GL and AH), and publications retrieved from the search were uploaded into Rayyan, a semi-automated review screening tool to facilitate the screening process [32]. Duplicate publications were excluded. Both reviewers independently applied the inclusion criteria. Titles and abstracts were screened for relevance. The results between the two independent reviewers were compared; discrepancies were resolved by discussion. Subsequently, GL obtained the full-text publications of potentially eligible studies, and GL and AH independently evaluated each publication for full-text eligibility using the pre-defined inclusion and exclusion criteria (Table S1). The results between the two authors were compared, and discrepancies were resolved by discussion. The reason for exclusion is tabulated in the table of excluded studies (Table S3).

2.5. Data Extraction and Management

From studies deemed to be eligible, GL and AH extracted, using a standardized data extraction form, detailed information, including intervention and control characteristics, age category of participants, country and settings where the studies were conducted, and details on the type of vaccines including vaccination schedules. Information on visit/dose-specific vaccination coverage in the intervention and control groups in addition to details on incentives provided to the participants were extracted.
Disagreements regarding data extracted were resolved by discussion until 100% agreement was achieved. All relevant data were entered into The Cochrane Collaboration Review Manager version 5.4.1 [33] software, and a second author conducted a quality control check to ensure no data entry errors occurred.

2.6. Assessment of Risk of Bias of Included Studies

GL and AH assessed the risk of bias of each RCT as well as the respective protocols and trial registry records by independently applying the Cochrane Collaboration’s tool for assessing risk of bias in randomized trial [34]. The risk of bias criteria assess bias arising due to (1) random sequence generation (selection bias), (2) allocation of concealment (selection bias), (3) blinding of participants and personnel (performance bias), (4) blinding of outcome assessment (detection bias), (5) incomplete outcome date (attrition bias), and (6) selective reporting (reporting bias) [34]. Following this independent assessment, any discrepant judgements for risk of bias between the two authors were resolved by discussion between the two authors or by an impartial third author where the disagreements persist. We contacted authors of the included studies when missing data or incomplete information was identified.

2.7. Measures of Effect

Risk ratio (RR) and mean differences were calculated for dichotomous outcomes and continuous outcomes, respectively.

2.8. Data Synthesis

Data analysis was conducted as outlined in the Cochrane Handbook for Systematic Review of Interventions [31]. Meta-analysis was done on the data considered homogenous using The Cochrane Collaboration Review Manager version 5.4.1 [33] software to produce synthesis of the treatment effect together with the respective 95% confidence intervals (95%CIs). Summary effect sizes were estimated using the random-effects model. We conducted analyses on an intention-to-treat basis for all outcomes.
Clinical heterogeneity of the included studies was assessed by evaluating variability in participants, interventions subtypes, and study outcomes. Heterogeneity in methods of the included studies was assessed by evaluating variability in risk of bias. Descriptive statistics were used to characterize both clinical and methodological heterogeneity using the I2 statistic.

2.8.1. Subgroup Analysis

Subgroup analysis was done to assess the effect of intervention type (text messaging only vs. text in addition to another component, e.g., appointment card reminders, standard verbal counselling, educational videos, and routine health education), country’s economic status (low- and middle-income countries (LMICs) vs. high-income countries (HICs)), study setting (urban vs. other), and vaccination types (early childhood vaccination vs. HPV vs. other) on the results of the meta-analysis.

2.8.2. Sensitivity Analysis

The effect of excluding studies with a high risk of attrition bias on the intervention effect was determined.

2.9. Risk of Publication Bias Assessment

We assessed publication bias by creating a funnel plot using The Cochrane Collaboration Review Manager version 5.4.1 software and plotting the standard errors of log RRs against RRs [33,35].

3. Results

3.1. Study Identification and Selection

The search identified 5887 publications from the databases search, comprising studies from PubMed (n = 3020), Scopus (n = 2797), and Cochrane CENTRAL (n = 70) (Figure 2). Articles were managed using the semi-automation tool Rayyan.ai [32]. In total, 479 duplicates were removed and the titles, and abstracts of the remaining 5408 publications were screened by GL and AH based on the exclusion criteria outlined in Table S1. Most studies (n = 5279) were excluded. Following this screening process, we selected 129 publications eligible for full-text screening and subsequently identified 32 studies that met the inclusion criteria (Table S1) for data extraction and quantitative synthesis.
The included studies were characterized, with six studies conducted in a rural setting [36,37,38,39,40,41], 22 in an urban setting [42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62], and four in a combination of semi-urban and rural or urban and suburban settings [63,64,65,66] (Table S4). The majority of the studies were conducted in the USA (n = 17) [36,40,41,42,43,44,46,47,48,49,52,55,58,60,62,65,67], followed by Africa (n = 6) [37,38,51,56,61,63], Australia (n = 4) [39,42,45,50], and the countries of Pakistan (n = 2) [54,59], Guatemala (n = 2) [57,64] and India (n = 1) [66] (Table S4). Of the 32 studies, seven [37,40,41,48,52,53,63] were excluded from further quantitative analysis since the outcome data were not stratified by the intervention type; thus, 25 studies were included for risk of bias assessment and meta-analysis (Table S4).
Studies were excluded from quantitative synthesis for the following reasons: ineligible study design (n = 44) [68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111], ineligible intervention, not MPTMRs (n = 20) [67,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130], ineligible outcome measured (n = 32) [128,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,154,155,156,157,158,159,160], and ineligible comparison (n = 1) [161] (Table S4).

3.2. Risk of Bias Assessment

Randomization sequence generation: All included studies were judged as having a low risk of selection bias with regards to randomization sequence generation (Figure 3 and Figure S1).
Allocation concealment: An unclear risk of bias for allocation concealment was concluded for most studies (n = 17; 68%).
Blinding: Blinding was assessed as a low risk of bias for most studies (n = 17; 68%).
Allocation concealment: The majority of studies (n = 17; 68%) were deemed as having an unclear risk of selection bias, with the remaining studies (n = 8; 32%) showing a low risk of selection bias [36,38,39,51,54,58,59] (Figure 3 and Figure S1).
Detection bias: The majority of studies (n = 16; 64%) showed low risks of detection bias where the outcome was assessed by data retrieval and the study analysts were blinded to the group assignments [43]. The remaining studies (n = 9; 36%) showed unclear risks of detection bias because these studies did not provide information on blinding of the assessment outcome (Figure 3 and Figure S1).
Incomplete outcomes: The majority of RCTs had a low risk of bias for incomplete outcome data reporting (n = 18; 72%) and selective reporting (n = 23; 92%) (Figure 3 and Figure S1).
Attrition bias: High attrition bias was observed in seven studies (28%) [36,47,49,56,64,66] (Figure 3 and Figure S1).
All but one study [56] reported a well-defined statistical analysis plan, thereby indicating a high reporting bias (Figure 3 and Figure S1). Additionally, all studies provided reasons for LTFU, which included, e.g., participants moved (out of state) or switched to a different clinic, study staff were unable to contact participants, telephone number disconnected, wrong telephone number, or participants died. Lastly, all but one study [49] showed an unclear risk of other biases (Figure 3 and Figure S1), and this was challenging to assess due to the small sample size.

3.3. Quantitative Data Synthesis

Twenty-five studies (n = 64,536 participants) were considered for quantitative synthesis of evidence regarding vaccination recall. Pooled data favored MPTMRs for vaccination recall compared to usual care (RR = 1.09 [95%CI: 1.06, 1.13]; I2 = 76%) (Figure 4, Table 1). Given the substantial heterogeneity among the study results, we conducted a sensitivity analysis, omitting studies of poor quality (n = 6) [44,45,46,49,58,65] that maintained the effect (pooled RR = 1.05 [95%CI: 1.03, 1.07]; I2 = 33%) (Figure S2). A meta-analysis conducted by excluding the results of studies with a high risk of attrition bias (n = 7) [36,47,49,56,60,64,66] produced similar results (pooled RR = 1.11 [95%CI: 1.07, 1.15]; I2 = 79%) (Table 1, Figure S3). A table summarizing the findings is provided in the Supplementary Material (Table S5).

3.4. Subgroup Analysis

3.4.1. Intervention Characteristics

The subgroup of MPTMRs with additional components had a similar effect on vaccination recall (RR = 1.10 [95%CI: 1.04, 1.16]; I2 = 83%) compared to the subgroup assessing the effect of MPTMRs alone (RR = 1.09 [95%CI: 1.04, 1.15]; I2 = 71%). The test for subgroup effect based on intervention characteristics demonstrated no statistically significant effect and no heterogeneity between the results of the two subgroups (I2 = 0%) (Table 1, Figure S4). This suggests that the intervention characteristics do not modify the effect of MPTMRs compared to usual care.

3.4.2. Country Setting

Subgroup analysis based on country setting showed no effect with no heterogeneity between results in the subgroups (I2 = 0%) (Table 1, Figure S5). Within the urban subgroup, the results show an effect in favor of MPTMRs (RR = 1.10 [95%CI: 1.06, 1.14]; I2 = 73%). Rural and/or suburban and/or semi-urban also shows an effect in favor of MPTMRs; however, there was no significant difference (RR = 1.10 [95%CI: 0.97, 1.24]; I2 = 89%) (Table 1, Figure S5).

3.4.3. Country Economic Status

The results show an effect in favor of MPTMRs regardless of a country’s income status. MPTMRs, when analyzed in the LMIC subgroup (RR = 1.07 [95%CI: 1.03, 1.11]; I2 = 65%), were slightly less effective than in the HIC subgroup (RR = 1.12 [95%CI: 1.06, 1.18]; I2 = 79%), with substantial heterogeneity observed in both subgroups (Table 1, Figure S6). The test for subgroup differences in country economic status shows that there is no statistically significant effect between the LMIC and HIC subgroups; moderate heterogeneity between results in the subgroups (I2 = 42.3%) was observed (Table 1, Figure S6). The HIC subgroup had more participants (57,186 participants) who contributed to the subgroup analysis compared to the LMIC subgroup (7350 participants), which may indicate that the analysis may not be able to detect subgroup differences.

3.4.4. Vaccination Type

The test for subgroup differences in vaccination type shows that there is no statistically significant effect among the vaccination types; however, moderate heterogeneity between results in the subgroups (I2 = 38.6%) was observed (Table 1, Figure S7). In all three subgroups, the results show an effect in favor of MPTMRs with RR = 1.07 [95%CI: 1.03, 1.11] observed in the early childhood vaccination subgroup, RR = 1.17 (95%CI: 1.05, 1.30) observed in the HPV subgroup, and RR = 1.14 [95%CI: 1.01, 1.28) observed in the other vaccination subgroup that comprised studies that investigated seasonal influenza vaccination recall. In addition, substantial heterogeneity was observed for the results in the early childhood vaccination subgroup (I2 = 63%), HPV subgroup (I2 = 86%) and the other vaccination type subgroup (I2 = 88%) (Table 1, Figure S7).

3.5. Risk of Publication Bias Assessment

Assessment of the funnel plot indicates a symmetrical plot that suggests the absence of publication bias (Figure S8).

4. Discussion

4.1. Summary of Main Findings

This meta-analysis of 25 studies presents the most recent available evidence on the effectiveness of MPTMRs on vaccination uptake in adolescents, children, and adults in all clinical settings, irrespective of country setting and vaccination type. Although small in effect, our pooled data demonstrate favoring MPTMRs for improving vaccination uptake compared to usual care. Subanalysis by intervention characteristics, country setting, country economic status, and vaccination type did not change the effectiveness of the intervention.
Notably, substantial heterogeneity was observed in the data of the included studies; nonetheless, similar results were obtained when excluding studies with high attrition bias from the meta-analysis. The findings in Neiderhauser et al. demonstrated an effect in favor of usual care (RR = 0.65; 95%CI: 0.40; 1.06) in relation to vaccination uptake. The sample size in this study was small, and the effect observed was not statistically significant. In addition, this study reported a high loss to follow-up in the MPTMRs (39%) compared to a 10% loss to follow-up in the control arm that could have influenced the findings [49].
MPTMRs having a positive effect on vaccination uptake could be influenced by a number of factors: (1) participants in the MPTMR arm receiving an additional $20 as incentive to support cellular phone charges [58], (2) participants in the MPTMR arm receiving at least 3 MPTMRs that could have influenced adherence to scheduled vaccination appointments [44,46,65], and (3) a study conducted in a high-risk population (individuals with chronic medical condition including pregnant individuals) in Australia that could have affected the findings [45]. We also observed relatively higher effectiveness of MPTMRs in HICs than in LMICs, which could be facilitated by easier access to health care, vaccination programs, and economic advancement.
The findings of this systematic review highlight the simplicity and effectiveness of mobile phone text message reminders (MPTMRs) in improving vaccination uptake. The effectiveness of MPTMRs was not influenced by intervention characteristics, country setting, economic status, or vaccination type. This suggests that MPTMRs are a universally effective strategy across various contexts, populations, and interventions. First, intervention characteristics (whether MPTMRs were used alone or combined with other components) showed no significant modification of the intervention’s effectiveness. This indicates that the core element—reminding individuals about upcoming vaccination appointments through text messaging—remains effective regardless of additional components, such as educational content or supplementary communication methods. The simplicity of MPTMRs likely plays a key role in their wide applicability and success, as they directly address one of the most common barriers to vaccination: missed appointments due to forgetfulness. Second, our country setting subgroup analysis (urban vs. rural) also revealed no substantial differences in the effectiveness of MPTMRs. This finding is particularly important as it challenges the notion that urban areas, which often have better infrastructure and access to health services, would show a greater benefit from text message reminders. Instead, the results suggest that the intervention is equally effective in rural or semi-urban settings, where health service access is more challenging. This supports the idea that digital interventions like MPTMRs can bridge the gap in health care delivery, even in less accessible regions. Furthermore, the review did not find significant differences in effectiveness when stratifying by country economic status (low- and middle-income countries [LMICs] vs. high-income countries [HICs]). This indicates that MPTMRs have the potential to be just as effective in resource-limited settings as in more affluent ones. Although fewer studies contributed data from LMICs compared to HICs, similar results across both groups suggest that the affordability and simplicity of MPTMRs make them a feasible intervention for improving vaccination uptake, regardless of a country’s financial status. Lastly, the type of vaccination (early childhood vaccines, HPV, or seasonal influenza) did not significantly impact the effectiveness of MPTMRs. The results reflect the adaptability of MPTMRs in reminding individuals of vaccinations across different stages of life, from infancy to adulthood, and for both routine and seasonal vaccinations.

4.2. Comparison with the Current Literature

Our findings are in agreement with findings from other published reviews that showed that MPTMRs significantly improved childhood, adolescent, and adult vaccination coverage, including pregnant women in LMICs [28,162], irrespective of country setting [163]. A recent systematic review also showed that MPTMRs significantly improved the receipt of vaccinations (RR = 1.29; 95%CI: 1.15 to 1.44) compared to postcard reminders [26]. In addition, findings in an earlier systematic review demonstrated that weekly MPTMRs lowered the risk of non-adherence to antiretroviral therapy, although quantitative synthesis was conducted on only two RCTs with adult patients only [164].

4.3. Impact of Mechanisms of MPTMRs

An estimated 7.41 billion people currently are mobile phone owners with an increase to 7.49 billion people expected in 2025 [165]. Since mobile phone use has also become more widespread [166] and MPTMRs were shown to be cost-effective in distributing health information in LMICs [167], MPTMRs could be used as a tool to penetrate areas that are hard to reach, fuel adoption of health intervention and expand the reach of vaccination programs in LMICs.

4.4. Strengths and Limitations of Methods

This systematic review had several strengths. Specifically, we included RCTs, conducted a well-defined comprehensive search of multiple bibliographic databases, and assessed and evaluated studies irrespective of study setting, publication language, or disease. While it is true that the effect size of mobile phone text message reminders (MPTMRs) on vaccination uptake is relatively small, this study remains highly significant for several reasons. First, small effect sizes can still have a substantial impact on public health when applied at scale. Given the global decline in vaccination coverage—exacerbated by the COVID-19 pandemic—every incremental increase in vaccination uptake has the potential to prevent vaccine-preventable diseases and save lives, especially in low- and middle-income countries where vaccination rates are already suboptimal. The population-level impact of small improvements in uptake should not be underestimated, particularly when considering large-scale immunisation efforts. Secondly, the simplicity, cost-effectiveness, and broad applicability of MPTMRs make them a practical tool for health care systems worldwide. Even a modest effect is valuable, as MPTMRs require minimal resources to implement and can be easily integrated into existing health care infrastructures. This is particularly important in resource-limited settings where more complex or costly interventions may not be feasible.
Moreover, MPTMRs are a low-barrier intervention that can reach diverse populations, including those in rural or underserved areas, where access to health care and timely vaccinations is often a challenge. The lack of significant variation in the intervention’s effectiveness across different economic statuses, settings, and vaccination types further underscores its utility in a variety of contexts. Finally, this study contributes to the growing body of evidence supporting digital health interventions. It lays the groundwork for future research aimed at optimizing and combining MPTMRs with other strategies, potentially enhancing their effectiveness. The ability to deliver personalized, timely reminders with minimal effort opens avenues for further innovation in public health interventions.
These studies, therefore, represent the most recent and available published evidence that evaluated the effectiveness of MPTMRs on vaccination uptake in a wide population. In addition, we diligently applied and adhered to the international standardized guidelines for conducting and reporting systematic reviews [31]. All studies included in the review showed a low risk of bias for random sequence generation, indicating an increased likelihood that the effect observed may be attributed to MPTMRs.

4.5. Limitations of Included Studies

Various limitations were identified in this review that are linked to limitations of the original studies. Most studies included in this review showed an unclear risk of bias since these studies did not report information on allocation concealment. In addition, seven studies showed a high risk of attrition bias, which could have influenced the study results. We did, however, conduct sensitivity analyses to better understand the impact of these limitations.

4.6. Implications for Future Research

The findings of this study have shown that MPTMRs are effective irrespective of a country’s economic status and the study setting. However, the majority of studies included in this review were conducted in HICs in an urban setting, making generalizability to LMICs a challenge. In addition, these studies focused on assessing the effect of MPTMRs in a population with bigger sample sizes, possibly due to increased ownership of mobile phones in this study population, compared to LMICs in rural settings. Future research should focus on assessing the effectiveness of MPTMRs in LMICs, irrespective of vaccination type.
A recent report demonstrated that language could have a positive influence on vaccine hesitancy [168]. Therefore, tailoring MPTMRs to include language specific to the population could thus influence vaccine hesitancy, which may have a positive effect on appointment adherence and subsequently vaccination recall. More studies are needed to assess tailored MPTMRs on vaccination recall, irrespective of the population.
MPTMRs were shown to be feasible in improving physical health in individuals with psychotic disorders [169] and cost-effective in distributing information on health and reminders in LMICs [167]. Currently, limited data are available on the feasibility and cost-effectiveness of MPTMRs in routine vaccination schedules globally. Generating these data is essential in evaluating the adoptability, scalability, and sustainability of this intervention in existing vaccination programs.

4.7. Implications for Practice and Policy

This study may have implications for both public health practice and vaccine research. The findings of this systematic review show that MPTMRs may be a useful tool to supplement existing standard practice within the health care system to facilitate behavior changes that may promote vaccination uptake. These findings could enable evidence-based decision making and enable evaluation of critical factors that influence achieving and sustaining immunization coverage globally, irrespective of the target population, country setting, and vaccination type.

5. Conclusions

MPTMRs have an effect, albeit relatively small, on vaccination uptake. The intervention works broadly across various programs irrespective of the target population characteristics or nature of the intervention. Our findings indicate that MPTMRs may be an effective tool to improve vaccination uptake, irrespective of disease, country setting, and economic status. These findings may assist public health practitioners, policymakers, and vaccine researchers in evidence-based decision making that focuses on MPTMRs and their effect on vaccination coverage.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/vaccines12101151/s1, Table S1: Pre-Defined Inclusion and Exclusion Criteria for Full-Text Eligibility; Table S2: Primary Search Strategy for PubMed; Table S3: Characteristics of Excluded Studies; Table S4: Characteristics of Included Studies; Table S5: Summary of Findings. Figure S1: Summary of Risk of Bias Graph for Included Studies; Figure S2: Meta-analysis of data from included studies omitting studies of poor quality; Figure S3: Meta-analysis of data from included studies that excluded studies with high attrition bias; Figure S4: Subgroup analysis based on intervention characteristics; Figure S5: Subgroup Analysis based on country setting; Figure S6: Subgroup analysis based on country economic status; Figure S7: Subgroup analysis based on vaccination type; Figure S8: Funnel plot illustrating publication bias.

Author Contributions

Conceptualization, G.E.L., A.S.-J.H., R.K. and M.E.E.; Methodology, G.E.L., A.S.-J.H., R.K. and M.E.E.; software, G.E.L.; validation, G.E.L. and A.S.-J.H.; formal analysis, G.E.L. and A.S.-J.H.; investigation, G.E.L. and A.S.-J.H.; data curation, G.E.L. and A.S.-J.H.; writing—original draft preparation, G.E.L.; writing—review and editing, A.S.-J.H. and M.E.E.; visualization, G.E.L. and A.S.-J.H.; supervision, A.S.-J.H. and M.E.E. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethical review and approval were waived for this study since it did not involve human subjects.

Informed Consent Statement

Not applicable.

Data Availability Statement

Detailed methods, results, and additional data are available in the manuscript and the Supplementary Materials.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. MacDonald, S.E.; Russell, M.L.; Liu, X.C.; Simmonds, K.A.; Lorenzetti, D.L.; Sharpe, H.; Svenson, J.; Svenson, L.W. Are we speaking the same language? An argument for the consistent use of terminology and definitions for childhood vaccination indicators. Hum. Vaccines Immunother. 2019, 15, 740–747. [Google Scholar] [CrossRef]
  2. Rachlin, A.; Danovaro-Holliday, M.C.; Murphy, P.; Sodha, S.V.; Wallace, A.S. Routine Vaccination Coverage—Worldwide, 2021. MMWR Morb. Mortal. Wkly. Rep. 2022, 71, 1396–1400. [Google Scholar] [CrossRef] [PubMed]
  3. Shet, A.; Carr, K.; Danovaro-Holliday, M.C.; Sodha, S.V.; Prosperi, C.; Wunderlich, J.; Wonodi, C.; Reynolds, H.W.; Mirza, I.; Gacic-Dobo, M.; et al. Impact of the SARS-CoV-2 pandemic on routine immunisation services: Evidence of disruption and recovery from 170 countries and territories. Lancet Glob. Health 2022, 10, e186–e194. [Google Scholar] [CrossRef] [PubMed]
  4. United Nations. The Sustainable Development Goals Report; United Nations: San Francisco, CA, USA, 2022. [Google Scholar]
  5. Dolan, S.B.; Carnahan, E.; Shearer, J.C.; Beylerian, E.N.; Thompson, J.; Gilbert, S.S.; Werner, L.; Ryman, T.K. Redefining vaccination coverage and timeliness measures using electronic immunization registry data in low- and middle-income countries. Vaccine 2019, 37, 1859–1867. [Google Scholar] [CrossRef] [PubMed]
  6. World Health Organization. Human Papillomavirus Vaccines: WHO Position Paper (2022 Update); World Health Organization: Geneva, Switzerland, 2022. [Google Scholar]
  7. World Health Organization. WHO Recommendations for Routine Immunization—Summary Tables. 2021. Available online: https://www.who.int/teams/immunization-vaccines-and-biologicals/policies/who-recommendations-for-routine-immunization---summary-tables (accessed on 10 October 2022).
  8. McLaughlin, J.M.; Swerdlow, D.L.; Khan, F.; Will, O.; Curry, A.; Snow, V.; Isturiz, R.E.; Jodar, L. Disparities in uptake of 13-valent pneumococcal conjugate vaccine among older adults in the United States. Hum. Vaccines Immunother. 2019, 15, 841–849. [Google Scholar] [CrossRef] [PubMed]
  9. Janssens, A.; Vaes, B.; Abels, C.; Crèvecoeur, J.; Mamouris, P.; Merckx, B.; Libin, P.; Van Pottelbergh, G.; Neyens, T. Pneumococcal vaccination coverage and adherence to recommended dosing schedules in adults: A repeated cross-sectional study of the INTEGO morbidity registry. BMC Public Health 2023, 23, 1104. [Google Scholar] [CrossRef]
  10. Hadjipanayis, A.; Efstathiou, E.; Michaelidou, K.; Papaevangelou, V. Adherence to pneumococcal conjugate vaccination schedule and uptake rate as compared to the established diphtheria-tetanus-acellular pertussis vaccination in Cyprus. Vaccine 2018, 36, 5685–5691. [Google Scholar] [CrossRef]
  11. Nkenyi, R.; Telep, D.; Ndip, L.; Nsagha, D. Factors Associated to the Non-adherence to Vaccination Appointments in the Ngambe Health District, Littoral Region, Cameroon: A Case Control Study. Int. J. Trop. Dis. Health 2019, 37, 1–9. [Google Scholar] [CrossRef]
  12. Tsachouridou, O.; Georgiou, A.; Naoum, S.; Vasdeki, D.; Papagianni, M.; Kotoreni, G.; Forozidou, E.; Tsoukra, P.; Gogou, C.; Chatzidimitriou, D.; et al. Factors associated with poor adherence to vaccination against hepatitis viruses, streptococcus pneumoniae and seasonal influenza in HIV-infected adults. Hum. Vaccines Immunother. 2019, 15, 295–304. [Google Scholar] [CrossRef]
  13. Srivastava, S.; Fledderjohann, J.; Upadhyay, A.K. Explaining socioeconomic inequalities in immunisation coverage in India: New insights from the fourth National Family Health Survey (2015–16). BMC Pediatr. 2020, 20, 295. [Google Scholar] [CrossRef]
  14. Caspi, G.; Dayan, A.; Eshal, Y.; Liverant-Taub, S.; Twig, G.; Shalit, U.; Lewis, Y.; Shina, A.; Caspi, O. Socioeconomic disparities and COVID-19 vaccination acceptance: A nationwide ecologic study. Clin. Microbiol. Infect. 2021, 27, 1502–1506. [Google Scholar] [CrossRef] [PubMed]
  15. Monguno, A.K. Socio cultural and geographical determinants of child immunisation in borno state, nigeria. J. Public Health Afr. 2013, 4, e10. [Google Scholar] [CrossRef] [PubMed]
  16. Jillian, O.; Kizito, O. Socio-Cultural Factors Associated with Incomplete Routine Immunization of Children—Amach Sub-County, Uganda. Cogent Med. 2020, 7, 1848755. [Google Scholar] [CrossRef]
  17. Keselman, A.; Arnott Smith, C.; Wilson, A.J.; Leroy, G.; Kaufman, D.R. Cognitive and Cultural Factors That Affect General Vaccination and COVID-19 Vaccination Attitudes. Vaccines 2022, 11, 94. [Google Scholar] [CrossRef] [PubMed]
  18. Tambe, T.A.; Tchetnya, X.; Nkfusai, C.N.; Shirinde, J.; Cumber, S.N. Reasons for non-compliance to immunization among Fulani children aged between 0-11 months in the Vekovi community in Cameroon. Pan Afr. Med. J. 2019, 33, 278. [Google Scholar] [CrossRef]
  19. World Health Organization. Global Vaccine Action Plan. 2011–2020; World Health Organization: Geneva, Switzerland, 2013. [Google Scholar]
  20. World Health Organization. Global Vaccine Action Plan: Monitoring, Evaluation and Accountability; Secretariat Annual Report 2020; Licence: CC BY-NC-SA 3.0 IGO; World Health Organization: Geneva, Switzerland, 2020. [Google Scholar]
  21. World Health Organization. Immunization Agenda 2030: A Global Strategy to Leave No One Behind; World Health Organization: Geneva, Switzerland, 2021. [Google Scholar]
  22. Galadima, A.N.; Zulkefli, N.A.M.; Said, S.M.; Ahmad, N. Factors influencing childhood immunisation uptake in Africa: A systematic review. BMC Public Health 2021, 21, 1475. [Google Scholar] [CrossRef]
  23. Aranda-Jan, C.B.; Mohutsiwa-Dibe, N.; Loukanova, S. Systematic review on what works, what does not work and why of implementation of mobile health (mHealth) projects in Africa. BMC Public Health 2014, 14, 188. [Google Scholar] [CrossRef] [PubMed]
  24. Odone, A.; Gianfredi, V.; Sorbello, S.; Capraro, M.; Frascella, B.; Vigezzi, G.P.; Signorelli, C. The Use of Digital Technologies to Support Vaccination Programmes in Europe: State of the Art and Best Practices from Experts’ Interviews. Vaccines 2021, 9, 1126. [Google Scholar] [CrossRef]
  25. Cascini, F.; Pantovic, A.; Al-Ajlouni, Y.A.; Failla, G.; Puleo, V.; Melnyk, A.; Lontano, A.; Ricciardi, W. Social media and attitudes towards a COVID-19 vaccination: A systematic review of the literature. EClinicalMedicine 2022, 48, 101454. [Google Scholar] [CrossRef]
  26. Jacobson Vann, J.C.; Jacobson, R.M.; Coyne-Beasley, T.; Asafu-Adjei, J.K.; Szilagyi, P.G. Patient reminder and recall interventions to improve immunization rates. Cochrane Database Syst. Rev. 2018, 1, CD003941. [Google Scholar] [CrossRef]
  27. Harvey, H.; Reissland, N.; Mason, J. Parental reminder, recall and educational interventions to improve early childhood immunisation uptake: A systematic review and meta-analysis. Vaccine 2015, 33, 2862–2880. [Google Scholar] [CrossRef] [PubMed]
  28. Eze, P.; Lawani, L.O.; Acharya, Y. Short message service (SMS) reminders for childhood immunisation in low-income and middle-income countries: A systematic review and meta-analysis. BMJ Glob. Health 2021, 6, e005035. [Google Scholar] [CrossRef] [PubMed]
  29. Batteux, E.; Mills, F.; Jones, L.F.; Symons, C.; Weston, D. The Effectiveness of Interventions for Increasing COVID-19 Vaccine Uptake: A Systematic Review. Vaccines 2022, 10, 386. [Google Scholar] [CrossRef]
  30. Page, M.; McKenzie, J.; Bossuyt, P.; Boutron, I.; Hoffmann, T.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef]
  31. Higgins, J.P.T.; Thomas, J.; Chandler, J.; Cumpston, M.; Li, T.; Page, M.J.; Welch, V.A. Cochrane Handbook for Systematic Reviews of Interventions Version 6.3 (Updated February 2022). 2022. Available online: https://training.cochrane.org/handbook/current (accessed on 23 July 2022).
  32. Johnson, N.; Phillips, M. Rayyan for systematic reviews. J. Electron. Resour. Librariansh. 2018, 30, 46–48. [Google Scholar] [CrossRef]
  33. The Cochrane Collaboration. Review Manager (RevMan) [Computer Program]; The Cochrane Collaboration: London, UK, 2020. [Google Scholar]
  34. Higgins, J.P.T.; Altman, D.G.; Gøtzsche, P.C.; Jüni, P.; Moher, D.; Oxman, A.D.; Savovic, J.; Schulz, K.F.; Weeks, L.; Sterne, J.A.; et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011, 343, d5928. [Google Scholar] [CrossRef] [PubMed]
  35. Sterne, J.; Harbord, R. Funnel plots in meta-analysis. Stata J. 2004, 4, 127–141. [Google Scholar] [CrossRef]
  36. Ahlers-Schmidt, C.R.; Chesser, A.K.; Nguyen, T.; Brannon, J.; Hart, T.A.; Williams, K.S.; Wittler, R.R. Feasibility of a randomized controlled trial to evaluate Text Reminders for Immunization Compliance in Kids (TRICKs). Vaccine 2012, 30, 5305–5309. [Google Scholar] [CrossRef] [PubMed]
  37. Ekhaguere, O.A.; Oluwafemi, R.O.; Badejoko, B.; Oyeneyin, L.O.; Butali, A.; Lowenthal, E.D.; Steenhoff, A.P. Automated phone call and text reminders for childhood immunisations (PRIMM): A randomised controlled trial in Nigeria. BMJ Glob. Health 2019, 4, e001232. [Google Scholar] [CrossRef]
  38. Gibson, D.G.; Ochieng, B.; Kagucia, E.W.; Were, J.; Hayford, K.; Moulton, L.H.; Levine, O.S.; Odhiambo, F.; O’Brien, K.L.; Feikin, D.R. Mobile phone-delivered reminders and incentives to improve childhood immunisation coverage and timeliness in Kenya (M-SIMU): A cluster randomised controlled trial. Lancet Glob. Health 2017, 5, e428–e438. [Google Scholar] [CrossRef]
  39. O’Grady, K.-A.F.; Kaus, M.; Jones, L.; Boddy, G.; Rablin, S.; Roberts, J.; Arnold, D.; Parfitt, S.; Johnston, R.; Hall, K.K.; et al. SMS reminders to improve the uptake and timeliness of the primary immunisation series in infants: A multi-centre randomised controlled trial. Commun. Dis. Intell. 2022, 46, 1–19. [Google Scholar] [CrossRef] [PubMed]
  40. Richman, A.R.; Maddy, L.; Torres, E.; Goldberg, E.J. A randomized intervention study to evaluate whether electronic messaging can increase human papillomavirus vaccine completion and knowledge among college students. J. Am. Coll. Health 2016, 64, 269–278. [Google Scholar] [CrossRef] [PubMed]
  41. Richman, A.R.; Torres, E.; Wu, Q.; Carlston, L.; O’Rorke, S.; Moreno, C.; Olsson, J. Text and Email Messaging for Increasing Human Papillomavirus Vaccine Completion among Uninsured or Medicaid-insured Adolescents in Rural Eastern North Carolina. J. Health Care Poor Underserved 2019, 30, 1499–1517. [Google Scholar] [CrossRef] [PubMed]
  42. Tull, F.; Borg, K.; Knott, C.; Beasley, M.; Halliday, J.; Faulkner, N.; Sutton, K.; Bragge, P. Short message service reminders to parents for increasing adolescent human papillomavirus vaccination rates in a secondary school vaccine program: A randomized control trial. J. Adolesc. Health 2019, 65, 116–123. [Google Scholar] [CrossRef] [PubMed]
  43. Hofstetter, A.M.; DuRivage, N.; Vargas, C.Y.; Camargo, S.; Vawdrey, D.K.; Fisher, A.; Stockwell, S. Text message reminders for timely routine MMR vaccination: A randomized controlled trial. Vaccine 2015, 33, 5741–5746. [Google Scholar] [CrossRef] [PubMed]
  44. Stockwell, M.S.; Kharbanda, E.O.; Martinez, R.A.; Lara, M.; Vawdrey, D.; Natarajan, K.; Rickert, V.I. Text4Health: Impact of text message reminder-recalls for pediatric and adolescent immunizations. Am. J. Public Health 2012, 102, e15–e21. [Google Scholar] [CrossRef]
  45. Regan, A.K.; Bloomfield, L.; Peters, I.; Effler, P.V. Randomized controlled trial of text message reminders for increasing influenza vaccination. Ann. Fam. Med. 2017, 15, 507–514. [Google Scholar] [CrossRef]
  46. Rand, C.M.; Vincelli, P.; Goldstein, N.P.N.; Blumkin, A.; Szilagyi, P.G. Effects of phone and text message reminders on completion of the human papillomavirus vaccine series. J. Adolesc. Health 2017, 60, 113–119. [Google Scholar] [CrossRef]
  47. Rand, C.M.; Brill, H.; Albertin, C.; Humiston, S.G.; Schaffer, S.; Shone, L.P.; Blumkin, A.k.; Szilagyi, P.G. Effectiveness of centralized text message reminders on human papillomavirus immunization coverage for publicly insured adolescents. J. Adolesc. Health 2015, 56, S17–S20. [Google Scholar] [CrossRef]
  48. Patel, A.; Stern, L.; Unger, Z.; Debevec, E.; Roston, A.; Hanover, R.; Morfesis, J. Staying on track: A cluster randomized controlled trial of automated reminders aimed at increasing human papillomavirus vaccine completion. Vaccine 2014, 32, 2428–2433. [Google Scholar] [CrossRef]
  49. Niederhauser, V.; Johnson, M.; Tavakoli, A.S. Vaccines4Kids: Assessing the impact of text message reminders on immunization rates in infants. Vaccine 2015, 33, 2984–2989. [Google Scholar] [CrossRef] [PubMed]
  50. Menzies, R.; Heron, L.; Lampard, J.; McMillan, M.; Joseph, T.; Chan, J.; Storken, A.; Marshall, H. A randomised controlled trial of SMS messaging and calendar reminders to improve vaccination timeliness in infants. Vaccine 2020, 38, 3137–3142. [Google Scholar] [CrossRef] [PubMed]
  51. Mekonnen, Z.A.; Gelaye, K.A.; Were, M.; Tilahun, B. Effect of mobile phone text message reminders on the completion and timely receipt of routine childhood vaccinations: Superiority randomized controlled trial in northwest ethiopia. JMIR Mhealth Uhealth 2021, 9, e27603. [Google Scholar] [CrossRef] [PubMed]
  52. Lerner, C.; Albertin, C.; Casillas, A.; Duru, O.K.; Ong, M.K.; Vangala, S.; Humiston, S.; Evans, S.; Sloyan, M.; Fox, C.R.; et al. Patient portal reminders for pediatric influenza vaccinations: A randomized clinical trial. Pediatrics 2021, 148, e2020048413. [Google Scholar] [CrossRef]
  53. Kempe, A.; O’Leary, S.T.; Shoup, J.A.; Stokley, S.; Lockhart, S.; Furniss, A.; Dickinson, L.M.; Barnard, J.; Daley, M.F. Parental choice of recall method for HPV vaccination: A pragmatic trial. Pediatrics 2016, 137, e20152857. [Google Scholar] [CrossRef] [PubMed]
  54. Kazi, A.M.; Ali, M.; Zubair, K.; Kalimuddin, H.; Kazi, A.N.; Iqbal, S.P.; Collet, J.P.; Ali, S.A. Effect of mobile phone text message reminders on routine immunization uptake in pakistan: Randomized controlled trial. JMIR Public Health Surveill. 2018, 4, e20. [Google Scholar] [CrossRef]
  55. Gurfinkel, D.; Kempe, A.; Albertin, C.; Breck, A.; Zhou, X.; Vangala, S.; Beaty, B.; Rice, J.; Tseng, C.H.; Campbell, J.D.; et al. Centralized Reminder/Recall for Human Papillomavirus Vaccination: Findings From Two States-A Randomized Clinical Trial. J. Adolesc. Health 2021, 69, 579–587. [Google Scholar] [CrossRef]
  56. Eze, G.U.; Adeleye, O.O. Enhancing Routine Immunization Performance using Innovative Technology in an Urban Area of Nigeria. West. Afr. J. Med. 2015, 34, 3–10. [Google Scholar]
  57. Domek, G.J.; Contreras-Roldan, I.L.; O’Leary, S.T.; Bull, S.; Furniss, A.; Kempe, A.; Asturias, E.J. SMS text message reminders to improve infant vaccination coverage in Guatemala: A pilot randomized controlled trial. Vaccine 2016, 34, 2437–2443. [Google Scholar] [CrossRef]
  58. DeCamp, L.R.; Godage, S.K.; Valenzuela Araujo, D.; Dominguez Cortez, J.; Wu, L.; Psoter, K.J.; Quintanilla, K.; Rivera Rodriguez, T.; Polk, S. A texting intervention in latino families to reduce ED use: A randomized trial. Pediatrics 2020, 145, e20191405. [Google Scholar] [CrossRef]
  59. Chandir, S.; Siddiqi, D.A.; Duflo, E.; Khan, A.J.; Glennerster, R. Conditional cash transfers; Mobile-based conditional cash transfers; Incentives; Immunizations; Vaccines; Coverage. EClinicalMedicine 2022, 50, 101500. [Google Scholar] [CrossRef] [PubMed]
  60. Buttenheim, A.; Milkman, K.L.; Duckworth, A.L.; Gromet, D.M.; Patel, M.; Chapman, G. Effects of ownership text message wording and reminders on receipt of an influenza vaccination: A randomized clinical trial. JAMA Netw. Open 2022, 5, e2143388. [Google Scholar] [CrossRef] [PubMed]
  61. Bangure, D.; Chirundu, D.; Gombe, N.; Marufu, T.; Mandozana, G.; Tshimanga, M.; Takundwa, L. Effectiveness of short message services reminder on childhood immunization programme in Kadoma, Zimbabwe—A randomized controlled trial, 2013. BMC Public Health 2015, 15, 137. [Google Scholar] [CrossRef]
  62. Stockwell, M.S.; Shone, L.P.; Nekrasova, E.; Wynn, C.; Torres, A.; Griffith, M.; Shults, J.; Unger, R.; Ware, L.A.; Kolff, C.; et al. Text message reminders for the second dose of influenza vaccine for children: An RCT. Pediatrics 2022, 150, e2022056967. [Google Scholar] [CrossRef] [PubMed]
  63. Dissieka, R.; Soohoo, M.; Janmohamed, A.; Doledec, D. Providing mothers with mobile phone message reminders increases childhood immunization and vitamin A supplementation coverage in Côte d’Ivoire: A randomized controlled trial. J. Public Health Afr. 2019, 10, 1032. [Google Scholar] [CrossRef] [PubMed]
  64. Domek, G.J.; Contreras-Roldan, I.L.; Bull, S.; O’Leary, S.T.; Bolaños Ventura, G.A.; Bronsert, M.; Kempe, A.; Asturias, E.J. Text message reminders to improve infant immunization in Guatemala: A randomized clinical trial. Vaccine 2019, 37, 6192–6200. [Google Scholar] [CrossRef]
  65. O’Leary, S.T.; Lee, M.; Lockhart, S.; Eisert, S.; Furniss, A.; Barnard, J.; Eblovi, D.E.; Shmueli, D.; Stokley, S.; Dickinson, L.M.; et al. Effectiveness and cost of bidirectional text messaging for adolescent vaccines and well care. Pediatrics 2015, 136, e1220–e1227. [Google Scholar] [CrossRef]
  66. Shinde, K.; Rani, U.; Kumar, P.N. Assessing the effectiveness of immunization reminder system among nursing mothers of South India. Res. J. Pharm. Technol. 2018, 11, 1761–1767. [Google Scholar] [CrossRef]
  67. Kempe, A.; Saville, A.W.; Albertin, C.; Helmkamp, L.; Zhou, X.; Vangela, S.; Dickinson, L.M.; Tseng, C.H.; Campbell, J.D.; Whittington, M.; et al. Centralized Reminder/Recall to Increase Influenza Vaccination Rates: A Two-State Pragmatic Randomized Trial. Acad. Pediatr. 2020, 20, 374–383. [Google Scholar] [CrossRef]
  68. Ahmed, N.; Quinn, S.C.; Hancock, G.R.; Freimuth, V.S.; Jamison, A. Social media use and influenza vaccine uptake among White and African American adults. Vaccine 2018, 36, 7556–7561. [Google Scholar] [CrossRef]
  69. Aragones, A.; Bruno, D.M.; Ehrenberg, M.; Tonda-Salcedo, J.; Gany, F.M. Parental education and text messaging reminders as effective community based tools to increase HPV vaccination rates among Mexican American children. Prev. Med. Rep. 2015, 2, 554–558. [Google Scholar] [CrossRef] [PubMed]
  70. Atchison, C.; Zvoc, M.; Balakrishnan, R. The evaluation of a standardized call/recall system for childhood immunizations in Wandsworth, England. J. Community Health 2013, 38, 581–587. [Google Scholar] [CrossRef] [PubMed]
  71. Atkinson, K.M.; Westeinde, J.; Ducharme, R.; Wilson, S.E.; Deeks, S.L.; Crowcroft, N.; Hawken, S.; Wilson, K. Can mobile technologies improve on-time vaccination? A study piloting maternal use of ImmunizeCA, a Pan-Canadian immunization app. Hum. Vaccines Immunother. 2016, 12, 2654–2661. [Google Scholar] [CrossRef] [PubMed]
  72. Bar-Shain, D.S.; Stager, M.M.; Runkle, A.P.; Leon, J.B.; Kaelber, D.C. Direct messaging to parents/guardians to improve adolescent immunizations. J. Adolesc. Health 2015, 56, S21–S26. [Google Scholar] [CrossRef]
  73. Bay, S.L.; Crawford, D.J. Using technology to affect influenza vaccine coverage among children with chronic respiratory conditions. J. Pediatr. Health Care 2017, 31, 155–160. [Google Scholar] [CrossRef]
  74. Bushar, J.A.; Kendrick, J.S.; Ding, H.; Black, C.L.; Greby, S.M. Text4baby influenza messaging and influenza vaccination among pregnant women. Am. J. Prev. Med. 2017, 53, 845–853. [Google Scholar] [CrossRef] [PubMed]
  75. Davis, R. Impact on child vaccination completion rates of short message services (SMS) reminders in developing countries. Pan Afr. Med. J. 2020, 35, 12. [Google Scholar] [CrossRef] [PubMed]
  76. de Oliveira Bressane Lima, P.; van Lier, A.; de Melker, H.; Ferreira, J.A.; van Vliet, H.; Knol, M.J. MenACWY vaccination campaign for adolescents in the Netherlands: Uptake and its determinants. Vaccine 2020, 38, 5516–5524. [Google Scholar] [CrossRef]
  77. Di Mauro, A.; Di Mauro, F.; De Nitto, S.; Rizzo, L.; Greco, C.; Stefanizzi, P.; Tafuri, S.; Baldassarre, M.E.; Laforgia, N. Social Media Interventions Strengthened COVID-19 Immunization Campaign. Front. Pediatr. 2022, 10, 869893. [Google Scholar] [CrossRef]
  78. Diallo, O.; Schlumberger, M.; Sanou, C.; Dicko, H.; Aplogan, A.; Drabo, F. Use of SMS to ask mothers to come to vaccination sessions in Bobo-Dioulasso. Bull. Soc. Pathol. Exot. 2012, 105, 291–295. [Google Scholar] [CrossRef]
  79. Dombkowski, K.J.; Cowan, A.E.; Reeves, S.L.; Foley, M.R.; Dempsey, A.F. The impacts of email reminder/recall on adolescent influenza vaccination. Vaccine 2017, 35, 3089–3095. [Google Scholar] [CrossRef] [PubMed]
  80. Dombkowski, K.J.; Cowan, A.E.; Costello, L.E.; Fisher, A.M.; Clark, S.J. Feasibility of automated appointment reminders using email. Clin. Pediatr. (Phila) 2014, 53, 1004–1007. [Google Scholar] [CrossRef] [PubMed]
  81. Fiks, A.G. Centralized Reminder/Recall. JAMA Pediatr. 2015, 169, 314. [Google Scholar] [CrossRef] [PubMed]
  82. Frew, P.M.; Lutz, C.S. Interventions to increase pediatric vaccine uptake: An overview of recent findings. Hum. Vaccines Immunother. 2017, 13, 2503–2511. [Google Scholar] [CrossRef]
  83. Garcia-Dia, M.J.; Fitzpatrick, J.J.; Madigan, E.A.; Peabody, J.W. Using text reminder to improve childhood immunization adherence in the philippines. Comput. Inform. Nurs. 2017, 35, 212–218. [Google Scholar] [CrossRef]
  84. Gerend, M.A.; Murdock, C.; Grove, K. An intervention for increasing HPV vaccination on a university campus. Vaccine 2020, 38, 725–729. [Google Scholar] [CrossRef]
  85. Haji, A.; Lowther, S.; Ngan’ga, Z.; Gura, Z.; Tabu, C.; Sandhu, H.; Arvelo, W. Reducing routine vaccination dropout rates: Evaluating two interventions in three Kenyan districts, 2014. BMC Public Health 2016, 16, 152. [Google Scholar] [CrossRef]
  86. Haskew, J.; Kenyi, V.; William, J.; Alum, R.; Puri, A.; Mostafa, Y.; Davis, R. Use of Mobile Information Technology during Planning, Implementation and Evaluation of a Polio Campaign in South Sudan. PLoS ONE 2015, 10, e0135362. [Google Scholar] [CrossRef] [PubMed]
  87. Ibraheem, R.; Akintola, M.; Abdulkadir, M.; Ameen, H.; Bolarinwa, O.; Adeboye, M. Effects of call reminders, short message services (SMS) reminders, and SMS immunization facts on childhood routine vaccination timing and completion in Ilorin, Nigeria. Afr. Health Sci. 2021, 21, 951–959. [Google Scholar] [CrossRef] [PubMed]
  88. James, E.K.; Bokemper, S.E.; Gerber, A.S.; Omer, S.B.; Huber, G.A. Persuasive messaging to increase COVID-19 vaccine uptake intentions. Vaccine 2021, 39, 7158–7165. [Google Scholar] [CrossRef] [PubMed]
  89. Jones Cooper, S.N.; Walton-Moss, B. Using reminder/recall systems to improve influenza immunization rates in children with asthma. J. Pediatr. Health Care 2013, 27, 327–333. [Google Scholar] [CrossRef] [PubMed]
  90. Jordan, E.T.; Bushar, J.A.; Kendrick, J.S.; Johnson, P.; Wang, J. Encouraging influenza vaccination among text4baby pregnant women and mothers. Am. J. Prev. Med. 2015, 49, 563–572. [Google Scholar] [CrossRef] [PubMed]
  91. Kahn, K.E.; Santibanez, T.A.; Zhai, Y.; Bridges, C.B. Association between patient reminders and influenza vaccination status among children. Vaccine 2018, 36, 8110–8118. [Google Scholar] [CrossRef] [PubMed]
  92. Kazi, A.M. The role of mobile phone-based interventions to improve routine childhood immunisation coverage. Lancet Glob. Health 2017, 5, e377–e378. [Google Scholar] [CrossRef] [PubMed]
  93. Keeshin, S.W.; Feinberg, J. Text Message Reminder-Recall to Increase HPV Immunization in Young HIV-1-Infected Patients. J. Int. Assoc. Provid. AIDS Care 2017, 16, 110–113. [Google Scholar] [CrossRef]
  94. Kim, S.S.; Patel, M.; Hinman, A. Use of m-Health in polio eradication and other immunization activities in developing countries. Vaccine 2017, 35, 1373–1379. [Google Scholar] [CrossRef]
  95. Lee, H.Y.; Koopmeiners, J.S.; McHugh, J.; Raveis, V.H.; Ahluwalia, J.S. mHealth Pilot Study: Text Messaging Intervention to Promote HPV Vaccination. Am. J. Health Behav. 2016, 40, 67–76. [Google Scholar] [CrossRef]
  96. Masresha, B.; Nwankwo, O.; Bawa, S.; Igbu, T.; Oteri, J.; Tafida, H.; Braka, F. The use of WhatsApp group messaging in the coordination of measles supplemental immunization activity in Cross Rivers State, Nigeria, 2018. Pan Afr. Med. J. 2020, 35, 6. [Google Scholar] [CrossRef]
  97. Matheson, E.C.; Derouin, A.; Gagliano, M.; Thompson, J.A.; Blood-Siegfried, J. Increasing HPV vaccination series completion rates via text message reminders. J. Pediatr. Health Care 2014, 28, e35–e39. [Google Scholar] [CrossRef]
  98. McGlone, M.S.; Stephens, K.K.; Rodriguez, S.A.; Fernandez, M.E. Persuasive texts for prompting action: Agency assignment in HPV vaccination reminders. Vaccine 2017, 35, 4295–4297. [Google Scholar] [CrossRef] [PubMed]
  99. Mohanty, S.; Leader, A.E.; Gibeau, E.; Johnson, C. Using Facebook to reach adolescents for human papillomavirus (HPV) vaccination. Vaccine 2018, 36, 5955–5961. [Google Scholar] [CrossRef] [PubMed]
  100. Morris, J.; Wang, W.; Wang, L.; Peddecord, K.M.; Sawyer, M.H. Comparison of reminder methods in selected adolescents with records in an immunization registry. J. Adolesc. Health 2015, 56, S27–S32. [Google Scholar] [CrossRef] [PubMed]
  101. Oladepo, O.; Dipeolu, I.O.; Oladunni, O. Outcome of reminder text messages intervention on completion of routine immunization in rural areas, Nigeria. Health Promot. Int. 2021, 36, 765–773. [Google Scholar] [CrossRef] [PubMed]
  102. Qamar, F.N.; Batool, R.; Qureshi, S.; Ali, M.; Sadaf, T.; Mehmood, J.; Iqbal, K.; Sultan, A.; Duff, N.; Yousafzai, M.T. Strategies to improve coverage of typhoid conjugate vaccine (TCV) immunization campaign in karachi, pakistan. Vaccines 2020, 8, 697. [Google Scholar] [CrossRef] [PubMed]
  103. Schlumberger, M.; Bamoko, A.; Yaméogo, T.M.; Rouvet, F.; Ouedraogo, R.; Traoré, B.; Tinto, M.; Bakyono, J.F.; Sombie, I.; Bazié, B.B.; et al. Positive impact on the Expanded Program on Immunization when sending call-back SMS through a Computerized Immunization Register, Bobo Dioulasso (Burkina Faso). Bull. Soc. Pathol. Exot. 2015, 108, 349–354. [Google Scholar] [CrossRef]
  104. Suppli, C.H.; Rasmussen, M.; Valentiner-Branth, P.; Mølbak, K.; Krause, T.G. Written reminders increase vaccine coverage in Danish children—Evaluation of a nationwide intervention using The Danish Vaccination Register, 2014 to 2015. Eurosurveillance 2017, 22, 30522. [Google Scholar] [CrossRef]
  105. Venkatesh, A.; Chia, D.T.; Tang, A.; Waldock, W. Efficacy of text message intervention for increasing MMR uptake in light of the recent loss of UK’s measles-free status. Br. J. Gen. Pract. 2020, 70, 110. [Google Scholar] [CrossRef]
  106. Venci, D.; Slain, D.; Elswick, B.; Sarwari, A.; Ross, A.; Smithmyer, A.; Hare, J.; Briggs, F. Inclusion of social media-based strategies in a health care worker influenza immunication campaign. Am. J. Infect. Control 2015, 43, 903. [Google Scholar] [CrossRef]
  107. Xeuatvongsa, A.; Datta, S.S.; Moturi, E.; Wannemuehler, K.; Philakong, P.; Vongxay, V.; Vilayvone, V.; Patel, M.K. Improving hepatitis B birth dose in rural Lao People’s Democratic Republic through the use of mobile phones to facilitate communication. Vaccine 2016, 34, 5777–5784. [Google Scholar] [CrossRef] [PubMed]
  108. Yunusa, U.; Ibrahim, A.H.; Ladan, M.A.; Gomaa, H.E.M. Effect of mobile phone text message and call reminders in the completeness of pentavalent vaccines in Kano state, Nigeria. J. Pediatr. Nurs. 2022, 64, e77–e83. [Google Scholar] [CrossRef]
  109. Manderson, J.L.; Smoll, N.R.; Krenske, D.L.; Nedwich, L.; Harbin, L.; Charles, M.G.; Wyatt, A.; Schulz, C.N.; Walker, J.; Khandaker, G.M. SMS reminders increase on-time vaccination in Aboriginal and Torres Strait Islander infants. Commun. Dis. Intell. 2023, 47, 1–17. [Google Scholar] [CrossRef] [PubMed]
  110. Alonge, O.D.; Hanson, K.E.; Eggebrecht, M.; Funk, P.; Christianson, B.; Williams, C.L.; Belongia, E.A.; McLean, H.Q. COVID-19 Booster Dose Reminder/Recall for Adolescents: Findings From a Health-Care System in Wisconsin. J. Adolesc. Health 2023, 73, 953–956. [Google Scholar] [CrossRef] [PubMed]
  111. Translating Best Evidence into Best Care. J. Pediatr. 2017, 190, 287–290. [CrossRef] [PubMed]
  112. Brigham, K.S.; Woods, E.R.; Steltz, S.K.; Sandora, T.J.; Blood, E.A. Randomized controlled trial of an immunization recall intervention for adolescents. Pediatrics 2012, 130, 507–514. [Google Scholar] [CrossRef]
  113. Brown, V.B.; Oluwatosin, O.A. Feasibility of implementing a cellphone-based reminder/recall strategy to improve childhood routine immunization in a low-resource setting: A descriptive report. BMC Health Serv. Res. 2017, 17, 703. [Google Scholar] [CrossRef]
  114. Bundy, D.G.; Persing, N.M.; Solomon, B.S.; King, T.M.; Murakami, P.N.; Thompson, R.E.; Engineer, L.D.; Lehmann, C.U.; Miller, M.R. Improving immunization delivery using an electronic health record: The ImmProve project. Acad. Pediatr. 2013, 13, 458–465. [Google Scholar] [CrossRef]
  115. Busso, M.; Cristia, J.; Humpage, S. Did you get your shots? Experimental evidence on the role of reminders. J. Health Econ. 2015, 44, 226–237. [Google Scholar] [CrossRef]
  116. Glanz, J.M.; Wagner, N.M.; Narwaney, K.J.; Kraus, C.R.; Shoup, J.A.; Xu, S.; O’Leary, S.T.; Omer, S.B.; Gleason, K.S.; Daley, M.F. Web-based Social Media Intervention to Increase Vaccine Acceptance: A Randomized Controlled Trial. Pediatrics 2017, 140, e20171117. [Google Scholar] [CrossRef]
  117. Gold, M.S.; Lincoln, G.; Cashman, P.; Braunack-Mayer, A.; Stocks, N. Efficacy of m-Health for the detection of adverse events following immunization—The stimulated telephone assisted rapid safety surveillance (STARSS) randomised control trial. Vaccine 2021, 39, 332–342. [Google Scholar] [CrossRef]
  118. Henrikson, N.B.; Zhu, W.; Baba, L.; Nguyen, M.; Berthoud, H.; Gundersen, G.; Hofstetter, A.M. Outreach and reminders to improve human papillomavirus vaccination in an integrated primary care system. Clin. Pediatr. (Phila) 2018, 57, 1523–1531. [Google Scholar] [CrossRef]
  119. Hurley, L.P.; Beaty, B.; Lockhart, S.; Gurfinkel, D.; Dickinson, L.M.; Roth, H.; Kempe, A. Randomized controlled trial of centralized vaccine reminder/recall to improve adult vaccination rates in an accountable care organization setting. Prev. Med. Rep. 2019, 15, 100893. [Google Scholar] [CrossRef] [PubMed]
  120. Hurley, L.P.; Beaty, B.; Lockhart, S.; Gurfinkel, D.; Breslin, K.; Dickinson, M.; Whittington, M.D.; Roth, H.; Kempe, A. RCT of centralized vaccine reminder/recall for adults. Am. J. Prev. Med. 2018, 55, 231–239. [Google Scholar] [CrossRef] [PubMed]
  121. Johri, M.; Chandra, D.; Kone, K.G.; Sylvestre, M.-P.; Mathur, A.K.; Harper, S.; Nandi, A. Social and Behavior Change Communication Interventions Delivered Face-to-Face and by a Mobile Phone to Strengthen Vaccination Uptake and Improve Child Health in Rural India: Randomized Pilot Study. JMIR mHealth uHealth 2020, 8, e20356. [Google Scholar] [CrossRef] [PubMed]
  122. Juon, H.-S.; Strong, C.; Kim, F.; Park, E.; Lee, S. Lay Health Worker Intervention Improved Compliance with Hepatitis B Vaccination in Asian Americans: Randomized Controlled Trial. PLoS ONE 2016, 11, e0162683. [Google Scholar] [CrossRef]
  123. Kempe, A.; Saville, A.W.; Dickinson, L.M.; Beaty, B.; Eisert, S.; Gurfinkel, D.; Brewer, S.; Shull, H.; Herrero, D.; Herlihy, R. Collaborative centralized reminder/recall notification to increase immunization rates among young children: A comparative effectiveness trial. JAMA Pediatr. 2015, 169, 365–373. [Google Scholar] [CrossRef]
  124. Levine, G.; Salifu, A.; Mohammed, I.; Fink, G. Mobile nudges and financial incentives to improve coverage of timely neonatal vaccination in rural areas (GEVaP trial): A 3-armed cluster randomized controlled trial in Northern Ghana. PLoS ONE 2021, 16, e0247485. [Google Scholar] [CrossRef]
  125. O’Leary, S.T.; Narwaney, K.J.; Wagner, N.M.; Kraus, C.R.; Omer, S.B.; Glanz, J.M. Efficacy of a Web-Based Intervention to Increase Uptake of Maternal Vaccines: An RCT. Am. J. Prev. Med. 2019, 57, e125–e133. [Google Scholar] [CrossRef] [PubMed]
  126. Suh, C.A.; Saville, A.; Daley, M.F.; Glazner, J.E.; Barrow, J.; Stokley, S.; Dong, F.; Beaty, B.; Dickinson, L.M.; Kempe, A. Effectiveness and net cost of reminder/recall for adolescent immunizations. Pediatrics 2012, 129, e1437–e1445. [Google Scholar] [CrossRef]
  127. Szilagyi, P.G.; Albertin, C.; Humiston, S.G.; Rand, C.M.; Schaffer, S.; Brill, H.; Stankaitis, J.; Yoo, B.K.; Blumkin, A.; Stokley, S. A randomized trial of the effect of centralized reminder/recall on immunizations and preventive care visits for adolescents. Acad. Pediatr. 2013, 13, 204–213. [Google Scholar] [CrossRef]
  128. Szilagyi, P.G.; Albertin, C.S.; Saville, A.W.; Valderrama, R.; Breck, A.; Helmkamp, L.; Zhou, X.; Vangala, S.; Dickinson, L.M.; Tseng, C.H.; et al. Effect of state immunization information system based reminder/recall for influenza vaccinations: A randomized trial of autodialer, text, and mailed messages. J. Pediatr. 2020, 221, 123–131. [Google Scholar] [CrossRef]
  129. Szilagyi, P.G.; Albertin, C.S.; Casillas, A.; Valderrama, R.; Duru, O.K.; Ong, M.K.; Vangala, S.; Tseng, C.H.; Humiston, S.G.; Evans, S.; et al. Effect of personalized messages sent by a health system’s patient portal on influenza vaccination rates: A randomized clinical trial. J. Gen. Intern. Med. 2022, 37, 615–623. [Google Scholar] [CrossRef] [PubMed]
  130. Debroy, P.; Balu, R.; Burnett, R.; Johnson, R.A.; Kappes, H.B.; Wallace, J.M.; Marconi, V.C. A cluster randomized controlled trial of a modified vaccination clinical reminder for primary care providers. Health Psychol. 2023, 42, 195–204. [Google Scholar] [CrossRef] [PubMed]
  131. Adams, W. Text messaging increases receipt of influenza vaccine among low-income, urban children. J. Pediatr. 2012, 161, 568–569. [Google Scholar] [CrossRef] [PubMed]
  132. Atnafu, A.; Otto, K.; Herbst, C.H. The role of mHealth intervention on maternal and child health service delivery: Findings from a randomized controlled field trial in rural Ethiopia. mHealth 2017, 3, 39. [Google Scholar] [CrossRef] [PubMed]
  133. Chai, S.J.; Tan, F.; Ji, Y.; Wei, X.; Li, R.; Frost, M. Community-level text messaging for 2009 H1N1 prevention in China. Am. J. Prev. Med. 2013, 45, 190–196. [Google Scholar] [CrossRef] [PubMed]
  134. Cutrona, S.L.; Golden, J.G.; Goff, S.L.; Ogarek, J.; Barton, B.; Fisher, L.; Preusse, P.; Sundaresan, D.; Garber, L.; Mazor, K.M. Improving rates of outpatient influenza vaccination through EHR portal messages and interactive automated calls: A randomized controlled trial. J. Gen. Intern. Med. 2018, 33, 659–667. [Google Scholar] [CrossRef]
  135. Erwin, E.; Aronson, K.J.; Day, A.; Ginsburg, O.; Macheku, G.; Feksi, A.; Oneko, O.; Sleeth, J.; Magoma, B.; West, N.; et al. SMS behaviour change communication and eVoucher interventions to increase uptake of cervical cancer screening in the Kilimanjaro and Arusha regions of Tanzania: A randomised, double-blind, controlled trial of effectiveness. BMJ Innov. 2019, 5, 28–34. [Google Scholar] [CrossRef]
  136. Gerend, M.A.; Madkins, K.; Crosby, S.; Korpak, A.K.; Phillips, G.L.; Bass, M.; Houlberg, M.; Mustanski, B. Evaluation of a Text Messaging-Based Human Papillomavirus Vaccination Intervention for Young Sexual Minority Men: Results from a Pilot Randomized Controlled Trial. Ann. Behav. Med. 2021, 55, 321–332. [Google Scholar] [CrossRef]
  137. Ghadieh, A.S.; Hamadeh, G.N.; Mahmassani, D.M.; Lakkis, N.A. The effect of various types of patients’ reminders on the uptake of pneumococcal vaccine in adults: A randomized controlled trial. Vaccine 2015, 33, 5868–5872. [Google Scholar] [CrossRef]
  138. Herrett, E.; Williamson, E.; van Staa, T.; Ranopa, M.; Free, C.; Chadborn, T.; Goldacre, B.; Smeeth, L. Text messaging reminders for influenza vaccine in primary care: A cluster randomised controlled trial (TXT4FLUJAB). BMJ Open 2016, 6, e010069. [Google Scholar] [CrossRef]
  139. Hofstetter, A.M.; Barrett, A.; Camargo, S.; Rosenthal, S.L.; Stockwell, M.S. Text message reminders for vaccination of adolescents with chronic medical conditions: A randomized clinical trial. Vaccine 2017, 35, 4554–4560. [Google Scholar] [CrossRef] [PubMed]
  140. Hofstetter, A.M.; Vargas, C.Y.; Camargo, S.; Holleran, S.; Vawdrey, D.K.; Kharbanda, E.O.; Stockwell, M.S. Impacting delayed pediatric influenza vaccination: A randomized controlled trial of text message reminders. Am. J. Prev. Med. 2015, 48, 392–401. [Google Scholar] [CrossRef] [PubMed]
  141. Kagucia, E.W.; Ochieng, B.; Were, J.; Hayford, K.; Obor, D.; O’Brien, K.L.; Gibson, D.G. Impact of mobile phone delivered reminders and unconditional incentives on measles-containing vaccine timeliness and coverage: A randomised controlled trial in western Kenya. BMJ Glob. Health 2021, 6, e003357. [Google Scholar] [CrossRef] [PubMed]
  142. Kawakatsu, Y.; Oyeniyi Adesina, A.; Kadoi, N.; Aiga, H. Cost-effectiveness of SMS appointment reminders in increasing vaccination uptake in Lagos, Nigeria: A multi-centered randomized controlled trial. Vaccine 2020, 38, 6600–6608. [Google Scholar] [CrossRef]
  143. Kiwanuka, N.; Mpendo, J.; Asiimwe, S.; Ssempiira, J.; Nalutaaya, A.; Nambuusi, B.; Wambuzi, M.; Kabuubi, B.; Namuniina, A.; Oporia, F.; et al. A randomized trial to assess retention rates using mobile phone reminders versus physical contact tracing in a potential HIV vaccine efficacy population of fishing communities around Lake Victoria, Uganda. BMC Infect. Dis. 2018, 18, 591. [Google Scholar] [CrossRef]
  144. Lee, W.N.; Stück, D.; Konty, K.; Rivers, C.; Brown, C.R.; Zbikowski, S.M.; Foschini, L. Large-scale influenza vaccination promotion on a mobile app platform: A randomized controlled trial. Vaccine 2020, 38, 3508–3514. [Google Scholar] [CrossRef]
  145. Liao, Q.; Fielding, R.; Cheung, Y.T.D.; Lian, J.; Yuan, J.; Lam, W.W.T. Effectiveness and parental acceptability of social networking interventions for promoting seasonal influenza vaccination among young children: Randomized controlled trial. J. Med. Internet Res. 2020, 22, e16427. [Google Scholar] [CrossRef] [PubMed]
  146. Liao, Q.; Fielding, R.; Cheung, D.Y.T.; Lian, J.; Lam, W.W.T. WhatsApp groups to promote childhood seasonal influenza vaccination: A randomised control trial (abridged secondary publication). Hong Kong Med. J. 2022, 28 (Suppl. S1), 38–41. [Google Scholar] [PubMed]
  147. Milkman, K.L.; Patel, M.S.; Gandhi, L.; Graci, H.N.; Gromet, D.M.; Ho, H.; Kay, J.S.; Lee, T.W.; Akinola, M.; Beshears, J.; et al. A megastudy of text-based nudges encouraging patients to get vaccinated at an upcoming doctor’s appointment. Proc. Natl. Acad. Sci. USA 2021, 118, e2101165118. [Google Scholar] [CrossRef]
  148. Moniz, M.H.; Hasley, S.; Meyn, L.A.; Beigi, R.H. Improving influenza vaccination rates in pregnancy through text messaging: A randomized controlled trial. Obstet. Gynecol. 2013, 121, 734–740. [Google Scholar] [CrossRef]
  149. Nehme, E.K.; Delphia, M.; Cha, E.M.; Thomas, M.; Lakey, D. Promoting influenza vaccination among an ACA health plan subscriber population: A randomized trial. Am. J. Health Promot. 2019, 33, 916–920. [Google Scholar] [CrossRef] [PubMed]
  150. Seth, R.; Akinboyo, I.; Chhabra, A.; Qaiyum, Y.; Shet, A.; Gupte, N.; Jain, A.K.; Jain, S.K. Mobile phone incentives for childhood immunizations in rural india. Pediatrics 2018, 141, e20173455. [Google Scholar] [CrossRef] [PubMed]
  151. Staras, S.A.S.; Richardson, E.; Merlo, L.J.; Bian, J.; Thompson, L.A.; Krieger, J.L.; Gurka, M.J.; Sanders, A.H.; Shenkman, E.A. A feasibility trial of parent HPV vaccine reminders and phone-based motivational interviewing. BMC Public Health 2021, 21, 109. [Google Scholar] [CrossRef] [PubMed]
  152. Stockwell, M.S.; Westhoff, C.; Kharbanda, E.O.; Vargas, C.Y.; Camargo, S.; Vawdrey, D.K.; Castaño, P.M. Influenza vaccine text message reminders for urban, low-income pregnant women: A randomized controlled trial. Am. J. Public Health 2014, 104 (Suppl. S1), e7–e12. [Google Scholar] [CrossRef] [PubMed]
  153. Szilagyi, P.G.; Schaffer, S.; Rand, C.M.; Goldstein, N.P.N.; Younge, M.; Mendoza, M.; Albertin, C.S.; Concannon, C.; Graupman, E.; Hightower, A.D.; et al. Text Message Reminders for Child Influenza Vaccination in the Setting of School-Located Influenza Vaccination: A Randomized Clinical Trial. Clin. Pediatr. (Phila) 2019, 58, 428–436. [Google Scholar] [CrossRef]
  154. Ueberroth, B.E.; Labonte, H.R.; Wallace, M.R. Impact of Patient Portal Messaging Reminders with Self-Scheduling Option on Influenza Vaccination Rates: A Prospective, Randomized Trial. J. Gen. Intern. Med. 2022, 37, 1394–1399. [Google Scholar] [CrossRef]
  155. Wagner, N.M.; Dempsey, A.F.; Narwaney, K.J.; Gleason, K.S.; Kraus, C.R.; Pyrzanowski, J.; Glanz, J.M. Addressing logistical barriers to childhood vaccination using an automated reminder system and online resource intervention: A randomized controlled trial. Vaccine 2021, 39, 3983–3990. [Google Scholar] [CrossRef] [PubMed]
  156. Wijesundara, J.G.; Ito Fukunaga, M.; Ogarek, J.; Barton, B.; Fisher, L.; Preusse, P.; Sundaresan, D.; Garber, L.; Mazor, K.M.; Cutrona, S.L. Electronic health record portal messages and interactive voice response calls to improve rates of early season influenza vaccination: Randomized controlled trial. J. Med. Internet Res. 2020, 22, e16373. [Google Scholar] [CrossRef] [PubMed]
  157. Yeung, K.H.T.; Tarrant, M.; Chan, K.C.C.; Tam, W.H.; Nelson, E.A.S. Increasing influenza vaccine uptake in children: A randomised controlled trial. Vaccine 2018, 36, 5524–5535. [Google Scholar] [CrossRef]
  158. Yudin, M.H.; Mistry, N.; De Souza, L.R.; Besel, K.; Patel, V.; Blanco Mejia, S.; Bernick, R.; Ryan, V.; Urquia, M.; Beigi, R.H.; et al. Text messages for influenza vaccination among pregnant women: A randomized controlled trial. Vaccine 2017, 35, 842–848. [Google Scholar] [CrossRef]
  159. Patel, M.S.; Milkman, K.L.; Gandhi, L.; Graci, H.N.; Gromet, D.; Ho, H.; Kay, S.J.; Lee, T.W.; Rothschild, J.; Akinola, M.; et al. A randomized trial of behavioral nudges delivered through text messages to increase influenza vaccination among patients with an upcoming primary care visit. Am. J. Health Promot. 2023, 37, 324–332. [Google Scholar] [CrossRef] [PubMed]
  160. Tuckerman, J.; Harper, K.; Sullivan, T.R.; Cuthbert, A.R.; Fereday, J.; Couper, J.; Smith, N.; Tai, A.; Kelly, A.; Couper, R.; et al. Short Message Service Reminder Nudge for Parents and Influenza Vaccination Uptake in Children and Adolescents With Special Risk Medical Conditions: The Flutext-4U Randomized Clinical Trial. JAMA Pediatr. 2023, 177, 337–344. [Google Scholar] [CrossRef] [PubMed]
  161. Wynn, C.S.; Catallozzi, M.; Kolff, C.A.; Holleran, S.; Meyer, D.; Ramakrishnan, R.; Stockwell, M.S. Personalized Reminders for Immunization Using Short Messaging Systems to Improve Human Papillomavirus Vaccination Series Completion: Parallel-Group Randomized Trial. JMIR mHealth uHealth 2021, 9, e26356. [Google Scholar] [CrossRef] [PubMed]
  162. Mekonnen, Z.A.; Gelaye, K.A.; Were, M.C.; Gashu, K.D.; Tilahun, B.C. Effect of mobile text message reminders on routine childhood vaccination: A systematic review and meta-analysis. Syst. Rev. 2019, 8, 154. [Google Scholar] [CrossRef] [PubMed]
  163. Odone, A.; Ferrari, A.; Spagnoli, F.; Visciarelli, S.; Shefer, A.; Pasquarella, C.; Signorelli, C. Effectiveness of interventions that apply new media to improve vaccine uptake and vaccine coverage. Hum. Vaccines Immunother. 2015, 11, 72–82. [Google Scholar] [CrossRef] [PubMed]
  164. Horvath, T.; Azman, H.; Kennedy, G.E.; Rutherford, G.W. Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. Cochrane Database Syst. Rev. 2012, 2012, CD009756. [Google Scholar] [CrossRef]
  165. Forecast Number of Mobile Users Worldwide from 2020 to 2025 n.d. Available online: https://www.statista.com/statistics/218984/number-of-global-mobile-users-since-2010/ (accessed on 24 January 2024).
  166. Taylor, K.; Silver, L. Smartphone Ownership Is Growing Rapidly Around the World, but Not Always Equally. Pew Research Center, 2019. Available online: https://www.pewresearch.org/global/wp-content/uploads/sites/2/2019/02/Pew-Research-Center_Global-Technology-Use-2018_2019-02-05.pdf (accessed on 11 January 2024).
  167. Kannisto, K.A.; Koivunen, M.H.; Välimäki, M.A. Use of mobile phone text message reminders in health care services: A narrative literature review. J. Med. Internet Res. 2014, 16, e222. [Google Scholar] [CrossRef]
  168. Geipel, J.; Grant, L.H.; Keysar, B. Use of a language intervention to reduce vaccine hesitancy. Sci. Rep. 2022, 12, 253. [Google Scholar] [CrossRef]
  169. Griffiths, H. The Acceptability and Feasibility of Using Text Messaging to Support the Delivery of Physical Health Care in those Suffering from a Psychotic Disorder: A Review of the Literature. Psychiatr. Q. 2020, 91, 1305–1316. [Google Scholar] [CrossRef]
Figure 1. Interplay among factors that influence vaccination uptake.
Figure 1. Interplay among factors that influence vaccination uptake.
Vaccines 12 01151 g001
Figure 2. PRISMA diagram of the studies identified in the systematic literature search.
Figure 2. PRISMA diagram of the studies identified in the systematic literature search.
Vaccines 12 01151 g002
Figure 3. Risk of bias summary of included studies [36,38,39,42,43,44,45,46,47,49,50,51,54,55,56,57,58,59,60,61,62,64,65,66,152].
Figure 3. Risk of bias summary of included studies [36,38,39,42,43,44,45,46,47,49,50,51,54,55,56,57,58,59,60,61,62,64,65,66,152].
Vaccines 12 01151 g003
Figure 4. Meta-analysis of data from included studies for vaccination recall after the enrolment visit [36,38,39,42,43,44,45,46,47,49,50,51,54,55,56,57,58,59,60,61,62,64,65,66,152].
Figure 4. Meta-analysis of data from included studies for vaccination recall after the enrolment visit [36,38,39,42,43,44,45,46,47,49,50,51,54,55,56,57,58,59,60,61,62,64,65,66,152].
Vaccines 12 01151 g004
Table 1. Meta-analysis, by subgroup, of the effectiveness of text message reminders for vaccination recall after enrollment visit.
Table 1. Meta-analysis, by subgroup, of the effectiveness of text message reminders for vaccination recall after enrollment visit.
Outcome or SubgroupNo of StudiesNo of ParticipantsPooled RR [95%CI]I2 Statistic (%)p Value a
All Studies 2564,5361.09 [1.06, 1.13]76%-
Intervention Characteristics 0.84
Text Message PLUS Additional b 1317,3941.10 [1.06, 1.16]83%
Text Message ONLY 1247,1421.10 [1.04, 1.15]71%
Country Setting 0.95
Urban1957,9291.09 [1.05, 1.13]73%
Other c666071.10 [0.97, 1.24]89%
Country Economic Status 0.19
LMIC973501.07 [1.03, 1.11]65%
HIC1657,1861.12 [1.06, 1.18]79%
Vaccination Type 0.20
Early Childhood Vaccinations 1610,4801.07 [1.03, 1.11]63%
HPV536,4181.17 [1.05, 1.30]86%
Other d 417,6381.14 [1.01, 1.28]88%
Studies without Attrition Bias1855,9881.11 [1.07, 1.15]79%-
RR, risk ratio; CI, confidence interval; LMIC, low- and middle-income country; HIC, high-income country; HPV, human papilloma virus. a test for subgroup differences; b additional components include interactive text messages, appointment card reminders, standard verbal counseling, educational videos, and routine health education; c includes rural, semi-urban, and suburban; d includes seasonal influenza vaccination.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Louw, G.E.; Hohlfeld, A.S.-J.; Kalan, R.; Engel, M.E. Mobile Phone Text Message Reminders to Improve Vaccination Uptake: A Systematic Review and Meta-Analysis. Vaccines 2024, 12, 1151. https://doi.org/10.3390/vaccines12101151

AMA Style

Louw GE, Hohlfeld AS-J, Kalan R, Engel ME. Mobile Phone Text Message Reminders to Improve Vaccination Uptake: A Systematic Review and Meta-Analysis. Vaccines. 2024; 12(10):1151. https://doi.org/10.3390/vaccines12101151

Chicago/Turabian Style

Louw, Gail Erika, Ameer Steven-Jorg Hohlfeld, Robyn Kalan, and Mark Emmanuel Engel. 2024. "Mobile Phone Text Message Reminders to Improve Vaccination Uptake: A Systematic Review and Meta-Analysis" Vaccines 12, no. 10: 1151. https://doi.org/10.3390/vaccines12101151

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Article metric data becomes available approximately 24 hours after publication online.
Back to TopTop