Next Article in Journal
Challenges and the Way Forward in Demand-Forecasting Practices within the Ethiopian Public Pharmaceutical Supply Chain
Previous Article in Journal
The Role of a Clinical Pharmacist in the Identification of Potentially Inadequate Drugs Prescribed to the Geriatric Population in Low-Resource Settings Using the Beers Criteria: A Pilot Study
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Pharmacy
Volume 12
Issue 3
10.3390/pharmacy12030085
pharmacy-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

COVID-19 Vaccine Hesitancy among Parents of Children Younger than 12 Years: Experience from a Tertiary Outpatient Clinic

by
Moataz Mohamed Hassan
1,*,
Laila Al Yazidi
2,
Nagi Elsidig
2,
Mohamed Al Falahi
1,
Najah Salmi
1,
Yahya Al-Jaffari
1,
Labiba Al-Amri
1,
Huyam Zeiidan
3 and
Ibrahim Al-Zakwani
1,4
1
Department of Pharmacy, Sultan Qaboos University Hospital, University Medical City, P.O. Box 35, Alkoudh, Muscat 123, Oman
2
Department of Child Health, Sultan Qaboos University Hospital, University Medical City, P.O. Box 35, Alkoudh, Muscat 123, Oman
3
Emergency Medical Department, Sultan Qaboos University Hospital, University Medical City, P.O. Box 35, Alkoudh, Muscat 123, Oman
4
Department of Pharmacology and Clinical Pharmacy, College of Medicine & Health Sciences, Sultan Qaboos University, P.O. Box 35, Alkoudh, Muscat 123, Oman
*
Author to whom correspondence should be addressed.
Pharmacy 2024, 12(3), 85; https://doi.org/10.3390/pharmacy12030085
Submission received: 3 February 2024 / Revised: 20 May 2024 / Accepted: 25 May 2024 / Published: 31 May 2024
Browse Figure
Review Reports Versions Notes

Abstract

:
This study explored parents’ attitudes towards vaccinating their children against COVID-19 and the rate of vaccine hesitancy in Oman. A cross-sectional, online, self-administered questionnaire, previously validated and administered between June 2021 and May 2022, was used. The questionnaire consisted of nine items. Parents of children younger than 12 years were eligible for participation. A total of 384 participants, including 207 males (54%), completed the questionnaire, resulting in an 86% response rate (384/447). The results showed that 69% of participants were hesitant to vaccinate their children aged 1–11 years. In parents of children aged 1–4 years, vaccination status was significantly associated with vaccine hesitancy (odds ratio [OR], 0.116; 95% confidence interval [CI], 0.044–0.306; p = 0.001). Furthermore, after multivariable analysis, compared to the fathers, mothers were significantly less likely to be associated with vaccine hesitancy (OR, 0.451; 95% CI, 0.240–0.848; p = 0.013).

1. Introduction

Since 2019, vaccine hesitancy (VH) has been among the top 10 global health threats [1]. VH, as defined by the World Health Organization (WHO) Strategic Advisory Group of Experts (SAGE), refers to a delay in both accepting and declining immunization services despite their accessibility [2]. Vaccination reduces infectious disease incidence, morbidity, and fatality and increases life expectancy [3]. As of May 5, 2024, more than 775 million coronavirus disease 2019 (COVID-19) cases were confirmed globally, including over 7 million deaths [4]. Vaccination against COVID-19 is essential because preventive measures alone are insufficient to inhibit its spread [5]. Globally, COVID-19 affects 1–5% of children aged <18 years [6]. Children with COVID-19 show a wide range of clinical symptoms, from no symptoms to severe infections such as severe pneumonia and multisystem inflammatory disease (MIS-C) [6,7,8]. Fortunately, only a small percentage of children with COVID-19 require extended hospitalization or intensive care, and fatal outcomes are uncommon [9]. Children with chronic diseases (CD) are at a significantly higher risk of hospitalization and severe illness due to COVID-19 than their peers without CD. Children with CD are almost eight times more likely to be hospitalized for COVID-19 and three times more likely to experience severe illness once hospitalized [10]. To date, there have been no reports of COVID-19-related mortalities in children in Oman [8]. According to recent surveys, 60–80% of adults are willing to receive the COVID-19 vaccine, 10% remain unwilling, and the rest are uncertain [11,12,13,14,15]. On October 12, 2022, the Food and Drug Administration (FDA) granted Emergency Use Authorizations (EUAs) for bivalent mRNA vaccines against COVID-19. Pfizer-BioNTech and Moderna developed these vaccines, which were authorized by the FDA for use as a single booster dose at least two months after completing the primary series or monovalent booster vaccination for children aged 5–11 and 6–17 years old, respectively. The FDA amended the EUAs on 8 December 2022, to include children aged six months and older [16,17].
In a systematic review conducted by Galanis et al. (2022), parents’ intention to vaccinate their children against COVID-19 was moderate (60.1%), with studies reporting figures ranging from 25.6% to 92.2% [18]. According to the same systematic review and meta-analysis, factors such as having a father, being older, having a higher income, and perceiving a higher threat from COVID-19 were the primary factors of parents’ intentions to vaccinate their children [18]. Another cross-sectional study assessed parents’ willingness to vaccinate their children against COVID-19 and found that 61.4% of parents were concerned about vaccine safety issues and 54% believed that there was a lack of evidence regarding the safety of new vaccines [19].
Vaccine-hesitant parents have received considerable attention in recent years. Although research has been conducted on parental VH, few studies have examined parental VH in children with CD [20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35]. Regarding parental COVID-19 VH, infection in CD ranges from 26% to 81% [28,31,36,37,38].
A systematic review conducted by Yam and Huhmann (2022) emphasized that improving accessibility, confidence, and complacency for COVID-19 boosters should be a top priority for public health initiatives [39]. Another systematic review by Galanis et al. (2022) highlighted the need for policymakers to understand parents’ reluctance towards COVID-19 [18]. Alalawi et al.’s (2024) systematic review identified key factors that influence parents’ willingness to vaccinate their children, including building trust in COVID-19 vaccines and increasing vaccination rates [40]. Additionally, regulatory bodies should focus on raising awareness about the safety and efficacy of vaccines, specifically targeting healthcare workers, to positively impact public attitudes towards vaccines and prepare for future pandemics. In Oman, a knowledge gap has been indicated concerning parents’ knowledge, behavior, and hesitation regarding vaccinations for children under 11 years of age with underlying chronic medical conditions. Considering the current epidemiological situation, the present study is crucial in addressing the existing gap in the literature. The aim of this cross-sectional survey was to evaluate the attitudes of parents in Oman with at least one child aged 1–11 years and who had a CD towards COVID-19 vaccination.

2. Materials and Methods

2.1. Study Design and Settings

This cross-sectional study used electronic data collected through an online self-administered, well-designed, pre-validated Google questionnaire [41]. The investigators, who were native Arabic speakers, translated the questionnaire into Arabic. An expert translated the Arabic version of the questionnaire into English to evaluate the preliminary translation. To test language equivalence, a multilingual expert answered both versions. Under the supervision of the researchers, the participants completed the final Arabic version of the questionnaire, which took approximately eight minutes to complete. A waiver of consent was obtained to indicate the need for participation. Participation in the survey was voluntary, and no compensation was provided. Data were collected from participants between 25 October 2021 and 1 May 2022, based on the following inclusion criteria: parents were required to be 18 years of age or older, and all parents with children under the age of 11 were asked to participate in the survey, attend an outpatient pediatric department, and be able to understand the Arabic language. Questionnaires were administered to one parent (father or mother) of each family member. Parents of children 12 years of age and older and those who did not consent to participate in the survey were excluded.

2.2. Vaccine Hesitancy Rate Measurement

The parental questionnaire consisted of sociodemographic information and the VH scale for COVID-19 [41]. The sociodemographic portion included information on the children (date of birth, gender, and medical background) and parents (relationship with the child, date of birth, and educational level). Education levels were divided into five groups: primary school, secondary school, bachelor’s degree, master’s degree, and doctorate. A waiver of consent was obtained to indicate the need for participation.
The “attitudes toward COVID-19 vaccines” section consists of nine statements with a five-point Likert scale (3 = Unsure, 1 = strongly disagree, 2 = disagree, 4 = agree, 5 = strongly agree), with questions about hesitancy and concerns regarding COVID-19 vaccines [41]. The responses to the positively worded questions (1, 2, 3, and 9) were as follows: strongly disagree, 1 point; disagree, 2 points; neither agree nor disagree, 3 points; agree, 4 points; strongly agree, 5 points. The responses to the other questions (4, 5, 6, 7, and 8) were flipped because the questions were negatively worded: strongly agree, 1 point; agree, 2 points; neither agree nor disagree, 3 points; disagree, 4 points; and strongly disagree, 5 points. The total score for all nine items was then summed to a maximum of 45. Lower scores represented higher VH values, and a cut-off value of ≤30 was used to define VH.

2.3. Sample Size

The calculated the sample size, assuming that the predicted COVID-19 vaccine coverage was 50% among children, with a margin of error of 5% and a 95% confidence interval, was 384 participants.

2.4. Validation of the Arabic Version of the COVID-19 Questionnaire

Forward and Backward Translation

Two bilingual translators who spoke Arabic in their native languages translated the tool into Arabic. The translators were health specialists who were familiar with the questionnaire’s contents. Following the translation, two multilingual translators translated the tool back into English. Disagreements between the source and the back-translated versions were also investigated. The bilingual expert panel revised the forward-translated tool as many times as necessary until an agreeable version was created. This study used standard Arabic because it is the official language of 21 Arab nations and is widely taught, understood, and spoken by local Arabs [42].

2.5. Internal Reliability

A pilot sample of 30 participants was used to assess the reliability of the questions (test–retest). The items in this section had a Cronbach’s alpha value of 0.91, indicating excellent reliability. The overall Cronbach’s alpha for parents’ hesitancy towards COVID-19 vaccination using VH was 0.81.

2.6. Statistical Analysis

Descriptive statistics were used to describe the data. Categorical variables were reported as frequencies and percentages. Differences between groups were analyzed using Pearson’s chi-squared test (Fisher’s exact test was performed for expected cells < five). The mean and standard deviation were used to present the data for continuous variables, and the analysis was performed using the Student’s t-test. The impact of demographic and clinical characteristics (age of the child, mother’s care (yes/no), sickle cell disease (SCD) (yes/no), and history of prior infection (yes/no)) on VH (yes/no) was analyzed using multiple logistic regression with the simultaneous method. The goodness-of-fit of the multivariable logistic model was examined using the Hosmer–Lemeshow goodness-of-fit statistic [43]. To measure internal consistency, Cronbach’s alpha was computed for the subscales of the questionnaire. The two-tailed level of significance was set, a priori, at p < 0.05. Statistical analyses were performed using STATA version 16.1 (STATA Corporation, College Station, TX, USA).

2.7. Ethics

This study was approved by the Medical Research Ethics Committee (SQU-EC/575/2021, MREC #2640; date of approval 7 November 2021). All parents provided written informed consent. De-identified data were collected, and participation was voluntary.

3. Results

We approached 447 potential respondents, of whom 63 refused to participate. Therefore, we received 384 caregivers’ data for the analysis, with a response rate of 86%. No data were missing. Table 1 presents the characteristics of the respondents and their children. The survey included both fathers (n = 207; 48%) and mothers (n = 177; 46%). The mean age of the participants (caregivers) was 35 ± 8 years, while that of the children was 3 ± 0.9 years. An analysis of age distribution among the children demonstrated the highest prevalence in children aged <1 year (n = 25; 6.5%), followed by those aged 1–4 years (n = 101; 26%), 5–7 years (n = 116; 30%), and 8–11 years (n = 142; 37%). Approximately 285 (74%) study participants reported a history of CD among their children. Regarding education, 47% (n = 181) of the participants had completed secondary school, whereas 41% (n = 151) had a BSc degree.
The mean age of the children with CD was 2.6 years, and more than half (56%) of them were female. The most common chronic medical conditions encountered were SCD (n = 50; 13% of all cases) and epilepsy (n = 32; 8% of all cases) (Table 2). Most children (n = 284; 73.90%) had a history of CD, while 100 (26%) were healthy with no history of CD. Parents of children with COVID-19 reported a hesitation rate of approximately 40% (n = 106). Children with CD such as depression and systemic lupus erythematosus had parents with high VH rates (100%). Furthermore, parents exhibited a high VH rate when their children were diagnosed with diseases, such as diabetes mellitus (n = 8; 89%), SCD (n = 36; 72%), and bone marrow or solid organ transplantation (n = 21; 70%). There have been few reports on VH. VH was 33% and 38% in parents whose children had cardiovascular disease and thalassemia, respectively. Table 2 shows parents’ responses to each item of the vaccine statement regarding hesitancy. Half of the parents (n = 187; 48%) strongly agreed or agreed that a vaccine is an excellent approach to protecting their child from COVID-19. Moreover, almost half of the parents (n = 212; 55%) strongly agreed or agreed that their children would have a serious vaccine side effect. Furthermore, almost three-fourths (n = 284; 74%) agreed or strongly agreed that they trusted and relied on the information they received regarding COVID-19 vaccinations in children.
Figure 1 shows the sources of information selected by the parents and guardians when deciding whether to vaccinate their children against COVID-19. The majority of parents depended on healthcare organizations (n = 219; 57%), WhatsApp (n = 185; 48%), or the Internet (n = 180; 47%) for COVID-19 vaccination information.
Table 2 lists pediatric diseases and the prevalence of VH and shows that there were no statistically significant differences in VH rates between children with and without CD (25% vs. 27%; p = 0.733). Table 3 shows that almost one-third of the parents believed that immunizations were essential for their children. In addition, approximately 62% (n = 238) of parents were still determining if they agreed or disagreed with the statement that newer vaccines such as the COVID-19 vaccine had more risks than older vaccines.
Table 4 shows the relationship between the underlying factors and VH in children using multivariable logistic regression. Mothers were less hesitant regarding COVID-19 vaccination than fathers (adjusted odds ratio (aOR) = 0.451, 95% confidence interval (CI) = 0.24–0.848; p = 0.013), and parents with children aged 1–4 years were less hesitant to vaccination than those aged <1 year (aOR = 0.116; 95% CI: 0.044–0.306; p < 0.001).

4. Discussion

To the best of our knowledge, this investigation is the first of its kind to examine a group of Omani parents of children aged 1–11 with chronic health conditions. The primary objective of this survey was to provide insight into their attitudes towards COVID-19 vaccination, specifically their enthusiasm and concerns as well as the factors that influence their beliefs.
To date, considerable information has been published regarding parental COVID-19 VH in individuals below 12 years of age [28,44,45,46,47,48,49,50,51,52,53]. Therefore, data on COVID-19 VH are valuable in guiding the planning of future COVID-19 immunization strategies for children with CD.
Vaccination against COVID-19 is currently the most effective method for minimizing the burden of the COVID-19 pandemic. Our survey at SQUH found that most caregivers were hesitant about vaccinating their children against COVID-19 [48]. In our study on SCD, bone marrow or solid organ transplantation, and blood cancer, parents reported high vaccine hesitancy at 72%, 70%, and 67%, respectively. This is consistent with the results of the previous studies by Elkhadry et al. (2022) [37] and Miraglia et al. (2023) [38]. In contrast, children with cardiovascular disease, thalassemia, and nephrotic syndrome had lower VH rates (33%, 38%, and 48%, respectively). These results were similar to those reported by Wang et al. (2023) [35] and Ma et al. (2022) [31]. The diversity in parental willingness has been confirmed by comparable examinations among the general public, and this variation can be attributed to differences in study designs, study populations, levels of awareness and information, and attitudes towards immunization [18,54,55].
In a systematic review conducted by Chen et al. in 2022, contradictory evidence was found regarding the efficacy of parental and guardian sex as a predictor (OR: 1.1130, 95% CI: 0.5903–2.0986) [19]. Our multivariate analysis revealed that being a mother (aOR, 0.451; 95% CI: 0.240–0.848; p = 0.013) was one of the factors influencing vaccine hesitancy, indicating that women were generally less resistant to vaccination than men. Our findings align with those of Babicki and Wan, who reported a higher acceptance rate in their research, similar to the results obtained in our study [56,57]. This could be attributed to the fact that Omani mothers devote more time to their offspring and are more attentive to health issues that affect their children. This insight can serve as a basis for crafting strategies, such as tailoring parental education initiatives to specific genders, for enhancing vaccine acceptance. Notably, we also showed that reluctant parents lacked confidence in vaccination because they were worried about its side effects. According to a systematic review conducted by Iqbal et al., 2023, the primary reason for parents’ decision not to vaccinate their children was the fear of side effects and safety concerns [58].
One possible explanation for the higher overall rate of VH in our study is that younger parents and guardians were aware of the low risk of severe COVID-19 in children. This assumption is consistent with previous studies showing that parents or guardians aged >50 years have greater vaccination confidence [59]. Furthermore, the incidence of VH was much higher in children younger than 11 years, which affected their parents’ perspectives regarding vaccination.
Our study had some limitations. First, this was a single-center study from a tertiary care center where the patients came from across the country. In addition, the case mix and severity of children may not be representative of the country. Moreover, since this was a retrospective cross-sectional study, its design limits its ability to establish a causal-effect relationship. This design could also have led to biases including social desirability bias, self-selection bias, non-response bias, and residual compounding. Therefore, future research should examine parental VH in different locations in Oman. In addition, regular childhood immunizations, such as the influenza vaccine, were not recorded for this age group of children as a control comparison, and the relationship between parents’ and healthcare workers’ VH was also not evaluated. Finally, the strengths of our study include the use of a validated questionnaire to assess VH and obtaining a high response rate [33].
VH can result in multiple public health implications. Unvaccinated individuals create pockets of susceptibility, allowing the virus to continue circulating, potentially leading to outbreaks or the resurgence of COVID-19. High vaccination rates are crucial for achieving community immunity and reducing the overall transmission of the virus [60]. Children who cannot receive the COVID-19 vaccine because of their age or medical conditions depend on community immunity for protection. If VH among other children leads to lower overall vaccination rates, the risk to vulnerable populations, such as immunocompromised individuals or those with underlying diseases who may be at a higher risk of severe illness or complications from COVID-19, increases [59].
Furthermore, VH among children can contribute to school disruptions and outbreaks. If a significant number of children remain unvaccinated, the likelihood of COVID-19 transmission within an educational setting increases. This can result in temporary closures of schools and quarantines and disruptions to in-person learning, affecting the educational experience and overall well-being of children [61].
In addition, vaccinating children is essential to controlling the COVID-19 pandemic. Children can contribute to the spread of the virus even if they are less likely to experience severe illness. VH among children can delay the achievement of widespread vaccination coverage, thereby prolonging the duration of the pandemic and its associated economic, social, and health impacts [62].

5. Conclusions

In our study, parents’ hesitancy toward giving their children the COVID-19 vaccine was higher than that reported in previous studies. Additionally, the female sex and the age of the child were factors that increased the risk of VH. Parental VH must be urgently addressed to improve vaccine uptake in guardians of children attending pediatric outpatient departments. Therefore, effective health education and awareness campaigns should focus on this age group to help parents immunize their children against SARS-CoV-2, which could decrease the spread of the virus in asymptomatic individuals and strengthen their immune systems.

Author Contributions

Conceptualization, M.M.H., L.A.Y. and N.E.; Methodology; Software, M.M.H.; Validation, L.A.Y., N.E. and I.A.-Z.; Formal analysis, I.A.-Z. and M.M.H.; Investigation, M.M.H., L.A.Y. and N.E.; Resources, M.M.H., L.A.Y. and N.E.; Data collection, M.M.H., L.A.Y., N.E., I.A.-Z., M.A.F., N.S., Y.A.-J., L.A.-A. and H.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

All participants provided informed consent for inclusion in the study. The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Medical Research Ethics Committee of the College of Medicine and Health Sciences, Sultan Qaboos University (SQU-EC/575/2021, MREC #2640, date of approval: 7 November 2021).

Informed Consent Statement

Informed consent was obtained from all participants.

Data Availability Statement

Data are available from the corresponding author on reasonable request.

Acknowledgments

We thank all the pediatric doctors and nurses for their cooperation. We also thank the parents who completed this survey.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Andre, F.E.; Booy, R.; Bock, H.L.; Clemens, J.; Datta, S.K.; John, T.J.; Lee, B.W.; Lolekha, S.; Peltola, H.; Ruff, T.A.; et al. Vaccination greatly reduces disease, disability, death and inequity worldwide. Bull. World Health Organ. 2008, 86, 140–146. [Google Scholar] [CrossRef] [PubMed]
  2. MacDonald, N.E.; SAGE Working Group on Vaccine Hesitancy. Vaccine hesitancy: Definition, scope and determinants. Vaccine 2015, 33, 4161–4164. [Google Scholar] [CrossRef] [PubMed]
  3. Rappuoli, R.; Santoni, A.; Mantovani, A. Vaccines: An achievement of civilization, a human right, our health insurance for the future. J. Exp. Med. 2019, 216, 7–9. [Google Scholar] [CrossRef] [PubMed]
  4. Why Is COVID-19 Data Being Presented as Weekly Statistics? Available online: http://data.who.int/dashboards/covid19/cases (accessed on 5 May 2024).
  5. Yang, Y.; Peng, F.; Wang, R.; Guan, K.; Jiang, T.; Xu, G.; Sun, J.; Chang, C. The deadly coronaviruses: The 2003 SARS pandemic and the 2020 novel coronavirus epidemic in China. J. Autoimmun. 2020, 109, 102434. [Google Scholar] [CrossRef] [PubMed]
  6. Ludvigsson, J.F. Systematic review of COVID-19 in children shows milder cases and a better prognosis than adults. Acta Paediatr. Oslo. Nor. 1992 2020, 109, 1088–1095. [Google Scholar] [CrossRef] [PubMed]
  7. Cui, X.; Zhao, Z.; Zhang, T.; Guo, W.; Guo, W.; Zheng, J.; Zhang, J.; Dong, C.; Na, R.; Zheng, L.; et al. A systematic review and meta-analysis of children with coronavirus disease 2019 (COVID-19). J. Med. Virol. 2021, 93, 1057–1069. [Google Scholar] [CrossRef]
  8. Al Yazidi, L.S.; Al Hinai, Z.; Al Waili, B.; Al Hashami, H.; Al Reesi, M.; Al Othmani, F.; Al Noobi, B.; Al Tahir, N.; Elsidig, N.; Al Barwani, L.; et al. Epidemiology, characteristics and outcome of children hospitalized with COVID-19 in Oman: A multicenter cohort study. Int. J. Infect. Dis. IJID Off. Publ. Int. Soc. Infect. Dis. 2021, 104, 655–660. [Google Scholar] [CrossRef]
  9. Götzinger, F.; Santiago-García, B.; Noguera-Julián, A.; Lanaspa, M.; Lancella, L.; Calò Carducci, F.I.; Gabrovska, N.; Velizarova, S.; Prunk, P.; Osterman, V.; et al. COVID-19 in children and adolescents in Europe: A multinational, multicentre cohort study. Lancet Child. Adolesc. Health 2020, 4, 653–661. [Google Scholar] [CrossRef] [PubMed]
  10. Kompaniyets, L.; Agathis, N.T.; Nelson, J.M.; Preston, L.E.; Ko, J.Y.; Belay, B.; Pennington, A.F.; Danielson, M.L.; DeSisto, C.L.; Chevinsky, J.R.; et al. Underlying Medical Conditions Associated with Severe COVID-19 Illness Among Children. JAMA Netw. Open. 2021, 4, e2111182. [Google Scholar] [CrossRef]
  11. Neumann-Böhme, S.; Varghese, N.E.; Sabat, I.; Barros, P.P.; Brouwer, W.; Van Exel, J.; Schreyögg, J.; Stargardt, T. Once we have it, will we use it? A European survey on willingness to be vaccinated against COVID-19. Eur. J. Health Econ. HEPAC Health Econ. Prev. Care 2020, 21, 977–982. [Google Scholar] [CrossRef]
  12. Fisher, K.A.; Bloomstone, S.J.; Walder, J.; Crawford, S.; Fouayzi, H.; Mazor, K.M. Attitudes Toward a Potential SARS-CoV-2 Vaccine: A Survey of U.S. Adults. Ann. Intern. Med. 2020, 173, 964–973. [Google Scholar] [CrossRef] [PubMed]
  13. Dodd, R.H.; Cvejic, E.; Bonner, C.; Pickles, K.; McCaffery, K.J.; Sydney Health Literacy Lab COVID-19 group. Willingness to vaccinate against COVID-19 in Australia. Lancet Infect. Dis. 2021, 21, 318–319. [Google Scholar] [CrossRef] [PubMed]
  14. Reiter, P.L.; Pennell, M.L.; Katz, M.L. Acceptability of a COVID-19 vaccine among adults in the United States: How many people would get vaccinated? Vaccine 2020, 38, 6500–6507. [Google Scholar] [CrossRef] [PubMed]
  15. Al-Marshoudi, S.; Al-Balushi, H.; Al-Wahaibi, A.; Al-Khalili, S.; Al-Maani, A.; Al-Farsi, N.; Al-Jahwari, A.; Al-Habsi, Z.; Al-Shaibi, M.; Al-Msharfi, M.; et al. Knowledge, Attitudes, and Practices (KAP) toward the COVID-19 Vaccine in Oman: A Pre-Campaign Cross-Sectional Study. Vaccines 2021, 9, 602. [Google Scholar] [CrossRef] [PubMed]
  16. Research C for BE and. Pfizer-BioNTech COVID-19 Vaccine. Available online: https://www.fda.gov/vaccines-blood-biologics/coronavirus-covid-19-cber-regulated-biologics/pfizer-biontech-covid-19-vaccine. (accessed on 27 April 2024).
  17. Research C for BE and. Moderna COVID-19 Vaccine. Available online: https://www.fda.gov/vaccines-blood-biologics/coronavirus-covid-19-cber-regulated-biologics/moderna-covid-19-vaccine. (accessed on 27 April 2024).
  18. Galanis, P.; Vraka, I.; Siskou, O.; Konstantakopoulou, O.; Katsiroumpa, A.; Kaitelidou, D. Willingness, refusal and influential factors of parents to vaccinate their children against the COVID-19: A systematic review and meta-analysis. Prev. Med. 2022, 157, 106994. [Google Scholar] [CrossRef] [PubMed]
  19. Chen, F.; He, Y.; Shi, Y. Parents’ and Guardians’ Willingness to Vaccinate Their Children against COVID-19: A Systematic Review and Meta-Analysis. Vaccines 2022, 10, 179. [Google Scholar] [CrossRef] [PubMed]
  20. Janssen, L.J.F.; Lo-A-Njoe, S.M.; Ten Pas, C.; Duits, A.J. A COVID-19 vaccination program for high-risk children aged 12-17 years in Curacao. Rev. Panam. Salud Publica Pan Am. J. Public Health 2023, 47, e129. [Google Scholar] [CrossRef] [PubMed]
  21. Skeens, M.; Guttoo, P.; Stanek, J.R.; Taylor, K.; Stratz, E.; Ardura, M.I.; Rangarajan, H.G. An Exploration of COVID-19 Impact and Vaccine Hesitancy in Parents of Pediatric Hematopoietic Stem Cell Transplant (HCT) Recipients. Bone Marrow Transplant. 2022, 57, 547–553. [Google Scholar] [CrossRef] [PubMed]
  22. Persaud, Y.; Mandrell, B.N.; Sharma, A.; Carroll, Y.; Irvine, M.; Olufadi, Y.; Kang, G.; Hijano, D.R.; Rai, P.; Hankins, J.S.; et al. Attitudes toward COVID-19 vaccine among pediatric patients with sickle cell disease and their caregivers. Pediatr. Blood Cancer 2023, 70, e30274. [Google Scholar] [CrossRef]
  23. Aron, M.B.; Connolly, E.; Vrkljan, K.; Zaniku, H.R.; Nyirongo, R.; Mailosi, B.; Ruderman, T.; Barnhart, D.A. Attitudes toward COVID-19 Vaccines among Patients with Complex Non-Communicable Disease and Their Caregivers in Rural Malawi. Vaccines 2022, 10, 792. [Google Scholar] [CrossRef]
  24. Wang, X.; Yan, W.; Lu, L.; Cao, L.; Tian, Y.; Zhou, K. Chinese Parent Intention to Vaccinate Children with Special Diseases Against COVID-19. Front. Public Health 2021, 9, 725980. [Google Scholar] [CrossRef] [PubMed]
  25. Shin, A.; Kim, D.W.; Kim, Y.E.; Kim, D.R.; Jung, J.; Kim, Y.J. COVID-19 Vaccination Status Among Korean Pediatric Population with Comorbidities. J. Korean Med. Sci. 2023, 38, e248. [Google Scholar] [CrossRef] [PubMed]
  26. Ateş, B.Ö.; Özyavuz, G.; Cöngöloğlu, M.A. COVID-19 vaccine hesitancy of adolescents with psychiatric disorders and their parents: Data from a child psychiatry outpatient clinic. Turk. J. Pediatr. 2023, 65, 205–217. [Google Scholar] [CrossRef]
  27. Khoodoruth, M.A.S.; Khoodoruth, W.N.C.-K.; Ramadan, A.A.M.; Johnson, B.; Gulistan, S.; Deluvio, R.B.C.; Alamri, M.N.; Al-Abdulla, M.; Ouanes, S.; Khan, Y.S. Evaluating COVID-19 vaccination intentions and vaccine hesitancy among parents of children with autism spectrum disorder. Sci. Rep. 2023, 13, 7353. [Google Scholar] [CrossRef] [PubMed]
  28. Miraglia Del Giudice, G.; Napoli, A.; Corea, F.; Folcarelli, L.; Angelillo, I.F. Evaluating COVID-19 Vaccine Willingness and Hesitancy among Parents of Children Aged 5-11 Years with Chronic Conditions in Italy. Vaccines 2022, 10, 396. [Google Scholar] [CrossRef] [PubMed]
  29. Gumy, J.M.; Silverstein, A.; Kaye, E.C.; Caniza, M.A.; Homsi, M.R.; Pritchard-Jones, K.; Bate, J.M. Global caregiver concerns of SARS-CoV-2 vaccination in children with cancer: A cross-sectional mixed-methods study. Pediatr. Hematol. Oncol. 2023, 40, 341–351. [Google Scholar] [CrossRef] [PubMed]
  30. Silverstein, A.; Gumy, J.M.; Bate, J.; Kaye, E.C. Global caregiver perspectives on COVID-19 immunization in childhood cancer: A qualitative study. Front. Public Health 2023, 11, 1004263. [Google Scholar] [CrossRef]
  31. Ma, Y.; Liu, N.; Zhong, G.; Wang, D.; Cao, L.; Bai, S.; Zhu, P.; Zhang, A.; Wang, X. Parent Acceptance toward Inactivated COVID-19 Vaccination in Children with Acute Lymphoblastic Leukemia: The Power of Oncologist and Alliance. Vaccines 2022, 10, 2016. [Google Scholar] [CrossRef]
  32. Ali, M.; Proma, T.S.; Tasnim, Z.; Islam, A.; Urmi, T.A.; Ahmed, S.; Sarkar, A.-S.; Bonna, A.S.; Khan, U.S. Parental COVID-19 vaccine hesitancy for children with neurodevelopmental disorders: A cross-sectional survey. Trop. Med. Health 2022, 50, 24. [Google Scholar] [CrossRef]
  33. Ng, D.-L.; Gan, G.-G.; Chai, C.-S.; Anuar, N.A.B.; Sindeh, W.; Chua, W.-J.; Said, A.B.; Tan, S.-B. The willingness of parents to vaccinate their children younger than 12 years against COVID-19: A cross-sectional study in Malaysia. BMC Public Health 2022, 22, 1265. [Google Scholar] [CrossRef]
  34. Ilic, A.; Haardoerfer, R.; Michel, G.; Escoffery, C.; Mertens, A.C.; Marchak, J.G. Understanding caregivers’ decision to vaccinate childhood cancer survivors against COVID-19. Cancer Med. 2023, 12, 21354–21363. [Google Scholar] [CrossRef] [PubMed]
  35. Wang, C.-S.; Doma, R.; Westbrook, A.L.; Johnson, J.; Anderson, E.J.; Greenbaum, L.A.; Rana, S.A.; George, R.P.; Garro, R.; Khanna-Farber, A.; et al. Vaccine Attitudes and COVID-19 Vaccine Intention Among Parents of Children With Kidney Disease or Primary Hypertension. Am. J. Kidney Dis. Off. J. Natl. Kidney Found 2023, 81, 25–35.e1. [Google Scholar] [CrossRef] [PubMed]
  36. Howell, K.D.; Kelly, M.M.; DeMuri, G.P.; McBride, J.A.; Katz, B.; Edmonson, M.B.; Sklansky, D.J.; Shadman, K.A.; Ehlenbach, M.L.; Butteris, S.M.; et al. COVID-19 Vaccination Intentions for Children with Medical Complexity. Hosp. Pediatr. 2022, 12, e295–e302. [Google Scholar] [CrossRef]
  37. Elkhadry, S.W.; Salem, T.A.E.H.; Elshabrawy, A.; Goda, S.S.; Al Bahwashy, H.A.; Youssef, N.; Hussein, M.; Ghazy, R.M. COVID-19 Vaccine Hesitancy among Parents of Children with Chronic Liver Diseases. Vaccines 2022, 10, 2094. [Google Scholar] [CrossRef] [PubMed]
  38. Miraglia Del Giudice, G.; Della Polla, G.; Postiglione, M.; Angelillo, I.F. Willingness and hesitancy of parents to vaccinate against COVID-19 their children ages 6 months to 4 years with frail conditions in Italy. Front. Public Health 2023, 11, 1212652. [Google Scholar] [CrossRef] [PubMed]
  39. Limbu, Y.B.; Huhmann, B.A. Why Some People Are Hesitant to Receive COVID-19 Boosters: A Systematic Review. Trop. Med. Infect. Dis. 2023, 8, 159. [Google Scholar] [CrossRef] [PubMed]
  40. Alalawi, M.; Alsalloum, M.A.; Garwan, Y.M.; Abuzeid, M.; Alalawi, H.; Eljaaly, K.; Thabit, A.K.; Jose, J. COVID-19 vaccine hesitancy among healthcare workers in Arab Countries: A systematic review and meta-analysis. PLoS ONE 2024, 19, e0296432. [Google Scholar] [CrossRef] [PubMed]
  41. Helmkamp, L.J.; Szilagyi, P.G.; Zimet, G.; Saville, A.W.; Gurfinkel, D.; Albertin, C.; Breck, A.; Vangala, S.; Kempe, A. A validated modification of the vaccine hesitancy scale for childhood, influenza and HPV vaccines. Vaccine 2021, 39, 1831–1839. [Google Scholar] [CrossRef] [PubMed]
  42. Abushariah, M.A.A.M.; Ainon, R.N.; Zainuddin, R.; Alqudah, A.A.M.; Elshafei Ahmed, M.; Khalifa, O.O. Modern standard Arabic speech corpus for implementing and evaluating automatic continuous speech recognition systems. J. Frankl. Inst. 2012, 349, 2215–2242. [Google Scholar] [CrossRef]
  43. Nattino, G.; Pennell, M.L.; Lemeshow, S. Assessing the goodness of fit of logistic regression models in large samples: A modification of the Hosmer-Lemeshow test. Biometrics 2020, 76, 549–560. [Google Scholar] [CrossRef]
  44. Bourguiba, A.; AbuHijleh, S.; Nached, Y.; Waleed, D.; Farghaly, S.; AlOlama, F. Assessing Parents’ Knowledge, Attitudes, and Practices Toward Vaccinating Children (Five to 15 Years Old) Against COVID-19 in the United Arab Emirates. Cureus 2022, 14, e32625. [Google Scholar] [CrossRef] [PubMed]
  45. Marzo, R.R.; Chakraborty, R.; Soh, S.Y.; Thew, H.Z.; Chong, C.; Siau, C.S.; Wahab, K.B.A.; Ariffin, I.A.B.; Chauhan, S.; Brackstone, K.; et al. Factors influencing parents’ hesitancy to vaccinate their children aged 5–11 years old against COVID-19: Results from a cross-sectional study in Malaysia. Front. Public Health 2023, 11, 1091015. [Google Scholar] [CrossRef] [PubMed]
  46. Esposito, S.; Rosafio, C.; Partesotti, S.; Fiore, M.; Antodaro, F.; Bergomi, A.; Neglia, C.; Argentiero, A.; Principi, N.; Zona, S. Knowledge on Parental Hesitancy toward COVID-19 Vaccination of Children 5–11 Years Old. Vaccines 2023, 11, 587. [Google Scholar] [CrossRef] [PubMed]
  47. Almuqbil, M.; Al-Asmi, R.; AlRamly, S.; Hijazi, N.; Alotaibi, H.; AlMubarak, A.; AlAnezi, K.; Al-Rowaili, M.; Al-Yamani, M.; Duwaidi, B.S.; et al. Parental COVID-19 Vaccine Hesitancy for Children and Its Influencing Factors: A Riyadh-Based Cross-Sectional Study. Vaccines 2023, 11, 518. [Google Scholar] [CrossRef] [PubMed]
  48. Iqbal, M.S.; Khan, M.N.; Qamer, S.; Khan, S.U.D. Parents’ Concerns, Behavior, Perception, and Hesitancy Regarding COVID-19 Vaccinations for Children in Central Saudi Arabia. Vaccines 2023, 11, 1566. [Google Scholar] [CrossRef] [PubMed]
  49. Khatrawi, E.M.; Sayed, A.A. The Reasons behind COVID-19 Vaccination Hesitancy among the Parents of Children Aged between 5 to 11 Years Old in Saudi Arabia. Int. J. Environ. Res. Public Health 2023, 20, 1345. [Google Scholar] [CrossRef]
  50. Waring, M.E.; Pagoto, S.L.; Rudin, L.R.; Ho, C.; Horkachuck, A.; Kapoor, I.A.; Foye, Q. Factors associated with mothers’ hesitancy to receive a COVID-19 vaccine. J. Behav. Med. 2023, 46, 179–184. [Google Scholar] [CrossRef] [PubMed]
  51. Deng, J.S.; Chen, J.Y.; Lin, X.Q.; Huang, C.L.; Tung, T.H.; Zhu, J.S. Parental hesitancy against COVID-19 vaccination for children and associated factors in Taiwan. BMC Public Health 2023, 23, 571. [Google Scholar] [CrossRef] [PubMed]
  52. Joachim, G.; Shih, S.F.; Singh, A.; Rajamoorthy, Y.; Harapan, H.; Chang, H.Y.; Lu, Y.; Wagner, A.L. Parental vaccine hesitancy and acceptance of a COVID-19 vaccine: An internet-based survey in the US and five Asian countries. PLoS Glob. Public Health 2024, 4, e0002961. [Google Scholar] [CrossRef]
  53. Oka, E.; Ueda, Y.; Yagi, A.; Ito, Y.; Hosokawa, Y.; Tabuchi, T.; Kimura, T. Parental gender influences their intention to HPV vaccinate their children, and the association between HPV and COVID-19 vaccination intentions. Vaccine X 2024, 17, 100441. [Google Scholar] [CrossRef]
  54. Snehota, M.; Vlckova, J.; Cizkova, K.; Vachutka, J.; Kolarova, H.; Klaskova, E.; Kollarova, H. Acceptance of a vaccine against COVID-19—A systematic review of surveys conducted worldwide. Bratisl. Lek. Listy 2021, 122, 538–547. [Google Scholar] [CrossRef]
  55. Wang, Z.; Chen, S.; Fang, Y. Parental Willingness and Associated Factors of Pediatric Vaccination in the Era of COVID-19 Pandemic: A Systematic Review and Meta-Analysis. Vaccines 2022, 10, 1453. [Google Scholar] [CrossRef] [PubMed]
  56. Babicki, M.; Pokorna-Kałwak, D.; Doniec, Z.; Mastalerz-Migas, A. Attitudes of Parents with Regard to Vaccination of Children against COVID-19 in Poland. A Nationwide Online Survey. Vaccines 2021, 9, 1192. [Google Scholar] [CrossRef] [PubMed]
  57. Wan, X.; Huang, H.; Shang, J.; Xie, Z.; Jia, R.; Lu, G.; Chen, C. Willingness and influential factors of parents of 3-6-year-old children to vaccinate their children with the COVID-19 vaccine in China. Hum. Vaccines Immunother. 2021, 17, 3969–3974. [Google Scholar] [CrossRef] [PubMed]
  58. Iqbal, M.S.; Khan, S.U.D.; Qamer, S.; Vohra, S. Vaccine Hesitancy of COVID-19 among Parents for Their Children in Middle Eastern Countries—A Systematic Review. Vaccines 2023, 11, 1556. [Google Scholar] [CrossRef] [PubMed]
  59. Khatatbeh, M.; Albalas, S.; Khatatbeh, H.; Momani, W.; Melhem, O.; Al Omari, O.; Tarhini, Z.; A’Aqoulah, A.; Al-Jubouri, M.; Nashwan, A.J.; et al. Children’s rates of COVID-19 vaccination as reported by parents, vaccine hesitancy, and determinants of COVID-19 vaccine uptake among children: A multi-country study from the Eastern Mediterranean Region. BMC Public Health 2022, 22, 1375. [Google Scholar] [CrossRef] [PubMed]
  60. Watanabe, A.; Iwagami, M.; Yasuhara, J.; Takagi, H.; Kuno, T. Protective effect of COVID-19 vaccination against long COVID syndrome: A systematic review and meta-analysis. Vaccine 2023, 41, 1783–1790. [Google Scholar] [CrossRef] [PubMed]
  61. Brüssow, H. COVID-19 and children: Medical impact and collateral damage. Microb. Biotechnol. 2022, 15, 1035–1049. [Google Scholar] [CrossRef]
  62. Nguyen, K.H.; Nguyen, K.; Lekshmi, D.; Corlin, L.; Niska, R.W. Delays in Children’s Preventive Health Services During the COVID-19 Pandemic. Fam. Med. 2022, 54, 350–361. [Google Scholar] [CrossRef]
Pharmacy 12 00085 g001
Figure 1. Parents’ sources of information about COVID-19.
Figure 1. Parents’ sources of information about COVID-19.
Pharmacy 12 00085 g001
Table 1. Vaccine hesitancy according to participant characteristics (N = 384).
Table 1. Vaccine hesitancy according to participant characteristics (N = 384).
CharacteristicValueHesitant
n (%)		p Value
Child
Age (years), mean ± SD2.9 ± 0.94
Gender n (%) 0.912
Male168 (44)116 (44)
Female216 (56)148 (56)
Age group (years), n (%) 0.227
<125 (6.5)20 (80)
1–4101 (26.3)74 (73)
5–7116 (30.2)80 (69)
8–11142 (37)90 (63)
Relationship of respondent to child 0.283
Father207 (54)123 (66)
Mother177 (46)141 (71)
Age group 0.744
18–2424 (6)17 (71)
25–34129 (34)94 (73)
35–44192 (50)126 (66)
45–5436 (9)25 (69)
≥553 (1)2 (67)
Educational level of the respondent 0.503
Primary school15 (4)13 (87)
Secondary school181 (47)121 (67)
Bachelor’s degree 159 (41)110 (69)
Master’s degree 25 (7)18 (72)
Doctoral degree4 (1)2 (50)
Table 2. Prevalence of vaccine hesitancy according to the child’s disease.
Table 2. Prevalence of vaccine hesitancy according to the child’s disease.
Disease in ChildHesitant
N (%)		Non-Hesitant
N (%)		p Value
Diabetes mellitus8 (89)1 (11)0.187
Cystic fibrosis 5 (56)4 (44)0.387
Sickle cell disease36 (72)14 (28)0.595
Bone marrow or solid organ transplantation21 (70)9 (30)0.878
Genetic/metabolic disorders11 (64)6 (35)0.713
Systemic lupus erythematosus2 (100)0 (0)0.339
Cardiovascular disease2 (33)4 (67)0.059
Rheumatoid arthritis3 (75)1 (25)0.786
Nephrotic syndrome 3 (43)4 (57)0.136
Thyroid disorder7 (87)1 (13)0.248
Asthma14 (64)8 (36)0.594
Thalassemia6 (38)10 (62)0.006
Hemophilia1 (25)3 (75)0.058
Blood cancer20 (67)10 (33)0.798
Epilepsy26 (81)6 (19)0.111
Depression2 (100)0 (0)0.339
Attention deficit hyperactivity disorder6 (75)2 (25)0.700
Other chronic disease17 (59)12 (41)0.221
Non-chronic disease74 (75)25 (25)0.135
Table 3. Parental vaccine hesitancy: nine statements and responses (N = 384).
Table 3. Parental vaccine hesitancy: nine statements and responses (N = 384).
Questions Strongly AgreeAgreeStrongly DisagreeDisagreeUnsure
(1)
Getting the vaccine is an excellent way to protect my child from COVID-19. (P)
55 (14)132 (34)28 (7)48 (13)121 (32)
(2)
Having my child vaccinated is important for the health of others in my community. (P)
94 (24)144 (38)14 (4)42 (11)90 (23)
(3)
The information I receive about the COVID-19 vaccine from my child’s healthcare provider is reliable and trustworthy. (P)
74 (19)210 (55)3 (1)15 (4)82 (21)
(4)
New vaccines like COVID-19 vaccines carry more risks than older vaccines. (N)
35 (9)71 (19)9 (2)31 (8)238 (62)
(5)
I am concerned about the severe side effects of the COVID-19 vaccine. (N)
86 (22)126 (33)10 (3)51 (13)111 (29)
(6)
I think the COVID-19 vaccines might cause short-term problems for my child, like fever, pain at the injection site, and fatigue. (N)
64 (17)150 (39)7 (2)39 (10)124 (32)
(7)
I think the COVID-19 vaccine might cause long-term health problems for my child. (N)
37 (10)70 (18)14 (4)76 (20)187 (48)
(8)
I think my child will not get sick with COVID-19 illness even if they do not get the COVID-19 vaccines. (N)
24 (6)78 (20)33 (9)73 (19)176 (46)
(9)
COVID-19 could make my child very sick. (P)
37 (10)71 (19)14 (4)76 (20)186 (47)
P, positive statements (1, 2, 3, and 9); N, negative statements (4, 5, 6, 7, and 8).
Table 4. Multivariable analysis of demographic and clinical characteristics regarding parental vaccine hesitancy.
Table 4. Multivariable analysis of demographic and clinical characteristics regarding parental vaccine hesitancy.
CharacteristicOdds Ratio (95% CI)p Value
Age group of child (years)
<11.000 (reference)
1–40.116 (0.044–0.306)0.001
5–70.685 (0.312–1.504)0.346
8–110.988 (0.459–2.128)0.975
Relationship of respondent to the child
Father1.000 (reference)
Mother0.451 (0.240–0.848)0.013
Sickle cell disease0.629 (0.345–1.149)0.132
Has your child ever been infected?1.453 (0.752–2.808)0.266
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hassan, M.M.; Al Yazidi, L.; Elsidig, N.; Al Falahi, M.; Salmi, N.; Al-Jaffari, Y.; Al-Amri, L.; Zeiidan, H.; Al-Zakwani, I. COVID-19 Vaccine Hesitancy among Parents of Children Younger than 12 Years: Experience from a Tertiary Outpatient Clinic. Pharmacy 2024, 12, 85. https://doi.org/10.3390/pharmacy12030085

AMA Style

Hassan MM, Al Yazidi L, Elsidig N, Al Falahi M, Salmi N, Al-Jaffari Y, Al-Amri L, Zeiidan H, Al-Zakwani I. COVID-19 Vaccine Hesitancy among Parents of Children Younger than 12 Years: Experience from a Tertiary Outpatient Clinic. Pharmacy. 2024; 12(3):85. https://doi.org/10.3390/pharmacy12030085

Chicago/Turabian Style

Hassan, Moataz Mohamed, Laila Al Yazidi, Nagi Elsidig, Mohamed Al Falahi, Najah Salmi, Yahya Al-Jaffari, Labiba Al-Amri, Huyam Zeiidan, and Ibrahim Al-Zakwani. 2024. "COVID-19 Vaccine Hesitancy among Parents of Children Younger than 12 Years: Experience from a Tertiary Outpatient Clinic" Pharmacy 12, no. 3: 85. https://doi.org/10.3390/pharmacy12030085

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop