Next Article in Journal
Vaccine Acceptance and Its Influencing Factors: An Online Cross-Sectional Study among International College Students Studying in China
Next Article in Special Issue
Timely Birth Dose Vaccine to Prevent Vertical Transmission of Hepatitis B: A Single Center Experience on the Road to the WHO Elimination Goals in Italy
Previous Article in Journal
Neonatal Immune System Ontogeny: The Role of Maternal Microbiota and Associated Factors. How Might the Non-Human Primate Model Enlighten the Path?
Previous Article in Special Issue
The Costs of Introducing the Hepatitis B Birth Dose Vaccine into the National Immunization Programme in Senegal (NéoVac Study)
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Impact of Introducing Hepatitis B Birth Dose Vaccines into the Infant Immunization Program in Burkina Faso: Study Protocol for a Stepped Wedge Cluster Randomized Trial (NéoVac Study)

by
Haoua Tall
1,†,
Pierrick Adam
2,†,
Abdoul Salam Eric Tiendrebeogo
1,†,
Jeanne Perpétue Vincent
2,†,
Laura Schaeffer
2,
Cassandre von Platen
3,
Sandrine Fernandes-Pellerin
3,
François Sawadogo
1,
Alkadri Bokoum
4,
Ghislain Bouda
5,
Seydou Ouattara
6,
Issa Ouédraogo
7,
Magali Herrant
8,
Pauline Boucheron
2,
Appolinaire Sawadogo
9,
Edouard Betsem
1,
Alima Essoh
1,
Lassané Kabore
1,
Amariane Ouattara
10,
Nicolas Méda
10,
Hervé Hien
10,
Andréa Gosset
11,
Tamara Giles-Vernick
12,
Sylvie Boyer
11,
Dramane Kania
10,
Muriel Vray
2,13,‡ and
Yusuke Shimakawa
2,*,‡
add Show full author list remove Hide full author list
1
Epidémiologie des Maladies Evitables par la Vaccination, Agence de Médecine Préventive (AMP), Ouagadougou BP 638, Burkina Faso
2
Unité d’Epidémiologie des Maladies Emergentes, Institut Pasteur, 75015 Paris, France
3
Centre de Recherche Translationnelle, Institut Pasteur, 75015 Paris, France
4
District Sanitaire de Dafra, Ministry of Health, Bobo-Dioulasso BP 1508, Burkina Faso
5
District Sanitaire de Dô, Ministry of Health, Bobo-Dioulasso BP 1508, Burkina Faso
6
Direction Régionale de la Santé des Hauts-Bassins, Ministry of Health, Bobo-Dioulasso BP 1508, Burkina Faso
7
Direction de la Prévention par les Vaccinations (DPV), Ministry of Health, Ouagadougou BP 7009, Burkina Faso
8
Direction Internationale, Institut Pasteur, 75015 Paris, France
9
Département de Médicine, CHU Souro Sanou, Bobo-Dioulasso BP 676, Burkina Faso
10
Laboratoire de Virologie, Centre Muraz, Bobo-Dioulasso BP 390, Burkina Faso
11
Sciences Economiques & Sociales de La Santé & Traitement de l’Information Médicale (SESSTIM), INSERM, IRD, Aix-Marseille University, 13385 Marseille, France
12
Unité d’Anthropologie et Ecologie de l’Emergence des Maladies, Institut Pasteur, 75015 Paris, France
13
INSERM, 75013 Paris, France
*
Author to whom correspondence should be addressed.
Co-first authors.
Co-last authors.
Vaccines 2021, 9(6), 583; https://doi.org/10.3390/vaccines9060583
Submission received: 24 March 2021 / Revised: 19 May 2021 / Accepted: 21 May 2021 / Published: 1 June 2021
(This article belongs to the Special Issue Timely Administration of the Hepatitis B Birth Dose Vaccine)

Abstract

:
To achieve global hepatitis elimination by 2030, it is critical to prevent the mother-to-child transmission (MTCT) of hepatitis B virus (HBV). Since 2009, the WHO has recommended administering hepatitis B vaccine to all neonates within 24 h of birth to prevent MTCT. However, many countries in sub-Saharan Africa only provide hepatitis B immunization at the age of 6, 10, and 14 weeks or 8, 12, and 16 weeks using a combined vaccine. To accelerate the introduction of the hepatitis B birth dose vaccine (HepB-BD) into sub-Saharan Africa, it is critical to establish to what extent the addition of HepB-BD can further reduce HBV transmission in areas where three-dose infant vaccination has been implemented. We therefore designed a study to evaluate the impact, acceptability, and cost-effectiveness of incorporating the HepB-BD into the routine immunization program in a real-life field condition in Burkina Faso, where the hepatitis B vaccination is currently scheduled at 8-12-16 weeks. Through a multidisciplinary approach combining epidemiology, anthropology, and health economics, the Neonatal Vaccination against Hepatitis B in Africa (NéoVac) study conducts a pragmatic stepped wedge cluster randomized controlled trial in rural areas of the Hauts-Bassins Region. The study was registered in ClinicalTrials.gov (identifier: NCT04029454). A health center is designated as a cluster, and the introduction of HepB-BD will be rolled out sequentially in 24 centers. Following an initial period in which no health center administers HepB-BD, one center will be randomly allocated to incorporate HepB-BD. Then, at a regular interval, another center will be randomized to cross from the control to the intervention period, until all 24 centers integrate HepB-BD. Pregnant women attending antenatal care will be systematically invited to participate. Infants born during the control period will follow the conventional immunization schedule (8-12-16 weeks), while those born in the interventional period will receive HepB-BD in addition to the routine vaccines (0-8-12-16 weeks). The primary outcome, the proportion of hepatitis B surface antigen (HBsAg) positivity in infants aged at 9 months, will be compared between children born before and after HepB-BD introduction. The study will generate data that may assist governments and stakeholders in sub-Saharan Africa to make evidence-based decisions about whether to add HepB-BD into the national immunization programs.

1. Introduction

Viral hepatitis is a serious global health concern. In 2015, the World Health Organization (WHO) estimated that 1.34 million people died from viral hepatitis [1]. This is the seventh leading cause of death in the world and is ranked higher than HIV, tuberculosis, and malaria [2]. Most of these deaths occur in low-income and middle-income countries (LMIC), and more than half are attributable to chronic infection with hepatitis B virus (HBV) [1]. In 2016, the WHO adopted a strategy to globally eliminate HBV infection as a public health threat by 2030, with a goal of reducing its incidence by 90% and its mortality by 65% [3]. To reach these targets, it is crucial to eliminate the mother-to-child transmission (MTCT) of HBV, because chronic HBV infection develops more frequently when infection occurs early during childhood, especially at birth through MTCT [4,5]. Moreover, the natural history of chronic HBV infection is likely to differ depending on the mode of transmission; those who acquired chronic HBV infection through MTCT may have a higher risk of prolonged viral replication, cirrhosis and hepatocellular carcinoma (HCC) than those who acquired chronic infection through horizontal transmission [6,7,8,9].
To prevent MTCT, the WHO recommends that all neonates, regardless of maternal HBV infection, receive their first dose of the hepatitis B vaccine as soon as possible after birth, preferably within 24 h, as a monovalent formulation [10]. This hepatitis B birth dose vaccine (HepB-BD) should be followed by at least two additional doses that can be given as a monovalent or as part of a combined vaccine [10]. Most countries worldwide already integrated in their immunization programs three doses of the infant hepatitis B vaccine as a combined vaccine (pentavalent: DTP-HepB-Hib, or hexavalent formulation: DTPa-HepB-IPV-Hib) scheduled at the age of 6-10-14 weeks or 8-12-16 weeks [11]. However, access to the birth dose monovalent vaccine is still limited in many LMICs, particularly in sub-Saharan Africa, for several reasons. First, among the 47 countries in the WHO African Region, only 13 have introduced by 2020 the monovalent hepatitis B vaccination scheduled at birth [12]. This situation is partly explained by the lack of financial support; Gavi, the Vaccine Alliance, has been supporting the pentavalent vaccines but not yet the monovalent hepatitis B vaccines, because the price of the monovalent vaccine per dose is below the minimum country co-financing level ($0.20) and is thus not eligible for the Gavi [13]. Nevertheless, the Gavi will hopefully soon support strengthening the country’s vaccine delivery system to implement its timely administration within 24 h of birth [14]. Second, even a few African countries that have integrated HepB-BD in their programs have been facing difficulties in its timely administration within 24 h after birth [15] due to the high rate of child delivery at home [16,17].
More importantly, the evidence base to support the WHO’s recommendation to start immunizing immediately after birth, rather than later at 6–8 weeks of life, is limited. First, most randomized controlled trials (RCTs) evaluating the efficacy of the vaccine series starting at birth have used a control group with a placebo or without any hepatitis B vaccine administration. A meta-analysis of RCTs indicated that among infants born to HBV-infected mothers, those who received the first dose at birth are 3.5 times less likely to be infected than those who did not receive any dose of the hepatitis B vaccine (relative risk: 0.28, 95% CI: 0.20–0.40) [18]. However, this finding is not informative for a country where the hepatitis B vaccination series is currently scheduled at 6-10-14 weeks or 8-12-16 weeks, and the future introduction of HepB-BD is carefully examined; the question in such a country is to what extent the program can further prevent HBV infections by adding the monovalent HepB-BD to three doses of the combined vaccines. Second, the WHO recently conducted a systematic review of RCTs and prospective observational studies to evaluate the efficacy of the vaccine administered within 24 h of life compared to the vaccine administered after 24 h [19]. This review identified only one nonrandomized interventional study conducted by Ekra et al. in Côte d’Ivoire, which compared two vaccination schedules: 0-6-14 weeks (interventional arm with HepB-BD) and 6-10-14 weeks (control arm without HepB-BD). The study did not observe a statistically significant difference in HBsAg positivity in infants aged 9 months between the groups: 0.5% (9/1896) with HepB-BD and 0.5% (10/1900) without HepB-BD [20]. Finally, the WHO’s HepB-BD recommendation has been based on a single retrospective study in Canada [10,21]. Marion et al. studied children born to HBsAg-positive mothers, and found an increased risk of MTCT with age at the first dose (1–3, 4–7, 8–61, and ≥62 days with an odds ratio of 3.3 (95% CI: 1.3–8.2) for each unit increase in age group) [22]. The retrospective design of this study, however, poses a risk of selection bias and does not provide a satisfactory level of evidence.
Consequently, we aim to conduct a stepped wedge cluster randomized controlled trial to assess the impact of incorporating the monovalent HepB-BD into the infant immunization program on the risk of HBV MTCT under real-life field conditions in Burkina Faso, where the hepatitis B vaccination is currently scheduled at 8-12-16 weeks of life. We also assessed the acceptability of the intervention and its cost-effectiveness by adopting a multidisciplinary approach combining epidemiology, anthropology, and health economics.

2. Methods

2.1. NéoVac Research Program

Neonatal Vaccination against Hepatitis B in Africa study (NéoVac), funded by the Total Foundation, is a research program originally started in 2015 in Senegal, Burkina Faso, and Madagascar, where the hepatitis B vaccination series have been scheduled at 6-10-14 weeks (Senegal and Madagascar) or 8-12-16 weeks (Burkina Faso), without HepB-BD. The aim of the program was to develop and evaluate a strategy to implement the timely administration of HepB-BD in these countries. The program was designed in two successive steps. Step 1, the formative phase, collects epidemiological, anthropological, and economic data in each country in order to develop a locally adapted, sustainable strategy for providing timely HepB-BD within 24 h of birth. This step is followed by Step 2 to evaluate the impact of the strategy to reduce the risk of HBV infection in infants. In Burkina Faso, Step 1 was conducted in Dafra District, Hauts-Bassins Region, in 2016–2017. The epidemiological study found approximately 90% of children born at health facilities, and 86% completed three doses of the pentavalent vaccine. The anthropological study observed that infant vaccination was widely accepted in the communities, and the economic study suggested that the costs of introducing HepB-BD would be relatively low compared to the introduction costs of other vaccines [23]. These results were presented at the steering committee organized by the study investigators in Ouagadougou on 20 Nov 2017, with local healthcare workers, researchers, civil society organizations, the Ministry of Health, and the WHO. Due to a high rate of institutional delivery in the study zone, the committee considered that the administration of HepB-BD in maternity services at health centers would result in good coverage of timely HepB-BD. However, the committee questioned to what extent the addition of HepB-BD would further prevent infant HBV infection. Consequently, the overall objectives of Step 2 were defined as follows: to assess the impact of adding HepB-BD to the current hepatitis B vaccination schedule at 8-12-16 weeks of life on the risk of MTCT, and to evaluate its acceptability among healthcare workers and community members, and its cost-effectiveness.

2.2. Specific Objectives

The study included three work packages (epidemiology, anthropology, the health economics) funded by the Total Foundation. Each has specific objectives described below. The NéoVac program has an ancillary study called “Performance of Diagnostic Test for Hepatitis B in Africa (PREDICT-B)” funded by Gilead Sciences and Abbott. This sub-study is described at the end of Section 2.
Work package (1) Epidemiology:
-
To assess the effectiveness of introducing HepB-BD on the risk of MTCT, defined as positive HBsAg in infants aged 9 months;
-
To assess the impact of introducing HepB-BD on the risk of MTCT in subgroups of mother–child pairs defined by the maternal HBsAg;
-
To assess the impact of introducing HepB-BD on the risk of MTCT in subgroups of mother–child pairs defined by the maternal hepatitis B e antigen (HBeAg) and HBV DNA levels;
-
To explore the dose–response relationship between the number of hepatitis B vaccine doses administered (0–4) and the risk of HBsAg positivity in infants;
-
To examine the association between the timeliness of the first dose of the hepatitis B vaccine and the risk of HBsAg positivity in infants;
-
To compare the immunological response between those who received HepB-BD and those who did not by titration of the antibody to HBsAg (anti-HBs) in infants;
-
To describe the coverage and timeliness of HepB-BD, pentavalent vaccines, and other vaccines recommended by the national infant immunization program in Burkina Faso;
-
To estimate the prevalence of HBsAg in mothers of children aged 9 months;
-
To estimate the prevalence of HBeAg in HBsAg-positive mothers;
-
To estimate the prevalence of HBV DNA levels ≥200,000 IU/mL in HBsAg-positive mothers.
Work package (2) Anthropology:
-
To evaluate the acceptability of adding HepB-BD into the infant immunization program among healthcare workers and community members.
Work package (3) Health economics:
-
To evaluate the public health benefits, the cost, and the cost-effectiveness of introducing HepB-BD into the infant immunization program in Burkina Faso versus the current situation.

2.3. Study Design

2.3.1. Stepped Wedge Cluster Randomized Trial

The current protocol was developed in accordance with the CONSORT 2010 extension to cluster randomized trials [24] and the modifications specific to the stepped wedge design proposed by Hemming et al. [25]. The protocol was registered with ClinicalTrials.gov (identifier: NCT04029454), and it was reported according to the SPIRIT 2013 Statement [26]. In this multicenter stepped wedge cluster randomized controlled trial, the cluster unit is a health center (Centre de Santé et de Promotion Sociale: CSPS), a primary healthcare facility that pregnant women routinely visit for antenatal care, child delivery, and child immunization in Burkina Faso. The introduction of HepB-BD will be rolled out sequentially in 24 CSPSs in the Hauts-Bassins Region. Following an initial period in which no CSPS administers HepB-BD, one CSPS will be randomly allocated to incorporate HepB-BD into the infant immunization schedule. Then, at a regular interval of 3 weeks, another CSPS will be randomized to cross from the control period to the intervention period. This process will be repeated until all 24 CSPSs have crossed over to the intervention period (Figure 1). Other vaccines recommended by the national immunization program, including three doses of the pentavalent vaccine, will be systematically provided throughout the study period as part of the routine practice. The stepped wedge design was retained by the steering committee based on the following rationales.

2.3.2. Why Cluster Randomized Trial Rather Than Individually Randomized Trial?

This is a pragmatic trial to evaluate a whole service delivery intervention that is “complex”. The intervention includes not only the administration of monovalent vaccines to newborns in a timely manner, but also the vaccine supply, storage, training of healthcare workers, and communication with pregnant women/mothers. The cluster design was chosen as it is logistically more convenient to provide the intervention at the CSPS level, rather than at the individual level. This design also enables us to limit the risk of contamination (i.e., individuals in the control group receive the intervention, and vice versa) that is more likely to happen when healthcare workers in the same facility simultaneously provide two different strategies [27].

2.3.3. Why Stepped Wedge Rather Than Parallel Design?

As discussed in the introduction, the evidence supporting the addition of HepB-BD to the conventional vaccination series is limited. Nevertheless, there has been an established WHO recommendation to administer HepB-BD to all newborns. The stepped wedge design has the advantage of making all CSPSs benefit from the intervention by the end of the trial, which is politically and ethically more acceptable than the parallel cluster randomized trials, in which half of clusters do not receive the intervention for the duration of the study [25]. Moreover, the sequential rollout has fewer logistical constraints, avoiding an overcommitment of human and financial resources in comparison to the instantaneous implementation.

2.4. Study Setting

The trial will be conducted in two districts in the Hauts-Bassins Region, called Dô and Dafra, where an estimated 548,000 and 348,000 people lived in 2017, respectively (Figure 2). In Dô, there is one district hospital (Centre Médical avec Antenne Chirurgicale: CMA) and 28 CSPSs. In Dafra, there is one district hospital and 16 CSPSs. Each CSPS has a well-demarcated area of operation, but with population sizes that differ substantially. Consequently, each CSPS has a varying number of staff, but normally includes a chief nurse, nurses, midwives, auxiliary midwives, and mobile health workers (agent itinérant de santé: AIS). The CSPS is the primary contact between communities and the healthcare system, whilst complicated cases are referred to the district hospital where there are medical doctors. At CSPS, the antenatal care, child delivery, and child immunization are commonly shared between staff members who have a different qualification.

2.5. Eligibility Criteria

2.5.1. Clusters

CSPSs are eligible if they are located in the rural/semi-rural zone of the Dô and Dafra districts, and they are accessible from our research center (Centre Muraz, located in Bobo-Dioulasso) all-year-round, including the rainy season. We finally selected a total of 24 CSPSs: 16 from Dô and 8 from Dafra, that met the criteria above.

2.5.2. Individuals

All pregnant women of any age living in the area covered by the study CSPSs, who attended the antenatal care or gave birth at one of the study CSPSs, and who gave a written informed consent will be included. Exclusion criteria include a miscarriage, abortion, stillbirth, neonatal defect incompatible with life and any maternal or child health condition incompatible with the research activities. They will be also excluded if they had participated in other clinical trials that are incompatible with this trial.

2.6. Interventions

2.6.1. Initial Training

Before the start of the trial, all healthcare workers from the 24 study CSPSs will be invited to the Centre Muraz for a two-day training course on the epidemiology and clinical management of hepatitis B, the administration of HepB-BD, and the study protocol including how to obtain informed consent, to fill case report forms (CRF), and to obtain blood samples. Similarly, all medical doctors from the district hospitals of Dô and Dafra will be invited for a one-day training course on the clinical management of patients with chronic HBV infection and the study protocol.

2.6.2. Control Period

During the control period, there will be no supply of the monovalent vaccines to the CSPS; therefore, babies born during this period in the catchment area of this CSPS will not receive HepB-BD.

2.6.3. Interventional Period

Once a CSPS crosses from the control to the intervention period, the monovalent vaccines will be delivered from the district center to the CSPS and healthcare workers will start immunizing newborns. The delivery of HepB-BD will be integrated into a monthly supply chain for the routine infant vaccines. Babies born in the CSPS during the intervention period will receive HepB-BD immediately after birth. Those born at home during the intervention period will receive HepB-BD at the first contact with the CSPS at any time up to the time when the next dose of hepatitis B vaccine is scheduled (i.e., 8 weeks as a pentavalent vaccine) according to the WHO recommendation [21].

2.6.4. Routine Care

All infants, irrespective of the study period, will receive three doses of pentavalent vaccine at 8-12-16 weeks as scheduled in the national immunization program. Screening of pregnant women for HBV infection is recommended in the country but not yet systematically conducted. In the study zone, none of the CSPSs and none of the district hospitals provide antenatal screening for HBV or the treatment of chronic HBV infection using antiviral therapy. Hepatitis B immune globulin (HBIG) is not available in the study area.

2.7. Outcomes

2.7.1. Primary Outcome

-
The risk of MTCT, defined as a prevalence of positive HBsAg in infants aged 9 months.

2.7.2. Secondary Outcomes

-
The coverage and timeliness of HepB-BD, pentavalent vaccines, and other vaccines recommended by the national infant immunization program.
-
The prevalence of anti-HBs ≥10 IU/L (or ≥100 IU/L) in infants aged 9 months.
-
The prevalence of HBsAg in mothers of children aged 9 months.
-
The prevalence of HBeAg in HBsAg-positive mothers.
-
The prevalence of HBV DNA levels ≥200,000 IU/mL in HBsAg-positive mothers.
-
Anthropology: the acceptability of adding HepB-BD into the infant immunization program among healthcare workers and community members.
-
Health economics: the public health benefits, the cost, and the cost-effectiveness of introducing HepB-BD into the infant immunization program in Burkina Faso versus the current situation.

2.8. Participant Flow

2.8.1. First Visit (V1)

The participant flow is schematically presented in Figure 3. Whenever a pregnant woman visits a study CSPS for antenatal care, she will be assessed for her eligibility and will be invited to participate in the study. Women coming directly to a CSPS for delivery without a prior antenatal care visit will be invited to participate immediately after the child delivery. Using a participant information sheet written in French (Document S1) and an illustrated information sheet (Document S2), healthcare workers will explain the study to all potentially eligible pregnant women in a local language. Women aged ≥18 years will be asked to sign an informed consent (Document S3). Those aged <18 years will be asked to sign an assent, in addition to an informed consent form that will be signed by her legally authorized representative. Illiterate participants will be asked to provide a fingerprint. Once the informed consent is obtained, sociodemographic data will be collected through an interview with the women, and the case report form (CRF) for V1 will be filled (Document S4).

2.8.2. Second Visit (V2)

The second visit takes place at the first contact between a mother–infant pair and the CSPS. V2 will be at the time of child delivery for women who give birth at the CSPS. For women who give birth outside the CSPS, V2 will be the first postnatal care visit to the CSPS. At V2, HepB-BD will be administered to an infant who was born after his/her CSPS has crossed over to the intervention period. In contrast, HepB-BD will not be given to an infant born before his/her CSPS has started the intervention. Data on the index pregnancy, childbirth, child’s date of birth and sex, and postnatal care, including whether and when HepB-BD was administered, will be collected on the CRF for V2 (Document S4).

2.8.3. Third Visit (V3)

Mother–child pairs will be screened for HBsAg when the children return to the CSPS to receive the yellow fever vaccine and the first doses of the measles and rubella vaccines that are scheduled at the age of 9 months in Burkina Faso. Capillary blood will be obtained from mother–child pairs by finger-prick for a rapid diagnostic test (RDT) to detect HBsAg (DETERMINE™ HBsAg 2, Abbott, Abbott Park, IL, USA) [30,31] and DBS. The result of the HBsAg test will be immediately given to the participants on-site. Following the post-test counselling, 8 and 4 mL of blood will be drawn by venipuncture from the HBsAg-positive mother and HBsAg-positive child, respectively. The DBS from all participants and venous samples from those positive for HBsAg will be transferred to the Centre Muraz. Sera from infected mothers will be tested for alanine aminotransferase (ALT), aspartate aminotransferase (AST), HBV DNA PCR (RealTime HBV Viral Load Assay, Abbott), qHBsAg and qHBeAg (ARCHITECT, Abbott), HBeAg RDT (SD Bioline, Abbott), HBcrAg (Lumipulse, Fujirebio Europe, Gent, Belgium), and HBV-LAMP (Eiken Chemicals, Tokyo, Japan). Sera from infected children will be tested for ALT, AST, and HBV DNA. Vaccination history ascertained through the child vaccination card and HBsAg test result will be entered in the V3 CRF (Document S4). Participants identified to carry HBsAg will be given a next appointment to receive results of the laboratory tests (Figure 4), while V3 will be the final study visit for those testing negative for HBsAg. Hepatitis B vaccinations will not be systematically offered to HBsAg-negative women, because the vast majority of adults in Burkina Faso have been in contact with HBV during childhood, resulting in the prevalence of total hepatitis B core antibodies (anti-HBc) exceeding 70–80% in adults [32,33].

2.8.4. Participants Found to Carry HBsAg

Figure 4 presents an algorithm illustrating the clinical management of HBsAg-positive mothers and HBsAg-positive children. Once the results of ALT, AST, and HBV DNA become available, HBsAg-positive participants will be referred to the district hospital; they will be examined by general physicians, who have been trained by hepatologists at the university hospital of Bobo-Dioulasso (Centre Hospitalier Universitaire (CHU) de Sourou Sanou). If ALT is elevated (>40 IU/L), the women will be further referred to CHU where the cause of ALT elevation is investigated. Women having both ALT >40 IU/L and HBV DNA >2000 IU/mL will immediately start anti-HBV therapy (generic of tenofovir disoproxil fumarate) for their own health and will be followed at the CHU every 3 months for the duration of at least 2 years. HBsAg-positive women who do not start treatment will be followed at the district hospital every 6 months. The women known to be co-infected with HIV will be referred to the National HIV Program. A 12 month follow-up will be carried out for HBsAg-positive children at the CHU if their ALT is >40 IU/L, and at the district hospital if their ALT is ≤40 IU/L.

2.9. Power Calculation

The power calculation was made for the primary endpoint: the prevalence of positive HBsAg in infants aged 9 months. The study will be carried out in the rural areas of the Dafra health district (8 CSPSs covering approximately 46,000 inhabitants) and Dô health district (16 CSPSs covering approximately 154,000 inhabitants) (Figure 2). At each step, we will have a 3-week interval to allow sufficient time to include the number of participants required per CSPS and per period. To obtain the highest possible statistical power, one cluster will be randomized for each step. The following assumptions were made:
(a)
The average number of live births in a catchment area covered by each CSPS is about 22 per month.
(b)
Infant death or lost to follow-up occurs in 10% of children by the age of 9 months.
(c)
The prevalence of HBsAg in pregnant women (PHBsAg) is estimated at 10%, but it can vary from 5% to 15% between the clusters [34].
(d)
The prevalence of HBeAg in HBsAg-positive pregnant women (PHBeAg) is estimated at 15%, but it can vary from 10% to 20% between the clusters [35].
(e)
With three doses of the pentavalent vaccine (8-12-16 weeks) without timely administration of HepB-BD, the risk of MTCT from HBsAg-positive and HBeAg-positive pregnant women (RHBeAg-pos) is 60% [20,36], and the risk from HBsAg-positive and HBeAg-negative pregnant women (RHBeAg-neg) is 5% [35].
(f)
With the timely administration of HepB-BD followed by three doses of pentavalent vaccine, the risk of MTCT from HBsAg-positive and HBeAg-positive pregnant women (RHBeAg-pos-BD) is 20% [18], and the risk from HBsAg-positive and HBeAg-negative pregnant women (RHBeAg-neg-BD) is 0% [35,37].
Using assumptions (a) and (b), the number of children evaluated at 9 months of age in each observation period (3 weeks) in each cluster (CSPS) was estimated at:
n = (Average number of live births/CSPS/month) × (1 − lost to follow-up) × (3/4 weeks) = 14.8
Using assumptions (c), (d), (e), and (f), the incidence of HBV infection among the infants aged 9 months in the intervention (π1) and the control (π0) was estimated at:
π0 = PHBsAg × PHBeAg × RHBeAg-pos + PHBsAg × (1 − PHBeAg) × RHBeAg-neg = 1.33%
π1 = PHBsAg × PHBeAg × RHBeAg-pos-BD + PHBsAg × (1 − PHBeAg) × RHBeAg-neg-BD = 0.30%
The coefficient of variation (CV) of the incidence of HBV infection in infants aged 9 months between control clusters (control observation periods) should be determined by the variation in the prevalence of HBV among pregnant women across the clusters. The prevalence of HBsAg in pregnant women is estimated to vary by a maximum of ±5% (5–15%), and the prevalence of HBeAg in HBsAg-positive pregnant women to vary by up to ±5% (10–20%) between the clusters. Consequently, the incidence of HBV infection in infants aged 9 months in the control periods would vary between 0.53% and 2.40% according to the CSPS, with a maximum variation of 1.07% around the estimated average of π0 = 1.33% (i.e., π0 ± 2SD = 1.33% ± 1.07%). The CV, the ratio of the standard deviation (SD) to the mean, was then estimated to be 0.40 in this study. Using the formula for the power calculation of the stepped wedge cluster randomized controlled trial [38], the study will have an 84% power to demonstrate that the intervention can reduce the incidence of HBV infection in infants aged 9 months, with a significance level of 5%. This corresponds to the inclusion of approximately 8500 mother–child pairs in a recruitment period lasting for 75 weeks (24 steps × 3 weeks + 3 weeks for the last period). Alternative scenarios were considered by varying the number of infants evaluated at the age of 9 months per cluster per period for the same number of participating CSPSs (Figure 5). This shows that the sample size of 13 children aged at 9 months/cluster/period provides a power of 80%.

2.10. Assignment of Intervention

The chronological order in which a CSPS crosses over to the intervention will be randomized by a statistician at the Institut Pasteur, Paris, using the STATA® version 15.0 (StataCorp, College Station, TX, USA). To minimize the imbalance between the intervention period and the control period, stratification will be performed by the districts (Dafra, n = 8; and Dô, n = 16). The list of the CSPS with its order will be kept in Paris, and will only be accessible by the study statistician. The intervention start date of each CSPS will be concealed from all the investigators, healthcare workers, and study participants, except the statistician. Two weeks prior to the date of the crossover from the control to the intervention, the statistician will inform the investigators about the next CSPS that will start the intervention. The study coordinator will then notify this CSPS of the intervention start date. This will ensure sufficient time for the delivery of the vaccines to the next CSPS and for the healthcare workers in this CSPS to be ready to start administering HepB-BD.
While a CSPS is in the control period, nobody will know when the intervention will begin in this CSPS. However, once CSPS has crossed over to the intervention, both the investigators and the healthcare workers in this CSPS will know that HepB-BD is now available and given in this CSPS. To limit the risk of selection bias during the enrolment of study participants, healthcare workers will inform pregnant women about the possibility of their child being vaccinated at birth, in the same way during the control and intervention period. However, despite such a precaution, if the pregnant woman spontaneously asks about the allocation status of the CSPS, the healthcare workers will tell her whether the intervention has already been assigned to this CSPS or not.

2.11. Data Management

At enrolment, a study identification number will be assigned to each woman. The anonymized data will be collected in a paper CRF at the CSPS, transferred to the research center at the Centre Muraz, and a double entry will be made in an electronic CRF built in the REDCap application [39]. The database will be developed and managed by the study statistician at the Institut Pasteur. All modifications made in the database will be registered according to the Good Clinical and Laboratory Practice (GCLP). Access to the final trial data and dissemination policy will be defined by the scientific committee of the NéoVac project. The final trial results will be presented at the local steering committee, and communicated with the local healthcare workers, civil societies, the Ministry of Health in Burkina Faso, the WHO country office, and the funders of the study.

2.12. Statistical Methods

Using an intention-to-treat analysis involving all mother–child pairs included in the study, the impact of introducing monovalent hepatitis B vaccines at birth on the risk of MTCT will be estimated by comparing the proportion of children positive for HBsAg at the age of 9 months between two groups: children born before the introduction of HepB-BD into their CSPS (control arm) and those born after their CSPS begins HepB-BD (intervention arm), regardless of whether or not they have received HepB-BD according to the assignment of the intervention to their CSPS. Our primary analysis will be “complete case analysis” excluding those with missing outcomes as it is unlikely that maternal HBV infection, the leading factor for the vaccine failure, is related with a loss to follow-up [40,41]. We will also conduct a sensitivity analysis with an extreme assumption that all those lost to follow-up were infected with HBV.
A per-protocol analysis will also be performed by restricting the analysis to children born before the introduction of HepB-BD into their CSPS and not having received HepB-BD, or to those born after the introduction of HepB-BD into their CSPS and who have received HepB-BD. To account for the calendar time and for the correlations between individuals within the same cluster, a logistic regression model with a random effect for clusters and a fixed effect for each step will be fitted [25]. All the analyses will be performed using STATA®.

2.13. Monitoring

Onsite monitoring will be performed by the team of the clinical research associate. They will monitor whether the research is conducted according to the ICH Good Clinical Practice (GCP) guidelines, including participants’ consents, cold chain, vaccine storage and administration, handling and transport of blood samples, and data quality control. Adverse events will be systematically collected and reported according to the national system. Site reports and weekly meetings with clinical research associates will be held to identify and solve the problems. A monitoring plan will be regularly reviewed and risk-based monitoring will be carried out.

2.14. Research Ethics Approval

The following committees rigorously evaluated the scientific, ethical, and regulatory aspects of the NéoVac study, including the PREDICT-B, and fully approved the conduct of the research:
-
Comité de Recherche Clinique (CoRC), Institut Pasteur, Paris, France: approved on 25 October 2018.
-
IRB, Institut Pasteur, Paris, France: approved on 8 November 2018.
-
Comité d’éthique pour la recherche en santé (CERS), Ministère de la santé/Ministère de l’enseignement supérieur, de la recherche scientifique et de l’innovation, Burkina Faso: approved on 4 December 2018.
-
Comité d’éthique institutionnel du Centre MURAZ: approved on 4 April 2019.
-
Comité technique d’examen des demandes d’autorisation d’essais cliniques (CTEC): approved on 4 November 2019.
-
The project has also been registered in the ClinicalTrials.gov with the following ID (NCT04029454).
Any changes to the protocol will be submitted to these committees.

2.15. Dissemination Policy

The study findings will be disseminated by publishing in peer-reviewed journals, and they will be communicated locally at the steering committee with the Ministry of Health, national hepatitis program, civil society organizations, and professional associations, and internationally with key stakeholders, including the WHO.

2.16. Work Package 2: Anthropology

An exploratory qualitative study will be performed during the main trial to assess whether the HepB-BD strategy is likely to be accepted by communities and healthcare professionals and to explore potential barriers and facilitators to implementing the strategy. This study will use validated methods for qualitative analyses of interventions: semi-directive interviews, focus groups and participants’ observations [42,43,44]. The study will be conducted in the catchment areas of two CSPSs, one in each study district, during the intervention by trained Burkinabe anthropologists in collaboration with a senior anthropologist at the Institut Pasteur. Healthcare workers and pregnant women attending the CSPS for antenatal care will be invited to participate. Data will be collected on their comprehension of newborn care management, the biomedical category hepatitis B and any local analogous illness categories [45,46], and the vaccination. Data will be entered in NVivo 10.0 (QSR International, Melbourne, Australia), which will identify similarities and differences in describing and understanding those concepts. Findings will be interpreted overall in the light of the trial and the economic evaluation.

2.17. Work Package 3: Health Economics

We will assess the economic value (in USD per disability-adjusted life years (DALYs) averted) associated with the introduction of the HepB-BD strategy compared to the current vaccination schedule starting at 8 weeks (the reference strategy). The costing analysis will be performed from the health system perspective. Mathematical modelling will be used to estimate over the lifetime of the study population the health benefits (in terms of HBV infections averted, life-years, and DALYs) and the costs with and without the introduction of the HepB-BD. The cost-effectiveness of the HepB-BD strategy will be computed as the difference in costs between the two strategies divided by the difference in effectiveness (in terms of DALYs), and it will be compared to the country cost-effectiveness threshold to provide an indication of its cost-effectiveness. Health benefits will be estimated using a dynamic model that will be developed specially for the sub-Saharan African setting using standardized recommendations for the economic evaluation of immunization programs [47]. The model will estimate the dynamics of HBV transmission over time and the natural history of chronic HBV infection based on previous dynamic models [48,49]. The risks of MTCT estimated from the current trial with and without HepB-BD according to maternal HBsAg and HBeAg status will be used to model the perinatal transmission of HBV. The force of infection will be estimated from age-specific HBsAg prevalence. Infected children with chronic HBV infection will progress according to the nomenclature described by the European Association for the Study of the Liver (EASL) [50]. We will use data on costs already collected from a costing study in Step 1 [23] and newly collected from a costing study during the current trial (Step 2). Parameters that are not available in the trial, particularly the rates of disease progression in HBV-infected children, will be derived from the literature [8].

2.18. Ancillary Study: PREDICT-B

Using the samples collected through the main NéoVac study, this PREDICT-B study aims to assess the performance and cost-effectiveness of low-cost HBV markers to identify women with high viral load (HBV DNA ≥ 200,000 IU/mL). We have the following objectives:
-
To evaluate the performance of low-cost HBV markers to diagnose high-HBV DNA levels (≥200,000 UI/mL) quantified by real-time polymerase chain reaction (PCR) as a reference standard, in serum samples and dried blood spots (DBS) collected from HBsAg-positive mothers in Burkina Faso. The following alternative markers will be assessed:
Quantification of HBsAg (qHBsAg) and HBeAg (qHBeAg) using chemiluminescent immunoassay (CLIA) [51,52];
Detection of HBeAg using rapid diagnostic test (RDT) [52,53,54,55,56,57,58,59];
Quantification of hepatitis B core-related antigen (HBcrAg) [60,61,62];
Semi-quantification of HBV DNA levels using hepatitis B loop-mediated isothermal amplification (HBV-LAMP) assay [63].
-
To evaluate the performance of the low-cost HBV markers in HBsAg-positive mothers to predict the risk of MTCT, defined as positive HBsAg in infants aged 9 months.
-
To compare the performance of the low-cost HBV markers to diagnose high HBV DNA levels (≥200,000 UI/mL) by the sample type (serum versus DBS).
-
To assess the effectiveness and cost-effectiveness of antenatal screening strategies using the low-cost HBV markers and subsequent antiviral treatment during pregnancy to prevent HBV MTCT in sub-Saharan Africa using modelling.
This ancillary study will use serum samples and DBS collected from HBsAg-positive mothers when their infants reach the age of 9 months, and it will test for the following markers: qHBeAg, HBeAg RDT, qHBsAg, HBcrAg, and HBV-LAMP. Then, we will evaluate the performance of these markers to diagnose the clinically important HBV DNA level (≥200,000 IU/mL) using real-time PCR (RealTime HBV Viral Load Assay) as a reference test. We will also evaluate the performance of maternal HBV markers to predict MTCT (defined as HBsAg positivity of their infants at the age of 9 months). Finally, we will assess the costs and cost-effectiveness of alternative antenatal HBV screening strategies in pregnant women based on the low-cost HBV markers.
Although it would be ideal to assess maternal HBV markers using samples collected during their pregnancy, we will evaluate these HBV markers at 9 months postpartum using the NéoVac study platform. The risk of change in maternal HBV status between pregnancy and 9 months postpartum is minimal for the following reasons:
  • In Burkina Faso, the vast majority of adults have been in contact with HBV during childhood, resulting in the prevalence of total hepatitis B core antibody (anti-HBc) exceeding 70–80% in adults [32]. Therefore, primo-infection during adulthood is very rare.
  • HBV viral replication remains stable after pregnancy in HBsAg-positive women; a large observational study in Australia did not find any significant difference in HBV DNA levels between samples collected during pregnancy and those collected 12 months after delivery [64].
The cost-effectiveness analysis will use real-life field data obtained from the NéoVac and PREDICT-B studies to assess the effectiveness and cost-effectiveness of alternative antenatal screening strategies using low-cost HBV markers, coupled with antiviral treatment during pregnancy. Using modelling, the effectiveness of each strategy will be estimated by the number of HBV infections averted in the cohort of children included in the NéoVac trial, as well as the number of life-years saved and DALYs saved. Costs will be estimated from a health system perspective in USD. A micro-costing study will be conducted in the study area to collect data on resources needed to implement the different screening strategies and their respective costs. The temporal horizon of the analysis will be the lifetime of the birth cohort. Table 1 summarizes the different “screen and treat” strategies that will be considered for the economic analysis. The model described in the previous section (Work package 3: Health Economics) will be used to conduct this analysis.

3. Discussion

This stepped wedge cluster randomized controlled trial is designed to answer two major public health questions to better fight hepatitis B in sub-Saharan Africa. The first question is what the additional impact of HepB-BD would be in reducing HBsAg prevalence in children in a country where three doses of the infant hepatitis B vaccine have been scheduled at 8-12-16 weeks. The trial will provide strong evidence to support the WHO recommendation of universal HepB-BD and to assist African countries to seriously consider integrating HepB-BD into their immunization programs. The second question is whether timely administration of HepB-BD would be enough to eliminate HBV MTCT, or whether additional measures, such as HBIG or peripartum antiviral prophylaxis, should be implemented in sub-Saharan Africa. It is well established that HBV-infected mothers with HBV DNA levels of ≥200,000 IU/mL have a substantial risk of transmitting HBV to their offspring despite infant immunoprophylaxis using both HepB-BD and HBIG [57]. As antiviral therapy during pregnancy is highly effective in preventing MTCT from these high-risk mothers [65,66], the WHO and other professional societies now recommend screening pregnant women for HBV and providing peripartum anti-HBV prophylaxis to those with high viraemia in addition to infant immunoprophylaxis at birth [50,67,68,69]. However, most of the evidence that guided these recommendations were obtained in Asia [57,66]; the applicability to sub-Saharan Africa is uncertain, given the difference between the continents in terms of HBV genotypes, natural history of chronic HBV infection, and current standards of care [11]. The NéoVac study will generate data that may inform African countries on whether to focus primarily on integrating and improving HepB-BD coverage, or whether antenatal HBV screening and peripartum antiviral prophylaxis should also be considered for the routine care of pregnant women.
In this study, we will assess the impact of universal HepB-BD, aiming to administer the monovalent hepatitis B vaccine to all neonates irrespective of maternal HBV sero-status. As an alternative strategy, selective HepB-BD, targeting neonates born to mothers who test positive for HBsAg, might be attractive and adapted to sub-Saharan Africa, because of the high uptake of antenatal care but low rate of institutional delivery in many African countries [70]. São Tomé and Príncipe, an island country in sub-Saharan Africa, introduced HepB-BD in 2002 as a selective strategy, but, recently, the Ministry of Health switched to the universal HepB-BD strategy. This was because an economic evaluation in this country found that, compared to the selective HepB-BD, the universal HepB-BD would result in a 19% reduction in chronic HBV infections per year at overall cost savings of 44% [71]. Using the data generated by NéoVac study, we will also investigate whether universal HepB-BD remains cost-effective compared to the selective HepB-BD in the study area.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/vaccines9060583/s1, Document S1: Patient Information Sheet, Document S2: Illustrated Patient Information Sheet, Document S3: Consent Form, Document S4: Case Report Form.

Author Contributions

Conceptualization: M.V. and Y.S.; project administration, H.T., A.S.E.T., J.P.V., C.v.P., S.F.-P., M.H., E.B., A.E., L.K., D.K., M.V. and Y.S.; formal analysis, L.S., T.G.-V., A.G., S.B. and Y.S.; data curation, L.S.; validation, A.O. and D.K.; funding acquisition, H.T., M.V. and Y.S.; supervision, H.T., A.S.E.T., J.P.V., C.v.P., S.F.-P., F.S., A.B., G.B., S.O., I.O., A.S., N.M., H.H., T.G.-V., S.B., D.K., M.V., Y.S.; writing—original draft preparation, P.A., J.P.V. and Y.S.; writing—review and editing, H.T., A.S.E.T., L.S., C.v.P., S.F.-P., F.S., A.B., G.B., S.O., I.O., M.H., P.B., A.S., E.B., A.E., L.K., A.O., N.M., H.H., A.G., T.G.-V., S.B., D.K. and M.V. All authors have read and agreed to the published version of the manuscript.

Funding

The NéoVac study was funded by the Total Foundation. The PREDICT-B study was funded by the Gilead Sciences and Abbott. JPV was funded by the Institut Pasteur, Ambassade de France au Japon, and Fondation Pasteur Japon. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Institutional Review Board Statement

The study was approved by the Comité de Recherche Clinique (CoRC), Institut Pasteur, Paris, France on 25 October 2018; the Institutional Review Board, Institut Pasteur, Paris, France on 8 November 2018; the Comité d’éthique pour la recherche en santé (CERS), Ministère de la santé/Ministère de l’enseignement supérieur, de la recherche scientifique et de l’innovation, Burkina Faso on 4 December 2018; the Comité d’éthique institutionnel du Centre MURAZ, Burkina Faso on 4 April 2019; and the Comité technique d’examen des demandes d’autorisation d’essais cliniques (CTEC), Burkina Faso on 4 November 2019.

Informed Consent Statement

Informed consent will be obtained from all subjects involved in the study.

Acknowledgments

The authors thank all the participants of the local steering committee. We acknowledge Salimata Drabo at the WHO country office, Ouagadougou, Burkina Faso, and Hyacinte Julien Kaboré at the WHO regional office for Africa, Brazzaville, Congo, for their scientific advice.

Conflicts of Interest

All authors report no competing interest.

References

  1. WHO. Global Hepatitis Report, 2017; WHO: Geneva, Switzerland, 2017. [Google Scholar]
  2. Stanaway, J.D.; Flaxman, A.D.; Naghavi, M.; Fitzmaurice, C.; Vos, T.; Abubakar, I.; Abu-Raddad, L.J.; Assadi, R.; Bhala, N.; Cowie, B.; et al. The global burden of viral hepatitis from 1990 to 2013: Findings from the Global Burden of Disease Study 2013. Lancet 2016, 388, 1081–1088. [Google Scholar] [CrossRef] [Green Version]
  3. WHO. Global Health Sector Strategy on Viral Hepatitis 2016–2021; WHO: Geneva, Switzerland, 2016. [Google Scholar]
  4. Edmunds, W.J.; Medley, G.F.; Nokes, D.J.; Hall, A.J.; Whittle, H.C. The influence of age on the development of the hepatitis B carrier state. Proc. Biol. Sci. 1993, 253, 197–201. [Google Scholar] [CrossRef]
  5. Hyams, K.C. Risks of Chronicity Following Acute Hepatitis B Virus Infection: A Review. Clin. Infect. Dis. 1995, 20, 992–1000. [Google Scholar] [CrossRef] [PubMed]
  6. Chang, M.-H. Natural history and clinical management of chronic hepatitis B virus infection in children. Hepatol. Int. 2008, 2, S28–S36. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Shimakawa, Y.; Yan, H.-J.; Tsuchiya, N.; Bottomley, C.; Hall, A.J. Association of early age at establishment of chronic hepatitis b infection with persistent viral replication, liver cirrhosis and hepatocellular carcinoma: A systematic review. PLoS ONE 2013, 8, e69430. [Google Scholar] [CrossRef] [PubMed]
  8. Shimakawa, Y.; Lemoine, M.; Njai, H.F.; Bottomley, C.; Ndow, G.; Goldin, R.D.; Jatta, A.; Jeng-Barry, A.; Wegmuller, R.; E Moore, S.; et al. Natural history of chronic HBV infection in West Africa: A longitudinal population-based study from The Gambia. Gut 2016, 65, 2007–2016. [Google Scholar] [CrossRef] [PubMed]
  9. Yang, Y.; Huang, A.; Zhao, Y. Spontaneous loss of chronic HBV infection markers in treatment-naïve children: A systematic review and pooled meta-analyses. Expert Rev. Anti Infect. Ther. 2021, 19, 649–660. [Google Scholar] [CrossRef]
  10. WHO. Hepatitis B vaccines. WHO position paper. Wkly. Epidemiol. Rec. 2009, 84, 405–420. [Google Scholar]
  11. Spearman, C.W.; Afihene, M.; Ally, R.; Apica, B.; Awuku, Y.; Cunha, L.; Dusheiko, G.; Gogela, N.; Kassianides, C.; Kew, M.; et al. Hepatitis B in sub-Saharan Africa: Strategies to achieve the 2030 elimination targets. Lancet Gastroenterol. Hepatol. 2017, 2, 900–909. [Google Scholar] [CrossRef] [Green Version]
  12. WHO. WHO Vaccine-Preventable Diseases: Monitoring System. 2020 Global Summary (Data as of 12 October 2020). 2020. Available online: https://apps.who.int/immunization_monitoring/globalsummary/schedules (accessed on 7 January 2021).
  13. Sosler, S. Update on Gavi’s Support for HepB Birthdose. 2021, pp. 1–8. Available online: https://www.globalhep.org/sites/default/files/content/webinar/files/2021-04/Update_Gavi%20support%20for%20HepB%20BD_March%202021.pdf (accessed on 20 May 2021).
  14. GAVI the Vaccine Alliance. Gavi Board Starts Framing Alliance’s Approach to 2021–2025 Period 2018. Available online: https://www.gavi.org/news/media-room/gavi-board-starts-framing-alliances-approach-2021-2025-period (accessed on 5 February 2021).
  15. Bassoum, O.; Kimura, M.; Dia, A.T.; Lemoine, M.; Shimakawa, Y. Coverage and Timeliness of Birth Dose Vaccination in Sub-Saharan Africa: A Systematic Review and Meta-Analysis. Vaccines 2020, 8, 301. [Google Scholar] [CrossRef]
  16. Moturi, E.; Tevi-Benissan, C.; Hagan, J.; Shendale, S.; Mayenga, D.; Murokora, D.; Patel, M.; Hennessey, K.; Mihigo, R. Implementing a Birth Dose of Hepatitis B Vaccine in Africa: Findings from Assessments in 5 Countries. J. Immunol. Sci. 2018, 2, 31–40. [Google Scholar] [CrossRef] [Green Version]
  17. WHO. Practices to Improve Coverage of the Hepatitis B Birth Dose Vaccine; WHO: Geneva, Switzerland, 2012. [Google Scholar]
  18. Lee, C.; Gong, Y.; Brok, J.; Boxall, E.H.; Gluud, C. Hepatitis B immunisation for newborn infants of hepatitis B surface antigen-positive mothers. Cochrane Database Syst. Rev. 2006, CD004790. [Google Scholar] [CrossRef]
  19. WHO. Systematic Review of Safety and Efficacy of Childhood Schedules Using Hepatitis B Containing Vaccines; WHO: Geneva, Switzerland, 2016. [Google Scholar]
  20. Ekra, D.; Herbinger, K.-H.; Konate, S.; Leblond, A.; Fretz, C.; Cilote, V.; Douai, C.; Da Silva, A.; Gessner, B.D.; Chauvin, P. A non-randomized vaccine effectiveness trial of accelerated infant hepatitis B immunization schedules with a first dose at birth or age 6 weeks in Côte d’Ivoire. Vaccine 2008, 26, 2753–2761. [Google Scholar] [CrossRef] [PubMed]
  21. WHO. Hepatitis B vaccines: WHO position paper—July 2017. Wkly. Epidemiol. Rec. 2017, 27, 369–392. [Google Scholar] [CrossRef]
  22. Marion, S.A.; Tomm Pastore, M.; Pi, D.W.; Mathias, R.G. Long-term follow-up of hepatitis b vaccine in infants of carrier mothers. Am. J. Epidemiol. 1994, 140, 734–746. [Google Scholar] [CrossRef]
  23. Diallo, M.Y.; Gosset, A.; Vray, M.; Ouédraogo, E.; Betsem, E.; Shimakawa, Y.; Boyer, S. Coût et efficacité de la vaccination à la naissance contre l’hépatite B au Burkina Faso, résultats préliminaires du projet Néovac. In Proceedings of the AfraVIH 2018, 9ème Conférence Internationale Francoph, VIH/Hépatites, Bordeaux, France, 4–7 April 2018; p. 115. [Google Scholar]
  24. Campbell, M.K.; Piaggio, G.; Elbourne, D.R.; Altman, D.G. Consort 2010 statement: Extension to cluster randomised trials. BMJ 2012, 345, e5661. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Hemming, K.; Haines, T.; Chilton, P.J.; Girling, A.J.; Lilford, R.J. The stepped wedge cluster randomised trial: Rationale, design, analysis, and reporting. BMJ 2015, 350, h391. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Chan, A.W.; Tetzlaff, J.M.; Altman, D.G.; Laupacis, A.; Gøtzsche, P.C.; Krleža-Jerić, K.; Hróbjartsson, A.; Mann, H.; Dickersin, K.; Berlin, J.A.; et al. SPIRIT 2013 statement: Defining standard protocol items for clinical trials. Ann. Intern. Med. 2013, 158, 200–207. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Hayes, R.J.; Moulton, L.H. Cluster Randomised Trials; Chapman & Hall/CRC: Boca Raton, FL, USA, 2009. [Google Scholar]
  28. Ministère de la Santé du Burkina Faso. Plan d’Action 2015 du District Sanitaire de Dô; Bobo-Dioulasso, Burkina Faso, 2014.
  29. Ministère de la Santé du Burkina Faso. Plan d’Action 2016 du District Sanitaire de Dafra; Bobo-Dioulasso, Burkina Faso, 2015.
  30. Murayama, A.; Momose, H.; Yamada, N.; Hoshi, Y.; Muramatsu, M.; Wakita, T.; Ishimaru, K.; Hamaguchi, I.; Kato, T. Evaluation of in vitro screening and diagnostic kits for hepatitis B virus infection. J. Clin. Virol. 2019, 117, 37–42. [Google Scholar] [CrossRef]
  31. Avellon, A.; Ala, A.; Diaz, A.; Domingo, D.; Gonzalez, R.; Hidalgo, L.; Kooner, P.; Loganathan, S.; Martin, D.; McPherson, S.; et al. Clinical performance of Determine HBsAg 2 rapid test for Hepatitis B detection. J. Med Virol. 2020, 92, 3403–3411. [Google Scholar] [CrossRef] [Green Version]
  32. Collenberg, E.; Ouedraogo, T.; Ganamé, J.; Fickenscher, H.; Kynast-Wolf, G.; Becher, H.; Kouyaté, B.; Kräusslich, H.-G.; Sangaré, L.; Tebit, D.M. Seroprevalence of six different viruses among pregnant women and blood donors in rural and urban Burkina Faso: A comparative analysis. J. Med. Virol. 2006, 78, 683–692. [Google Scholar] [CrossRef] [PubMed]
  33. McNaughton, A.L.; Lourenço, J.; Bester, P.A.; Mokaya, J.; Lumley, S.F.; Obolski, U.; Forde, D.; Maponga, T.G.; Katumba, K.R.; Goedhals, D.; et al. Hepatitis B virus seroepidemiology data for Africa: Modelling intervention strategies based on a systematic review and meta-analysis. PLoS Med. 2020, 17, e1003068. [Google Scholar] [CrossRef] [Green Version]
  34. Lingani, M.; Akita, T.; Ouoba, S.; Sanou, A.M.; Sugiyama, A.; Tarnagda, Z.; Ohisa, M.; Tinto, H.; Mishiro, S.; Tanaka, J. High prevalence of hepatitis B infections in Burkina Faso (1996–2017): A systematic review with meta-analysis of epidemiological studies. BMC Public Health 2018, 18, 1–11. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Keane, E.; Funk, A.L.; Shimakawa, Y. Systematic review with meta-analysis: The risk of mother-to-child transmission of hepatitis B virus infection in sub-Saharan Africa. Aliment. Pharmacol. Ther. 2016, 44, 1005–1017. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Lee, S.D.; Lo, K.J.; Wu, J.C.; Tsai, Y.T.; Wang, J.Y.; Ting, L.P.; Tong, M.J. Prevention of maternal-infant hepatitis B virus transmission by immunization: The role of serum hepatitis B virus DNA. Hepatology 1986, 6, 369–373. [Google Scholar] [CrossRef] [PubMed]
  37. Machaira, M.; Papaevangelou, V.; Vouloumanou, E.K.; Tansarli, G.S.; Falagas, M.E. Hepatitis B vaccine alone or with hepatitis B immunoglobulin in neonates of HBsAg+/HBeAg− mothers: A systematic review and meta-analysis. J. Antimicrob. Chemother. 2015, 70, 396–404. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Hemming, K.; Girling, A. A Menu-Driven Facility for Power and Detectable-Difference Calculations in Stepped-Wedge Cluster-Randomized Trials. Stata J. Promot. Commun. Stat. Stata 2014, 14, 363–380. [Google Scholar] [CrossRef] [Green Version]
  39. Harris, P.A.; Taylor, R.; Minor, B.L.; Elliott, V.; Fernandez, M.; O’Neal, L.; McLeod, L.; Delacqua, G.; Delacqua, F.; Kirby, J.; et al. The REDCap consortium: Building an international community of software partners. J Biomed. Inform 2019. [Google Scholar] [CrossRef]
  40. White, I.R.; Horton, N.J.; Carpenter, J.; Pocock, S.J. Strategy for intention to treat analysis in randomised trials with missing outcome data. BMJ 2011, 342, 910–912. [Google Scholar] [CrossRef] [Green Version]
  41. Moher, D.; Hopewell, S.; Schulz, K.F.; Montori, V.; Gøtzsche, P.C.; Devereaux, P.J.; Elbourne, D.; Egger, M.; Altman, D.G. CONSORT 2010 Explanation and Elaboration: Updated guidelines for reporting parallel group randomised trials. BMJ 2010, 340, c869. [Google Scholar] [CrossRef] [Green Version]
  42. Démolis, R.; Botão, C.; Heyerdahl, L.W.; Gessner, B.D.; Cavailler, P.; Sinai, C.; Magaço, A.; Le Gargasson, J.-B.; Mengel, M.; Guillermet, E. A rapid qualitative assessment of oral cholera vaccine anticipated acceptability in a context of resistance towards cholera intervention in Nampula, Mozambique. Vaccine 2018, 36, 6497–6505. [Google Scholar] [CrossRef]
  43. Giles-Vernick, T.; Traoré, A.; Bainilago, L. Incertitude, Hepatitis B, and Infant Vaccination in West and Central Africa. Med. Anthropol. Q. 2016, 30, 203–221. [Google Scholar] [CrossRef]
  44. Giles-Vernick, T.; Hejoaka, F.; Sanou, A.; Shimakawa, Y.; Bamba, I.; Traoré, A. Barriers to Linkage to Care for Hepatitis B Virus Infection: A Qualitative Analysis in Burkina Faso, West Africa. Am. J. Trop. Med. Hyg. 2016, 95, 1368–1375. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Shimakawa, Y.; Pourette, D.; Bainilago, L.; Enel, C.; Sombié, R.; Rado, R.; Lemoine, M.; Giles-Vernick, T. Improving communication about viral hepatitis in Africa. Lancet Infect. Dis. 2017, 17, 688–689. [Google Scholar] [CrossRef]
  46. Boye, S.; Shimakawa, Y.; Vray, M.; Giles-Vernick, T. Limited awareness of hepatitis B but widespread recognition of its sequelae in rural senegal: A qualitative study. Am. J. Trop. Med. Hyg. 2020, 102, 637–643. [Google Scholar] [CrossRef] [PubMed]
  47. WHO. WHO Guide for Standardization of Economic Evaluations of Immunization Programmes, 2nd ed.; WHO: Geneva, Switzerland, 2019. [Google Scholar]
  48. Nayagam, S.; Thursz, M.; Sicuri, E.; Conteh, L.; Wiktor, S.; Low-Beer, D.; Hallett, T.B. Requirements for global elimination of hepatitis B: A modelling study. Lancet Infect. Dis. 2016, 16, 1399–1408. [Google Scholar] [CrossRef] [Green Version]
  49. De Villiers, M.J.; Gamkrelidze, I.; Hallett, T.B.; Nayagam, S.; Razavi, H.; Razavi-Shearer, D. Modelling hepatitis B virus infection and impact of timely birth dose vaccine: A comparison of two simulation models. PLoS ONE 2020, 15, e0237525. [Google Scholar] [CrossRef]
  50. European Association for the Study of the Liver. EASL 2017 Clinical Practice Guidelines on the management of hepatitis B virus infection. J. Hepatol. 2017, 67, 370–398. [Google Scholar] [CrossRef] [Green Version]
  51. Maylin, S.; Boyd, A.; Martinot-Peignoux, M.; Delaugerre, C.; Bagnard, G.; Lapalus, M.; Zoulim, F.; Lavocat, F.; Marcellin, P.; Simon, F.; et al. Quantification of hepatitis B e antigen between Elecsys HBeAg and Architect HBeAg assays among patients infected with hepatitis B virus. J. Clin. Virol. 2013, 56, 306–311. [Google Scholar] [CrossRef]
  52. Seck, A.; Ndiaye, F.; Maylin, S.; Ndiaye, B.; Simon, F.; Funk, A.L.; Fontanet, A.; Takahashi, K.; Akbar, S.M.F.; Mishiro, S.; et al. Poor Sensitivity of Commercial Rapid Diagnostic Tests for Hepatitis B e Antigen in Senegal, West Africa. Am. J. Trop. Med. Hyg. 2018, 99, 428–434. [Google Scholar] [CrossRef]
  53. Clement, F.; Dewint, P.; Leroux-Roels, G. Evaluation of a New Rapid Test for the Combined Detection of Hepatitis B Virus Surface Antigen and Hepatitis B Virus e Antigen. J. Clin. Microbiol. 2002, 40, 4603–4606. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  54. Lau, D.T.-Y.; Ma, H.; Lemon, S.M.; Doo, E.; Ghany, M.G.; Miskovsky, E.; Woods, G.L.; Park, Y.; Hoofnagle, J.H. A rapid immunochromatographic assay for hepatitis B virus screening. J. Viral Hepat. 2003, 10, 331–334. [Google Scholar] [CrossRef] [PubMed]
  55. Akanmu, A.S.; A Esan, O.; O Adewuyi, J.; O Davies, A.; Okany, C.C.; O Olatunji, R.; Babalola, T. Evaluation of a rapid test kit for detection of HBsAg/eAg in whole blood: A possible method for pre-donation testing. Afr. J. Med. Med. Sci. 2006, 35, 5–8. [Google Scholar]
  56. Mainet-González, D.; Palenzuela-Gardon, D.O.; Aguilar Rubido, J.C. Comparison between an immunochromatographic test with an amplified ELISA for detecting e antigen and anti-e antigen antibodies in chronic Hepatitis B. Biotecnol. Apl. 2009, 26, 143–145. [Google Scholar]
  57. Boucheron, P.; Lu, Y.; Yoshida, K.; Zhao, T.; Funk, A.L.; Lunel-Fabiani, F.; Guingané, A.; Tuaillon, E.; van Holten, J.; Chou, R.; et al. Accuracy of HBeAg to identify pregnant women at risk of transmitting hepatitis B virus to their neonates: A systematic review and meta-analysis. Lancet Infect. Dis. 2021, 21, 85–96. [Google Scholar] [CrossRef]
  58. Ségéral, O.; N’Diaye, D.S.; Prak, S.; Nouhin, J.; Chhun, S.; Khamduang, W.; Chim, K.; Roque-Afonso, A.-M.; Piola, P.; Borand, L.; et al. Usefulness of a serial algorithm of HBsAg and HBeAg rapid diagnosis tests to detect pregnant women at risk of HBV mother-to-child transmission in Cambodia, the ANRS 12328 pilot study. J. Clin. Virol. 2018, 109, 29–34. [Google Scholar] [CrossRef] [PubMed]
  59. Segeral, O.; Dim, B.; Durier, C.; Prak, S.; Chhim, K.; Vong, C.; Pech, S.; Tiv, S.; Nem, B.; Hout, K.; et al. Hepatitis B e Antigen (HBeAg) Rapid Test and Alanine Aminotransferase Level–Based Algorithm to Identify Pregnant Women at Risk of HBV Mother-to-Child Transmission: The ANRS 12345 TA PROHM Study. Clin. Infect. Dis. 2020, 71, E587–E593. [Google Scholar] [CrossRef] [Green Version]
  60. Shimakawa, Y.; Ndow, G.; Njie, R.; Njai, H.F.; Takahashi, K.; Akbar, S.M.F.; Cohen, D.; Nayagam, S.; Jeng, A.; Ceesay, A.; et al. Hepatitis B corerelated antigen: An alternative to hepatitis B Virus DNA to assess treatment eligibility in Africa. Clin. Infect. Dis. 2019, 70, 1442–1452. [Google Scholar] [CrossRef]
  61. Yoshida, K.; Desbiolles, A.; Feldman, S.F.; Ahn, S.H.; Alidjinou, E.K.; Atsukawa, M.; Bocket, L.; Brunetto, M.R.; Buti, M.; Carey, I.; et al. Hepatitis B Core-Related Antigen to Indicate High Viral Load: Systematic Review and Meta-Analysis of 10,397 Individual Participants. Clin. Gastroenterol. Hepatol. 2021, 19, 46–60.e8. [Google Scholar] [CrossRef]
  62. Shimakawa, Y.; Vernoux, L.; Gabassi, A.; Mercier-Delarue, S.; Vincent, J.P.; Simon, F.; Maylin, S. Analytical validation of hepatitis B core-related antigen (HBcrAg) using dried blood spots (DBS). J. Viral Hepat. 2021, 28, 837–843. [Google Scholar] [CrossRef]
  63. Vanhomwegen, J.; Kwasiborski, A.; Diop, A.; Boizeau, L.; Hoinard, D.; Vray, M.; Bercion, R.; Ndiaye, B.; Dublineau, A.; Michiyuki, S.; et al. Development and clinical validation of loop-mediated isothermal amplification (LAMP) assay to diagnose high HBV DNA levels in resource-limited settings. Clin. Microbiol. Infect. 2021. [Google Scholar] [CrossRef]
  64. Giles, M.; Visvanathan, K.; Lewin, S.; Bowden, S.; Locarnini, S.; Spelman, T.; Sasadeusz, J. Clinical and virological predictors of hepatic flares in pregnant women with chronic hepatitis B. Gut 2015, 64, 1810–1815. [Google Scholar] [CrossRef]
  65. Brown, R.S.; McMahon, B.J.; Lok, A.S.; Wong, J.B.; Ahmed, A.T.; Mouchli, M.A.; Wang, Z.; Prokop, L.J.; Murad, M.H.; Mohammed, K. Antiviral therapy in chronic hepatitis B viral infection during pregnancy: A systematic review and meta-analysis. Hepatology 2016, 63, 319–333. [Google Scholar] [CrossRef]
  66. Funk, A.L.; Lu, Y.; Yoshida, K.; Zhao, T.; Boucheron, P.; van Holten, J.; Chou, R.; Bulterys, M.; Shimakawa, Y. Efficacy and safety of antiviral prophylaxis during pregnancy to prevent mother-to-child transmission of hepatitis B virus: A systematic review and meta-analysis. Lancet Infect. Dis. 2021, 21, 70–84. [Google Scholar] [CrossRef]
  67. WHO. Prevention of Mother-to-Child Transmission of Hepatitis B Virus: Guidelines on Antiviral Prophylaxis in Pregnancy; WHO: Geneva, Switzerland, 2020. [Google Scholar]
  68. Terrault, N.A.; Lok, A.S.; McMahon, B.J.; Chang, K.-M.; Hwang, J.; Jonas, M.M.; Brown, R.S., Jr.; Bzowej, N.H.; Wong, J.B. Update on prevention, diagnosis, and treatment of chronic hepatitis B: AASLD 2018 hepatitis B guidance. Hepatology 2018, 67, 1560–1599. [Google Scholar] [CrossRef]
  69. Sarin, S.K.; Kumar, M.P.; Lau, G.K.; Abbas, Z.; Chan, H.L.Y.; Chen, C.J.; Chen, D.-S.; Chen, H.L.; Chien, R.N.; Dokmeci, A.; et al. Asian-Pacific clinical practice guidelines on the management of hepatitis B: A 2015 update. Hepatol. Int. 2016, 10, 1–98. [Google Scholar] [CrossRef] [PubMed]
  70. Shimakawa, Y.; Toure-Kane, C.; Mendy, M.; Thursz, M.; Lemoine, M. Mother-to-child transmission of hepatitis B in sub-Saharan Africa. Lancet Infect. Dis. 2016, 16, 19–20. [Google Scholar] [CrossRef]
  71. Hagan, J.E.; Carvalho, E.; Souza, V.; Dos Anjos, M.Q.; Abimbola, T.O.; Pallas, S.W.; Benissan, M.C.T.; Shendale, S.; Hennessey, K.; Patel, M.K. Selective Hepatitis B Birth-Dose Vaccination in São Tomé and Príncipe: A Program Assessment and Cost-Effectiveness Study. Am. J. Trop. Med. Hyg. 2019, 101, 891–898. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic representation of the stepped wedge design (24 clusters with an interval of 3 weeks per step).
Figure 1. Schematic representation of the stepped wedge design (24 clusters with an interval of 3 weeks per step).
Vaccines 09 00583 g001
Figure 2. Study area (rural zones of Dô and Dafra districts in Hauts-Bassins Region). Adapted from Plan d’action sanitaire de Dô et Dafra [28,29].
Figure 2. Study area (rural zones of Dô and Dafra districts in Hauts-Bassins Region). Adapted from Plan d’action sanitaire de Dô et Dafra [28,29].
Vaccines 09 00583 g002
Figure 3. Participant timeline.
Figure 3. Participant timeline.
Vaccines 09 00583 g003
Figure 4. Algorithm for participants tested positive for HBsAg.
Figure 4. Algorithm for participants tested positive for HBsAg.
Vaccines 09 00583 g004
Figure 5. Power of the study according to the number of infants evaluated at the age of 9 months per cluster and per period.
Figure 5. Power of the study according to the number of infants evaluated at the age of 9 months per cluster and per period.
Vaccines 09 00583 g005
Table 1. Strategies for the prevention of mother-to-child transmission of HBV.
Table 1. Strategies for the prevention of mother-to-child transmission of HBV.
StrategiesScreening For Pregnant WomenPeripartum Antiviral ProphylaxisHepB-BDHepB3 (8-12-16 weeks)
HBsAg RDTTest for High Viral Replication *
Current standard of care----Yes
Universal birth dose vaccination---YesYes
Two-step diagnostic procedure (conventional approach in resource-rich context)YesYes
(Only those tested positive for HBsAg)
Yes
(Only those with high viral replication)
YesYes
One-step diagnostic procedure-Yes
(Test all women for high viral replication)
Yes
(Only those with high viral replication)
YesYes
Treat-all strategyYes-Yes
(All HBsAg-positive women)
YesYes
Abbreviations: HepB-BD, birth dose of hepatitis B vaccine; HepB3, infant vaccination with three doses of pentavalent vaccine; RDT, rapid diagnostic test. * Tests for high viral replication that we will assess are: Real-time PCR to quantify HBV DNA levels (gold standard test); qHBeAg; HBeAg RDT; qHBsAg; HBcrAg; HBV-LAMP.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Tall, H.; Adam, P.; Tiendrebeogo, A.S.E.; Vincent, J.P.; Schaeffer, L.; von Platen, C.; Fernandes-Pellerin, S.; Sawadogo, F.; Bokoum, A.; Bouda, G.; et al. Impact of Introducing Hepatitis B Birth Dose Vaccines into the Infant Immunization Program in Burkina Faso: Study Protocol for a Stepped Wedge Cluster Randomized Trial (NéoVac Study). Vaccines 2021, 9, 583. https://doi.org/10.3390/vaccines9060583

AMA Style

Tall H, Adam P, Tiendrebeogo ASE, Vincent JP, Schaeffer L, von Platen C, Fernandes-Pellerin S, Sawadogo F, Bokoum A, Bouda G, et al. Impact of Introducing Hepatitis B Birth Dose Vaccines into the Infant Immunization Program in Burkina Faso: Study Protocol for a Stepped Wedge Cluster Randomized Trial (NéoVac Study). Vaccines. 2021; 9(6):583. https://doi.org/10.3390/vaccines9060583

Chicago/Turabian Style

Tall, Haoua, Pierrick Adam, Abdoul Salam Eric Tiendrebeogo, Jeanne Perpétue Vincent, Laura Schaeffer, Cassandre von Platen, Sandrine Fernandes-Pellerin, François Sawadogo, Alkadri Bokoum, Ghislain Bouda, and et al. 2021. "Impact of Introducing Hepatitis B Birth Dose Vaccines into the Infant Immunization Program in Burkina Faso: Study Protocol for a Stepped Wedge Cluster Randomized Trial (NéoVac Study)" Vaccines 9, no. 6: 583. https://doi.org/10.3390/vaccines9060583

APA Style

Tall, H., Adam, P., Tiendrebeogo, A. S. E., Vincent, J. P., Schaeffer, L., von Platen, C., Fernandes-Pellerin, S., Sawadogo, F., Bokoum, A., Bouda, G., Ouattara, S., Ouédraogo, I., Herrant, M., Boucheron, P., Sawadogo, A., Betsem, E., Essoh, A., Kabore, L., Ouattara, A., ... Shimakawa, Y. (2021). Impact of Introducing Hepatitis B Birth Dose Vaccines into the Infant Immunization Program in Burkina Faso: Study Protocol for a Stepped Wedge Cluster Randomized Trial (NéoVac Study). Vaccines, 9(6), 583. https://doi.org/10.3390/vaccines9060583

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop