Next Article in Journal
Whole-Genome Sequencing of a Colistin-Resistant Acinetobacter baumannii Strain Isolated at a Tertiary Health Facility in Pretoria, South Africa
Next Article in Special Issue
Chlorhexidine Improves Hygiene Reducing Oral Polymorphonuclear Leukocytes with Antimicrobial Effects at Distinct Microenvironments amongst Subjects Stratified by Health Status
Previous Article in Journal
Hydroxyapatite/TiO2 Nanomaterial with Defined Microstructural and Good Antimicrobial Properties
Previous Article in Special Issue
Influence of Anti-Infective Periodontal Therapy on Subgingival Microbiota Evaluated by Chair-Side Test Compared to qPCR—A Clinical Follow-Up Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Effectiveness of Different Chemotherapeutic Agents for Decontamination of Infected Dental Implant Surface: A Systematic Review

by
Chayya Patil
1,
Amit Agrawal
1,
Shahabe Saquib Abullais
2,*,
Suraj Arora
3,
Shafait Ullah Khateeb
3 and
Mohamed Fadul A. Elagib
2
1
Department of Periodontics, M.G.V’s K.B.H Dental College and Hospital, Nasik 422022, India
2
Department of Periodontics and Community Dental Sciences, King Khalid University, Abha 61421, Saudi Arabia
3
Department of Restorative Dental Sciences, King Khalid University, Abha 61421, Saudi Arabia
*
Author to whom correspondence should be addressed.
Antibiotics 2022, 11(5), 593; https://doi.org/10.3390/antibiotics11050593
Submission received: 12 March 2022 / Revised: 24 April 2022 / Accepted: 26 April 2022 / Published: 28 April 2022
(This article belongs to the Special Issue Antibacterial Treatment in Periodontal and Endodontic Therapy)

Abstract

:
Aim: To evaluate the most effective chemotherapeutic agent for decontamination of infected dental implants. Material and methods: A systematic electronic literature search in MEDLINE (PubMed) and Google scholar between January 2010 to December 2021 was carried out by using the PRISMA guidelines. A total of five studies related to chemical decontamination of the dental implant were evaluated. The search strategy was based on the PICOS framework. Randomized controlled trials (RCT’s) and cohort studies evaluating the effectiveness of different chemotherapeutic agents for the decontamination of dental implants were included in the study. The outcome variable examined was the most effective chemotherapeutic agent(s) for dental implant surface decontamination after comparing the chemotherapeutic agents used in the qualifying studies. Result: Out of the basic database of 1564 records, 1380 articles were excluded due to irrelevance, unavailability, and repetition. Furthermore, 134 articles were excluded from 184 studies for various reasons. After further filtration, 13 studies were shortlisted. Two investigators (SSA and SA) appraised the quality of the selected studies using the risk of bias assessment tool. After excluding eight studies, five articles were finally included in the present systematic review. Conclusion: The data reported for the efficacy of chemotherapeutic agents in cleaning contaminated titanium surfaces are scarce, thus it is not possible to draw a definite conclusion. However, chlorhexidine (CHX) (0.2%, 0.12%), citric acid (40%) and sodium hypochlorite (1%) are the most commonly used chemotherapeutic agents; amongst them, citric acid showed the highest potential for biofilm removal from the contaminated implant surface. All three agents [CHX (0.2%, 0.12%), citric acid (40%), and sodium hypochlorite (1%)] can be recommended as therapeutic agents along with their curbs.

1. Introduction

Recently, oral implantology has become an integral part of dentistry. It helps dentists to improve the quality of life for a large patient population [1]. Dental implants are the best solution for simulating the aesthetic, perception, and function of natural teeth. Dental implants do not just replace the missing teeth, but also help in maintaining and reinforcing the bone structure. In a prospective cohort study, van Velzen et al. reported a 91.6% success rate for SLA-surface dental implants and reported 7% peri-implantitis after 10 years of follow-up [2]. Moraschini V et al., in their systematic review, evaluated the survival and success rate of osseointegrated implants for at least 10 years. Out of the final 23 articles selected, 14 studies showed survival rates of around 94.6% and mean marginal bone resorption of around 1.3 mm. They concluded that osseointegrated implants are safe and present high survival rates and minimal marginal bone resorption in the long term [3]. Atieh MA. systematically estimated the overall frequency of peri-implant diseases in general and high-risk group participants. The nine studies included showed that the frequency of peri-implant mucositis and peri-implantitis was 63.4% and 18.8%, respectively. Smokers showed a higher frequency (36.3%) of exhibiting peri-implantitis. They concluded that, to reduce the risk of peri-implantitis, long-term maintenance therapy for high-risk groups is essential, as peri-implant diseases are common after implant therapy [4].
Dental implants have a high success rate in the long term, however, failure is inevitable. Peri-implant disease, which is commenced by bacteria, has two subtypes: peri-implant mucositis, and peri-implantitis. At the first European workshop on periodontology (1993), peri-implantitis was defined as a destructive inflammatory process affecting the soft and hard tissues around osseointegrated implants, leading to the formation of a peri-implant pocket and loss of the supporting bone. Peri-implant mucositis was defined as “reversible” inflammatory changes in soft tissues surrounding a functional implant, without bone loss [5]. Reasons for implant failure, besides bacterial causes, are patient-related factors such as imbalanced occlusal forces, poor bone quality, improper surgical placement, poor oral hygiene, excessive surgical trauma, uncontrolled diabetes, smoking, bruxism, and edentulism status. [6].
Peri-implant tissues, similar to periodontal tissues, are susceptible to bacterial infection. Bacterial colonization of implant surfaces occurs rapidly. Fürst et al., in their study, have concluded that early colonization patterns differ between implant and tooth surfaces [7]. Bacterial diversity and its transition from a healthy peri-implant sulcus to an inflamed peri-implant pocket is related to bacterial shifts in dental plaque [8]. According to Quirynen et al., to improve or preserve periodontal health around titanium implants, a reduction of the number of pathogenic species is required [9]. Various methods were used for decontamination in previous studies, which are categorized into physical and chemical methods. Physical methods are further subdivided into mechanical and laser decontamination techniques. Photodynamic therapy falls into either category as it combines light-sensitive chemical agents with the laser used to promote their cytotoxicity. Chemical decontamination mainly involves the localized use of anti-microbial solutions such as topical chlorhexidine, tetracycline or minocycline, citric acid, hydrogen peroxide, 35% phosphoric acid gel, or saline [10]. Chemical decontamination can be combined with mechanical decontamination. Mechanical decontamination techniques alone were found to be not very effective in removing the bacterial biofilm, so adjunct use of different chemotherapeutic agents was advised to treat the infected dental implants [11].
A systematic review by Ntrouka VI et al., in search of the most effective chemotherapeutic agent for decontamination of the implant surface, has evaluated four different studies. They cautiously concluded that citric acid can be considered as a chemotherapeutic agent with the highest potential for the removal of biofilms from contaminated titanium surfaces in vitro. Yet, complete biofilm removal was not achieved by citric acid. They reported scarce data on this topic comparing the efficacy of chemotherapeutic agents on titanium implant surfaces [12].
In the present review, only five eligible studies were identified out of 1564 records obtained. Most of the studies have compared one chemotherapeutic agent with normal saline as a control group, so they were excluded as they failed to satisfy the inclusion criteria [13,14]. The systematic search was carried out to focus on “which is the most effective chemotherapeutic agent for decontamination of the infected dental implant (with or without adjunctive mechanical cleaning)?” using a structured search strategy and through the selection of the best available evidence. The purpose of this systematic review was to find the most effective chemotherapeutic agent for decontamination of infected dental implants (with or without adjunctive mechanical cleaning) from the existing literature.

2. Materials and Methods

This systematic review was conducted according to the guidelines of Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA statement 2009) [15,16]. This systematic review topic was registered on an international database of prospectively registered systematic reviews PROSPERO (CRD42020173838) to avoid any unintentional iteration/duplication of the review on the same topic.

2.1. Rationale and Focused Question for Review

To our knowledge, only one systematic review was carried out to explore the chemotherapeutic agents in the past literature including studies published on/before June 2010 [10]. There is no absolute explanation regarding the effectiveness of different chemotherapeutic agents in the decontamination of infected dental implants.
The addressed focused question is: “which is the most effective chemotherapeutic agent for decontamination of an infected dental implant (with or without adjunctive mechanical cleaning)?” In this review, an attempt has been made to answer this question using a structured search strategy and through the selection of the best available evidence.
To date, all of the studies and reviews have failed to distinguish a sole chemotherapeutic agent as the gold standard for implant surface decontamination [10,17]. Therefore, an effort was made to search the recent literature (from January 2010 to December 2021) focusing on the use and comparison of different chemotherapeutic agents for decontamination of infected implant surfaces. Thus, this review aimed to find evidence regarding the most effective chemotherapeutic agent for the decontamination of infected titanium surfaces (with/without mechanical decontamination).

2.2. Sources of Information and Search Strategy

A systematic electronic literature search in MEDLINE (PubMed) and the Google Scholar search engine was conducted. The separate search strategies were framed and used for the said databases. The search was limited to studies involving humans, in the English language, and published from January 2010 to December 2021.
A random combination of the following terms was used for the search: “peri-implantitis treatment”, “chemotherapeutic agents”, “implant surface decontamination”, “chemical disinfectant”, “titanium”, and “biofilm”. All retrieved articles were reviewed to identify additional relevant randomized controlled trials (RCTs). The titles and abstracts of potential references were manually examined to exclude irrelevant publications. Two reviewers independently reviewed all additional pertinent studies of the remaining pieces of literature on the topic of interest (Table 1).

2.3. Study Selection Criteria

In the current review, RCTs and cohort studies were included.

2.4. Eligibility Criteria

The current systematic review included in vitro and in vivo studies that evaluated the PICO question described above, excluding case studies or case series, animal studies, and literature reviews.

2.5. Primary and Secondary Outcomes

The primary outcome of this review was to identify the most effective chemotherapeutic agent(s) for dental implant surface decontamination after comparison among existing chemotherapeutic agents in the studies qualifying the inclusion criteria.

2.6. Screening and Data Extraction

After reading the title and abstract of initially identified studies from electronic databases, two reviewers (CP and AA) independently screened all the collected studies. Any duplication or articles that did not meet inclusion criteria were exempted. Studies with the full text available and meeting all the inclusion criteria were again assessed separately by the reviewers to determine whether they qualified the inclusion norms. Any disagreement/discrepancy was resolved by discussion. Once the screening was done, data were extracted by two independent authors from the relevant studies. Characteristics that have been extracted from each study were as follows: (i) year of publication; (ii) last name of first author; (iii) study type; (iv) sample size; (v) implant surface used; (vi) in-surgical or non-surgical; (vii) with or without mechanical cleaning; and (viii) mode of application of the chemotherapeutic agent.

2.7. Quality Assessment

Two review authors (CP and SSA) independently assessed the quality of each study and the risk of bias in the included studies. After a preliminary evaluation of the selected papers, considerable heterogeneity was found in the study designs, characteristics, outcome variables, and measurements.

2.8. Statistical Analysis

Meta-analysis was not carried out due to the heterogeneity of data.

3. Results

A total of 1564 records were identified through the database searches (PubMed, Google Scholar), out of which 1380 records were excluded as they were irrelevant, as data units were unavailable, or due to repetition. The remaining 184 articles were assessed for eligibility based on their title, out of which 134 articles were excluded due to the following reasons: not relevant to implant surface decontamination; articles not in English; and articles in which other methods were used for implant surface decontamination. Furthermore, out of the 47 remaining articles, 13 were selected based on the keywords such as “peri-implantitis treatment”, “chemotherapeutic agents”, “implant surface decontamination” and “chemical disinfectant for implant surface”. Thirty-four full-text articles were excluded for the following reasons: comparison between different decontamination methods; and comparison of only one chemotherapeutic agent with normal saline as the control group. In the final step of article selection, out of 13 articles, eight were excluded due to incomplete studies, not comparing more than two chemotherapeutic agents. Thus, finally, five studies were included in the present systematic review. The selection process was outlined in the PRISMA flow chart (Figure 1). Details of the selected studies are summarized in Table 2.
Risk of bias assessment:
There could be a potential language bias in this systematic review as we only considered literature written in English. Two investigators (AA, SSA) appraised the quality of the selected studies separately using the risk of bias assessment tool (The Cochrane collaboration’s tool) [18]. If there was any debate over a review, then it was settled by conversation. By using the risk-of-bias assessment tool, the studies were categorized as high, low, or unclear risk of bias. After the quality assessment, the included studies were graded into (1) low risk: when all criteria were met, or one criterion was unclear/not met; (2) moderate risk: when two criteria were unclear/not met; (3) high risk: when more than two criteria were not met. There are 13 studies in which different chemotherapeutic agents were compared on contaminated implant surfaces. Out of these, nine studies showed heterogeneity in terms of contamination, different chemicals used for decontamination in different studies, and outcome measures.
Table 2. Details of the selected studies for systematic review.
Table 2. Details of the selected studies for systematic review.
Author
(Year, with/without Mechanical Cleaning)
Implant Surface Contaminated
with
Chemical Used
(Application Form, Time)/Type of Intervention
Sample SizeOutcome Measure/Primary EndpointConclusion/Outcome
Gosau M et al. [19] (2010, without)in vivoOral biofilm1% sodium hypochlorite (NaOCL)
3% H2O20.2% CHX gluconate
Plax (Triclosan 0.3%)
Listerine cool mint (alcohol based)
Citric acid (Ph 1, 40%)
PBS solution(control)
(in liquid form, for 1 min)
8
8
8
8
8
8
8
The proportion of live/dead bacterial cellAll six antimicrobial agents were effective in reducing oral bacterial biofilm on titanium disc, compared to control.
All (except Plax, 40%) showed a significant bactericidal effect on adhering bacteria.
Ntrouka et al. [20] (2011, without)
In-vitro
1-streptococcus mutans24% EDTA
40% Citric acid
10% H2O2
Ardox-X
0.07% CPC
0.2% CHX digluconate
Sterile water(control)
(in liquid form, for 5 min)
6
6
6
6
6
6
6
1. Total CFU count
2. Protein measurement (µg)
H2O2, Ardox-X, 40% citric acid
Were most effective & Ardox-X, 40% citric acid were most potent in killing streptococcus mutans.
40% citric acid was most effective in bacterial killing, the addition of H2O2,/Ardox-X to Citric acid didn’t have a significant effect
2-saliva to grow polymicrobial biofilm40% Citric acid (5 min)
Ardox-X (5 min)
10% H2O2 (5 min)
Ardox-X then Citric acid (2.5 min each)
10% H2O2 then Citric acid (2.5 min each)
6
6
6
6
6
R Burgers et al. [21] (2012, without)
In-vitro
Staphylococcus epidermis1% sodium hypochlorite
3% H2O20.2% CHX gluconate
Plax (Triclosan 0.3%)
Listerine
Citric acid (Ph 1, 40%)
Saline(control)
(in liquid form, for 60 s)
(The chemicals used are not categorized well please arrange)
35The proportion of live/dead bacterial cellOnly sodium hypochlorite (1%) was effective against all 3 species. Whereas
H2O2 only against Candida albicans.
CHX gluconate (0.2%) & Listerine against Candida albicans and Streptococcus sanguis.
Plax (0.3%) against Streptococcus sanguis and Staphylococcus epidermis.
Candida albicans35
Streptococcus sanguis35
Georgis A Kotsakis et al. [22] (2016, without)Multi-species biofilm0.12% chlorhexidine
20% citric acid gel
25% EDTA 15% sodium hypochlorite
0.9% NaCl (sterile saline)
(Burnished for 20 s with cotton pellet moistened in chemical agent
6
6
6
6
1. CFU count
2. Surface characterization
Antimicrobial effect was greater for citric acid, sodium hypochlorite/EDTA groups followed by Chlorhexidine (0.12%) group as compared to non-contaminated control.
sterile saline only had a minimal antimicrobial effect.
Chlorhexidine (0.12%) use is not recommended as it produces a cytotoxic effect on the decontaminated surface and compromise the biocompatibility of the titanium surface.
Dostie S et al. [23] (2017, without)Multi-species mature oral biofilmControl group (not rinsed/treated with chemical)31. Bacterial cell count
2. Viability of bacteria after treatment
The double rinse group removed more bacteria compared to the rinse group. But no significant difference between the double rinse and disinfectant group suggests a mechanical effect of rinsing was responsible for the removal of bacteria and not the chemical effect.
Proportion of dead cells for CHX group (11.8%), Etch group (6.9%) & tetracycline (3.9%) respectively compared to double saline group.
No significant difference was noted between double rinse and the C.C.E. group.
Rinse group (0.9% sodium chlorite, 6 increments, total 6 mL)3
CHX group (1% Chlorhexidine in methylcellulose gel)3
Etch group (35% phosphoric acid gel)3
Tetracycline group (250 mg tetracycline with 0.9% NaCl to form thick paste)3
C.C.E group (0.3% cetrimide, 0.1% CHX, 0.5% EDTA in 3% methylcellulose gel)3
Double-rinse group (12 increments of 1 mL 30.9% NaCl) without any chemical agents
(Irrigation/application of gel, 2 min)
3

4. Discussion

The dental implant has become a crucial therapy in dentistry to replace missing teeth in different clinical situations. Once the biofilms are completely formed on implant surfaces, the peri-implant tissue response seems to follow patterns similar to those of the periodontal tissues in a susceptible host. Over the last few decades, there is increasing evidence of the presence of peri-implant inflammation representing one of the most frequent complications affecting both the surrounding soft and hard tissues, which can lead to implant failure. Therefore, strategies for the prevention and treatment of peri-implant disease should be integrated into modern rehabilitation concepts in dentistry. Peri-implant inflammation represents a serious matter after dental implant placement, which affects both the surrounding hard and soft tissue [24]. Despite various preventive and treatment modalities for the treatment of peri-implant diseases, none has shown excellent results. Chemical surface decontamination is one of the treatment modalities in which different chemotherapeutic agents are used for surface decontamination.
Persson et al., in an animal study used two-part implants. Peri-implantitis was induced on those parts. Complete re-osseointegration was observed after decontamination. So, they insisted that decontamination of the titanium surface is of utmost importance for re-osseointegration [25]. Leonhardt A et al., in their 5-year follow-up human study evaluated the outcome of combined surgical and antimicrobial treatment of peri-implantitis. After surgical exposure, the implant surface was treated with 10% hydrogen peroxide, and washing with saline solution was carried out. It was followed by a 0.2% chlorhexidine mouthwash and systemic antibiotic therapy (amoxicillin + metronidazole). Results showed a significant reduction in plaque and gingival bleeding. Out of 26 implants included in the study, seven were lost within 5 years of follow-up, six showed increases in bone level, four showed a continued bone loss, and in nine, bone level was not changed significantly. Based on the clinical, microbiological, and radiographic evaluation they concluded a 58% success rate of implants after chemical decontamination [26]. In another study, it was noted that biofilm formation was increased during exposure to the oral environment, due to the implant surface morphology and roughness [27]. Thus, the effect of mechanical debridement was limited [28]. Kozlovsky et al. [29] and Renvert et al. [11] put forward the use of chemotherapeutic agents as an adjunct to mechanical therapy. As titanium surfaces are not instrumented in chemical decontamination, it led to minimal risk of damage [30].
Among all modalities, decontamination using chemotherapeutic agents is one of the promising treatment modalities to control the further progression of peri-implant disease. The past literature shows various studies on the chemical decontamination of titanium implant surfaces. In those studies, implant surfaces were contaminated either with specific microorganisms or with an oral biofilm, and different chemotherapeutic agents were used for decontamination. The outcome parameters evaluated in each selected study were different. Considering this heterogeneity of the studies in the literature, the results in this study were based on the most frequently used chemotherapeutic agents. In the five studies included in this review, the chemotherapeutic agents were chlorhexidine, citric acid, and sodium hypochlorite.
In a discourse on citric acid, Ntrouka VI et al. [10] carried out a systematic review in which they cautiously reported that citric acid is considered a most promising chemical agent with the highest potential for biofilm removal from titanium surfaces. This was mostly based on the findings of in-vitro studies. Lastly, they noted that complete removal of the biofilm was not achieved by any particular chemotherapeutic agent. Wheelis et al. [31] showed that citric acid leads to changes in the titanium surface, resulting in a greater roughness after treatment (which includes an increase in the depths of valleys and the prominence of peaks) when analyzed using the electron microscope. It was found that citric acid seems to dissolve the oxide layer when the acid is applied under abrasion. Also, the degradation of the implant oxide film can influence the electrochemical behavior of titanium, leading to its corrosion and favoring the release of particles and debris that may cause detrimental outcomes to surrounding tissue [31,32,33].
Souza et al. [14] in their study evaluated the antimicrobial effect of citric acid on in-situ biofilms, whether this treatment favors bacterial recolonization, and its effect on the electrochemical properties of titanium. Palatal appliances containing titanium discs were worn by volunteers for around 7 days. After 7 days, the discs were exposed to subsequent treatment: immersion in 0.9% sodium chloride (control); 40% citric acid immersion; and 40% citric acid rubbing. After chemical treatment, appliances were exposed in-vitro to new bacterial adhesion with Streptococcus sanguinis. New discs (n = 18) without a biofilm were exposed to the various treatments and subjected to electrochemical tests and surface characterization. Results showed that the citric acid groups had a significant reduction in the biofilm formed in-situ compared with the control group (p < 0.05), but no difference was found between the citric acid application methods (p = 0.680). The acid treatment did not favor the recolonization of bacteria (p = 0.629). Citric acid treatment did not influence the polarization resistance and capacitance of the oxide film, but statistically enhanced the electrochemical stability of titanium. Therefore, they conclude that citric acid can be used as an effective alternative to treat the main etiologic factor in dental implant failure, biofilm formation, without impairing the electrochemical behavior of the titanium surface.
Recently, in vitro studies on the toxicity of citric acid have been evaluated and it was found that citric acid at 4% to 10% concentrations did not result in cytotoxicity on human osteoblastic cells. A significant decrease in cell proliferation was reported, but it was also reported that the normal proliferation rate was restored around 3 days after treatment with a 4% concentration [34]. In the literature, mostly citric acid was used at pH 1 with a concentration of 40%. In an in-vitro study, it was found that citric acid suppressed the attachment and spreading of fibroblasts on culture plates and type-I collagen, along with confirming that the toxic effect of media containing citric acid was due to their acidity rather than the citrate content [35]. Thus, citric acid application must be limited to the implant surface. Clinical application of citric acid is more difficult because of the mandate to avoid the its spread to bone and marrow spaces.
In the literature, chlorhexidine was used for decontamination of contaminated titanium implant surfaces at 0.12% and 0.2% concentrations, mostly. Menezes KM et al., 2016, in a human study, evaluated the efficacy of 0.12% chlorhexidine gluconate in peri-mucositis patients. A total of 37 peri-mucositis patients were assigned to either the test group (basic periodontal therapy +0.12% chlorhexidine) and the control group (basic periodontal therapy+placebo). Clinical parameters were evaluated at baseline and one, three, and six months post-therapy. The results showed a statistically significant improvement in the plaque index, gingival bleeding index, probing depth, and bleeding on probing. They concluded that mechanical therapy alone, and along with 0.12% chlorhexidine mouthwash, reduced peri-implant mucositis [36].
In a study on canines, it was found that chlorhexidine has also been shown to favor re-osseointegration. In induced peri-implantitis lesions, the bony lesions were debrided post flap elevation and the implant surfaces were mechanically cleaned using curettes followed by a rinse with 0.12% chlorhexidine. Guided tissue regeneration (GTR) membranes were adapted and covered using flaps. Metronidazole was given to the animals. A total of 60 to 80% of bone fill was obtained and re-osseointegration ranged from 2 to 19.7% [37]. In another animal study, the implant surface was debrided and then rubbed with chlorhexidine soaked gauze followed by a rinse with saline approximately 20 times. Implants were randomized to receive autogenous bone grafts and platelet-enriched fibrin glue or just chlorhexidine. The combined treatment resulted in 50.1% re-osseointegration while the chlorhexidine group revealed a mere 6.5%. [38] In a recent study on monkeys, 0.1% chlorhexidine applied with gauze for 5 min, with a subsequent rinse using chlorhexidine and saline 20 times, yielded a 14% re-osseointegration. If the same therapy was given in combination with an autogenous bone graft, there was 22% re-osseointegration and an extended polytetrafluoroethylene (e-PTFE) membrane alone showed 21% re-osseointegration. However, chlorhexidine, bone graft, and membrane combination resulted in the highest rate of 45% [39].
In a randomized clinical trial, chlorhexidine was evaluated for a reduction in the total anaerobic bacterial load and putative periodontal pathogens. Forty-eight implants with peri-implantitis were debrided surgically and cleaned using gauze soaked in saline, with subsequent irrigation using a solution of 0.12% chlorhexidine plus 0.5% cetylpyridinium for 1 min, and then rinsed with saline. Irrigation with a placebo solution was done for the control group (31 implants). One-year follow-up showed no statistically significant difference between the groups in terms of bacterial counts or clinical markers like plaque, bleeding on probing (BOP), or suppuration [40]. The cell toxicity of chlorhexidine on human bone cells has been assessed. Cellular toxicity seems to be affected by concentration and exposure time. Scanning electron microscope (SEM) analysis proved the absence of osteoblast phenotypic alterations after exposure to 0.2% chlorhexidine for one minute and chlorhexidine 1% for 30 s [41]. Another in-vitro study demonstrated that chlorhexidine influenced osteoblast viability in a dose- and time-dependent manner. It resulted in apoptotic and autophagic/necrotic cell deaths and involved disturbance of mitochondrial function, intracellular Ca2+ increase, and oxidative stress. Chlorhexidine has also been shown to restrain cell proliferation and collagen synthesis [42,43].
Sodium hypochlorite (1%) shows broad antimicrobial activity, rapid bactericidal action, and relative non-toxicity at common concentrations [44]. It demonstrates high bactericidal and fungicidal activity in experimental biofilms with various endodontic or periodontal pathogens [44,45,46]. Subgingival irrigation with 0.5% sodium hypochlorite causes a significantly higher and long-lasting reduction in plaque and gingivitis than irrigation with water [45,47,48]. Thus, it was used as an effective decontaminating agent for infected titanium surfaces of implants. Gosau M et al. [19] concluded, along with other chemotherapeutic agents, that sodium hypochlorite is effective in reducing the oral bacterial biofilm on titanium disc as compared to the control. R. Burgers et al. [21] concluded that only sodium hypochlorite (1%) was effective against all three species of microorganisms, such as Staphylococcus epidermis, Candida albicans, and Streptococcus sanguis.
Retrograde peri-implantitis was also one of the reasons for implant failure, although its prevalence is very low (0.26%) [49]. Incidence increased up to 7.8% when adjacent teeth showed a previous history of root canal therapy [50]. It appears as a radiolucency around the most apical part of an implant. Different treatment modalities of retrograde peri-implantitis have been suggested to increase the survival of the involved implant. Among these modalities, Park et al. [51] suggested the use of systemic antibiotics plus 0.12% chlorhexidine mouthwash. In a case report, they surgically retrieved the retained root fragment and implant and replaced it with a new wide-body implant along with DFDBA mixed with tetracycline. At the end of 6 months follow-up, increased radiographic density, and bone formation were noted in one case, while in other cases, good defect repair was not noted. Thus, they concluded that antibiotics can be used for disease suppression until a definitive surgical procedure is performed. Soldatos et al., in their report, presented the comprehensive management of retrograde peri-implantitis by using an air-abrasive device, Er, Cr: YSGG, and guided bone regeneration (GBR). The site was monitored for 13 months and increased radiographic bone density was noted [52]. A recent literature review by Sarmast et al. focused on the novel treatment decision tree for retrograde peri-implantitis. They concluded that the most common etiology for retrograde peri-implantitis is endodontic infection from neighboring teeth, which was diagnosed within 6 months of the implant insertion. Common clinical and radiographic findings are sinus tract and radiolucency around the implant apex respectively [53].
Based on observed facts, most of the studies have different outcomes tested and it is inconsistent and unpredictable. The literature search showed there is still no consensus among clinicians regarding the best treatment. All the treatments described in past were effective with their pros and cons, but a systematic approach to the decontamination treatment of contaminated implant surfaces, along with more in vivo studies, should be initiated. Due to the heterogeneity of the data, it is challenging to categorize and evaluate the data in a controlled manner and finally come to any definitive conclusions, as no two studies showed the same type of chemotherapeutic agent used, similar bacterial contamination, and outcome parameters.
Limitations of this study were: the heterogeneity of the data; the limited number of studies with restricted data; not a single study comparing all the existing chemotherapeutic agents, comparing constant outcome measures, and the same type of titanium metal/implant surface; and differences in the microbial contamination of implant surface in all existing studies. Thus, there is a comparatively high risk of bias. Hence higher-quality RCTs comparing more chemotherapeutic agents with each other and normal saline, with a substantial sample size are needed to draw a definitive conclusion.

5. Conclusions

Within the limitations of the present study, it seems that chlorhexidine (0.2%, 0.12%), citric acid (40%), and sodium hypochlorite (1%) are the most commonly used chemotherapeutic agents in previous studies. They can be recommended along with their pros and cons for the decontamination of contaminated titanium implant surfaces. They are effective at killing bacterial cells, and biofilm removal, along with minimal/no alteration of the surface characteristics of the titanium implant surface.
However, only a preliminary conclusion can be drawn from this study due to the limited number of studies with restricted and heterogenous data. Thus, we conclude that the existing data is inconclusive.

Author Contributions

Conceptualization, C.P., A.A. and S.S.A.; methodology, C.P. and A.A.; software, A.A.; validation, S.S.A., S.A. and S.U.K.; formal analysis, A.A. and M.F.A.E.; investigation, S.A. and S.U.K.; resources, A.A. and M.F.A.E.; data curation, C.P. and A.A.; writing—original draft preparation, C.P., A.A., S.S.A., S.A. and S.U.K.; writing—review and editing, C.P., A.A., S.S.A., S.A., M.F.A.E. and S.U.K.; visualization, S.U.K.; supervision, A.A. and S.S.A.; project administration, A.A.; funding acquisition, S.S.A. and M.F.A.E. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Institutional review board clearance is not required since it’s a review project.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on reasonable request from the corresponding author. The data are not publicly available due to privacy restrictions.

Acknowledgments

The authors extend their appreciation to the Deanship of Scientific Research at King Khalid University, Abha, Saudi Arabia for funding this work through the Large Research Group Project under grant number (RGP-2/234/1443).

Conflicts of Interest

The authors declare that they have no conflict of interest.

References

  1. Qassadi, W.; AlShehri, T.; Alshehri, A.; ALonazi, K.; Aldhayan, I. Review on Dental Implantology. Egypt. J. Hosp. Med. 2018, 1, 2217–2225. [Google Scholar] [CrossRef]
  2. Van Velzen, F.J.; Ofec, R.; Schulten, E.A.; Ten Bruggenkate, C.M. 10-year survival rate and the incidence of peri-implant disease of 374 titanium dental implants with an SLA surface: A prospective cohort study in 177 fully and partially edentulous patients. Clin. Oral Implant. Res. 2015, 10, 1121–1128. [Google Scholar] [CrossRef] [PubMed]
  3. Moraschini, V.; Poubel, L.D.; Ferreira, V.F.; dos Sp Barboza, E. Evaluation of survival and success rates of dental implants reported in longitudinal studies with a follow-up period of at least 10 years: A systematic review. Int. J. Oral Maxillofac. Surg. 2015, 44, 377–388. [Google Scholar] [CrossRef] [PubMed]
  4. Atieh, M.A.; Alsabeeha, N.H.; Faggion, C.M., Jr.; Duncan, W.J. The frequency of peri-implant diseases: A systematic review and meta-analysis. J. Periodontol. 2013, 84, 1586–1598. [Google Scholar] [CrossRef] [Green Version]
  5. Albrektsson, T.; Isidor, F. Consensus report of session IV. In Proceedings of the First European Workshop on Periodontology; Lang, N.P., Karring, T., Eds.; Quintessence Publishing: London, UK, 1994; pp. 365–369. [Google Scholar]
  6. Chrcanovic, B.R.; Albrektsson, T.; Wennerberg, A. Reasons for failures of oral implants. J. Oral Rehabil. 2014, 6, 443–476. [Google Scholar] [CrossRef]
  7. Fürst, M.M.; Salvi, G.E.; Lang, N.P.; Persson, G.R. Bacterial colonization immediately after installation on oral titanium implants. Clin. Oral Implant. Res. 2007, 4, 501–508. [Google Scholar] [CrossRef]
  8. Pokrowiecki, R.; Mielczarek, A.; Zaręba, T.; Tyski, S. Oral microbiome and peri-implant diseases: Where are we now? Ther. Clin Risk Manag. 2017, 13, 1529–1542. [Google Scholar] [CrossRef] [Green Version]
  9. Quirynen, M.; Vogels, R.; Peeters, W.; van Steenberghe, D.; Naert, I.; Haffajee, A. Dynamics of initial subgingival colonization of ‘pristine’ peri-implant pockets. Clin. Oral Implant. Res. 2006, 17, 25–37. [Google Scholar] [CrossRef]
  10. Mellado-Valero, A.; Buitrago-Vera, P.; Solá-Ruiz, M.F.; Ferrer-García, J.C. Decontamination of dental implant surface in peri-implantitis treatment: A literature review. Med. Oral Patol. Oral Cir. Bucal 2013, 6, e869–e876. [Google Scholar] [CrossRef]
  11. Renvert, S.; Roos-Jansåker, A.M.; Claffey, N. Non-surgical treatment of peri-implant mucositis and peri-implantitis: A literature review. J. Clin. Periodontol. 2008, 35, 305–315. [Google Scholar] [CrossRef]
  12. Ntrouka, V.I.; Slot, D.E.; Louropoulou, A.; Van der Weijden, F. The effect of chemotherapeutic agents on contaminated titanium surfaces: A systematic review. Clin. Oral Implant. Res. 2011, 22, 681–690. [Google Scholar] [CrossRef]
  13. Hentenaar, D.; De Waal, Y.; Strooker, H.; Meijer, H.; Van Winkelhoff, A.J.; Raghoebar, G.M. Implant decontamination with phosphoric acid during surgical peri-implantitis treatment. Int. J. Implant Dent. 2017, 1, 33. [Google Scholar] [CrossRef]
  14. Souza, J.G.S.; Cordeiro, J.M.; Lima, C.V.; Barão, V.A.R. Citric acid reduces oral biofilm and influences the electrochemical behavior of titanium: An in situ and in vitro study. J. Periodontol. 2018, 90, 149–158. [Google Scholar] [CrossRef]
  15. Liberati, A.; Altman, D.G.; Tetzlaff, J.; Mulrow, C.; Gøtzsche, P.C.; Ioannidis, J.P.; Clarke, M.; Devereaux, P.J.; Kleijnen, J.; Moher, D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. J. Clin. Epidemiol. 2009, 62, e1–e34. [Google Scholar] [CrossRef] [Green Version]
  16. Moher, D.; Shamseer, L.; Clarke, M.; Ghersi, D.; Liberati, A.; Petticrew, M.; Shekelle, P.; Stewart, L.A. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst. Rev. 2015, 4, 1. [Google Scholar] [CrossRef] [Green Version]
  17. Claffey, N.; Clarke, E.; Polyzois, I.; Renvert, S. Surgical treatment of peri-implantitis. J. Clin. Periodontol. 2008, 35, 316–332. [Google Scholar] [CrossRef]
  18. Higgins, J. Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0; The Cochrane Collaboration: London, UK, 2011; Available online: http://www.cochrane-handbook.org (accessed on 12 January 2019).
  19. Gosau, M.; Hahnel, S.; Schwarz, F.; Gerlach, T.; Reichert, T.E.; Bürgers, R. Effect of six different peri-implantitis disinfection methods on in vivo human oral biofilm. Clin. Oral Implant. Res. 2010, 21, 866–872. [Google Scholar] [CrossRef]
  20. Ntrouka, V.; Hoogenkamp, M.; Zaura, E.; van der Weijden, F. The effect of chemotherapeutic agents on titanium-adherent biofilms. Clin. Oral Implant. Res. 2011, 22, 1227–1234. [Google Scholar] [CrossRef]
  21. Bürgers, R.; Witecy, C.; Hahnel, S.; Gosau, M. The effect of various topical peri-implantitis antiseptics on Staphylococcus epidermidis, Candida albicans, and Streptococcus anguinis. Arch. Oral Biol. 2012, 7, 940–947. [Google Scholar] [CrossRef]
  22. Kotsakis, G.A.; Lan, C.; Barbosa, J.; Lill, K.; Chen, R.; Rudney, J.; Aparicio, C. Antimicrobial Agents Used in the Treatment of Peri-Implantitis Alter the Physicochemistry and Cytocompatibility of Titanium Surfaces. J. Periodontol. 2016, 87, 809–819. [Google Scholar] [CrossRef]
  23. Dostie, S.; Alkadi, L.T.; Owen, G.; Bi, J.; Shen, Y.; Haapasalo, M.; Larjava, H.S. Chemotherapeutic decontamination of dental implants colonized by mature multispecies oral biofilm. J. Clin. Periodontol. 2017, 44, 403–409. [Google Scholar] [CrossRef] [PubMed]
  24. Smeets, R.; Henningsen, A.; Jung, O.; Heiland, M.; Hammächer, C.; Stein, J.M. Definition, etiology, prevention and treatment of peri-implantitis—A review. Head Face Med. 2014, 10, 34. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Persson, L.G.; Ericsson, I.; Berglundh, T.; Lindhe, J. Osseintegration following treatment of periimplantitis and replacement of implant components. An experimental study in the dog. J. Clin. Periodontol. 2001, 28, 258–263. [Google Scholar] [CrossRef] [PubMed]
  26. Leonhardt, A.; Dahlen, G.; Renvert, S. Five-year clinical, microbiological, and radiological outcome following treatment of periimplantitis in man. J. Periodontol. 2003, 74, 1415–1422. [Google Scholar] [CrossRef]
  27. Renvert, S.; Polyzois, I.; Maguire, R. Reosseointegration on previously contaminated surfaces: A systematic review. Clin. Oral Implant. Res. 2009, 4, 216–227. [Google Scholar] [CrossRef]
  28. Karring, E.S.; Stavropoulos, A.; Ellegaard, B.; Karring, T. Treatment of peri-implantitis by the Vector system. Clin. Oral Implant. Res. 2005, 16, 288–293. [Google Scholar] [CrossRef]
  29. Kozlovsky, A.; Artzi, Z.; Moses, O.; Kamin-Belsky, N.; Greenstein, R.B. Interaction of chlorhexidine with smooth and rough types of titanium surfaces. J. Periodontol. 2006, 77, 1194–1200. [Google Scholar] [CrossRef]
  30. Strooker, H.; Rohn, S.; Van Winkelhoff, A.J. Clinical and microbiologic effects of chemical versus mechanical cleansing in professional supportive implant therapy. Int. J. Oral Maxillofac. Implant. 1998, 13, 845–850. [Google Scholar]
  31. Ramesh, D.; Sridhar, S.; Siddiqui, D.A.; Valderrama, P.; Rodrigues, D.C. Detoxification of titanium implant surfaces: Evaluation of surface morphology and bone-forming cell compatibility. J. Bio Tribo-Corros. 2017, 3, 50. [Google Scholar] [CrossRef]
  32. Wheelis, S.E.; Gindri, I.M.; Valderrama, P.; Wilson, T.G., Jr.; Huang, J.; Rodrigues, D.C. Effects of decontamination solutions on the surface of titanium: Investigation of surface morphology, composition, and roughness. Clin. Oral Implant. Res. 2016, 27, 329–340. [Google Scholar] [CrossRef]
  33. Noronha Oliveira, M.; Schunemann, W.V.H.; Mathew, M.T.; Henriques, B.; Magini, R.S.; Teughels, W.; Souza, J.C.M. Can degradation products released from dental implants affect peri-implant tissues? J. Periodontal Res. 2018, 53, 1–11. [Google Scholar] [CrossRef]
  34. Guimarães, L.F.; Fidalgo, T.K.; Menezes, G.C.; Primo, L.G.; e Silva-Filho, F.C. Effects of citric acid on cultured human osteoblastic cells. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. Endodontol. 2010, 110, 665–669. [Google Scholar] [CrossRef]
  35. Lan, W.C.; Lan, W.H.; Chan, C.P.; Hsieh, C.C.; Chang, M.C.; Jeng, J.H. The effects of extracellular citric acid acidosis on the viability, cellular adhesion capacity and protein synthesis of cultured human gingival fibroblasts. Aust. Dent. J. 1999, 44, 123–130. [Google Scholar] [CrossRef] [Green Version]
  36. Menezes, K.M.; Fernandes-Costa, A.N.; Silva-Neto, R.D.; Calderon, P.S.; Gurgel, B.C. Efficacy of 0.12% chlorhexidine gluconate for non-surgical treatment of peri-implant mucositis. J. Periodontal 2016, 87, 1305–1313. [Google Scholar] [CrossRef]
  37. Wetzel, A.C.; Vlassis, J.; Caffesse, R.G.; Hämmerle, C.H.; Lang, N.P. Attempts to obtain re-osseointegration following experimental peri-implantitis in dogs. Clin. Oral Implant. Res. 1999, 10, 111–119. [Google Scholar] [CrossRef]
  38. You, T.M.; Choi, B.H.; Zhu, S.J.; Jung, J.H.; Lee, S.H.; Huh, J.Y.; Lee, H.J.; Li, J. Treatment of experimental peri-implantitis using autogenous bone grafts and platelet enriched fibrin glue in dogs. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. Endodontol. 2007, 103, 34–37. [Google Scholar] [CrossRef]
  39. Schou, S.; Holmstrup, P.; Skovgaard, L.T.; Stoltze, K.; Hjørting-Hansen, E.; Gundersen, H.J. Autogenous bone graft and ePTFEmembrane in the treatment of peri-implantitis. II. Stereologic and histologic observations in cynomolgus monkeys. Clin. Oral Implant. Res. 2003, 14, 404–411. [Google Scholar] [CrossRef]
  40. De Waal, Y.C.; Raghoebar, G.M.; Huddleston Slater, J.J.; Meijer, H.J.; Winkel, E.G.; van Winkelhoff, A.J. Implant decontamination during surgical peri-implantitis treatment: A randomized, double-blind, placebo-controlled trial. J. Clin. Periodontol. 2013, 40, 186–195. [Google Scholar] [CrossRef] [Green Version]
  41. Lehmann, B.; Bragger, U.; Hammerle, C.H.; Fourmousis, I.; Lang, N.P. Treatment of an early implant failure according to the principles of guided tissue regeneration (GTR). Clin. Oral Implant. Res. 1992, 3, 42–48. [Google Scholar] [CrossRef]
  42. Giannelli, M.; Chellini, F.; Margheri, M.; Tonelli, P.; Tani, A. Effect of chlorhexidine digluconate on different cell types: A molecular and ultrastructural investigation. Toxicol. In Vitro 2008, 22, 308–317. [Google Scholar] [CrossRef]
  43. Lee, T.H.; Hu, C.C.; Lee, S.S.; Chou, M.Y.; Chang, Y.C. Cytotoxicity of chlorhexidine on human osteoblastic cells is related to intracellular glutathione levels. Int. Endod. J. 2010, 43, 430–435. [Google Scholar] [CrossRef] [PubMed]
  44. Buergers, R.; Rosentritt, M.; Schneider-Brachert, W.; Behr, M.; Handel, G.; Hahnel, S. Efficacy of denture disinfection methods in controlling Candida albicans colonization in vitro. Acta Odontol. Scand. 2008, 66, 174–180. [Google Scholar] [CrossRef] [PubMed]
  45. Slots, J. Selection of antimicrobial agents in periodontal therapy. J. Periodontal Res. 2002, 37, 389–398. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Spratt, D.A.; Pratten, J.; Wilson, M.; Gulabivala, K. An in vitro evaluation of the antimicrobial efficacy of irrigants on biofilms of root canal isolates. Int. Endod. J. 2001, 34, 300–307. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Lobene, R.R.; Soparkar, P.M.; Hein, J.W.; Quigley, G.A. A study of the effects of antiseptic agents and a pulsating irrigating device on plaque and gingivitis. J. Periodontol. 1972, 43, 564–568. [Google Scholar] [CrossRef] [PubMed]
  48. Adcock, J.E.; Berry, W.C., Jr.; Kalkwarf, K.L. Effect of sodium hypochlorite solution on the subgingival microflora of juvenile periodontitis lesions. Pediatr. Dent. 1983, 5, 190–194. [Google Scholar]
  49. Soldatos, N.; Romanos, G.E.; Michaiel, M.; Sajadi, A.; Angelov, N.; Weltman, R. Management of Retrograde Peri-Implantitis Using an Air-Abrasive Device, Er, Cr:YSGG Laser, and Guided Bone Regeneration. Case Rep. Dent. 2018, 2018, 7283240. [Google Scholar] [CrossRef] [Green Version]
  50. Bain, C.A.; Moy, P.K. The association between the failure of dental implants and cigarette smoking. Int. J. Oral Maxillofac. Implant. 1993, 8, 609–615. [Google Scholar]
  51. Alsaadi, G.; Quirynen, M.; Komarek, A.; van Steenberghe, D. Impact of local and systemic factors on the incidence of oral implant failures, up to abutment connection. J. Clin. Periodontol. 2007, 34, 610–617. [Google Scholar] [CrossRef]
  52. Park, S.H.; Sorensen, W.P.; Wang, H.L. Management and prevention of retrograde peri-implant infection from retained root tips: Two case reports. Int. J. Periodontics Restor. Dent. 2004, 24, 422–433. [Google Scholar] [CrossRef] [Green Version]
  53. Sarmast, N.D.; Wang, H.H.; Soldatos, N.K.; Angelov, N.; Dorn, S.; Yukna, R.; Iacono, V.J. A Novel Treatment Decision Tree and Literature Review of Retrograde Peri-Implantitis. J. Periodontol. 2016, 87, 1458–1467. [Google Scholar] [CrossRef]
Figure 1. Literature search flowchart.
Figure 1. Literature search flowchart.
Antibiotics 11 00593 g001
Table 1. Systematic search strategy.
Table 1. Systematic search strategy.
I. Focus Question“Which Is the Most Effective Chemotherapeutic Agent for Decontamination of an Infected Dental Implant (with or without Adjunctive Mechanical Cleaning)?”
II. Search strategy
P—Population
I—Intervention
C—Comparison
O—Outcome
Infected dental implants/different chemotherapeutic agents?
Effectiveness of different chemotherapeutic agents used for implant surface decontamination and comparison of them, with or without mechanical cleaning of the implant surface.
Use of chemotherapeutic agents along with mechanical cleaning
To identify the most effective chemotherapeutic agent (s) for dental implant surface.
III. Search keywordsPeri-implantitis treatment, chemotherapeutic agents, implant surface decontamination, chemical disinfectant for implant surface.
IV. Database searchPubMed, Google
V. Selection criteria
Inclusion criteria
Exclusion criteria
Studies involving a minimum of two chemotherapeutic agents for implant decontamination
Contaminated implant surface
Decontamination was done without implantoplasty
Only in the English language
Experimental human studies
Where the full text is not available
No access to an English version of the title and abstract.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Patil, C.; Agrawal, A.; Abullais, S.S.; Arora, S.; Khateeb, S.U.; Fadul A. Elagib, M. Effectiveness of Different Chemotherapeutic Agents for Decontamination of Infected Dental Implant Surface: A Systematic Review. Antibiotics 2022, 11, 593. https://doi.org/10.3390/antibiotics11050593

AMA Style

Patil C, Agrawal A, Abullais SS, Arora S, Khateeb SU, Fadul A. Elagib M. Effectiveness of Different Chemotherapeutic Agents for Decontamination of Infected Dental Implant Surface: A Systematic Review. Antibiotics. 2022; 11(5):593. https://doi.org/10.3390/antibiotics11050593

Chicago/Turabian Style

Patil, Chayya, Amit Agrawal, Shahabe Saquib Abullais, Suraj Arora, Shafait Ullah Khateeb, and Mohamed Fadul A. Elagib. 2022. "Effectiveness of Different Chemotherapeutic Agents for Decontamination of Infected Dental Implant Surface: A Systematic Review" Antibiotics 11, no. 5: 593. https://doi.org/10.3390/antibiotics11050593

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop