Next Article in Journal
Seed Endophyte Microbiome of Crotalaria pumila Unpeeled: Identification of Plant-Beneficial Methylobacteria
Next Article in Special Issue
Prenatal Metformin Therapy Attenuates Hypertension of Developmental Origin in Male Adult Offspring Exposed to Maternal High-Fructose and Post-Weaning High-Fat Diets
Previous Article in Journal
Growth Hormone (GH) and Cardiovascular System
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Proangiogenic Effect of Metformin in Endothelial Cells Is via Upregulation of VEGFR1/2 and Their Signaling under Hyperglycemia-Hypoxia

by
Sherin Bakhashab
1,2,3,
Farid Ahmed
3,
Hans-Juergen Schulten
3,
Fahad W. Ahmed
2,4,
Michael Glanville
2,
Mohammed H. Al-Qahtani
3 and
Jolanta U. Weaver
2,4,5,*
1
Biochemistry Department, King Abdulaziz University, Jeddah P.O. Box 80218, Saudi Arabia
2
Institute of Cellular Medicine, Newcastle University, Newcastle Upon Tyne NE2 4HH, UK
3
Centre of Excellence in Genomic Medicine Research, King Abdulaziz University, Jeddah P.O. Box 80216, Saudi Arabia
4
Queen Elizabeth Hospital, Gateshead, Newcastle Upon Tyne NE9 6SH, UK
5
Cardiovascular Research Centre, Newcastle University, Newcastle Upon Tyne NE2 4HH, UK
*
Author to whom correspondence should be addressed.
Int. J. Mol. Sci. 2018, 19(1), 293; https://doi.org/10.3390/ijms19010293
Submission received: 10 December 2017 / Revised: 12 January 2018 / Accepted: 17 January 2018 / Published: 19 January 2018
(This article belongs to the Special Issue Metformin: Mechanism and Application)

Abstract

:
Cardiovascular disease is the leading cause of morbidity/mortality worldwide. Metformin is the first therapy offering cardioprotection in type 2 diabetes and non-diabetic animals with unknown mechanism. We have shown that metformin improves angiogenesis via affecting expression of growth factors/angiogenic inhibitors in CD34+ cells under hyperglycemia-hypoxia. Now we studied the direct effect of physiological dose of metformin on human umbilical vein endothelial cells (HUVEC) under conditions mimicking hypoxia-hyperglycemia. HUVEC migration and apoptosis were studied after induction with euglycemia or hyperglycemia and/or CoCl2 induced hypoxia in the presence or absence of metformin. HUVEC mRNA was assayed by whole transcript microarrays. Genes were confirmed by qRT-PCR, proteins by western blot, ELISA or flow cytometry. Metformin promoted HUVEC migration and inhibited apoptosis via upregulation of vascular endothelial growth factor (VEGF) receptors (VEGFR1/R2), fatty acid binding protein 4 (FABP4), ERK/mitogen-activated protein kinase signaling, chemokine ligand 8, lymphocyte antigen 96, Rho kinase 1 (ROCK1), matrix metalloproteinase 16 (MMP16) and tissue factor inhibitor-2 under hyperglycemia-chemical hypoxia. Therefore, metformin’s dual effect in hyperglycemia-chemical hypoxia is mediated by direct effect on VEGFR1/R2 leading to activation of cell migration through MMP16 and ROCK1 upregulation, and inhibition of apoptosis by increase in phospho-ERK1/2 and FABP4, components of VEGF signaling cascades.

Graphical Abstract

1. Introduction

Cardiovascular disease (CVD) remains the leading cause of death worldwide according to the World Health Organization 2016 mortality database. The outcome of CVD management is affected by diabetes mellitus (DM), which results in a two- to four-fold increased risk of CVD [1,2]. The outcomes of CVD interventions such as percutaneous coronary intervention (PCI) and coronary artery bypass graft are much worse in diabetic than non-diabetic individuals [3,4].
Diabetes associated endothelial dysfunction is a known early step in the adverse sequence of events leading to the development of micro- and macrovascular complications, which results in mortality linked to diabetes in 75% of cases [5]. Vascular complications include both qualitative and quantitative changes in vascular architecture, in particular: abrogation of neovascularization and remodeling of the existing vasculature that results in a lack of ability to control ischemic injury. Understanding the mechanisms involved in diabetes associated impaired vascular repair and known interventions is paramount. Therefore, investigating drugs affecting angiogenesis during a therapeutic window for myocardial infarction (1 h), delayed (3 h) and prolonged (12 h) period of ischemia and acute hyperglycemia is of importance. Metformin is the first hypoglycemic therapy to display cardioprotective properties as shown in long-term randomized clinical trials [6,7]. Furthermore, when used in patients with metabolic syndrome, post-PCI myocardial injury was improved [8].
Pre-treatment of diabetic patients with metformin was found to be associated with reduced myocardial infarction (MI) size compared to non-metformin treated [9]. Additionally, studies in animal models suggested that metformin at physiological doses improved coronary blood flow following MI [10], and limited infarct size in diabetic rats [11]. Our recent work has shown that metformin improved angiogenesis by augmenting the expression of VEGFA and reducing angiogenic inhibitors in CD34+ cells under hyperglycemia-hypoxia [12]. However, no data on the direct effect of physiological doses of metformin on vascular repair (migration, apoptosis) under hyperglycemia-hypoxia is available to date.
In this paper, we hypothesized that metformin at physiological dose enhances endothelial cell (EC) survival and migration under the conditions of hyperglycemia and hypoxia. As it is important for the research to be of translational value, we specifically applied clinically relevant physiological doses of metformin. Although cell culture systems have certain limitations in mimicking and simulating CVD; they are indispensable tools to unravel critical underlying molecular mechanisms of the disease. Therefore, we employed freshly isolated HUVEC from different donors as an in vitro model to study the effect of physiological concentration of metformin on cell survival, migration and gene expression under chemical hypoxia and hyperglycemia.

2. Results

2.1. Metformin Promotes Endothelial Cell Migration under Hyperglycemia-CoCl2

Metformin reduced cell migration under euglycemia-CoCl2 at 18 (p < 0.01) and 24 h (p < 0.001, Figure 1B) of CoCl2 but accelerated cell migration under hyperglycemia-CoCl2 at 24 h of CoCl2 (p < 0.01, Figure 2C).
Euglycemia-CoCl2 had no effect on EC migration compared to control (Figure 1A,B). However, hyperglycemia alone significantly increased migration at 6 (p < 0.001), 12 (p < 0.001), and 18 h (p < 0.001, Figure 2A,B) but not at 24 h (plateau phase). Hyperglycemia-CoCl2 inhibited migration at 6 (p < 0.001), 12 (p < 0.001), 18 (p < 0.001), and 24 h of CoCl2 (p < 0.01, Figure 2A,C) compared to hyperglycemia alone.

2.2. Inhibition of Metformin Action Mediated by VEGFA in Cell Migration Assay

Sunitinib, a VEGF inhibitor, blocked the effect of metformin in euglycaemia-CoCl2 and hyperglycemia-CoCl2 (Figure 1A,B and Figure 2A,C).

2.3. Metformin Reduces Apoptosis under Hyperglycemia-CoCl2

Metformin significantly reduced the apoptosis (−1.3-fold, p = 0.045) under hyperglycemia-CoCl2 at 24 h of CoCl2 (Figure 3D). However, metformin concentration exhibited no effect on HUVEC apoptosis under euglycemia-CoCl2 at 3, 12, or 24 h of CoCl2 or under hyperglycemia-CoCl2 at 3 and 12 h of CoCl2 (Figure S1). A supra-physiological concentration of metformin (1.0 mmol/L) non-significantly enhanced apoptosis (1.3-fold, p > 0.05) in HUVEC treated with hyperglycemia for 48 h (Figure 3C).
No effect on apoptosis at 3 and 12 h of CoCl2 was detected neither under euglycemia nor hyperglycemia (Figure 3A,B). At 24 h of CoCl2 there was a non-significant increase (1.3-fold, p > 0.05) in the apoptotic cells under euglycemic conditions (Figure 3A); but a significant increase (1.9-fold, p = 0.018) under hyperglycemia-CoCl2 (Figure 3B).

2.4. Microarray Gene Expression Profiling in HUVEC and Western Blot

In the microarray experiments, the number of differentially expressed genes with a p-value < 0.05 and a cutoff fold change of 1.5 varied considerably between the conditions.

2.5. Metformin Has No Effect on HIF-1α Gene/Protein Expression under Hyperglycemia-CoCl2

Transcriptome analysis demonstrated that physiological concentration of metformin exerted no effect on HIF-1α signaling when HUVEC were exposed to CoCl2 for 1, 3, 12 h either under euglycemia or hyperglycemia. Western blot (WB) assay revealed that metformin led to a significant downregulation of HIF-1α protein levels at 1 h of CoCl2 under euglycemia-CoCl2 (−7.6-fold, p < 0.001) but exhibited no effect under hyperglycemia-CoCl2 (Figure S2).
HIF-1α mRNA levels at 1 and 3 h of CoCl2 were unchanged under euglycemia-CoCl2 and hyperglycemia-CoCl2. Whereas, a significant decrease was detected at 12 h of CoCl2 in both euglycemia (−1.6-fold, p = 1.4 ×10−6) and hyperglycemia (−1.9-fold, p = 4.4 × 10−9). WB revealed a significant increase in HIF-1α protein at 1 h of CoCl2 under euglycemia-CoCl2 (3.4-fold, p < 0.01) but no significant increase under hyperglycemia-CoCl2 (Figure S2).

2.6. Metformin Has No Significant Effect on VEGFA Gene Expression but Increased Protein Expression at 1 h of CoCl2 under Hyperglycemia-CoCl2

Metformin exhibited no effect on VEGFA mRNA expression under euglycemia-CoCl2 and hyperglycemia-CoCl2 up to 12 h as assayed by microarray and qRT-PCR (Figure 4A) versus parallel condition without metformin.
In WB, metformin exhibited no significant effect on VEGF 165A protein expression under euglycemia-CoCl2. However, under hyperglycemia-CoCl2, metformin significantly increased VEGF 165A protein level at 1 h of CoCl2 (7.7-fold, p = 0.012), whereas the level decreased at 12 h of CoCl2 (−5.2-fold, p = 0.019) versus parallel conditions without metformin (Figure 4B).
Transcriptome analysis showed a time dependent increase in VEGFA mRNA upon exposure to CoCl2 (1, 3, or 12 h) under euglycemia (1.8-fold, 3.79-fold, and 5.15-fold respectively) and hyperglycemia (1.6-fold, 3.5-fold, 4.7-fold respectively). qRT-PCR validation showed upregulation of VEGFA upon exposure to CoCl2 at 3 and 12 h under euglycemia-CoCl2 (7.2-fold, p = 0.017 and 9.4-fold, p = 0.002 respectively versus no CoCl2), and hyperglycemia-CoCl2 (7.4-fold, p = 0.015 and 8.4-fold, p = 0.005 respectively versus hyperglycemia alone) as illustrated in Figure 4A.
In WB VEGF 165A protein expression was unchanged under euglycemia-CoCl2 but was significantly upregulated at 12 h of CoCl2 under hyperglycemia-CoCl2 (6.8-fold, p = 0.011 compared to hyperglycemia alone) but not at 1 or 3 h (Figure 4B).

2.7. Metformin Activates VEGF Downstream Signaling

Several key signaling cascades, including ERK/MAPK and PI3K/Akt pathways are known to be implicated in the modulation of VEGF induced angiogenic and proliferation effects mediated via VEGFR1 [13]. Microarray studies showed that the mRNA of VEGFR1 (alias FLT1) was upregulated (1.7-fold, p = 7.36 × 10−3) under euglycemia-CoCl2 at 12 h of CoCl2 but not under hyperglycemia-CoCl2. A number of VEGFR1 downstream genes was significantly differentially expressed under euglycemia and hyperglycemia following 12 h of CoCl2 exposure. Among these genes was the mitogen-activated protein kinase kinase 1 (MAP2K1), a key molecule in the ERK1/2 MAP kinase pathway, with 1.7-fold (p = 5.37 × 10−9) upregulated under euglycemia-CoCl2, and 1.6-fold (p = 6.8 × 10−8) upregulated under hyperglycemia-CoCl2. Moreover, gene expression of phosphoinositide-3-kinase, regulatory subunit 1 (PI3KR1) which is a PI3K/Akt signaling molecule, was increased at 12 h CoCl2 with euglycemia to 1.9-fold (p = 2.25 × 10−7) and hyperglycemia to 1.7-fold (p = 7.37 × 10−6). In contrast, PI3KR3 was detected to be downregulated by −2.5-fold (p = 2.09 × 10−9) under euglycemia-CoCl2 at 12 h of CoCl2.
To substantiate these findings, the protein levels of VEGFR1 and VEGFR2 were assessed by ELISA. Metformin increased the expression of VEGFR1 and VEGFR2 only under hyperglycemia-CoCl2 at 3 h of CoCl2 (1.5-fold, p = 0.02 and 1.4-fold, p = 0.02 respectively (Figures S4 and S5)).
The expression of VEGFR1 was upregulated under hyperglycemia-CoCl2 at 1, 3, 12 h of CoCl2 exposure (1.8-fold, p = 0.02; 1.6-fold, p = 0.04; 1.9-fold, p = 0.01) compared to hyperglycemia alone (Figure S3a). Whereas, the expression of VEGFR2 showed downregulation under euglycemia-CoCl2 at 1, 3, 12 h of CoCl2 (−1.3-fold, p = 0.034; −1.3-fold, p = 0.04; −1.9-fold, p < 0.001) and hyperglycemia (−1.4-fold, p = 0.015) compared to euglycemia. However, hyperglycemia-CoCl2 led to decrease in VEGFR2 at 12 h of CoCl2 (−1.4-fold, p = 0.034) compared to hyperglycemia (Figure S3b).

2.7.1. MAPK Pathway; Metformin Increases Phosphor-ERK1/2 to Total ERK Ratio under Hyperglycemia-CoCl2

Metformin led to significant decrease of phospho-ERK1/2 to total ERK ratio to 32.5% (p = 0.007) under euglycemia-normoxia (Figure 5B). Whereas an increase of phopho-ERK1/2 to total ERK ratio by 33.6% (p = 0.024) was observed under hyperglycemia-CoCl2 at 12 h of CoCl2 (Figure 5C). No change in the activity of ERK1/2 was detected under euglycemia-CoCl2 or hyperglycemia-normoxia when compared pairwise.
We observed a significant decrease in phosphorylation ratio of ERK1/2 to 12.0% (p = 0.004) at 12 h of CoCl2 under euglycemia, to 33.8% (p = 0.05) under hyperglycemia alone, and to 7.5% (p = 0.001) at 12 h of CoCl2 under hyperglycemia-CoCl2 (Figure 5A). Whereas, no significant change in the expression of total ERK1/2 protein was detected in all conditions assayed.

2.7.2. Metformin Increases the Expression of CXCL8, LY96, ROCK1, MMP16, TFPI2, and FABP4 under Hyperglycemia-CoCl2

Microarray data showed that metformin, under hyperglycemia-CoCl2 at 12 h of CoCl2, significantly upregulated chemokine (C-X-C Motif) ligand 8 (CXCL8) to 1.9-fold (p = 2.84 × 10−2), lymphocyte antigen 96 (LY96) to 1.6-fold (p = 2.01 × 10−3), MMP16 to 1.7-fold (p = 2.34 × 10−2), and Rho-associated, coiled-coil containing protein kinase 1 (ROCK1) to 2.7-fold (p = 1.15 × 10−2) that are known to enhance cell migration. Furthermore, metformin led to a significant overexpression of tissue factor pathway inhibitor 2 (TFPI2), a regulator of EC migration [6], to 1.6-fold (p = 2.07 × 10−4) under hyperglycemia-CoCl2 at 12 h of CoCl2.Whilst, this effect was not observed without metformin leading to downregulation of LY96 to −1.7-fold (p = 5.4 × 10−4), and TFPI2 to −1.7-fold (p = 1.4 × 10−5). The most differentially expressed genes affected by metformin under hyperglycemia-CoCl2 are summarized in Table 1.
Fatty acid binding protein 4 (FABP4) mRNA levels were downregulated at 12 h of CoCl2 in euglycemia (−1.6-fold, p = 2.4 × 10−2) and hyperglycemia (−1.6-fold, p = 2.9 × 10−2). Conversely, the expression of FABP4 was significantly induced by adding metformin to HUVEC cultured under hyperglycemia-CoCl2 at 12 h of CoCl2 (1.6-fold, p = 2.53 × 10−2).
MMP16 was selected to be validated by qRT-PCR showing that hyperglycemia increased the mRNA level (1.4-fold, p = 0.023) compared to control. There was a decrease in MMP16 expression under hyperglycemia-CoCl2 at 12 h of CoCl2 (−1.9-fold, p < 0.001) compared to hyperglycemia alone (Figure 6). However, metformin significantly increased the mRNA level of MMP16 by 1.5-fold, p = 0.04 under hyperglycemia-CoCl2 at 12 h of CoCl2 versus parallel conditions without metformin.

2.8. Inhibition of Metformin Action Mediated by MMP16 in Cell Migration Assay

To confirm that MMP16 mediates the effect of metformin on cell migration, we used an MMP16 antagonist, marimastat. Treatment with marimastat reversed the positive effect of metformin on cell migration at 18h (p < 0.01) and 24 h (p < 0.001) as shown in Figure 7A,C. As metformin had no effect on VEGF signaling in HUVEC exposed to euglycemia-CoCl2, marimastat had no effect on cell migration of ECs treated with metformin under euglycemia-CoCl2 versus parallel conditions without metformin (Figure 7B).

3. Discussion

Large randomized controlled trial has shown that metformin improves CVD outcome in diabetic patients [6]. The current study was aimed to understand the mechanism behind the action of metformin, in order to facilitate the identification of novel markers and therapeutic targets to reduce macrovascular disease. Therefore, we report the effect of metformin on cell survival and migration under conditions of acute hyperglycemia and hyperglycemia-chemical hypoxia combined, with the focus on important VEGF pathway targets. Furthermore, to keep our research relevant to clinical practice, we specifically avoided supra-physiological doses of metformin and used concentrations as anticipated in patients treated with metformin [12]. In addition, we have used relevant hyperglycemia (16.5 mmol/L) which can be observed in diabetic patients as opposed to extremely high glucose levels that are taken up by numerous studies [14,15]. This glucose concentration was also high enough to cause inflammatory changes without causing cytotoxicity [16,17].
Impaired angiogenesis in response to ischemia is elaborated as major macrovascular complications in DM [18]. Additionally, previous study on streptozotocin-induced diabetic mice showed impaired cell migration and tube formation which was improved by metformin [19]. This enhanced effect was attributed to increased expression of phosphorylated-AMP-activated protein kinase, phosphorylated- endothelial nitric oxide synthase and augmented nitric oxide production by metformin in endothelial cells of diabetic mice. For the first time, we have shown that physiological concentrations of metformin improved EC survival and migration under hyperglycemia-chemical hypoxia through activation of VEGF signaling pathway. In our study, an exposure of EC to hyperglycemia lead to a marked increase in cell migration when compared to euglycemia and reduction in cell migration when treated with hyperglycemia-CoCl2, as reported previously [20]. Furthermore, we have shown that metformin inhibited cell migration under euglycemia-CoCl2 while improving migration under hyperglycemia-CoCl2. Esfahanian et al., have reported a similar inhibiting effect of metformin in EC migration under euglycemia although at supra-physiological metformin (0.5–3.0 mmol/L) concentrations [21].
Vascular remodeling by cell migration and angiogenesis is regulated mainly by VEGF signaling [22]. It has been established by others that VEGFA production is regulated by HIF which supports an early involvement of VEGF in angiogenesis [23]. As a downstream of HIF, VEGF induction by hypoxia is delayed with maximal levels at 48 h as reported by others [24,25]. Metformin’s effect on VEGFA165 protein is short lived under hyperglycemia-CoCl2 (1 h), and this may be beneficial as a protective mechanism against prolonged angiogenesis. For instance, 1 h of chemical hypoxia is a critical time defined in clinical practice when patients benefit from cardiovascular intervention following acute myocardial infarction.
Our microarray experiments demonstrated that metformin upregulated downstream targets in VEGFA pathway; MMP16, FABP4, ROCK1, TFPI2, CXCL-8, and LY96 under hyperglycemia-CoCl2, which play a part in cell migration. The role of metformin on migration was confirmed in our experiments using VEGF and MMPs inhibitors. MMP16 is a membrane-type MT3-MMP that contributes to angiogenesis by degrading extracellular matrix components, thus promoting cell migration and bioavailability of growth factors [26,27]. Park et al., showed that upon secretion, VEGF becomes bound to the extracellular matrix (ECM) and acts in a paracrine fashion [28]. The interaction of VEGF with matrix proteins is mediated through the carboxy-terminal region, also known as an ECM-binding domain [29,30]. The regulation of VEGF in the extracellular environment has also been implicated in the angiogenic switch [31]. A prior study found that inhibition of MMP16 significantly reduces the VEGFA-enhanced tube formation in ECs [32]. This is in agreement with our results from the scratch assay where the pro-angiogenic effect of metformin in the combined hyperglycemia-CoCl2 treatment was inhibited by marimastat, an MMP inhibitor.
A downstream mediator of VEGF/VEGFR2 in our study, FABP4 [33] was found to be increased by metformin under hyperglycemia-CoCl2 at 12 h of CoCl2 enhancing cell survival and migration. FABP4 knockdown in HUVEC has been shown to decrease cell migration and increase apoptosis [33], whilst VEGF knockdown was lethal [34,35]. Additionally, metformin enhanced the expression of ROCK1 under hyperglycemia-CoCl2, another moderator of cell migration. RhoA/ROCK signaling had previously shown to promote endothelial migration in response to VEGFA through the modulation of the actin cytoskeleton organization [36]. Moreover, ROCK activation appears to be a key event in the initiation of angiogenic process by mediating an increase in endothelial permeability and migration, whilst ROCK1 inhibitor suppressed cell migration as shown recently [37]. We also found that metformin upregulated the proinflammatory chemokine CXCL8. This chemokine revealed pro-angiogenic properties by preserving VEGFA expression and secretion [38], whereas anti-CXCL8 was reported to reduce EC migration [39].
A Kunitz-type serine proteinase inhibitor TFPI-2 [40], upregulated by metformin in our study, was shown to be overexpressed in migrating EC [41]. Previous studies have demonstrated that VEGF mediates the induction of TFPI-2 through ERK1/2 activation [42,43]. However, as TFPI-2 was detected to control cell migration [41], it presumably acts as an important regulator to prevent excessive and uncontrolled cell migration.
Our results demonstrate that metformin inhibited apoptosis under combined hyperglycemia-CoCl2 through VEGF and activation of VEGF downstream signaling pathways. This was confirmed by using VEGF inhibitor (sunitinib) in the apoptosis assay. It is known that VEGF activates the phosphorylation of ERK1/ERK2 leading to activation of MAPK pathway, which is an essential step in determining the survival of EC [44]. We found that the activity of the ERK/MAPK pathway was inhibited by euglycemia-CoCl2, hyperglycemia, and hyperglycemia combined with CoCl2 at 12 h which is measured by MAPK activation dual detection assay. A previous study demonstrated that the level of phospho-ERK1/2 in astrocytes was elevated after 1 h ischemia and reached a maximal level after 4 h ischemia, before decreasing at 5 h resulting in enhanced ischemia-induced cell death [45]. In another study activation of ERK/MAPK signaling was required for cardioprotection from ischemia-reperfusion injury in vivo through antagonism of apoptotic regulatory pathways [46]. In our experiments we were able to demonstrate that metformin activates ERK/MAPK signaling in HUVEC exposed to hyperglycemia-CoCl2, augmenting cell survival. Therefore, metformin may have properties to enhance cardioprotection from ischemia-reperfusion; however, we have not studied the reperfusion phase in our study.
Previous studies have shown that VEGFA expression was significantly elevated in diabetic patients with chronic coronary heart disease, and the cellular response to VEGFA was attenuated due to defect in VEGF receptors and downstream signal transduction [47,48]. Our data confirm these findings of overexpression of VEGFA combined with downregulation of VEGFR2 and VEGF downstream intracellular signaling in HUVEC exposed to hyperglycemia-CoCl2.
Thus, the pivotal effect of metformin as documented by us was to restore the VEGFA pathway to non-diabetic state by augmenting the expression of VEGFR1 and VEGFR2 that transduce the vasoprotective downstream signalings of VEGF (Figure 8); a mechanism also documented in other cardioprotective therapies such as statins (HMG CoA reductase inhibitors) [49]. The lack of metformin’s beneficial effect in euglycemia is related to the fact that the VEGF related genes were principally unaltered in euglycemia-CoCl2. In line with these findings, clinical studies confirm that metformin offers no benefit in cardiovascular outcome in non-diabetic individuals [50,51]. Our data shows that metformin has a direct effect on several targets within VEGFA pathway and therefore could lead to further drug discovery of other cardioprotective therapies.

4. Materials and Methods

4.1. HUVEC Cultures

The study was approved by the Biomedical Ethics Unit, Faculty of Medicine, King Abdulaziz University (approval number: 440-10) and NRES Committee North East-Sunderland, UK (approval number: 12/NE/0044). HUVEC were harvested from three independent umbilical cords as previously described [17]. All experiments were performed in passage two. HUVEC were incubated in a culture medium with 5.5 mmol/L (euglycemia) or 16.5 mmol/L (hyperglycemia) glucose concentrations (Sigma-Aldrich, Dorset, UK) for 24 h except for functional assays (scratch, apoptosis, MAPK) for 48 h [16,17] and in presence/absence of 0.01 mmol/L metformin (Sigma-Aldrich) for up to 24 h or 48 h. Subsequently, HUVEC were incubated under normoxia or CoCl2 for 1, 3, or 12 h using a final concentration of 150 µmol/L CoCl2 (Sigma-Aldrich, Dorset, UK) as per protocol [52] in the same experiment. Whereas up to 24 h CoCl2 exposure was utilized in functional assays (scratch assay, apoptosis). Metformin concentration was selected according to the peak plasma concentration suggested by FDA fact sheet [10]. The concentration of metformin used was validated previously as tube formation was increased at 0.005–0.05 mmol/L but decreased at 0.5 mmol/L [53].

4.2. In Vitro Scratch Assay (Cell Migration Assay)

HUVEC were subcultured onto 24 well plate (1 × 105 cells/well). Cells were incubated under euglycemia or hyperglycemia in the presence/absence of metformin for 24 h. Scratch lines were created on confluent HUVEC monolayers using 1000 µL pipette tip. The medium was replaced with fresh medium containing respective concentrations of glucose and metformin, and then the cells were exposed to CoCl2 for up to 24 h. As a negative control for cell migration, HUVEC were treated with marimastat, an matrix metalloproteinase (MMP) inhibitor (Sigma-Aldrich, Dorset, UK) to a final concentration of 10 µmol/L in DMSO [54] or 0.1 µmol/L sunitinib malate a VEGF inhibitor (Sigma-Aldrich, Dorset, UK) [55]. A subtoxic sunitinib dose was selected based on our previously published results [12]. Subsequently, the cells were incubated in a 5% CO2 chamber (OkoLab) for 24 h that was connected to the camera (Hamamatsu Orca ER, Hamamatsu, Japan). Cell migration was examined by phase-contrast microscopy (Nikon Eclipse Tie, Tokyo, Japan) using software-based autofocus (NIS Elements V4.13, Nikon, Tokyo, Japan). Images were acquired every hour, and three independent biological experiments were performed at which each condition was assessed in duplicate. The scratch area in each image was measured using NIS Elements software. Cell migration is presented as a percentage of gap closure and has been calculated by the following equation:
T h e   p e r c e n t a g e   o f   g a p   c l o s u r e = A r e a   ( 0 )   A r e a   ( t ) A r e a   ( 0 ) ×   100
where Area (0) is the area of scratch pre-migration, Area (t) is an area of the scratch after migration at time t.

4.3. Apoptosis Assay

HUVEC were treated in passage two at 60% confluency. The supra-physiological concentration of metformin 1.0 mmol/L on apoptosis was additionally used. Culture media and metformin were replaced every 12 h. A positive control for the apoptosis assay was established by treating the cells with 14 µmol/L sunitinib malate for 24 h. To measure apoptosis, Annexin V APC staining assay (BD, Bioscience, San Jose, CA, USA) was performed according to the manufacturer’s recommendations and acquiring 10,000 events by FACSAria III flow cytometer (BD, Bioscience, San Jose, CA, USA).

4.4. Total RNA Extraction

Total RNA from HUVEC was extracted using the RNeasy Mini Kit (QIAGEN, Hilden, Germany) and on-column DNase digestion with RNase-Free DNase set (QIAGEN) was performed according to the manufacturer’s instructions. The integrity of RNA samples was assessed by using Agilent 2100 Bioanalyzer (Santa Clara, CA, USA) yielding high RNA Integrity Numbers (RIN) between 9.1 and 10.

4.5. Microarray Experiments and Gene Expression Analysis

Microarray experiments were performed using Affymetrix (Santa Clara, CA, USA) Human Gene 1.0 ST arrays according to manufacturer’s instructions with minor modifications [17,56]. Three biological replicates were hybridized for each experimental condition resulting in a total of 48 microarray experiments.
Affymetrix CEL files were imported into Partek Genomic Suite version 6.6 (Partek Inc., Chesterfield, MO, USA) and then data were normalized and analyzed as described previously [12]. The complete dataset and associated experimental information were submitted to NCBI’s Gene Expression Omnibus with accession number GSE46263. Ingenuity pathway analysis (IPA) software version 9 (Ingenuity, Redwood City, CA, USA) was used to explore the Canonical Pathways that may be activated or inhibited. Additionally, IPA assisted in detecting the interactive molecular and cellular functions in each condition.

4.6. Quantitative RT-PCR

Total RNA (100 ng) from each sample was reversed transcribed to cDNA using SuperScript® VILO™ cDNA Synthesis Kit (Life Technologies, Paisley, UK) in a final volume of 20 μL. cDNA were quantified by hydrolysis probe real-time PCR performed with TaqMan® Universal Master Mix II (Life Technologies) using StepOne Plus Real-time PCR system (Life Technologies) according to the manufacturer’s recommendations. Expression of the selected genes VEGFA and MMP16 was validated using TaqMan gene expression assays (VEGFA ID Hs0090005_m1, MMP16 ID Hs0023467_m1, Life Technologies). Three independent biological replicates were tested for each gene, and all samples were run in triplicates. The Comparative Ct (ΔΔCt) method was applied to the mean value of each triplicate to quantify expression of the target genes, which were normalized to reference control gene for the large ribosomal protein P0 [17] (Life Technologies).

4.7. Protein Studies

Protein was extracted using the mirVana PARIS (Ambion, Grand Island, NY, USA) and the concentration was measured using Pierce Microplate BCA protein assay (Thermo Scientific, Waltham, MA, USA) according to the manufacturer’s protocol. The concentration was scanned using ELISA plate reader (Multiskan Ascent, Thermo Labsystems, Waltham, MA, USA). Western blots were performed using commercially available kits (Life Technologies) XCell SureLock (Life Technologies) for protein fractionation, and Mini Protean II (BioRad, Hercules, CA, USA) for blot transfer. Nitrocellulose membranes (Life Technologies) were blocked with blocking buffer from Li-COR (Lincoln, NE, USA) and blocking buffer was diluted 1:2 with 1× TBS-T for incubation with antibodies. Transferred protein were probed for hypoxia-inducible factor-1α (HIF-1α, mouse monoclonal anti-HIF-1α, 5:3000; Abcam, Cambridge, UK), VEGFA (mouse monoclonal anti-VEGFA, 1:1000; Abcam), and VEGF165A (mouse monoclonal anti-VEGF 165A, 1:1000; Abcam) and subsequently a secondary antibody (IRDye® 680RD goat (polyclonal) anti-mouse IgG, 0.5:5000; Li-COR) was applied. β-actin (mouse monoclonal anti-beta actin, 1:3000; Abcam) was used as a loading control. Anti-VEGF showed many extra protein non-specific bands; therefore, we studied VEGF165A in detail. Bands were detected by infrared imager Odyssey (Li-COR) and quantified by Image Studio Lite version 3.1 (Li-COR Biosciences, Lincoln, NE, USA). For stripping, bound antibodies were removed by incubation in RestoreTM Plus Western Blot Stripping Buffer (Thermo Scientific, Waltham, MA, USA).
VEGFR1/Flt-1 (R & D Systems, Minneapolis, MN, USA), VEGFR-2 and phospho-VEGFR-2 (Cell Signaling, Danvers, MA, USA) were assessed by ELISA according to the manufacturers’ instructions.

4.8. MAPK Activation Dual Detection Assay

The activation of mitogen-activated protein kinase (MAPK) signaling pathway was measured by phosphorylation of extracellular signal-regulated protein kinases 1 and 2 (ERK1/2) using the FlowCellect™ MAPK Activation Dual Detection kit (Millipore, Darmstadt, Germany) which includes two antibodies, a phospho-specific anti-phospho-ERK1/2 (Thr202/Tyr204, Thr185/Tyr187)-PE and, for quantification of total levels of ERK, an anti-ERK1/2-Alexa Fluor® 647 conjugated antibody. HUVEC were treated with 5.5 mmol/L) or 16.5 mmol/L glucose concentrations in the presence/absence of metformin (0.01 mmol/L) for 48 h and then were exposed to CoCl2 for 12 h. All conditions were assayed in 2 or 3 independent replicates. Culture media and metformin were replaced every 12 h. For VEGF inhibitor assays, cells were incubated with EBM-2 medium containing VEGF as a positive control or with EBM-2 medium containing 7 µmol/L sunitinib malate as a negative control. Subsequently, 2 × 105 cells were fixed by an equal volume of ice-cold fixation buffer for 20 min and processed according to the manufacturer’s instructions by acquiring 14,000 events using FACSAria III flow cytometer.

4.9. Statistical Analysis

Results are presented as mean ± SEM. Statistical analysis was performed using one-way ANOVA followed by post-hoc analysis Fisher’s least significant difference (LSD) test for qRT-PCR, ELISA, western blot, and in vitro scratch assays. The Student’s t-test between any two experimental groups was applied for the MAPK activation dual detection assay and Annexin V Apoptosis assay. Calculations were performed using IBM SPSS software version 21.0 (SPSS Inc., Armonk, NY, USA). A p-value < 0.05 was considered statistically significant.

5. Conclusions

In conclusion, our in vitro study demonstrates that the effect of metformin in acute hyperglycemia-chemical hypoxia model is mediated through restoring VEGFA pathway. This occurs through upregulation of VEGFR1 and VEGFR2, leading to dual effect on activation of cell migration through MMP16 and ROCK1 upregulation, in addition to inhibition of apoptosis by increase in phospho-ERK1/2 and FABP4, components of VEGF signaling cascades.

Supplementary Materials

Supplementary materials can be found at www.mdpi.com/1422-0067/19/1/293/s1.

Acknowledgments

The authors would like to thank the midwives at Queen Elizabeth Hospital Gateshead, UK and King Abdulaziz University Hospital, Saudi Arabia. Additionally, the authors would like to show great appreciation to Manar M Ata, Microarray Service Unit at CEGMR, King Abdulaziz University, Saudi Arabia. This work was supported by the Diabetes Research and Wellness Foundation, UK [open funding 2011]; Joint Supervision Program, King Abdulaziz University, Jeddah 21589, Saudi Arabia; and King Abdulaziz City for Science and Technology, Riyadh 11442, Saudi Arabia [GSP-32-68].

Author Contributions

Sherin Bakhashab and Jolanta U. Weaver conceptualized the study. Sherin Bakhashab, Farid Ahmed, Fahad W. Ahmed, Michael Glanville, Hans-Juergen Schulten and Jolanta U. Weaver collected the umbilical cord from subjects, performed experiments and analyzed data. Mohammed H. Al-Qahtani provided scientific advice. Sherin Bakhashab, Farid Ahmed, Hans-Juergen Schulten and Jolanta U. Weaver wrote the manuscript. Jolanta U. Weaver corrected the final version of the manuscript. Jolanta U. Weaver is the guarantor of this work and had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

CVDCardiovascular disease
CXCL8Chemokine (C-X-C Motif) Ligand 8
DMDiabetes mellitus
ECEndothelial cell
ERK1/2Extracellular signal-regulated protein kinases 1 and 2
FABP4Fatty acid binding protein 4
LY96Lymphocyte antigen 96
MAPKMitogen-activated protein kinase
MIMyocardial infarction
MMP16Matrix metalloproteinase 16
PI3KPhosphatidylinositol 3′-kinase
ROCK1Rho-associated, coiled-coil containing protein kinase 1
TFPI2Tissue factor pathway inhibitor 2
VEGFAVascular endothelial growth factor A

References

  1. Hanson, R.L.; Imperatore, G.; Bennett, P.H.; Knowler, W.C. Components of the “metabolic syndrome” and incidence of type 2 diabetes. Diabetes 2002, 51, 3120–3127. [Google Scholar] [CrossRef] [PubMed]
  2. Nolan, C.J.; Damm, P.; Prentki, M. Type 2 diabetes across generations: From pathophysiology to prevention and management. Lancet 2011, 378, 169–181. [Google Scholar] [CrossRef]
  3. Ekezue, B.F.; Laditka, S.B.; Laditka, J.N.; Studnicki, J.; Blanchette, C.M. Diabetes complications and adverse health outcomes after coronary revascularization. Diabetes Res. Clin. Pract. 2014, 103, 530–537. [Google Scholar] [CrossRef] [PubMed]
  4. Piccolo, R.; Galasso, G.; Iversen, A.Z.; Eitel, I.; Dominguez-Rodriguez, A.; Gu, Y.L.; de Smet, B.J.; Mahmoud, K.D.; Abreu-Gonzalez, P.; Trimarco, B.; et al. Effects of baseline coronary occlusion and diabetes mellitus in patients with ST-segment elevation myocardial infarction undergoing primary percutaneous coronary intervention. Am. J. Cardiol. 2014, 114, 1145–1150. [Google Scholar] [CrossRef] [PubMed]
  5. Xu, J.; Zou, M.H. Molecular insights and therapeutic targets for diabetic endothelial dysfunction. Circulation 2009, 120, 1266–1286. [Google Scholar] [CrossRef] [PubMed]
  6. UK Prospective Diabetes Study (UKPDS) Group. Effect of intensive blood-glucose control with metformin on complications in overweight patients with type 2 diabetes (UKPDS 34). Lancet 1998, 352, 854–865. [Google Scholar]
  7. Roussel, R.; Travert, F.; Pasquet, B.; Wilson, P.W.; Smith, S.C., Jr.; Goto, S.; Ravaud, P.; Marre, M.; Porath, A.; Bhatt, D.L.; et al. Reduction of Atherothrombosis for Continued Health Registry, I. Metformin use and mortality among patients with diabetes and atherothrombosis. Arch. Intern. Med. 2010, 170, 1892–1899. [Google Scholar] [CrossRef] [PubMed]
  8. Li, J.; Xu, J.P.; Zhao, X.Z.; Sun, X.J.; Xu, Z.W.; Song, S.J. Protective effect of metformin on myocardial injury in metabolic syndrome patients following percutaneous coronary intervention. Cardiology 2014, 127, 133–139. [Google Scholar] [CrossRef] [PubMed]
  9. Lexis, C.P.; Wieringa, W.G.; Hiemstra, B.; van Deursen, V.M.; Lipsic, E.; van der Harst, P.; van Veldhuisen, D.J.; van der Horst, I.C. Chronic metformin treatment is associated with reduced myocardial infarct size in diabetic patients with ST-segment elevation myocardial infarction. Cardiovasc. Drugs Ther. 2014, 28, 163–171. [Google Scholar] [CrossRef] [PubMed]
  10. Legtenberg, R.J.; Houston, R.J.; Oeseburg, B.; Smits, P. Metformin improves cardiac functional recovery after ischemia in rats. Horm. Metab. Res. 2002, 34, 182–185. [Google Scholar] [CrossRef] [PubMed]
  11. Bhamra, G.S.; Hausenloy, D.J.; Davidson, S.M.; Carr, R.D.; Paiva, M.; Wynne, A.M.; Mocanu, M.M.; Yellon, D.M. Metformin protects the ischemic heart by the Akt-mediated inhibition of mitochondrial permeability transition pore opening. Basic Res. Cardiol. 2008, 103, 274–284. [Google Scholar] [CrossRef] [PubMed]
  12. Bakhashab, S.; Ahmed, F.W.; Schulten, H.J.; Bashir, A.; Karim, S.; Al-Malki, A.L.; Gari, M.A.; Abuzenadah, A.M.; Chaudhary, A.G.; Alqahtani, M.H.; et al. Metformin improves the angiogenic potential of human CD34(+) cells co-incident with downregulating CXCL10 and TIMP1 gene expression and increasing VEGFA under hyperglycemia and hypoxia within a therapeutic window for myocardial infarction. Cardiovasc. Diabetol. 2016, 15, 27. [Google Scholar] [CrossRef] [PubMed]
  13. Cross, M.J.; Claesson-Welsh, L. FGF and VEGF function in angiogenesis: Signalling pathways, biological responses and therapeutic inhibition. Trends Pharmacol. Sci. 2001, 22, 201–207. [Google Scholar] [CrossRef]
  14. He, Y.; Wang, N.; Shen, Y.; Zheng, Z.; Xu, X. Inhibition of high glucose-induced apoptosis by uncoupling protein 2 in human umbilical vein endothelial cells. Int. J. Mol. Med. 2014, 33, 1275–1281. [Google Scholar] [CrossRef] [PubMed]
  15. Tsuneki, H.; Sekizaki, N.; Suzuki, T.; Kobayashi, S.; Wada, T.; Okamoto, T.; Kimura, I.; Sasaoka, T. Coenzyme Q10 prevents high glucose-induced oxidative stress in human umbilical vein endothelial cells. Eur. J. Pharmacol. 2007, 566, 1–10. [Google Scholar] [CrossRef] [PubMed]
  16. Altannavch, T.S.; Roubalova, K.; Kucera, P.; Andel, M. Effect of high glucose concentrations on expression of ELAM-1, VCAM-1 and ICAM-1 in HUVEC with and without cytokine activation. Physiol. Res. Acad. Sci. Bohemoslov. 2004, 53, 77–82. [Google Scholar]
  17. Bakhashab, S.; Lary, S.; Ahmed, F.; Schulten, H.J.; Bashir, A.; Ahmed, F.W.; Al-Malki, A.L.; Jamal, H.S.; Gari, M.A.; Weaver, J.U. Reference genes for expression studies in hypoxia and hyperglycemia models in human umbilical vein endothelial cells. G3 Genes Genomes Genet. 2014, 4, 2159–2165. [Google Scholar] [CrossRef] [PubMed]
  18. Zou, M.H.; Cohen, R.; Ullrich, V. Peroxynitrite and vascular endothelial dysfunction in diabetes mellitus. Endothel. J. Endothel. Cell Res. 2004, 11, 89–97. [Google Scholar] [CrossRef] [PubMed]
  19. Yu, J.W.; Deng, Y.P.; Han, X.; Ren, G.F.; Cai, J.; Jiang, G.J. Metformin improves the angiogenic functions of endothelial progenitor cells via activating AMPK/eNOS pathway in diabetic mice. Cardiovasc. Diabetol. 2016, 15, 88. [Google Scholar] [CrossRef] [PubMed]
  20. Shigematsu, S.; Yamauchi, K.; Nakajima, K.; Iijima, S.; Aizawa, T.; Hashizume, K. D-Glucose and insulin stimulate migration and tubular formation of human endothelial cells in vitro. Am. J. Physiol. 1999, 277, E433–E438. [Google Scholar] [CrossRef] [PubMed]
  21. Esfahanian, N.; Shakiba, Y.; Nikbin, B.; Soraya, H.; Maleki-Dizaji, N.; Ghazi-Khansari, M.; Garjani, A. Effect of metformin on the proliferation, migration, and MMP-2 and -9 expression of human umbilical vein endothelial cells. Mol. Med. Rep. 2012, 5, 1068–1074. [Google Scholar] [CrossRef] [PubMed]
  22. Asahara, T.; Bauters, C.; Pastore, C.; Kearney, M.; Rossow, S.; Bunting, S.; Ferrara, N.; Symes, J.F.; Isner, J.M. Local delivery of vascular endothelial growth factor accelerates reendothelialization and attenuates intimal hyperplasia in balloon-injured rat carotid artery. Circulation 1995, 91, 2793–2801. [Google Scholar] [CrossRef] [PubMed]
  23. Forsythe, J.A.; Jiang, B.H.; Iyer, N.V.; Agani, F.; Leung, S.W.; Koos, R.D.; Semenza, G.L. Activation of vascular endothelial growth factor gene transcription by hypoxia-inducible factor 1. Mol. Cell. Boil. 1996, 16, 4604–4613. [Google Scholar] [CrossRef]
  24. Namiki, A.; Brogi, E.; Kearney, M.; Kim, E.A.; Wu, T.; Couffinhal, T.; Varticovski, L.; Isner, J.M. Hypoxia induces vascular endothelial growth factor in cultured human endothelial cells. J. Biol. Chem. 1995, 270, 31189–31195. [Google Scholar] [CrossRef] [PubMed]
  25. Brogi, E.; Wu, T.; Namiki, A.; Isner, J.M. Indirect angiogenic cytokines upregulate VEGF and bFGF gene expression in vascular smooth muscle cells, whereas hypoxia upregulates VEGF expression only. Circulation 1994, 90, 649–652. [Google Scholar] [CrossRef] [PubMed]
  26. Hotary, K.; Allen, E.; Punturieri, A.; Yana, I.; Weiss, S.J. Regulation of cell invasion and morphogenesis in a three-dimensional type I collagen matrix by membrane-type matrix metalloproteinases 1, 2, and 3. J. Cell Biol. 2000, 149, 1309–1323. [Google Scholar] [CrossRef] [PubMed]
  27. Shofuda, K.I.; Hasenstab, D.; Kenagy, R.D.; Shofuda, T.; Li, Z.Y.; Lieber, A.; Clowes, A.W. Membrane-type matrix metalloproteinase-1 and -3 activity in primate smooth muscle cells. FASEB J. 2001, 15, 2010–2012. [Google Scholar] [CrossRef] [PubMed]
  28. Park, J.E.; Keller, G.A.; Ferrara, N. The vascular endothelial growth factor (VEGF) isoforms: Differential deposition into the subepithelial extracellular matrix and bioactivity of extracellular matrix-bound VEGF. Mol. Biol. Cell 1993, 4, 1317–1326. [Google Scholar] [CrossRef] [PubMed]
  29. Houck, K.A.; Ferrara, N.; Winer, J.; Cachianes, G.; Li, B.; Leung, D.W. The vascular endothelial growth factor family: Identification of a fourth molecular species and characterization of alternative splicing of RNA. Mol. Endocrinol. 1991, 5, 1806–1814. [Google Scholar] [CrossRef] [PubMed]
  30. Houck, K.A.; Leung, D.W.; Rowland, A.M.; Winer, J.; Ferrara, N. Dual regulation of vascular endothelial growth factor bioavailability by genetic and proteolytic mechanisms. J. Biol. Chem. 1992, 267, 26031–26037. [Google Scholar] [PubMed]
  31. Bergers, G.; Brekken, R.; McMahon, G.; Vu, T.H.; Itoh, T.; Tamaki, K.; Tanzawa, K.; Thorpe, P.; Itohara, S.; Werb, Z.; et al. Matrix metalloproteinase-9 triggers the angiogenic switch during carcinogenesis. Nat. Cell Biol. 2000, 2, 737–744. [Google Scholar] [PubMed]
  32. Plaisier, M.; Kapiteijn, K.; Koolwijk, P.; Fijten, C.; Hanemaaijer, R.; Grimbergen, J.M.; Mulder-Stapel, A.; Quax, P.H.; Helmerhorst, F.M.; van Hinsbergh, V.W. Involvement of membrane-type matrix metalloproteinases (MT-MMPs) in capillary tube formation by human endometrial microvascular endothelial cells: Role of MT3-MMP. J. Clin. Endocrinol. Metab. 2004, 89, 5828–5836. [Google Scholar] [CrossRef] [PubMed]
  33. Elmasri, H.; Ghelfi, E.; Yu, C.W.; Traphagen, S.; Cernadas, M.; Cao, H.; Shi, G.P.; Plutzky, J.; Sahin, M.; Hotamisligil, G.; et al. Endothelial cell-fatty acid binding protein 4 promotes angiogenesis: Role of stem cell factor/c-kit pathway. Angiogenesis 2012, 15, 457–468. [Google Scholar] [CrossRef] [PubMed]
  34. Carmeliet, P.; Ferreira, V.; Breier, G.; Pollefeyt, S.; Kieckens, L.; Gertsenstein, M.; Fahrig, M.; Vandenhoeck, A.; Harpal, K.; Eberhardt, C.; et al. Abnormal blood vessel development and lethality in embryos lacking a single VEGF allele. Nature 1996, 380, 435–439. [Google Scholar] [CrossRef] [PubMed]
  35. Ferrara, N.; Carver-Moore, K.; Chen, H.; Dowd, M.; Lu, L.; O’Shea, K.S.; Powell-Braxton, L.; Hillan, K.J.; Moore, M.W. Heterozygous embryonic lethality induced by targeted inactivation of the VEGF gene. Nature 1996, 380, 439–442. [Google Scholar] [CrossRef] [PubMed]
  36. Rolfe, B.E.; Worth, N.F.; World, C.J.; Campbell, J.H.; Campbell, G.R. Rho and vascular disease. Atherosclerosis 2005, 183, 1–16. [Google Scholar] [CrossRef] [PubMed]
  37. Patel, R.A.; Liu, Y.; Wang, B.; Li, R.; Sebti, S.M. Identification of novel ROCK inhibitors with anti-migratory and anti-invasive activities. Oncogene 2014, 33, 550–555. [Google Scholar] [CrossRef] [PubMed]
  38. Martin, D.; Galisteo, R.; Gutkind, J.S. CXCL8/IL8 stimulates vascular endothelial growth factor (VEGF) expression and the autocrine activation of VEGFR2 in endothelial cells by activating NFkappaB through the CBM (Carma3/Bcl10/Malt1) complex. J. Boil. Chem. 2009, 284, 6038–6042. [Google Scholar] [CrossRef] [PubMed]
  39. Li, A.; Varney, M.L.; Valasek, J.; Godfrey, M.; Dave, B.J.; Singh, R.K. Autocrine role of interleukin-8 in induction of endothelial cell proliferation, survival, migration and MMP-2 production and angiogenesis. Angiogenesis 2005, 8, 63–71. [Google Scholar] [CrossRef] [PubMed]
  40. Sprecher, C.A.; Kisiel, W.; Mathewes, S.; Foster, D.C. Molecular cloning, expression, and partial characterization of a second human tissue-factor-pathway inhibitor. Proc. Natl. Acad. Sci. USA 1994, 91, 3353–3357. [Google Scholar] [CrossRef] [PubMed]
  41. Ivanciu, L.; Gerard, R.D.; Tang, H.; Lupu, F.; Lupu, C. Adenovirus-mediated expression of tissue factor pathway inhibitor-2 inhibits endothelial cell migration and angiogenesis. Arterioscler. Thromb. Vasc. Boil. 2007, 27, 310–316. [Google Scholar] [CrossRef] [PubMed]
  42. Xu, Z.; Maiti, D.; Kisiel, W.; Duh, E.J. Tissue factor pathway inhibitor-2 is upregulated by vascular endothelial growth factor and suppresses growth factor-induced proliferation of endothelial cells. Arterioscler. Thromb. Vasc. Boil. 2006, 26, 2819–2825. [Google Scholar] [CrossRef] [PubMed]
  43. Kast, C.; Wang, M.; Whiteway, M. The ERK/MAPK pathway regulates the activity of the human tissue factor pathway inhibitor-2 promoter. J. Boil. Chem. 2003, 278, 6787–6794. [Google Scholar] [CrossRef] [PubMed]
  44. Gupta, K.; Kshirsagar, S.; Li, W.; Gui, L.; Ramakrishnan, S.; Gupta, P.; Law, P.Y.; Hebbel, R.P. VEGF prevents apoptosis of human microvascular endothelial cells via opposing effects on MAPK/ERK and SAPK/JNK signaling. Exp. Cell Res. 1999, 247, 495–504. [Google Scholar] [CrossRef] [PubMed]
  45. Jiang, Z.; Zhang, Y.; Chen, X.; Lam, P.Y.; Yang, H.; Xu, Q.; Yu, A.C. Activation of Erk1/2 and Akt in astrocytes under ischemia. Biochem. Biophys. Res. Commun. 2002, 294, 726–733. [Google Scholar] [CrossRef]
  46. Yue, T.L.; Wang, C.; Gu, J.L.; Ma, X.L.; Kumar, S.; Lee, J.C.; Feuerstein, G.Z.; Thomas, H.; Maleeff, B.; Ohlstein, E.H. Inhibition of extracellular signal-regulated kinase enhances Ischemia/Reoxygenation-induced apoptosis in cultured cardiac myocytes and exaggerates reperfusion injury in isolated perfused heart. Circ. Res. 2000, 86, 692–699. [Google Scholar] [CrossRef] [PubMed]
  47. Waltenberger, J.; Lange, J.; Kranz, A. Vascular endothelial growth factor-A-induced chemotaxis of monocytes is attenuated in patients with diabetes mellitus: A potential predictor for the individual capacity to develop collaterals. Circulation 2000, 102, 185–190. [Google Scholar] [CrossRef] [PubMed]
  48. Sasso, F.C.; Torella, D.; Carbonara, O.; Ellison, G.M.; Torella, M.; Scardone, M.; Marra, C.; Nasti, R.; Marfella, R.; Cozzolino, D.; et al. Increased vascular endothelial growth factor expression but impaired vascular endothelial growth factor receptor signaling in the myocardium of type 2 diabetic patients with chronic coronary heart disease. J. Am. Coll. Cardiol. 2005, 46, 827–834. [Google Scholar] [CrossRef] [PubMed]
  49. Zaitone, S.A.; Abo-Gresha, N.M. Rosuvastatin promotes angiogenesis and reverses isoproterenol-induced acute myocardial infarction in rats: Role of iNOS and VEGF. Eur. J. Pharmacol. 2012, 691, 134–142. [Google Scholar] [CrossRef] [PubMed]
  50. Preiss, D.; Lloyd, S.M.; Ford, I.; McMurray, J.J.; Holman, R.R.; Welsh, P.; Fisher, M.; Packard, C.J.; Sattar, N. Metformin for non-diabetic patients with coronary heart disease (the CAMERA study): A randomised controlled trial. Lancet Diabetes Endocrinol. 2014, 2, 116–124. [Google Scholar] [CrossRef]
  51. Lexis, C.P.; van der Horst, I.C.; Lipsic, E.; Wieringa, W.G.; de Boer, R.A.; van den Heuvel, A.F.; van der Werf, H.W.; Schurer, R.A.; Pundziute, G.; Tan, E.S.; et al. Effect of metformin on left ventricular function after acute myocardial infarction in patients without diabetes: The GIPS-III randomized clinical trial. JAMA 2014, 311, 1526–1535. [Google Scholar] [CrossRef] [PubMed]
  52. Sultana, C.; Shen, Y.; Johnson, C.; Kalra, V.K. Cobalt chloride-induced signaling in endothelium leading to the augmented adherence of sickle red blood cells and transendothelial migration of monocyte-like HL-60 cells is blocked by PAF-receptor antagonist. J. Cell. Physiol. 1999, 179, 67–78. [Google Scholar] [CrossRef]
  53. Teng, R.J.; Du, J.; Afolayan, A.J.; Eis, A.; Shi, Y.; Konduri, G.G. AMP kinase activation improves angiogenesis in pulmonary artery endothelial cells with in utero pulmonary hypertension. Am. J. Physiol. Lung Cell. Mol. Physiol. 2013, 304, L29–L42. [Google Scholar] [CrossRef] [PubMed]
  54. Scott, K.A.; Wood, E.J.; Karran, E.H. A matrix metalloproteinase inhibitor which prevents fibroblast-mediated collagen lattice contraction. FEBS Lett. 1998, 441, 137–140. [Google Scholar] [CrossRef]
  55. Huang, D.; Ding, Y.; Li, Y.; Luo, W.M.; Zhang, Z.F.; Snider, J.; Vandenbeldt, K.; Qian, C.N.; Teh, B.T. Sunitinib acts primarily on tumor endothelium rather than tumor cells to inhibit the growth of renal cell carcinoma. Cancer Res. 2010, 70, 1053–1062. [Google Scholar] [CrossRef] [PubMed]
  56. Merdad, A.; Karim, S.; Schulten, H.J.; Dallol, A.; Buhmeida, A.; Al-Thubaity, F.; Gari, M.A.; Chaudhary, A.G.; Abuzenadah, A.M.; Al-Qahtani, M.H. Expression of matrix metalloproteinases (MMPs) in primary human breast cancer: MMP-9 as a potential biomarker for cancer invasion and metastasis. Anticancer Res. 2014, 34, 1355–1366. [Google Scholar] [PubMed]
Figure 1. Metformin impairs cell migration in HUVEC exposed to euglycemia and CoCl2. (A) HUVEC were incubated for 24 h with euglycemia in the presence or absence of metformin. Scratch lines were created on confluent monolayers. The media containing different glucose concentrations and metformin were replaced. Then cells were incubated with CoCl2 for 24 h in a 5% CO2 chamber that was connected to CCD camera. Images were acquired every hour, and three independent biological experiments were performed at which each condition was assessed in duplicate. The scratch area was measured using NIS Elements software. (B) CoCl2 induction exhibited no significant effect on cell migration under euglycemia, whereas metformin reduced migration after 18 h. Sunitinib (0.1 µmol/L) was used as a negative control, therefore the line with sunitinab is on x axis as cell migration not affected. Results are expressed as mean ± SEM and were analyzed by one-way ANOVA followed by LSD, ## p < 0.01, ### p < 0.001 compared pairwise, i.e., the metformin-treated versus metformin-untreated condition. Scale bar is 100 µm. Key: met: metformin; sun: sunitinib.
Figure 1. Metformin impairs cell migration in HUVEC exposed to euglycemia and CoCl2. (A) HUVEC were incubated for 24 h with euglycemia in the presence or absence of metformin. Scratch lines were created on confluent monolayers. The media containing different glucose concentrations and metformin were replaced. Then cells were incubated with CoCl2 for 24 h in a 5% CO2 chamber that was connected to CCD camera. Images were acquired every hour, and three independent biological experiments were performed at which each condition was assessed in duplicate. The scratch area was measured using NIS Elements software. (B) CoCl2 induction exhibited no significant effect on cell migration under euglycemia, whereas metformin reduced migration after 18 h. Sunitinib (0.1 µmol/L) was used as a negative control, therefore the line with sunitinab is on x axis as cell migration not affected. Results are expressed as mean ± SEM and were analyzed by one-way ANOVA followed by LSD, ## p < 0.01, ### p < 0.001 compared pairwise, i.e., the metformin-treated versus metformin-untreated condition. Scale bar is 100 µm. Key: met: metformin; sun: sunitinib.
Ijms 19 00293 g001
Figure 2. Metformin improves cell migration in HUVEC exposed to hyperglycemia and CoCl2. (A) HUVEC were incubated for 24 h with hyperglycemia in the presence or absence of metformin. Scratch lines were created on confluent monolayers. The media containing different glucose concentrations and metformin were replaced. Then cells were incubated with CoCl2 for 24 h in a 5% CO2 chamber that was connected to CCD camera. Images were acquired every hour, and three independent biological experiments were performed at which each condition was assessed in duplicate. The scratch area was measured using NIS Elements software. (B) Hyperglycemia increased migration after 6, 12, and 18 h; (C) whereas hyperglycemia-CoCl2 significantly reduced migration. Metformin increased cell migration under hyperglycemia-CoCl2. Sunitinib was used as a negative control, therefore the line with sunitinab is on x axis as cell migration not affected. Results are expressed as mean ± SEM and were analyzed by one-way ANOVA followed by LSD, ** p < 0.01, *** p < 0.001 compared to the control. ## p < 0.01, ### p < 0.001 compared pairwise, i.e., the metformin-treated versus metformin-untreated condition. Scale bar is 100 µm. Key: met: metformin; sun: sunitinib.
Figure 2. Metformin improves cell migration in HUVEC exposed to hyperglycemia and CoCl2. (A) HUVEC were incubated for 24 h with hyperglycemia in the presence or absence of metformin. Scratch lines were created on confluent monolayers. The media containing different glucose concentrations and metformin were replaced. Then cells were incubated with CoCl2 for 24 h in a 5% CO2 chamber that was connected to CCD camera. Images were acquired every hour, and three independent biological experiments were performed at which each condition was assessed in duplicate. The scratch area was measured using NIS Elements software. (B) Hyperglycemia increased migration after 6, 12, and 18 h; (C) whereas hyperglycemia-CoCl2 significantly reduced migration. Metformin increased cell migration under hyperglycemia-CoCl2. Sunitinib was used as a negative control, therefore the line with sunitinab is on x axis as cell migration not affected. Results are expressed as mean ± SEM and were analyzed by one-way ANOVA followed by LSD, ** p < 0.01, *** p < 0.001 compared to the control. ## p < 0.01, ### p < 0.001 compared pairwise, i.e., the metformin-treated versus metformin-untreated condition. Scale bar is 100 µm. Key: met: metformin; sun: sunitinib.
Ijms 19 00293 g002
Figure 3. Metformin improves cell survival with hyperglycemia-CoCl2. (A) HUVEC were treated with 5.5 or (B) 16.5 mmol/L glucose for 48 h exposed to chemical hypoxia for 3, 12 or 24 h in the absence of metformin, (C) hyperglycemia treated with metformin (0.01 mmol/L) and supra-physiological concentration of metformin (1.0 mmol/L), and (D) hyperglycemia exposed to CoCl2 for 24 h and parallel cultures were treated with metformin. Apoptosis was assessed by Annexin V staining and flow cytometry. Results are representative of 3 independent experiments and expressed as mean ± SEM and were analyzed by paired t-test, * p < 0.05, compared to hyperglycemia, # p < 0.05 compared pairwise, i.e., metformin-treated condition versus untreated condition.
Figure 3. Metformin improves cell survival with hyperglycemia-CoCl2. (A) HUVEC were treated with 5.5 or (B) 16.5 mmol/L glucose for 48 h exposed to chemical hypoxia for 3, 12 or 24 h in the absence of metformin, (C) hyperglycemia treated with metformin (0.01 mmol/L) and supra-physiological concentration of metformin (1.0 mmol/L), and (D) hyperglycemia exposed to CoCl2 for 24 h and parallel cultures were treated with metformin. Apoptosis was assessed by Annexin V staining and flow cytometry. Results are representative of 3 independent experiments and expressed as mean ± SEM and were analyzed by paired t-test, * p < 0.05, compared to hyperglycemia, # p < 0.05 compared pairwise, i.e., metformin-treated condition versus untreated condition.
Ijms 19 00293 g003
Figure 4. Effect of metformin on VEGFA mRNA and VEGF 165A protein under euglycemia-CoCl2, hyperglycemia and hyperglycemia-CoCl2. HUVEC were treated with hyperglycemic or euglycemic glucose concentrations as a control. After 24 h, metformin was added to euglycemic and hyperglycemic cultures, then CoCl2 was added for either 1, 3 or 12 h. (A) The variation in mRNA expression levels of VEGFA was assessed by qRT-PCR on three independent biological replicates and (B) the variation in protein levels of VEGF 165A was assessed by western blot on three independent biological replicates. Results are presented as mean ± SEM and were analyzed using one-way ANOVA followed by LSD, * p < 0.05, ** p < 0.01 compared to the control. # p < 0.05 compared pairwise, i.e.; metformin-treated condition versus untreated condition.
Figure 4. Effect of metformin on VEGFA mRNA and VEGF 165A protein under euglycemia-CoCl2, hyperglycemia and hyperglycemia-CoCl2. HUVEC were treated with hyperglycemic or euglycemic glucose concentrations as a control. After 24 h, metformin was added to euglycemic and hyperglycemic cultures, then CoCl2 was added for either 1, 3 or 12 h. (A) The variation in mRNA expression levels of VEGFA was assessed by qRT-PCR on three independent biological replicates and (B) the variation in protein levels of VEGF 165A was assessed by western blot on three independent biological replicates. Results are presented as mean ± SEM and were analyzed using one-way ANOVA followed by LSD, * p < 0.05, ** p < 0.01 compared to the control. # p < 0.05 compared pairwise, i.e.; metformin-treated condition versus untreated condition.
Ijms 19 00293 g004
Figure 5. Effect of metformin on the activity of MAPK pathway. HUVEC were treated with euglycemia or hyperglycemia in the presence or absence of metformin for 48 h, and parallel cultures were exposed to CoCl2 for 12 h. (A) Represents % of ERK1/2 phosphorylation (B) Effect of metformin on euglycemia, and (C) hyperglycemia combined with 12 h chemical hypoxia CoCl2. Percentage of phosphorylation indicates relative intensity of phospho-protein/total protein. The variation in protein expression levels was assessed by flow cytometry on three independent biological replicates. Results are presented as mean ± SEM and were analyzed using paired t-test. * p < 0.05, ** p < 0.01, *** p < 0.002 compared to the control. # p < 0.05, ## p < 0.01 compared pairwise, i.e., metformin-treated condition versus untreated condition.
Figure 5. Effect of metformin on the activity of MAPK pathway. HUVEC were treated with euglycemia or hyperglycemia in the presence or absence of metformin for 48 h, and parallel cultures were exposed to CoCl2 for 12 h. (A) Represents % of ERK1/2 phosphorylation (B) Effect of metformin on euglycemia, and (C) hyperglycemia combined with 12 h chemical hypoxia CoCl2. Percentage of phosphorylation indicates relative intensity of phospho-protein/total protein. The variation in protein expression levels was assessed by flow cytometry on three independent biological replicates. Results are presented as mean ± SEM and were analyzed using paired t-test. * p < 0.05, ** p < 0.01, *** p < 0.002 compared to the control. # p < 0.05, ## p < 0.01 compared pairwise, i.e., metformin-treated condition versus untreated condition.
Ijms 19 00293 g005
Figure 6. Effect of metformin on MMP16 mRNA expression in euglycemic and hyperglycemic conditions with CoCl2 induction. The variation in RNA expression levels of MMP16 was assessed by qRT-PCR on three independent biological replicates. Results are presented as mean ± SEM and were analyzed using one-way ANOVA followed by LSD. * p < 0.05, *** p < 0.001 compared to the control or hyperglycemia or pairwise, i.e., metformin-treated condition versus untreated condition.
Figure 6. Effect of metformin on MMP16 mRNA expression in euglycemic and hyperglycemic conditions with CoCl2 induction. The variation in RNA expression levels of MMP16 was assessed by qRT-PCR on three independent biological replicates. Results are presented as mean ± SEM and were analyzed using one-way ANOVA followed by LSD. * p < 0.05, *** p < 0.001 compared to the control or hyperglycemia or pairwise, i.e., metformin-treated condition versus untreated condition.
Ijms 19 00293 g006
Figure 7. Marimastat antagonizes the effect of metformin on cell migration in HUVEC exposed to hyperglycemia-CoCl2. (A) HUVEC were incubated with euglycemia or hyperglycemia in the presence or absence of metformin for 24 h. Images were acquired every hour, and three independent biological experiments were performed in duplicate for each condition. The scratch area was measured using NIS Elements software. (B) Marimastat had no significant effect on cells treated with euglycemia, metformin and CoCl2 induction. (C) The effect of metformin was inhibited by marimastat treatment. Results are expressed as mean ± SEM and were analyzed using one-way ANOVA followed by LSD, †† p < 0.01, ††† p < 0.001 compared with marimastat treated versus untreated-condition. Scale bar is 100 µm. Key: mar: marimastat; met: metformin.
Figure 7. Marimastat antagonizes the effect of metformin on cell migration in HUVEC exposed to hyperglycemia-CoCl2. (A) HUVEC were incubated with euglycemia or hyperglycemia in the presence or absence of metformin for 24 h. Images were acquired every hour, and three independent biological experiments were performed in duplicate for each condition. The scratch area was measured using NIS Elements software. (B) Marimastat had no significant effect on cells treated with euglycemia, metformin and CoCl2 induction. (C) The effect of metformin was inhibited by marimastat treatment. Results are expressed as mean ± SEM and were analyzed using one-way ANOVA followed by LSD, †† p < 0.01, ††† p < 0.001 compared with marimastat treated versus untreated-condition. Scale bar is 100 µm. Key: mar: marimastat; met: metformin.
Ijms 19 00293 g007
Figure 8. Comprehensive VEGF signaling network of genes and proteins involved in cell migration and survival. Metformin-treated condition is compared to metformin-untreated condition under hyperglycemia-CoCl2 for 12 h. The network was created by IPA software rendering VEGF signal transduction pathways. The genes from microarray expression study that are represented with red shades are upregulated, and green shades are downregulated, MMP16 was validated by qRT-PCR. The activity of ERK1/2 was assessed by MAPK activation dual detection assay flow cytometry. The red shade on functional assays denoted activation while green shade inhibition. Solid lines denoted direct interaction; interrupted lines denoted indirect interaction.
Figure 8. Comprehensive VEGF signaling network of genes and proteins involved in cell migration and survival. Metformin-treated condition is compared to metformin-untreated condition under hyperglycemia-CoCl2 for 12 h. The network was created by IPA software rendering VEGF signal transduction pathways. The genes from microarray expression study that are represented with red shades are upregulated, and green shades are downregulated, MMP16 was validated by qRT-PCR. The activity of ERK1/2 was assessed by MAPK activation dual detection assay flow cytometry. The red shade on functional assays denoted activation while green shade inhibition. Solid lines denoted direct interaction; interrupted lines denoted indirect interaction.
Ijms 19 00293 g008
Table 1. The top differentially expressed genes in HUVEC treated with metformin and exposed to hyperglyemia-CoCl2.
Table 1. The top differentially expressed genes in HUVEC treated with metformin and exposed to hyperglyemia-CoCl2.
Gene NameGene Symbolp-ValueFC Hyperglycemia-CoCl2 3 h + Metforminp-ValueFC Hyperglycemia-CoCl2 12 h + Metformin
small nucleolar RNA, H/ACA box 20 SNORA205.45 × 10−1−1.281.23 × 10−34.01
small nucleolar RNA, C/D box 45CSNORD45C3.62 × 10−1−1.501.26 × 10−23.16
metastasis associated lung adenocarcinoma transcript 1 (non-protein)MALAT12.88 × 10−22.388.78 × 10−32.87
Rho-associated, coiled-coil containing protein kinase 1ROCK19.38 × 10−21.901.15 × 10−22.68
cerebellar degeneration-related protein 1, 34 kDaCDR15.47 × 10−32.801.20 × 10−22.52
Chemokine (C-X-C Motif) ligand 8CXCL81.49 × 10−11.542.84 × 10−21.94
cytochrome c oxidase subunit VIIbCOX7B4.23 × 10−11.175.53 × 10−31.76
matrix metallopeptidase 16 (membrane-inserted)MMP168.78 × 10−1−1.042.34 × 10−21.73
fatty acid binding protein 4FABP42.92 × 10−21.582.53 × 10−21.60
lymphocyte antigen 96LY962.29 × 10−11.182.01 × 10−31.57
tissue factor pathway inhibitor 2TFPI26.17 × 10−11.062.07 × 10−41.55
HUVEC were incubated with high glucose concentration 16.5 mmol/L and 0.01 mmol/L metformin then chemical hypoxia was induced by 150 µmol/L CoCl2. Affymetrix .CEL files were imported to Partek Genomic Suite version 6.6 and normalized using RMA. Differentially expressed gene sets were generated using one-way ANOVA, FDR-unadjusted p-value < 0.05 and fold change (FC) cutoff of 1.5 compared pairwise, i.e., the condition treated with and without metformin. Subsequently, the most influenced genes were compared among different conditions of hypoxia. The signs in the FC column denote (−) downregulated, (+) upregulated genes.

Share and Cite

MDPI and ACS Style

Bakhashab, S.; Ahmed, F.; Schulten, H.-J.; Ahmed, F.W.; Glanville, M.; Al-Qahtani, M.H.; Weaver, J.U. Proangiogenic Effect of Metformin in Endothelial Cells Is via Upregulation of VEGFR1/2 and Their Signaling under Hyperglycemia-Hypoxia. Int. J. Mol. Sci. 2018, 19, 293. https://doi.org/10.3390/ijms19010293

AMA Style

Bakhashab S, Ahmed F, Schulten H-J, Ahmed FW, Glanville M, Al-Qahtani MH, Weaver JU. Proangiogenic Effect of Metformin in Endothelial Cells Is via Upregulation of VEGFR1/2 and Their Signaling under Hyperglycemia-Hypoxia. International Journal of Molecular Sciences. 2018; 19(1):293. https://doi.org/10.3390/ijms19010293

Chicago/Turabian Style

Bakhashab, Sherin, Farid Ahmed, Hans-Juergen Schulten, Fahad W. Ahmed, Michael Glanville, Mohammed H. Al-Qahtani, and Jolanta U. Weaver. 2018. "Proangiogenic Effect of Metformin in Endothelial Cells Is via Upregulation of VEGFR1/2 and Their Signaling under Hyperglycemia-Hypoxia" International Journal of Molecular Sciences 19, no. 1: 293. https://doi.org/10.3390/ijms19010293

APA Style

Bakhashab, S., Ahmed, F., Schulten, H. -J., Ahmed, F. W., Glanville, M., Al-Qahtani, M. H., & Weaver, J. U. (2018). Proangiogenic Effect of Metformin in Endothelial Cells Is via Upregulation of VEGFR1/2 and Their Signaling under Hyperglycemia-Hypoxia. International Journal of Molecular Sciences, 19(1), 293. https://doi.org/10.3390/ijms19010293

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop