Next Article in Journal
Metabolomics of Breast Cancer: A Review
Next Article in Special Issue
Signatures of Mitochondrial Dysfunction and Impaired Fatty Acid Metabolism in Plasma of Patients with Post-Acute Sequelae of COVID-19 (PASC)
Previous Article in Journal
Special Issue on Metabolism and Metabolite Markers in Type 2 Diabetes
Previous Article in Special Issue
Human Serum Metabolites as Potential Mediators from Type 2 Diabetes and Obesity to COVID-19 Severity and Susceptibility: Evidence from Mendelian Randomization Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Persistence of Metabolomic Changes in Patients during Post-COVID Phase: A Prospective, Observational Study

1
Clinic of Internal Medicine-Gastroenterology, University Hospital in Martin, Jessenius Faculty of Medicine in Martin (JFM CU), Comenius University in Bratislava, 036 01 Martin, Slovakia
2
Biomedical Centre BioMed, Jessenius Faculty of Medicine in Martin (JFM CU), Comenius University in Bratislava, Mala Hora 4, 036 01 Martin, Slovakia
3
Clinic of Infectology and Travel Medicine, University Hospital in Martin, Jessenius Faculty of Medicine in Martin (JFM CU), Comenius University in Bratislava, 036 01 Martin, Slovakia
4
Clinic of Pneumology and Phthisiology, University Hospital in Martin, Jessenius Faculty of Medicine in Martin (JFM CU), Comenius University in Bratislava, 036 01 Martin, Slovakia
*
Author to whom correspondence should be addressed.
Metabolites 2022, 12(7), 641; https://doi.org/10.3390/metabo12070641
Submission received: 13 June 2022 / Revised: 7 July 2022 / Accepted: 10 July 2022 / Published: 13 July 2022
(This article belongs to the Special Issue COVIDomics: Metabolomic Views on COVID-19 and Related Diseases)

Abstract

:
Several relatively recently published studies have shown changes in plasma metabolites in various viral diseases such as Zika, Dengue, RSV or SARS-CoV-1. The aim of this study was to analyze the metabolome profile of patients during acute COVID-19 approximately one month after the acute infection and to compare these results with healthy (SARS-CoV-2-negative) controls. The metabolome analysis was performed by NMR spectroscopy from the peripheral blood of patients and controls. The blood samples were collected on 3 different occasions (at admission, during hospitalization and on control visit after discharge from the hospital). When comparing sample groups (based on the date of acquisition) to controls, there is an indicative shift in metabolomics features based on the time passed after the first sample was taken towards controls. Based on the random forest algorithm, there is a strong discriminatory predictive value between controls and different sample groups (AUC equals 1 for controls versus samples taken at admission, Mathew correlation coefficient equals 1). Significant metabolomic changes persist in patients more than a month after acute SARS-CoV-2 infection. The random forest algorithm shows very strong discrimination (almost ideal) when comparing metabolite levels of patients in two various stages of disease and during the recovery period compared to SARS-CoV-2-negative controls.

1. Introduction

In the last two decades, the metabolite profiling has been used to help understand pathophysiological processes in various diseases. Different biomolecules that form human metabolome may be affected by endogenous and exogenous factors, ultimately resulting in its dysregulation. Metabolic dysregulation is associated with a variety of diseases. Therefore, substantial research effort is focused on identifying promising biomarkers that could be useful for the diagnosis of different diseases or determination of their prognosis [1].
Recently published studies have shown changes in plasma metabolites in various viral diseases such as Zika, Dengue, RSV or SARS-CoV-1 [2,3,4]. Their occurrence in SARS-CoV-2 infection is therefore highly anticipated. Indeed, results of studies conducted so far are attributing importance to metabolomics status in COVID-19 patients in terms of early diagnosis, prognosis and prediction of the disease course [5,6]. Changes in the level of serum metabolites and lipidemic profile [7] in COVID-19 patients may reflect and reveal specific pathological processes that affect not only the lung tissue but entire organisms [8,9]. Despite some evidence that serum metabolite levels change during the acute SARS-CoV-2 infection, data describing their levels after the acute phase are scarce [10,11,12]. Therefore, the aim of this study was to analyze the metabolite profile of patients who suffered from a clinically moderate to serious course of COVID-19 approximately one month after the acute infection and to compare these results with healthy (SARS-CoV-2-negative) controls.

2. Results

Twenty-three metabolites and lipoprotein fraction were identified in denatured plasma in both patients and healthy subjects. Signals from 22 compounds were suitable for quantitative evaluation (Table S1). To obtain a complex look at the metabolomics data, we employed PCA analysis that processes multidimensional data into 2D visualization and PLS-DA analysis that includes also a discriminatory algorithm. For both algorithms, the relative concentrations of metabolites in blood plasma determined by NMR were used as input variables. We avoided feeding the algorithms with intensities of 0.05–0.01 ppm binned NMR spectra as it is common in the metabolomic studies, since there may be regions of NMR spectra marked by the algorithms as important that are not unambiguously related to one single metabolite and therefore may be more hardly associated with the biological relevance.
When comparing all sample groups together, both algorithms showed an indicative shift in metabolomics features from sample group A (samples taken within 24 h of admission) over sample group B (5–8 days after admission) and sample group C (average 42 days after admission) towards the controls (Figure 1), where the time distance between the A-group and controls was the longest and group C partially overlapped with the control group. The PCA and PLS-DA analyses of metabolomics data comparing patients in the acute phase of COVID-19 and controls was the subject of previous studies [5]. In this study, we focused on the binary comparison of the systems in post-COVID-19 patients (sampling C) against controls. Here, both algorithms showed that the separation of the groups is attainable, but not ideal (Figure 2). The calculated VIP scores from PLS-DA analysis for both showed that systems are included in Supplement S1.
The null hypothesis of equality of population medians among groups was tested by the non-parametrical Kruskal–Wallis test for multiple comparison with Dun’s post hoc test for pairwise comparison. Both tests are designed for non-normal distribution, which is assumed since the normality cannot be reliably tested in groups of size under 30. The results from statistical evaluation of metabolomics data are shown in Table 1, the corrected α using Bonferroni’s correction method was 0.008333 (threshold for p-value to be considered significant). Relative percentage changes were derived from medians. No significant changes among groups were observed for plasma lactate and lysine level.
One of the aims of the study was the evaluation of the classification power of the binary systems patients-controls. For this, we employed cross-validated random forest (RF) algorithm to obtain a more realistic estimation of the discriminatory power of the systems, since RF algorithm is known to be robust to outliers [13] and it does not tend to overfit the data in comparison to PLS-DA [13,14]. As input variables, relative concentrations of metabolites in blood plasma determined by NMR spectroscopy were used (lipoprotein fraction was omitted because of not meeting the criteria of metabolite). Results are summarized in Table 2, where we rated the performance after the area under curve (AUC) derived from the receiver operator characteristic curve (ROC), as recommended by Xia et al. [15]. Besides that, we used the Matthews correlation coefficient (MCC), calculated from the confusion matrix, that is, intuitive and straightforward: to get a high-quality score, the classifier has to make correct predictions both on the majority of the negative cases, and on the majority of the positive cases, independently of their ratios in the overall dataset [16].
With the increasing number of variables included in the algorithm, the discriminatory performance increased, as expected. Based on AUC values, the ideal discrimination with AUC equal to 1 was achieved for the system A-controls. Binary systems B-controls and C-controls were discriminated almost ideally with an AUC of 0.99, when evaluated by AUC value.
Matthew correlation coefficients revealed that the ideal discrimination is attainable only for the system A-controls, where MCC = 1. For systems B-controls and C-controls, MCC = 0.936 or 0.895, respectively revealed weaker, but still promising discrimination. After repeated RF runs, metabolites permuted in the importance order. Histidine appeared in all analyses as a metabolite with a very high discriminatory power. The subsequent analyses, where histidine was omitted, also achieved very high AUC (A, B, C vs. controls: 0.99, 0.94 and 0.96), implying that histidine plays a supporting but not key role for the RF performance. Very similarly, after omitting both, histidine and proline, high AUCs were achieved (A, B, C vs. controls: 0.98, 0.95, and 0.93). In other words, the discriminatory power of the system does not rely on one or two sole metabolites.

3. Discussion

One of the most known and prevalent factors influencing COVID-19 disease progression [17] is hyperglycemia. COVID-19 disease may cause prolonged uncontrolled elevated blood glucose level [18] due to COVID-19-induced insulin resistance [19] and COVID-19-impaired insulin production [20]. Contrary to COVID-19 non-survivors, patients with positive COVID-19 outcome showed the ability to normalize energy metabolism during the first week of hospitalization. [5]. The hyperglycemic condition in the first days of hospitalization could be, besides others, attributed to the treatment with dexamethasone. This synthetic glucocorticoid with anti-inflammatory properties impairs glucose metabolism via stimulation of hepatic gluconeogenesis from amino acids released from muscles and inhibition of glucose uptake [21]. It was observed that even a single dose of 10 mg dexamethasone could temporarily increase blood glucose level [22]. After the reduction of steroid doses, drug-induced diabetes is expected to resolve [23]. As expected, patients included in our study showed significantly increased plasma glucose level on the first day of sampling that decreased over time, but remained increased up to circa 20% against controls one month after hospital discharge. This indicates persistent alterations in the glucose metabolism. Decreased glucose utilization over the whole monitoring time was also supported by decreased plasma levels of glycolytic product pyruvate in COVID-19 patients (Figure 3). Increasing evidence suggests that pyruvate plays a crucial role as an immunonutritional factor for polymorphonuclears (PMN) and other white blood cells (WBC), e.g., granulocytes that are largely involved in the immune response regulation. According to the available clinical data and experience, the course of infection most often worsened within 7 days of the patient’s admission and was related to gradual development of inflammatory changes in lung tissue. We believe that the observed odd trend is related to the collection of sample B at the peak of the disease, when patients mobilize all reserves and cells of the immune system, with high demand for their nutrition and survival [24].
In times of impaired glycolysis, other energy substrates are expected to maintain body requirements. The switch to ketone bodies metabolism in time of insufficient glucose utilization is often observed in various stress conditions, as it was observed previously in COVID-19 patients during hospitalization [5]. The initial increase in ketone body 3-hydroxybutyrate on the first day suggested a ketotic-like state that was reduced over day 7, but still persisted to a small extent at a follow-up examination. Ketone bodies accumulation in COVID-19 patients may be related to a reduced hepatic capacity to oxidize acetyl-CoA in the mitochondria, which is then redirected to the synthesis of acetoacetic acid and 2-hydroxybutyric acid. In parallel with that, a plasma level of lipoprotein fraction consisting of more than 30% triacylglycerols showed a reverse time course to 3-hydroxybutyrate (Figure 3), as these are in a mutual relation of substrate-product, since the ketone bodies are produced predominantly from fatty acid oxidation-derived acetyl-CoA. Besides basal function as an energy source for the brain, heart and skeletal muscle, 3-hydroxybutyrate plays a key role as a signaling mediator [25], driver of protein post-translational modification [26], and modulator of inflammation, showing predominantly anti-inflammatory, but also pro-inflammatory, effects [27,28]. These and many other functions of 3-hydroxybutyrate make it an important agent in the acute as well as recovery phase in patients. We observed increased levels of succinate in samples A and C and no percentual change in sample B. Some hypotheses suggest that succinate has potent antiviral activity [25], thus the reduction in the level of succinate in sample B in our study may be explained by this activity during continuous severe infection.
In the post-COVID-19 phase, we observed the tendency of the plasma levels of several further metabolites to normalize towards the levels of controls. Glutamine serves, besides others, as a fuel for immune cells: lymphocytes, neutrophils, and macrophages [29] and plays a crucial role in the production of cytokines [30]. In an acute inflammatory condition, the demand for glutamine increases, and if the endogenous synthesis of glutamine does not fulfil the requirements of the body, this may lead to a decrease in its plasma levels. In our study, the plasma levels of glutamine restored relatively quickly after an initial decrease and remained unchanged in the post-COVID phase (Figure 3). In a previous study by Cengiz et al., the administration of glutamine in the early period of infection suggested a shortened hospital stay due to COVID-19 and decreased the need for ICU stay [31]. The patients included in our study were able to balance the level of glutamine in the blood relatively early, which could have contributed to their recovery.
The temporal changes of plasma levels of BCAAs including leucine, isoleucine and valine, together with their corresponding ketoacids (BCKAs), showed very similar pattern, namely, increase in the first hospitalization days that normalized towards the control levels during one month after hospital discharge (Figure 3, boxplot shown for leucine and ketoleucine). Their common biochemical pathways are manifested on the heatmap, where strong relations between BCAAs and BCKAs are shown (Supplement S3). BCAAs are closely connected to glucose metabolism, as they are (not causative) markers of a loss of insulin action [26], which supports the above-discussed findings. The observed significant increase in blood plasma levels of leucine, isoleucine and valine in the acute COVID-19 phase (A and B sampling) may indicate their restricted degradation that is controlled by a number of tissues, particularly by the muscles and liver. The BCAAs status also convey the ability of the organism to maintain the vital functions of protein synthesis and breakdown and BCAAs accumulation may signalize their limited utilization with the negative effect on protein expression. Besides that, there is an established association between the elevated circulating BCAAs and their deleterious effects, as their increased concentration may promote oxidative stress and inflammation [27], having also a neurological impact [28].
COVID-19 patients showed decreased histidine plasma levels in comparison to controls over the whole evaluation time. L-histidine, which cannot be synthetized de novo in humans and which is sourced mainly from the diet, exhibits antioxidant capabilities [32], and it is able to suppress the accumulation of IL-6 and TNF-α mRNA in a dose-dependent manner and could directly affect the regulation of pro-inflammatory cytokines [33]. In COVID-19 infection, cytokine storm is associated with the development of severe pneumonia requiring oxygen supplementation, which can finally lead to respiratory failure of the patient. Cytokine storm correlates mostly with the levels of pro-inflammatory cytokines, which are increased. This can explain such an odd trend in sample B, which was collected at the peak of the infection [34]. However, the immune response is known to be controlled also by histamine, an amine produced exclusively by histidine decarboxylation. The pleiotropic actions of histamine due to the different natures of its receptors allow to exert broad and oppose effects on the immune system, histamine balances important inflammatory reactions as well as immunomodulation [29]. Given the fact that both histidine and its main metabolic product histamine participate in immune processes, the exact biochemical mechanisms could be worthy of a deeper analysis and examination in the complex immune response.
Plasma levels of alanine were decreased only on the first sampling day, and later they increased towards controls. Alanine, together with BCAAs and glutamine, are a major part of inter-organ nitrogen shuttle. It could be suggested that, simultaneously with other processes, an insufficient utilization of BCAAs may lead to a reduced availability of amino groups needed for the synthesis of alanine and glutamine. Besides this, we observed a slightly increased creatinine level in COVID-19 patients in all sampling times, which may be linked to dehydration due to strong inflammation; however, impaired renal function cannot be excluded. Interestingly, this trend did not change over time and the patients in the post-acute phase showed a remaining increased level of blood creatinine. The metabolomics co-partner, creatine, was significantly increased only in one sampling time after one week of hospitalization. Patients forced to lie in bed for a substantial time period lacked spontaneous movement utilizing muscle energy, which is probably the reason for the increase of plasma creatine solely at this time point.
Perturbations in phenylalanine and tyrosine biosynthesis were recognized in SARS-CoV-2 positive patients previously by Barberis et al. [30]. In our study, we observed increased phenylalanine levels in COVID-19 patients during the hospital stay, but normalized levels in the later post-COVID phase. Besides being a proteinogenic amino acid, phenylalanine is irreversible hydroxylated to tyrosine in kidneys and liver and tyrosine is further used for catecholamine synthesis. In our work, we did not observe a tyrosine decrease in COVID-19 patients that would indicate primary impaired hydroxylation from phenylalanine, suggesting that the utilization of phenylalanine is restricted by other regulation mechanisms.
In summary, the metabolomics changes observed on the first day of sampling gradually subsided, where some metabolites reached the level of control, but some remained altered even 42 days (mean) after the first sampling. A limitation of this study could be a relatively small cohort of patients, although we tried to correct this by choosing a homogenous population. Another limitation is a rather long-range interval of sample C collection. This is due to different durations of hospitalization of the patients. From a clinical point of view, all patients on a clinical medical check-up during the collection of sample C presented the same spectrum of post-COVID recovery symptoms (slightly higher exhaustion after basic physical activity than before COVID, dyspnea after more intensive physical activity comparably worse than before COVID, no requirement of oxygen supplementation, no gastrointestinal or neurological symptoms). The homogeneity of the group is also further supported by standard biochemical and haematological examination, which does not show any relevant or statistically significant differences between patients.

Multivariate and Discriminatory Analyses

PCA as well as PLS-DA analyses (Figure 1 and Figure 2) both showed obvious differences between metabolomic data from patients in the COVID-acute phase (group A and B) and controls. Interestingly, a relative shift of metabolomics data from Group A over Group B and C towards controls can be well traced, visualizing the metabolomic recovery over time. The variables with the highest VIP score in PLS-DA were: lipoproteins, glucose, alanine and glutamine in A-B-C-controls comparison and lipoproteins, glutamine, alanine and leucine in the C-controls comparison. Given that the lipoprotein fraction, that scored as highest, cannot be considered as a metabolite, we omitted it in the next analyses when searching for the possibilities of correct classification.
The high potential of metabolomics in the field of biomarkers was already demonstrated by successful discrimination of COVID-19 patients in the acute phase against controls [5]. In this work, the employed RF algorithm used included cross-validation via balanced subsampling. It worked with two-thirds of the data for training and the rest for testing for regression, and about 70% of the data for training and the rest for testing during classification to overcome the negative aspects of training and testing on the same data. This approach partially substitutes the validation on an independent dataset; however, it cannot fully replace the clinical validation. We used relative concentrations of metabolites in plasma expressed by the spectral integrals of particular NMR regions as input variables for RF algorithm. In the case of highly correlating predictors, RF may label some of them as unimportant, so RF was ran ten times. Within the RF re-runs, metabolites permuted in the importance order a little.
In our study, massive metabolomics changes in acute COVID-19 resulted in the ideal discrimination for binary system Group A-controls (AUC = 1, MCC = 1) and slightly weaker, but still very promising discrimination, for the system B-controls (AUC = 0.992, MCC = 0.936) (Table 2, Figure 4). The post-COVID metabolomics changes and related discriminations are less known. In this study, we show that the persisting metabolomics alterations in the post-COVID phase are strong enough to discriminate post-COVID patients from controls with very high specificity and sensitivity; in our patients group achieving AUC = 0.991. Although the AUC parameter indicates that the lastly mentioned binary system can be separated almost ideally, it obtained an out-of-bag error of 3/62 results to an error of correct classification of 5%. The further parameter, the proportion of the correct predictions among the total number of cases examined, achieved averaged accuracy, which for this system equaled 0.932. The last parameter expressing the classification performance was MCC (a coefficient of 1 would represent perfect, and of 0 random prediction), which showed an encouraging value of 0.895, but not ideal results.
In some patients, post-acute sequelae of SARS-CoV-2 infection may persist for a long time, with significant consequences for their further quality of life. Understanding the pathophysiological processes at the enzymatic level, which individually take place not only in the acute phase of infectious diseases, but also in the stage of convalescence, appears to be an important milestone for the future. Metabolomics may contribute to a better understanding of these processes in the future, which may ultimately benefit the patient.

4. Materials and Methods

The study was performed from November 2021 until February 2022. Twenty-five (25) patients were enrolled in the study. All participants signed the informed consent. The study was approved by the Ethical Committee of the Jessenius Faculty of Medicine in Martin, Comenius University, Slovakia (Certification code at the US Office for Human Research Protection, US Department of Health and Human Services: IRB00005636 Jessenius Faculty of Medicine, Comenius University in Martin IRB # 1) with identification number: EK 65/2021. Every patient enrolled in the study had SARS-CoV-2 infection confirmed by a polymerase chain reaction (PCR). The study focused on patients with typical SARS-CoV-2 infection symptoms (fever, cough and dyspnea) in order to achieve a high level of homogeneity (in the means of the COVID-19 presentation) within the cohort. Therefore, only hospitalized patients with a severe course of COVID-19, requiring oxygen supplementation but not invasive artificial pulmonary ventilation [31], (based on the National Institutes of Health/NIH/criteria) with X-ray or CT confirmed pneumonia were considered for the study. The characterization of the patient group is shown in Table 3. Only patients with compensated chronical diseases were considered for the study. Exclusion criteria were age under 18 years, pregnancy and unwillingness or incapability to sign the informed consent. Blood samples from age-matched 37 subjectively healthy volunteers from our internal biobank, age 51 ± 16 yrs (female/male = 12/25), sampled before the COVID pandemic (in the years 2018–2019), were used as controls.
Peripheral blood was used for the analysis. Blood samples were collected at aseptic conditions on 3 occasions. Each time, two 10 mL EDTA (Ethylenediamin tetra-acetic acid) collection tubes were used. The first sample (Sample A) was taken within 24 h of admission to the hospital. The second sample (Sample B) was taken on days 5–8 (based on the course of the hospitalization, e.g., early discharge would lead to a shorter interval between Samples A and B) and the third sample (Sample C) was taken 42 days (29–54 days) after the first sample. Blood for standard biochemical and hematological analysis was obtained during every sample-taking occasion (A, B, C), Table 4.
The groups of samples were labeled Group A, Group B and Group C based on the sample labeling (A, B or C) for further analysis.

4.1. Sample Preparation

Blood was collected in EDTA-coated tubes, centrifuged at 4 °C, 2000 rpm (380× g-force), for 20 min. Plasma was deproteinized according to Gowda et al. [35]. The mixture obtained after adding 600 μL of methanol to 300 μL of plasma was shortly vortexed and stored at −20 °C for 20 min. After centrifugation at 14,000 rpm (14,800× g-force), 700 μL of supernatant were dried out. Before measurement, the dried matter was carefully mixed with 100 μL of stock solution and 500 μL of deuterated water. Then, 550 μL of final mixture were transferred into 5 mm NMR tube. Stock solution consisted of: 100 mM phosphate buffer (pH-meter reading 7.40) and 0.30 mM TSP-d4 (3-(trimethylsilyl)-propionic-2,2,3,3-d4 acid sodium salt) as a chemical shift reference in deuterated water.

4.2. NMR Data Acquisition

NMR (Nuclear Magnetic Resonance) data were acquired on a 600 MHz NMR spectrometer Avance III from Bruker equipped with TCI (triple resonance) cryoprobe. Initial settings were done on an independent sample and adopted for measurements. Samples were stored in Sample Jet at approximately 6 °C before measurement for a maximum of 2 h. We used standard Bruker profiling protocols that we modified as follows: profiling 1D NOESY with presaturation (noesygppr1d): FID size 64k, dummy scans 4, number of scans 128, spectral width 20.4750 ppm; COSY with presaturation was acquired for randomly chosen 20 samples (cosygpprqf): FID size 4k, dummy scans 8, number of scans 1, spectral width 16.0125 ppm; homonuclear J-resolved (jresgpprqf): FID size 8k, dummy scans 16, number of scans 4; profiling CPMG with presaturation (cpmgpr1d, L4 = 126, d20 = 3 ms): FID size 64k, dummy scans 4, number of scans 128, spectral width 20.0156 ppm. All experiments were conducted with a relaxation delay of 4 s; all data were once zero-filled. An exponential noise filter was used to introduce 0.3 Hz line broadening before Fourier transform. Samples were measured at 310 K and randomly ordered for acquisition.

4.3. Data Analysis

Spectra were solved using internal metabolite database, online human metabolome database (www.hmdb.ca) [36], chenomx software free trial version and literature [35]. For all compounds, the multiplicity of peaks was confirmed in J-resolved spectra, homonuclear cross peaks were confirmed in cosy spectra (Table S1). A chemical shift of 0.000 ppm was assigned to TSP-d4 signal. All spectra were binned to bins of the size of 0.001 ppm, starting from 0.500 ppm to 9.500 ppm, with excluded water region 4.6–4.9 ppm and EDTA region 3.07–3.62 and 3.6–3.62 ppm. No normalization method was applied on NMR data, as we took exactly the same amount of blood plasma from all samples. In 0.001 ppm binned spectra, we summed bin intensities expressing the integrals of signals in the spectra subregions without overlapping peaks, i.e., assigned to sole particular metabolites. These values were used as a relative concentration of metabolites in blood plasma. Metabolites not having appropriate signals for the quantitative evaluation, or if their peak assignment was not unambiguous, were excluded from further processing. The NMR spectra of patients in various sampling times and controls are shown in Supplement S2.
The null hypothesis of equality of population medians among groups was tested by the non-parametric Kruskal–Wallis test with Dun’s post hoc test for pairwise comparison. Principal component analysis (PCA) and the receiver operating characteristic curves (ROC) derived from random forest (RF) algorithm were performed using Metaboanalyst [37].
Note: In this work, we use common labelling BCAAs for branched-chain amino acids: leucine, isoleucine and valine, and BCKAs for their 2-oxoderivates, branched-chain keto acids: ketoleucine (2-oxoisocaproate), ketosioleucine (3-methyl-2-oxopentanonate) and ketovaline (2-oxoisovalerate), as well as mentioned trivial names of BCKAs that better evoke their origin.

5. Conclusions

Significant metabolomic changes persist in patients more than a month after acute SARS-CoV-2 infection based on the presented data. This is predominantly defined by increased plasma levels of glucose and 3-hydroxybutyrate and decreased plasma level of acetate and histidine with normalization of BCAAs and BCKAs. Random forest algorithm is showing very strong discrimination (almost ideal) obtained when comparing metabolite levels of patients in 2 various stages of disease and during the recovery period compared to SARS-CoV-2-negative controls. It is therefore possible to conclude, that, based on our data, patients with moderate-to-serious course of COVID-19 approximately one month after acute infection are not fully recovered and it is possible to identify these patients based on metabolomic profile with 95% specificity and 95% sensitivity when compared to healthy (SARS-CoV-2-negative controls).

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/metabo12070641/s1. Table S1: Chemical shifts, J couplings and multiplicities for the pool of metabolites identified in blood plasma, Supplement S1: PLS-DA VIP scores for the top 15 most important metabolites (including lipoprotein fraction not meeting the criteria of metabolite), Supplement S2: NMR spectra–regions for the most interesting metabolites, Supplement S3: Correlation heatmap for the relative concentrations of plasma metabolites, including data from patients in sampling poins A, B, C) and controls, evaluated by Pearsons’correlation.

Author Contributions

Conceptualization P.L.; methodology P.L., E.B., R.R. and P.B.; investigation P.L., E.B., R.R., A.B., R.V., Z.D., A.K., D.D., M.D., K.S.; data curation and formal analysis E.B.; writing—original draft preparation, P.L., E.B., R.R.; writing—review and editing, Z.D., E.H.; funding acquisition E.H., P.B.; supervision P.B. All authors have read and agreed to the published version of the manuscript.

Funding

This publication was produced with the support of the Integrated Infrastructure Operational Program for the project: New possibilities for laboratory diagnostics and massive screening of SARS-CoV-2 and identification of mechanisms of virus behaviour in human body, ITMS: 313011AUA4, co-financed by the European Regional Development Fund. This publication has been produced with the support of the Integrated Infrastructure Operational Program for the project: Research and development of a telemedicine system to support the monitoring of a possible spread of COVID-19 in order to develop analytical tools used to reduce the risk of infection, ITMS: 313011ASX4, co-financed by the European Regional Development Fund.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of Jessenius Faculty of Medicine in Martin, Comenius University, Slovakia (Certification code at the US Office for Human Research Protection, US Department of Health and Human Services: IRB00005636 Jessenius Faculty of Medicine, Comenius University in Martin IRB # 1) (protocol code EK 65/2021, date of approval: 22 November 20221) for studies involving humans.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data including raw and evaluated NMR spectra are available on request: [email protected].

Acknowledgments

The authors would like to acknowledge the support of Andrea Duchajová, Katarína Dirnbachová and Martin Petráš from the Biomedical Center Martin-Jessenius Faculty of Medicine in Martin for the sample collection and transport. We would like to thank the medical staff from the COVID-dedicated department (Department 3/2), Clinic of Pneumology and Phthisiology and Clinic of Infectology and Travel Medicine, Martin University Hospital, Slovakia, for their helpfulness during sample collection.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hasan, M.R.; Suleiman, M.; Pérez-López, A. Metabolomics in the Diagnosis and Prognosis of COVID-19. Front. Genet. 2021, 12, 1358. [Google Scholar] [CrossRef] [PubMed]
  2. Wu, Q.; Zhou, L.; Sun, X.; Yan, Z.; Hu, C.; Wu, J.; Xu, L.; Li, X.; Liu, H.; Yin, P.; et al. Altered Lipid Metabolism in Recovered SARS Patients Twelve Years after Infection. Sci. Rep. 2017, 7, 9110. [Google Scholar] [CrossRef] [PubMed]
  3. Byers, N.; Fleshman, A.; Perera, R.; Molins, C. Metabolomic Insights into Human Arboviral Infections: Dengue, Chikungunya, and Zika Viruses. Viruses 2019, 11, 225. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Fujiogi, M.; Camargo, C.A., Jr.; Raita, Y.; Bochkov, Y.A.; Gern, J.E.; Mansbach, J.M.; Piedra, P.A.; Hasegawa, K. Respiratory viruses are associated with serum metabolome among infants hospitalized for bronchiolitis: A multicenter study. Pediatr. Allergy Immunol. 2020, 31, 755–766. [Google Scholar] [CrossRef] [PubMed]
  5. Baranovicova, E.; Bobcakova, A.; Vysehradsky, R.; Dankova, Z.; Halasova, E.; Nosal, V.; Lehotsky, J. The Ability to Normalise Energy Metabolism in Advanced COVID-19 Disease Seems to Be One of the Key Factors Determining the Disease Progression—A Metabolomic NMR Study on Blood Plasma. Appl. Sci. 2021, 11, 4231. [Google Scholar] [CrossRef]
  6. Jia, H.; Liu, C.; Li, D.; Huang, Q.; Liu, D.; Zhang, Y.; Ye, C.; Zhou, D.; Wang, Y.; Tan, Y.; et al. Metabolomic analyses reveal new stage-specific features of COVID-19. Eur. Respir. J. 2021, 59, 2100284. [Google Scholar] [CrossRef]
  7. Wu, D.; Shu, T.; Yang, X.; Song, J.-X.; Zhang, M.; Yao, C.; Liu, W.; Huang, M.; Yu, Y.; Yang, Q.; et al. Plasma metabolomic and lipidomic alterations associated with COVID-19. Natl. Sci. Rev. 2020, 7, 1157–1168. [Google Scholar] [CrossRef]
  8. Danlos, F.-X.; Grajeda-Iglesias, C.; Durand, S.; Sauvat, A.; Roumier, M.; Cantin, D.; Colomba, E.; Rohmer, J.; Pommeret, F.; Baciarello, G.; et al. Metabolomic analyses of COVID-19 patients unravel stage-dependent and prognostic biomarkers. Cell Death Dis. 2021, 12, 258. [Google Scholar] [CrossRef]
  9. Shi, D.; Yan, R.; Lv, L.; Jiang, H.; Lu, Y.; Sheng, J.; Xie, J.; Wu, W.; Xia, J.; Xu, K.; et al. The serum metabolome of COVID-19 patients is distinctive and predictive. Metabolism 2021, 118, 154739. [Google Scholar] [CrossRef]
  10. Zhang, S.; Luo, P.; Xu, J.; Yang, L.; Ma, P.; Tan, X.; Chen, Q.; Zhou, M.; Song, S.; Xia, H.; et al. Plasma Metabolomic Profiles in Recovered COVID-19 Patients without Previous Underlying Diseases 3 Months after Discharge. J. Inflamm. Res. 2021, 14, 4485–4501. [Google Scholar] [CrossRef]
  11. Valdés, A.; Moreno, L.O.; Rello, S.R.; Orduña, A.; Bernardo, D.; Cifuentes, A. Metabolomics study of COVID-19 patients in four different clinical stages. Sci. Rep. 2022, 12, 1650. [Google Scholar] [CrossRef] [PubMed]
  12. Xu, J.; Zhou, M.; Luo, P.; Yin, Z.; Wang, S.; Liao, T.; Yang, F.; Wang, Z.; Yang, D.; Peng, Y.; et al. Plasma Metabolomic Profiling of Patients Recovered From Coronavirus Disease 2019 (COVID-19) with Pulmonary Sequelae 3 Months after Discharge. Clin. Infect. Dis. 2021, 73, 2228–2239. [Google Scholar] [CrossRef] [PubMed]
  13. Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Green Version]
  14. Rodríguez-Pérez, R.; Fernández, L.; Marco, S. Overoptimism in cross-validation when using partial least squares-discriminant analysis for omics data: A systematic study. Anal. Bioanal. Chem. 2018, 410, 5981–5992. [Google Scholar] [CrossRef] [PubMed]
  15. Xia, J.; Broadhurst, D.; Wilson, M.; Wishart, D.S. Translational biomarker discovery in clinical metabolomics: An introductory tutorial. Metabolomics 2012, 9, 280–299. [Google Scholar] [CrossRef] [Green Version]
  16. Chicco, D.; Tötsch, N.; Jurman, G. The matthews correlation coefficient (Mcc) is more reliable than balanced accuracy, bookmaker informedness, and markedness in two-class confusion matrix evaluation. BioData Min. 2021, 14, 1–22. [Google Scholar] [CrossRef]
  17. Erener, S. Diabetes, infection risk and COVID-19. Mol. Metab. 2020, 39, 101044. [Google Scholar] [CrossRef]
  18. Al-Kuraishy, H.M.; Al-Gareeb, A.I.; Alblihed, M.; Guerreiro, S.G.; Cruz-Martins, N.; Batiha, G.E.-S. COVID-19 in Relation to Hyperglycemia and Diabetes Mellitus. Front. Cardiovasc. Med. 2021, 8, 644095. [Google Scholar] [CrossRef]
  19. He, X.; Liu, C.; Peng, J.; Li, Z.; Li, F.; Wang, J.; Hu, A.; Peng, M.; Huang, K.; Fan, D.; et al. COVID-19 induces new-onset insulin resistance and lipid metabolic dysregulation via regulation of secreted metabolic factors. Signal Transduct. Target. Ther. 2021, 6, 427. [Google Scholar] [CrossRef]
  20. Rayman, G.; Lumb, A.; Kennon, B.; Cottrell, C.; Nagi, D.; Page, E.; Voigt, D.; Courtney, H.C.; Atkins, H.; Higgins, K.; et al. Dexamethasone therapy in COVID-19 patients: Implications and guidance for the management of blood glucose in people with and without diabetes. Diabet. Med. 2020, 38, e14378. [Google Scholar] [CrossRef]
  21. Kuo, T.; McQueen, A.; Chen, T.-C.; Wang, J.-C. Regulation of Glucose Homeostasis by Glucocorticoids. Adv. Exp. Med. 2015, 872, 99–126. [Google Scholar]
  22. Pasternak, J.J.; McGregor, D.G.; Lanier, W.L. Effect of Single-Dose Dexamethasone on Blood Glucose Concentration in Patients Undergoing Craniotomy. J. Neurosurg. Anesthesiol. 2004, 16, 122–125. [Google Scholar] [CrossRef] [PubMed]
  23. Tamez-Pérez, H.E.; Quintanilla-Flores, D.L.; Rodríguez-Gutiérrez, R.; González-González, J.G.; Tamez-Peña, A.L. Steroid hyperglycemia: Prevalence, early detection and therapeutic recommendations: A narrative review. World J. Diabetes 2015, 6, 1073–1081. [Google Scholar] [CrossRef]
  24. Mathioudakis, D.; Engel, J.; Welters, I.D.; Dehne, M.G.; Matejec, R.; Harbach, H.; Henrich, M.; Schwandner, T.; Fuchs, M.; Weismüller, K.; et al. Pyruvate: Immunonutritional effects on neutrophil intracellular amino or alpha-keto acid profiles and reactive oxygen species production. Amino Acids 2010, 40, 1077–1090. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Guillon, A.; Brea-Diakite, D.; Cezard, A.; Wacquiez, A.; Baranek, T.; Bourgeais, J.; Picou, F.; Vasseur, V.; Meyer, L.; Chevalier, C.; et al. Host succinate inhibits influenza virus infection through succinylation and nuclear retention of the viral nucleoprotein. EMBO J. 2022, 41, e108306. [Google Scholar] [CrossRef]
  26. Yoon, M.-S. The Emerging Role of Branched-Chain Amino Acids in Insulin Resistance and Metabolism. Nutrients 2016, 8, 405. [Google Scholar] [CrossRef] [Green Version]
  27. Zhenyukh, O.; González-Amor, M.; Díez, R.R.; Esteban, V.; Ruiz-Ortega, M.; Salaices, M.; Mas, S.; Briones, A.M.; Egido, J. Branched-chain amino acids promote endothelial dysfunction through increased reactive oxygen species generation and inflammation. J. Cell. Mol. Med. 2018, 22, 4948–4962. [Google Scholar] [CrossRef]
  28. Fernstrom, J.D. Branched-Chain Amino Acids and Brain Function. J. Nutr. 2005, 135, 1539S–1546S. [Google Scholar] [CrossRef]
  29. Branco, A.C.C.C.; Yoshikawa, F.S.Y.; Pietrobon, A.J.; Sato, M.N. Role of Histamine in Modulating the Immune Response and Inflammation. Mediat. Inflamm. 2018, 2018, 9524075. [Google Scholar] [CrossRef]
  30. Barberis, E.; Timo, S.; Amede, E.; Vanella, V.V.; Puricelli, C.; Cappellano, G.; Raineri, D.; Cittone, M.G.; Rizzi, E.; Pedrinelli, A.R.; et al. Large-Scale Plasma Analysis Revealed New Mechanisms and Molecules Associated with the Host Response to SARS-CoV-2. Int. J. Mol. Sci. 2020, 21, 8623. [Google Scholar] [CrossRef]
  31. National Institutes of Health. COVID-19 Treatment Guidelines. 2021. Available online: https://www.covid19treatmentguidelines.nih.gov (accessed on 13 March 2022).
  32. Holeček, M. Histidine in Health and Disease: Metabolism, Physiological Importance, and Use as a Supplement. Nutrients 2020, 12, 848. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Liu, W.-H.; Liu, T.-C.; Yin, M.-C. Beneficial effects of histidine and carnosine on ethanol-induced chronic liver injury. Food Chem. Toxicol. 2008, 46, 1503–1509. [Google Scholar] [CrossRef] [PubMed]
  34. Lee, Y.-T.; Hsu, C.-C.; Lin, M.-H.; Liu, K.-S.; Yin, M.-C. Histidine and carnosine delay diabetic deterioration in mice and protect human low density lipoprotein against oxidation and glycation. Eur. J. Pharmacol. 2005, 513, 145–150. [Google Scholar] [CrossRef] [PubMed]
  35. Gowda, G.A.N.; Gowda, Y.N.; Raftery, D. Expanding the Limits of Human Blood Metabolite Quantitation Using NMR Spectroscopy. Anal. Chem. 2014, 87, 706–715. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Wishart, D.S.; Feunang, Y.D.; Marcu, A.; Guo, A.C.; Liang, K.; Vázquez-Fresno, R.; Sajed, T.; Johnson, D.; Li, C.; Karu, N.; et al. HMDB 4.0: The human metabolome database for 2018. Nucleic Acids Res. 2018, 46, D608–D617. [Google Scholar] [CrossRef]
  37. Pang, Z.; Chong, J.; Zhou, G.; de Lima Morais, D.A.; Chang, L.; Barrette, M.; Gauthier, C.; Jacques, P.-É.; Li, S.; Xia, J. MetaboAnalyst 5.0: Narrowing the gap between raw spectra and functional insights. Nucleic Acids Res. 2021, 49, W388–W396. [Google Scholar] [CrossRef]
Figure 1. PCA (left) and PLS–DA (right) analysis of patients with COVID–19 disease at three various sampling times in patients and controls, the relative concentrations of metabolites in blood plasma were used as input variables.
Figure 1. PCA (left) and PLS–DA (right) analysis of patients with COVID–19 disease at three various sampling times in patients and controls, the relative concentrations of metabolites in blood plasma were used as input variables.
Metabolites 12 00641 g001
Figure 2. PCA (left) and PLS–DA (right) analysis of patients with COVID–19 disease at sampling time C in average 42 days after hospitalization in patients and controls, the relative concentrations of metabolites in blood plasma were used as input variables.
Figure 2. PCA (left) and PLS–DA (right) analysis of patients with COVID–19 disease at sampling time C in average 42 days after hospitalization in patients and controls, the relative concentrations of metabolites in blood plasma were used as input variables.
Metabolites 12 00641 g002
Figure 3. Relative concentrations of plasma metabolites in patients in three various sampling times and controls, values related to median of controls set to 1.
Figure 3. Relative concentrations of plasma metabolites in patients in three various sampling times and controls, values related to median of controls set to 1.
Metabolites 12 00641 g003
Figure 4. ROC curves derived from random forest discriminatory analysis for binary systems: patients in various sampling times versus controls: A-First day of hospital admission, B-In average 7 days after hospital admission. C-In average 42 days after hospital admission, relative concentrations of plasma metabolites were used as input variables. All evaluated metabolites were used as input variables; more details in Table 2.
Figure 4. ROC curves derived from random forest discriminatory analysis for binary systems: patients in various sampling times versus controls: A-First day of hospital admission, B-In average 7 days after hospital admission. C-In average 42 days after hospital admission, relative concentrations of plasma metabolites were used as input variables. All evaluated metabolites were used as input variables; more details in Table 2.
Metabolites 12 00641 g004
Table 1. Statistical evaluation based on the Kruskal–Wallis test for multiple comparison and post hoc Dun’s tests for pairwise comparison, percentual change derived from medians, algorithms used relative concentrations of metabolites in blood plasma.
Table 1. Statistical evaluation based on the Kruskal–Wallis test for multiple comparison and post hoc Dun’s tests for pairwise comparison, percentual change derived from medians, algorithms used relative concentrations of metabolites in blood plasma.
Kruskal–WallisA-ControlsB-ControlsC-Controls
p Valuep Value% Change p Value% Change p Value% Change
alanine 0.00710.0031−150.85x0.71x
valine0.000820.00099150.00051160.012x
glucose0.000116.3 × 10−6540.20210.1526
leucine8.4 × 10−79.6 × 10−7370.00077150.63x
isoleucine 2.6 × 10−72.6 × 10−8320.00029210.001617
acetate0.00000920.00037−252.5 × 10−5−285.2 × 10−5−28
pyruvate0.0000204.4 × 10−6−280.0066−160.00049−26
citrate6.4 × 10−100.041x0.00030−260.0007821
phenylalanine1.1 × 10−142.4 × 10−9777.6 × 10−8490.40x
tyrosine0.0000510.042x6.1 × 10−6220.52x
glutamine0.00890.024−150.24x0.17x
lipoproteins1.1 × 10−161.4 × 10−13−751.9 × 10−13−770.00014−54
ketoleucine0.000363.0 × 10−5290.37x0.060x
ketoisoleucine0.000256.5 × 10−5370.059x0.001119
ketovaline0.0430.0057200.11x0.090x
3-hydroxy-butyrate1.6 × 10−129.3 × 10−142618.4 × 10−6340.001024
creatine0.00280.82x0.00067250.81x
creatinine0.00250.0040390.052x0.0006622
histidine4.0 × 10−105.8 × 10−10−290.00026−152.8 × 10−7−26
succinate0.00130.0083280.023x0.0002048
proline3.3 × 10−88.6 × 10−9−300.00018−220.14x
Table 2. Result from RF discriminatory analyses of binary systems patients-controls, AUC values derived from ROC curve, MCC–Matthews correlation coefficient.
Table 2. Result from RF discriminatory analyses of binary systems patients-controls, AUC values derived from ROC curve, MCC–Matthews correlation coefficient.
SystemFeaturesOob Error (Based on Predicted Class Probabilities)Average Accuracy Based on 100 Cross-ValidationsAUCMCC
A-control3 most important metabolites: histidine, proline, 3-hydroxybutyrate00.99911
5 most important metabolites: histidine, proline, 3-hydroxyburtyrate, acetate, citrate00.99911
all evaluated metabolites0111
B-control3 most important metabolites: histidine, proline, 3-hydroxybutyrate5/620.8840.9660.839
5 most important metabolites: histidine, proline, 3-hydroxyburtyrate, pyruvate, citrate5/620.9230.9810.839
all evaluated metabolites2/620.9480.9920.936
C-control3 most important metabolites: histidine, glucose, pyruvate5/620.9290.9690.829
5 most important metabolites: histidine, glucose, pyruvate, phenylalanine, glutamine5/620.9290.9870.829
all evaluated metabolites3/620.9320.9910.895
Table 3. Characteristics of patients enrolled in the study.
Table 3. Characteristics of patients enrolled in the study.
Median (IQR)
Patients n = 25
Age [years]58 (21)
Sex: Female/Male7/18
Weight [kg]82.6 (26)
Height [cm]171 (8)
BMI29 (9)
Chronic liver disease3
Chronic kidney disease3
Ischemic cardiac disease3
Diabetes Mellitus 3
Thyroidal disease 4
Rheumatic disease 0
Other relevantNA
Table 4. Standard biochemical and hematological results of patients at the sampling times, median (IQR).
Table 4. Standard biochemical and hematological results of patients at the sampling times, median (IQR).
Samples ASamples BSamples Cp Value (Multiple Comparison)
Na133.32 (5.5)140 (6)139.4 (3.0)<0.001
K3.972 (0.6)4.2 (0.65)4.2 (0.45)0.017
Cl99.48 (6.0)104 (6)104 (3.0)<0.001
Glucose8.068 (1.35)5.8 (3.05)5.6 (1.5)0.0021
Cretinine83 (38.5)60 (22.5) one missing68 (32.5)0.32
CRP116.5 (123.4)16.6 (31.45) one missing2.2 (4.55)<0.001
AST1.2604 (0.68)0.92 (1.13) eight missing0.508 (0.285) one missing<0.001
ALT1.0365 (0.715) one missing1.465 (1.325) nine missing0.575 (0.49) one missing<0.01
GMT1.6815 (1.715) five missing1.47 (2.48) three missing0.815 (1.08) one missing0.037
Bilirubin10.7 (5.85)11.4 (6.65) eight missing9.6 (6.3) one missing0.41
Leukocytes6.7 (3.05)7.7 (3.75) one missing8.2 (2.5)0.029
Hemoglobine [g/l]142 (13)135.5 (18.5) one missing138 (13.5)0.16
Platelets count190 (162.5)360.5 (215.5) one missing259 (133)<0.01
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Liptak, P.; Baranovicova, E.; Rosolanka, R.; Simekova, K.; Bobcakova, A.; Vysehradsky, R.; Duricek, M.; Dankova, Z.; Kapinova, A.; Dvorska, D.; et al. Persistence of Metabolomic Changes in Patients during Post-COVID Phase: A Prospective, Observational Study. Metabolites 2022, 12, 641. https://doi.org/10.3390/metabo12070641

AMA Style

Liptak P, Baranovicova E, Rosolanka R, Simekova K, Bobcakova A, Vysehradsky R, Duricek M, Dankova Z, Kapinova A, Dvorska D, et al. Persistence of Metabolomic Changes in Patients during Post-COVID Phase: A Prospective, Observational Study. Metabolites. 2022; 12(7):641. https://doi.org/10.3390/metabo12070641

Chicago/Turabian Style

Liptak, Peter, Eva Baranovicova, Robert Rosolanka, Katarina Simekova, Anna Bobcakova, Robert Vysehradsky, Martin Duricek, Zuzana Dankova, Andrea Kapinova, Dana Dvorska, and et al. 2022. "Persistence of Metabolomic Changes in Patients during Post-COVID Phase: A Prospective, Observational Study" Metabolites 12, no. 7: 641. https://doi.org/10.3390/metabo12070641

APA Style

Liptak, P., Baranovicova, E., Rosolanka, R., Simekova, K., Bobcakova, A., Vysehradsky, R., Duricek, M., Dankova, Z., Kapinova, A., Dvorska, D., Halasova, E., & Banovcin, P. (2022). Persistence of Metabolomic Changes in Patients during Post-COVID Phase: A Prospective, Observational Study. Metabolites, 12(7), 641. https://doi.org/10.3390/metabo12070641

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop