Next Article in Journal
Detection and Classification of Saffron Adulterants by Vis-Nir Imaging, Chemical Analysis, and Soft Computing
Previous Article in Journal
Application of Physical-Chemical Approaches for Encapsulation of Active Substances in Pharmaceutical and Food Industries
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluation of Body Changes and the Anti-Obesity Effect after Consumption of Korean Fermented Food, Cheonggukjang: Randomized, Double-Blind Clinical Trial

1
Department of Family Medicine, Wonkwang University Hospital, Iksan 54538, Republic of Korea
2
Microbial Institute for Fermentation Industry, Sunchang 56048, Republic of Korea
3
Department of Family Medicine, Wonkwang University Sanbon Hospital, Sanbon 15865, Republic of Korea
*
Author to whom correspondence should be addressed.
Foods 2023, 12(11), 2190; https://doi.org/10.3390/foods12112190
Submission received: 23 March 2023 / Revised: 13 May 2023 / Accepted: 23 May 2023 / Published: 30 May 2023
(This article belongs to the Section Food Quality and Safety)

Abstract

:
Cheonggukjang is a traditional Korean fermented soybean food with potential health benefits. For this reason, Cheonggukjang is consumed in the form of pills in addition to being used as a food ingredient. There are few clinical studies that have evaluated changes in various health indicators through blood and stool tests before and after consumption of Cheonggukjang. In this study, symptoms and hematological changes were analyzed before and after the intake of traditional Cheonggukjang pills containing high-dose (n = 19) or low-dose (n = 20) beneficial bacteria and commercial Cheonggukjang pills (n = 20). Anti-obesity effects and body composition changes were determined before and after Cheonggukjang consumption. Lastly, the changes in microorganisms and short-chain fatty acids in the stool were compared. No changes in obesity and inflammation-related indicators were observed before and after Cheonggukjang consumption. The Firmicutes/Bacteroidetes ratio, associated with obesity, decreased in all three groups after Cheonggukjang consumption, but no statistical significance was indicated. Cheonggukjang contained various BAs, but they did not adversely affect symptoms and hematological changes in the participants. BAs generated during the manufacturing process of Cheonggukjang did not have any adverse effects in this randomized, double-blind clinical trial. Further research is needed in future concerning the anti-obesity effect or regarding changes in the microbiome and short-chain fatty acids in feces.

1. Introduction

Soybeans are a food with high nutritional value, containing many vitamins and minerals [1]; they are used as a dietary source of nutrition in daily life in Asian countries, including Korea [2]. Cheonggukjang is a traditional Korean fermented food made from soybeans and is a nutritionally vital functional food because it contains essential amino acids, fatty acids, organic acids, minerals, and vitamins [2]. Cheonggukjang belongs to a family of traditional sauces, including soy sauce, soybean paste, and red pepper paste.
The aging of Cheonggukjang involves a fermentation process using microorganisms, and strains of the genus Bacillus, such as Bacillus subtilis, Bacillus licheniformis, and Bacillus megaterium, used alone [3,4,5], or two strains are mixed [6]. During fermentation, Bacillus spp. break down the proteins and other nutrients in soybeans, producing a variety of compounds, including a sticky mucus-like substance. The mucus-like substance produced during Cheonggukjang fermentation is a complex mixture of various compounds, including levan and polyglutamate. However, harmful substances, such as biogenic amines (BAs), can be produced during fermentation. BAs are low-molecular-weight compounds produced by the amination and transamination reactions of aldehydes and ketones [7]. BAs are in the form of aliphatic (putrescine (PUT), cadaverine (CAD), spermine, spermidine (SPD)), aromatic (tyramine (TYR), phenylethylamine), and heterocyclic structures (histamine (HIS), tryptamine) [8]. BAs are an essential substance for maintaining the physiological function of the human body and are balanced in trace amounts through metabolic processes; however, BAs generated during the manufacturing process of food sometimes affect the human body. In particular, in soybean- or milk-containing foods with a high amino acid and protein content, BAs that exceed the digestion limit of the human body may be generated during the fermentation process. These BAs are continuously detected in various fermented foods, including Cheonggukjang, and can cause nervous and vascular system abnormalities in the human body. HIS can cause food poisoning, and some BAs can be converted into carcinogens such as N-nitrosamine [8]. Excessive HIS intake can lower blood pressure and cause allergies, TYR can increase blood pressure and cause headaches, and CAD and PUT can produce potent carcinogens, including nitrosamines, nitrosopiperidine, and nitrosopyrrolidine in the intestines [9,10,11]. Because of this risk, the European Union carried out a project to reduce BAs in traditional European fermented foods, such as cheese, wine, and sausages, from 2008 to 2011 [12]. Worldwide, studies have been conducted on the content of BAs in various foods, such as meat, fish, dairy products, wine, chocolate, vegetables, fruits, and nuts. As a standard for managing amines, tolerance standards for HIS and TYR have been set concerning fermented foods, marine products, and wine [12].
In Cheonggukjang, the tissue is softened by the action of microorganisms such as B. subtilis on steamed soybean. In addition, the mucilage produced during the fermentation process of Cheonggukjang is a biopolymer that is a mixture of gamma-polyglutamic acid and levan, a fructose polymer [13]. These substances in Cheonggukjang inhibit adipocyte differentiation and adipogenesis, proving their usefulness in obesity and metabolic disease treatment [14]. In previous clinical studies on Cheonggukjang, Cheonggukjang reduced body weight and body fat, decreased low-density lipoprotein cholesterol and total cholesterol levels, and improved serum lipids [15].
In this clinical trial, we first analyzed the bioamine content of Cheonggukjang, with a high or low content of effective microbial strains, and commercially available Cheonggukjang, and attempted to confirm its safety when consumed. The anti-obesity and lipid-lowering effects of the three types of Cheonggukjang were investigated. Lastly, microbial changes in stool samples after Cheonggukjang ingestion were compared and confirmed.

2. Materials and Methods

2.1. Study Design

This study was an 8-week randomized, double-blind clinical trial (registration number: KCT0007734). The participants were asked to visit the research center three times. After 4 weeks of Cheonggukjang supplementation, the participants visited the research center to check vital signs, side effects, and medication compliance. Efficacy indicators, such as weight, abdominal fat computed tomography (CT), inflammatory markers, lipid profile, and blood tests, were assessed at the first and last visits. The following Cheonggukjang tablets were provided to the participants: tablets made from traditional Cheonggukjang with a high useful microorganisms content (HTC), tablets made from traditional Cheonggukjang with a low useful microorganisms content (LTC), and pills made from commercially available Cheonggukjang (CC). Enrolled participants were randomly assigned to one of the three groups: HTC (n = 19), LTC (n = 20), or CC pills (n = 20). A total of 62 study participants were enrolled, and the dropout rate was 5%. Therefore, 59 participants completed the study.
Screening numbers were provided to those who provided written consent to participate in the study. The numbers represent the order of study participants and range from 01 to 62. The number assigned to each subject was used as the participant identification code. All participants were instructed not to take drugs or healthy functional foods other than the Cheonggukjang pills and were asked to maintain their usual diet and activity level.

2.2. BAs Analysis

BA quantification followed the Korean Food Code (MFDS, 2016). The final volume of the sample (1.0 mL) was adjusted to 50 mL with 0.1 N HCl to prepare the test solution. Then, 1 mL of test solution was placed in a test tube, and 0.1 mL of the internal standard solution, saturated sodium carbonate solution, and 0.8 mL of a 1% dansyl chloride solution were added and mixed thoroughly. The mixture was sealed and heated at 45 °C for 1 h to form a derivative. Then, 0.5 mL of 10% proline and 5 mL of ether solution were added to the derivatized standard solution, and the supernatant was collected and concentrated using nitrogen gas. The solution was then dissolved in 1 mL of acetonitrile and filtered through a 0.45 µm syringe filter. The filtered solution was analyzed using high-performance liquid chromatography (HPLC, Ultimate 3000, Thermo Fisher Scientific Co., Waltham, MA, USA). The analysis conditions are listed in Table 1.

2.3. Participants

Obese volunteers with a body mass index (BMI) ≥25 kg/m2 (age 19–70 years) were recruited and randomly assigned to three groups. The exclusion criteria were as follows: >10% change in body weight in the last 3 months, cardiovascular diseases such as arrhythmia, heart failure, myocardial infarction, and pacemaker use, allergy or hypersensitivity to any component of the test product, colon diseases such as Crohn’s disease, history of gastrointestinal surgery (e.g., appendix or bowel surgery), participation in another clinical trial within the last 2 months, liver dysfunction or acute/chronic kidney disease, antipsychotic drug therapy use within the past 2 months, laboratory test abnormality assessed by the investigator, abnormal psychological condition, alcohol or drug abuse history, and pregnancy or breastfeeding. The study protocol was approved by the Institutional Review Board of Wonkwang University Hospital (IRB approval number: WKUH 2022-05-025).
Participants were given a dietary diary and recorded all the foods they consumed as accurately as possible. The study participants completed a physical activity questionnaire based on the Global Physical Activity Questionnaire during their visit [16]. Participants ingested 3 g Cheonggukjang tablets (3 g fermented soybeans) once a day.

2.4. Safety Assessment

Participants underwent screening tests, including electrocardiogram, urinalysis, hematology, and blood chemistry tests. These included white and red blood cell counts and hemoglobin, hematocrit, platelet counts, total protein, albumin, alanine aminotransferase (ALT), aspartate aminotransferase (AST), blood urea nitrogen (BUN), and creatinine levels. The participants’ pulse and blood pressure were measured after a 10-min break at each visit. They reported any symptoms that occurred while taking the Cheonggukjang pills.

2.5. Indicators of Obesity Assessment

CT (HiSpeed CT/e; General Electric, Boston, MA, USA) was performed with the participant in a supine position for abdominal fat measurement. The total abdominal, subcutaneous, and visceral fat areas were measured and expressed in mm2. The participants fasted for >12 h before blood collection. Total cholesterol (TC), low-density lipoprotein cholesterol (LDL-C), high-density lipoprotein cholesterol (HDL-C), triglyceride (TG), nonHDL cholesterol (NonHDL-C), ALT, AST, gamma-glutamyl transferase (GGT), BUN, creatinine, glucose, insulin and high-sensitivity C-reactive protein levels were measured using a Hitachi 7600 automatic analyzer (Hitachi, Tokyo, Japan). HOMA_IR (Homeostatic Model Assessment for Insulin Resistance) and QUICKI (quantitative insulin-sensitivity check index) levels were calculated.

2.6. Inflammation Marker Assessment

Serum inflammatory markers, interleukin (IL)-6 and haptoglobin, were measured to determine whether inflammation improved before and after taking Cheonggukjang pills. Blood was left for 30 min for clotting after collection and then centrifuged at 3000 rpm for 10 min. The separated supernatant was transferred to a microtube, stored at −70 °C, collected, and analyzed by a commissioned institution (SCL Healthcare Co., Ltd., 13, Heungdeok 1-ro, Giheung-gu, Yongin-si, Gyeonggi-do, Republic of Korea).

2.7. Changes in the Gut Microbiome Assessment

To analyze changes in the intestinal microbiome, the participants underwent a stool test at the first visit and 8 weeks later. Participants collected feces of 1 g or more using the MICROBE & ME stool collection kit (Macrogen, Seoul, Republic of Korea) and submitted it frozen.

2.8. Experimental Cheonggukjang Pill Preparation

In traditional Cheonggukjang, rice straw is used as a fermentation starter. In the conventional method, soybeans are soaked and boiled until they become soft. The beans were then covered with rice straw and placed in a warm, humid environment for fermentation. The temperature is typically 35–40 °C, and the humidity is 80% to promote the microorganism growth for 24 to 72 h.
The manufacturing process of the traditional Cheonggukjang is shown in Figure 1. To create a tablet form of Cheonggukjang for clinical trials, Cheonggukjang was freeze-dried and crushed. Next, it was mixed with the excipients following the ratios specified in Table 2 before manufacturing.

2.9. Statistical Analysis

All statistical analyses were performed using PASW statistics 23 (previously SPSS statistics) (SPSS version 23.0; IMP SPSS, Chicago, IL, USA). All data are expressed as the mean ± standard error or percentages (%) for categorical variables. Values of p < 0.05 were considered significant.
The sample size was determined to achieve 80% statistical power with an alpha of 0.05. The sample size for each group was determined by allowing a dropout rate of 20%. Efficacy parameters were analyzed in the per protocol group, and safety parameters were analyzed in the intention-to-treat group. A chi-square test was performed to determine the baseline differences in the frequencies of categorized variables between the groups. Students’ paired t-test was performed to assess differences between the groups before and after the 8-week intervention period. A linear mixed-effects model was applied to the repeated measures data for each continuous outcome variable and data. An expert analyzed the 24-h dietary intake data using Can-Pro 3.0 software (Korean Nutrition Society, Seoul, Republic of Korea).

3. Results

3.1. Participants

A total of 62 participants were enrolled; one did not meet the inclusion criteria, and two declined to participate. The remaining 59 participants patients were randomly assigned to three groups: HTC, LTC, and CC, and all participants completed the 8-week study. A total of 59 participants from the HTC (n = 19), LTC (n = 20), and CC (n = 20) groups were included in the final analysis (Table 3). No participants indicated any adverse events after completing the study.

3.2. Anthropometric Parameters

The general characteristics of the participants are presented in Table 3. A cross-analysis was performed for sex, drinking, and smoking, and a one-way analysis of variance was performed for the age, weight, and BMI. There were no significant differences in the baseline characteristics among the three groups regarding age, sex, weight, height, drinking, smoking, initial weight, and initial BMI (p > 0.05). The dietary intake surveys found no significant changes in caloric intake within or between the groups (p > 0.05). The physical activity survey found no significant differences in the metabolic equivalents of tasks within or between the groups (p > 0.05).
The average deviation values for PUT, CAD, HIS, serotonin, TYR, SPD, noradrenaline, dopamine, and spermine were measured for the three types of soybean paste products. CAD, HIS, and SPD were detected in all samples among the nine biogenic amines tested, whereas, the other BAs were not. Although the content varied between the samples, these three BAs were consistently present (Table 4).

3.3. Safety Assessment

In the blood tests, such as liver inflammation level, kidney function, and general blood, there was no increase after Cheonggukjang pill administration. However, after consuming Cheonggukjang, the GGT, AST, and ALT levels decreased in the CC group. In all groups, no abnormal symptoms were reported after taking Cheonggukjang pills.

3.4. Effects on Obesity and Inflammation

Cheonggukjang showed no anti-obesity effects. In contrast, the body fat mass and fat percentage increased in the LTC group after administering Cheonggukjang pills. No change in the abdominal fat CT results in any group after Cheonggukjang administration was observed. Cheonggukjang had no effect on TC, LDL-C, HDL-C, TG, or NonHDL-C. Cheonggukjang did not affect glucose, insulin, HOMA_IR, or QUICKI levels. The serum inflammatory markers, hs-CRP, IL-6, and haptoglobin, also showed no change after Cheonggukjang administration in all groups. However, the GGT, AST, and ALT levels decreased in the CC group (Table 5). In all groups, no abnormal symptoms were reported after taking Cheonggukjang pills.

3.5. Microbiome and Short-Chain Fatty Acids Analysis in Feces

The Firmicutes/Bacteroidetes (F/B) ratio, associated with obesity in all three groups, decreased after Cheonggukjang pill consumption, but there was no statistical significance. In all three groups, the presence of beneficial, harmful, and other microorganisms was evaluated in stool samples after consuming the Cheonggukjang pill. After supplementation, the numbers of beneficial and harmful bacteria did not show statistically significant differences in any of the three groups. The beneficial microorganisms included Lactobacillus spp., Bifidobacterium spp., Lactococcus lactis, Enterococcus faecium, and Bacteroides spp. Harmful bacteria included Clostridium perfringens, Bacteroides eggerthii, Sutterella stercoricanis, Ruminococcus torques, Parabacteroides merdae, and Parabacteroides distasonis (Table 6).
After supplementation, the short-chain fatty acid concentration in the feces decreased only in the HCT group, but the difference was not statistically significant. The short-chain fatty acids analyzed in the feces were acetic, propionic, and butyric acid (Table 7).

4. Discussion

Cheonggukjang is a traditional Korean food made from fermented boiled soybeans and rice straw. Cheonggukjang is a functional food because it contains various biologically active substances, including isoflavones, phytic acid, saponins, trypsin inhibitors, tocopherols, unsaturated fatty acids, dietary fiber, oligosaccharides, antioxidants, and thrombolytic enzymes [17]. These components are essential because of their potential health benefits.
BAs, produced during soy protein fermentation (the main ingredient in fermented soybean products such as Cheonggukjang), affect cell growth and proliferation. However, BAs can also cause adverse effects, such as skin inflammation, headaches, and abdominal pain, and may be carcinogenic through intestinal microbial metabolism [18]. Additionally, BAs can stimulate the blood vessels and nerves, causing discomfort in some individuals. Therefore, the BA level in food has been used to indicate food safety, which is also considered a quality indicator for evaluating good manufacturing practices [19]. Producing many fermented foods worldwide is a complex biochemical process involving several microbial species that play a crucial role in BA accumulation [19,20]. Therefore, we investigated the BA content in Cheonggukjang prepared traditionally and in fermented foods. In addition, human safety was confirmed by examining the BA content in conventional Cheonggukjang with many and fewer effective strains.
Food microorganisms typically produce BA by secreting amino acid decarboxylases. Therefore, attempts have been made to characterize the microbiomes of fermented foods and evaluate their ability to produce BAs to gain better insight into how BA accumulates in food [18,19,20]. Controlling the BA content will ensure the quality and safety of such popular traditional fermented foods as Cheonggukjang. Therefore, it is necessary to investigate the BA content using the existing fermented food manufacturing process and confirm that it is clinically safe for human consumption. However, despite the regular consumption of traditional fermented products, i.e., Cheonggukjang, no cases of illness or death caused by BA in these fermented foods have been reported. Simultaneously, research continues to produce evidence of the potential health benefits of consuming these traditional fermented foods [21,22,23,24,25,26].
A previous study conducted in Korea investigated the contents of eight BAs and 18 inorganic components in 37 Cheonggukjang products distributed in supermarkets and markets. Among the eight BA components, the TYR content was the highest at 113.7 mg/kg, and the concentration difference was large depending on the sample [27]. Many types of Cheonggukjang are produced in Korea, and each product has a marked difference in flavor and nutritional content. This difference is because each region uses different raw soybean varieties and fermentation processes, which are not uniformized and systematized [27]. Therefore, comparing the BA content in various types of Cheonggukjang is meaningless because the type and BA content vary depending on the factors influencing Cheonggukjang production.
However, research on the effect of BAs on the human body is needed. In Korea, studies have been conducted to analyze eight BAs, namely TRP, PHE, PUT, CAD, HIS, TYR, SPD, and SPM, in various Cheonggukjang products. Different results were obtained for each study, and in the same study, multiple values were found depending on the Cheonggukjang product [28,29,30]. Among the analyzed BAs, substances related to risk were PUT, CAD, HIS, TYR, and PHE, but no risk-related results have been reported for other amines [30]. In animal models, Cheonggukjang had various metabolic benefits, including anti-obesity, anti-diabetic, anti-inflammatory, and neuroprotective effects [31,32,33]. Cheonggukjang reduced body weight, epididymal fat accumulation, serum total cholesterol, and low-density lipoprotein cholesterol in an animal model of diet-induced obesity [31]. In addition, Cheonggukjang supplementation substantially reduced blood glucose and glycated hemoglobin levels in a mouse model and improved insulin resistance [32]. However, our study showed no improvement in all obesity-related indicators, such as lipid profile, blood glucose, insulin index, abdominal visceral fat CT, and body composition analysis results after Cheonggukjang pill administration. Previous animal models showed the anti-inflammatory effect of Cheonggukjang [31,32], but in our study, the anti-inflammatory indices hs-CRP, haptoglobin, and IL-6 did not improve after Cheonggukjang pill administration.
The Firmicutes phylum accounts for most of the intestinal microbiota. A decrease in Firmicutes and an increase in Bacteroidetes were associated with weight loss [34]. Bacillus, Clostridium, Lactococcus, and Streptococcus make up the majority of the Firmicutes phylum and the rest of the phylum is mostly Bacteroides acidifaciens, B. distasonis, and B. fragilis [35]. This study only investigated the two major bacterial phyla of the gastrointestinal tract, Firmicutes, and Bacteroidetes, to simplify the complex problems of the total microbial components. The F/B ratio is associated with homeostasis, and a change can cause various pathological conditions. For example, an increase in this ratio leads to obesity [36]. In this study, the F/B ratio of all three groups who ingested the Cheonggukjang pills decreased, but the difference was not statistically significant. An analysis of stool samples from Japanese people with obesity showed a substantial difference in the F/B ratio. The percentage of Firmicutes was 37.0 ± 9.1% (lean participants) and 40.8 ± 15.0% (obese participants), but the percentage of Bacteroidetes was 44.0 ± 9.8% (lean participants) and 37.0 ± 14.0% (obese participants) [37]. Researchers reported similar results for the F/B ratio related to BMI in 61 Ukrainian adults. Individuals with an F/B ratio of ≥1 were more likely to be overweight than those with < 1 [38]. Similarly, Qatar patients (37 obese and 36 not obese people) had an F/B ratio of 2.25 ± 1.83 and 1.76 ± 0.58, respectively [39]. In Kazakhstan [40] and Belgium [41], the F/B ratio in the obesity group was relatively high compared to that in the control group of schoolchildren. In contrast, no relationship between the F/B ratio and weight gain or BMI was observed. The fecal samples collected from obese patients (BMI ≥ 30 kg/m2) and not obese patients (BMI < 25 kg/m2) had no statistical difference in the F/B ratio in Korean youth (13–16 years) (0.50 ± 0.53 in not obese vs. 0.56 ± 0.86 in obese people). The Firmicutes to Bacteroidetes ratio is a common index to measure the structure of the gut microbiota. In research at the phylum level, an increase in the Firmicutes to Bacteroidetes ratio was observed in overweight/obese adults, resulting in an increased abundance of Firmicutes and a reduced abundance of Bacteroidetes. However, members of Firmicutes show greater heterogeneity in their composition than Bacteroidetes in the gut of metabolic syndrome patients (e.g., overweight/obesity), especially in the gut of children. For example, Clostridium (Firmicutes phylum) is positively associated with the body mass index (BMI) in children, and it is more important in young adults. An increased abundance of Clostridium, Dorea, and Ruminococcus (Firmicutes phylum) was also detected in Irritable Bowel Syndrome.
However, this study had several limitations. First, although the participants were instructed not to change their eating and exercise habits, the diet and activity levels could not be fully controlled. Second, the sample size of the participants was small and could not be generalized.

5. Conclusions

There has never been a clinical study that simultaneously confirmed various indicators such as safety, anti-obesity-related indicators, inflammation indicators, microbiome, and short-chain fatty acids after consuming Cheonggukjang. Although the indicators did not have statistical significance, these research results are worth referencing for future clinical trials on Cheonggukjang consumption. The results show no particular change in the indicators; therefore, there was no anti-obesity effect of Cheonggukjang. In addition, although there was no statistical significance, the F/B ratio decreased in all participants in the three groups, giving value to further research.

Author Contributions

Conceptualization, Project administration D.-Y.J.; methodology, S.-J.J. and M.-S.R.; Resources, Funding acquisition, M.-S.R. and H.-J.Y.; Visualization, S.-J.J. and H.-J.Y.; Writing—review A.L.H.; Editing, Y.-B.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Ministry of Agriculture, Food and Rural Affairs and the Korea Agro-Fisheries and Food Trade Corporation.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of Wonkwang University Hospital (IRB approval no. WKUH 2022-05-025).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available, because the ownership of the data resides with the research institute.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wang, Y.; Kwang, S. Biochemical properties of seed lectin from Korean soybean cultivars developed for soy source. KSBB J. 2009, 24, 170–176. [Google Scholar]
  2. Lee, B.-Y.; Dong-Man, K.; Kil-Hwan, K. Studies on the change in rheological properties of Chungkook-jang. Korean J. Food Sci. Technol. 1991, 23, 478–484. [Google Scholar]
  3. Moon, J.S.; Seung, K.; Cho, H.; Young, C.; Kim, J.E.; Kim, S.-Y.; Cho, K.-J.; Han, N.S. Isolation and characterization of biogenic amine-producing bacteria in fermented soybean pastes. J. Microbiol. 2010, 48, 257–261. [Google Scholar] [CrossRef] [PubMed]
  4. Ibe, A.; Taichiro, N.; Nobuhiko, K. Bacteriological properties of and amine-production conditions for tyramine-and histamine-producing bacterial strains isolated from soybean paste (miso) starting materials. Eisei Kagaku 1992, 38, 403–409. [Google Scholar] [CrossRef]
  5. Maijala, R.L.; Eerola, S.H.; Aho, M.A.; Hirn, J.A. The effect of GDL-induced pH decrease on the formation of biogenic amines in meat. J. Food Prot. 1993, 56, 125–129. [Google Scholar] [CrossRef]
  6. García-Ruiz, A.; González-Rompinelli, E.M.; Bartolomé, B.; Moreno-Arribas, M.V. Potential of wine-associated lactic acid bacteria to degrade biogenic amines. Int. J. Food Microbiol. 2011, 148, 115–120. [Google Scholar] [CrossRef]
  7. Özogul, F.; Hamed, I. The importance of lactic acid bacteria for the prevention of bacterial growth and their biogenic amines formation: A review. Crit. Rev. Food Sci. Nutr. 2018, 58, 1660–1670. [Google Scholar] [CrossRef]
  8. Aishath, N.; Flint, S.; Fletcher, G.; Bremer, P.; Meerdink, G. Control of biogenic amines in food—Existing and emerging approaches. J. Food Sci. 2010, 75, 139–150. [Google Scholar] [CrossRef]
  9. Shalaby, A.R. Significance of biogenic amines for food safety and human health. Food Res. Int. 1996, 29, 675–690. [Google Scholar] [CrossRef]
  10. Smith, T.A. Amines in food. Food Chem. 1981, 6, 169–200. [Google Scholar] [CrossRef]
  11. Karovicova, J.; Kohajdova, Z. Biogenic amines in foods. Chem. Pap. 2005, 59, 70–79. [Google Scholar] [CrossRef]
  12. BIAMFOOD. Controlling biogenic amines in traditional food fermentations in regional Europe (Project Reference no. 211441). In EU’s 7th Framework Program for Research; EU: Maastricht, The Netherlands, 2008. [Google Scholar]
  13. Lee, Y.L.; Kim, S.H.; Choung, N.H.; Lim, M.H. A study on the production of viscous substance during the Chungkookjang fermentation. Appl. Biol. Chem. 1992, 35, 202–209. [Google Scholar]
  14. Setchell, K.D. Phytoestrogens: The biochemistry, physiology, and implications for human health of soy isoflavones. Am. J. Clin. Nutr. 1996, 68, 1333S–1346S. [Google Scholar] [CrossRef]
  15. Daubioul, C.A.; Taper, H.S.; De Wispelaere, L.D.; Delzenne, N.M. Dietary oligofructose lessens hepatic steatosis, but does not prevent hypertriglyceridemia in obese Zucker rats. J. Nutr. 2000, 130, 1314–1319. [Google Scholar] [CrossRef]
  16. Armstrong, T.; Bull, F. Development of the World Health Organization Global Physical Activity Questionnaire (GPAQ). J. Public Health 2006, 14, 66–70. [Google Scholar] [CrossRef]
  17. Kim, W.; Choi, K.; Kim, Y.; Park, H.; Choi, J.; Lee, Y.; Oh, H.; Kwon, I.; Lee, S. The purification and characterization of a fibrinolytic enzyme produced from Bacillus sp. strain CK 11-4 screened by Chungkook-Jang. Appl. Environ. Microbiol. 1996, 62, 2482–2488. [Google Scholar] [CrossRef]
  18. Warthesen, J.J.; Scanlan, R.A.; Bills, D.D.; Libbey, L.M. Formation of heterocyclic N-nitrosamines from the reaction of nitrite with selected primary diamines and amino acids. J. Agric. Food Chem. 1975, 23, 898–902. [Google Scholar] [CrossRef]
  19. Li, L.; Zou, D.; Ruan, L.; Wen, Z.; Chen, S.; Xu, L.; Wei, X. Evaluation of biogenic amine and microbial contributions in traditional Chinese sausages. Front. Microbiol. 2019, 10, 872. [Google Scholar] [CrossRef]
  20. Gu, J.; Liu, T.; Sadiq, F.A.; Yang, H.; Yuan, L.; Zhang, G.; He, J. Biogenic amine content and assessment of bacterial and fungal diversity in stinky tofu, a traditional fermented soy curd. LWT 2018, 88, 26–34. [Google Scholar] [CrossRef]
  21. Park, S.; Zhang, T.; Yue, Y.; Jeong, S.J.; Ryu, M.S.; Wu, X.; Yang, H.-J.; Jeong, D.-Y. Alleviation of metabolic disturbance by substituting kanjang high in Bacillus for salt through modulation of the gut microbiota in estrogen-deficient rats. Foods 2022, 11, 1951. [Google Scholar] [CrossRef]
  22. Yang, H.J.; Jeong, S.J.; Ryu, M.S.; Ha, G.; Jeong, D.Y.; Park, Y.M.; Lee, H.Y.; Bae, J.S. Protective effect of traditional Korean fermented soybean foods (doenjang) in a dextran sulfate sodium-induced colitis mouse model. Food Funct. 2022, 13, 8616–8626. [Google Scholar] [CrossRef] [PubMed]
  23. Zhang, T.; Ryu, M.S.; Wu, X.; Yang, H.J.; Jeong, S.J.; Seo, J.W.; Jeong, D.-Y.; Park, S. Alleviation of neuronal cell death and memory deficit with Chungkookjang made with Bacillus amyloliquefaciens and Bacillus subtilis potentially through promoting gut-brain axis in artery-occluded gerbils. Foods 2021, 10, 2697. [Google Scholar] [CrossRef] [PubMed]
  24. Lim, H.J.; Kim, H.R.; Jeong, S.J.; Yang, H.J.; Ryu, M.S.; Jeong, D.Y.; Kim, S.-Y.; Jung, C.-H. Protective effects of fermented soybeans (Cheonggukjang) on dextran sodium sulfate (DSS)-induced colitis in a mouse model. Foods 2022, 11, 776. [Google Scholar] [CrossRef] [PubMed]
  25. Han, A.L.; Jeong, S.J.; Ryu, M.S.; Yang, H.J.; Jeong, D.Y.; Park, D.S.; Lee, H.K. Anti-obesity effects of traditional and commercial Kochujang in overweight and obese adults: A randomized controlled trial. Nutrients 2022, 14, 2783. [Google Scholar] [CrossRef]
  26. Lim, H.J.; Park, I.S.; Jeong, S.J.; Ha, G.S.; Yang, H.J.; Jeong, D.Y.; Kim, S.-Y.; Jung, C.-H. Effects of Cheonggukjang (fermented soybean) on the development of colitis-associated colorectal cancer in mice. Foods 2023, 12, 383. [Google Scholar] [CrossRef]
  27. Seo, M.J.; Lee, C.D.; Lee, J.N.; Yang, H.J.; Jeong, D.Y. Analysis of biogenic amines and inorganic elements in Cheonggukjang. Korean J. Food Preserv. 2019, 26, 101–108. [Google Scholar] [CrossRef]
  28. Han, G.H.; Cho, T.Y.; Yoo, M.S.; Kim, C.S.; Kim, J.M.; Kim, H.A.; Kim, M.O.; Kim, S.C.; Lee, S.A.; Lo, Y.S.; et al. Biogenic amines formation and content in fermented soybean paste (Cheonggukjang). Korean J. Food Sci. Technol. 2007, 39, 541–545. [Google Scholar]
  29. Cho, T.Y.; Han, G.H.; Bahn, K.N.; Son, Y.W.; Jang, M.R.; Lee, C.H.; Kim, S.H.; Kim, D.B.; Kim, S.B. Evaluation of biogenic amines in Korean commercial fermented foods. Korean J. Food Sci. Technol. 2006, 38, 730–737. [Google Scholar]
  30. Lee, S.; Eom, H.S.; Yoo, M.; Cho, Y.S.; Shin, D.B. Determination of biogenic amines in Cheonggukjang using ultra high pressure liquid chromatography coupled with mass spectrometry. Food Sci. Biotechnol. 2011, 20, 123–129. [Google Scholar] [CrossRef]
  31. Soh, J.R.; Kwon, D.Y.; Cha, Y.S. Hepatic gene expression profiles are altered by dietary unsalted Korean fermented soybean (Chungkookjang) consumption in mice with diet-induced obesity. J. Nutr. Metab. 2011, 2011, 260214. [Google Scholar] [CrossRef]
  32. Kim, D.J.; Jeong, Y.J.; Kwon, J.H.; Moon, K.D.; Kim, H.J.; Jeon, S.M.; Lee, M.-Y.; Park, Y.B.; Choi, M.-S. Beneficial effects of chungkukjang on the regulation of blood glucose and pancreatic β-cell functions in C75BL/KsJ-db/db mice. J. Med. Food 2008, 11, 215–223. [Google Scholar] [CrossRef]
  33. Choi, Y.H.; Lim, H.; Heo, M.Y.; Kwon, D.Y.; Kim, H.P. Anti-inflammatory activity of the ethanol extract of Chungkukjang, Korean fermented bean: 5-lipoxygenase inhibition. J. Med. Food 2008, 11, 539–543. [Google Scholar] [CrossRef]
  34. Bobek, P.; Ozdíin, L.; Galbavýy, S. Dose- and time-dependent hypocholesterolemic effects of oyster mushroom (Pleurotus ostreatus) in rats. Nutrition 1998, 14, 282–286. [Google Scholar] [CrossRef]
  35. Urnbaugh, P.J.; Ley, R.E.; Klein, S.; Gordon, J.I. An obesity-associated gut microbiome with increased capacity for energy harvesting. Nature 2006, 444, 1027–1031. [Google Scholar] [CrossRef]
  36. Abenavoli, L.; Scarpellini, E.; Colica, C.; Boccuto, L.; Salehi, B.; Sharifi-Rad, J.; Aiello, V.; Romano, B.; De Lorenzo, A.; Izzo, A.; et al. Gut microbiota and obesity: Role of probiotics. Nutrients 2019, 11, 2690. [Google Scholar] [CrossRef]
  37. Kasai, C.; Sugimoto, K.; Moritani, I.; Tanaka, J.; Oya, Y.; Inoue, H.; Tameda, M.; Shiraki, K.; Ito, M.; Takei, Y.; et al. Comparison of gut microbiota composition between obese and non-obese individuals in a Japanese population, as analyzed by terminal restriction fragment length polymorphism and next-generation sequencing. BMC Gastroenterol. 2015, 15, 100. [Google Scholar] [CrossRef]
  38. Koliada, A.; Syzenko, G.; Moseiko, V.; Budovska, L.; Puchkov, K.; Perederiy, V.; Gavalko, Y.; Dorofeyev, A.; Romanenko, M.; Tkach, S.; et al. Association between body mass index and Firmicutes/Bacteroidetes ratio in an adult Ukrainian population. BMC Microbiol. 2017, 17, 120. [Google Scholar] [CrossRef]
  39. Sohail, M.A.; Elrayess, M.A.; Al Thani, A.A.; Al-Asmakh, M.; Yassine, H.M. Profiling the oral microbiome and plasma biochemistry of obese hyperglycemic subjects in Qatar. Microorganisms 2019, 7, 645. [Google Scholar] [CrossRef]
  40. Xu, P.; Li, M.; Zhang, J.; Zhang, T. Correlation of intestinal microbiota with overweight and obesity in Kazakh schoolchildren. BMC Microbiol. 2012, 12, 283. [Google Scholar] [CrossRef] [PubMed]
  41. Bervoets, L.; Van Hoorenbeeck, K.; Kortleven, I.; Van Noten, C.; Hens, N.; Vael, C.; Goossens, H.; Desager, K.; Vankerckhoven, V. Differences in gut microbiota composition between obese and lean children: A cross-sectional study. Gut Pathog. 2013, 5, 10. [Google Scholar] [CrossRef]
Figure 1. The manufacturing process of traditional Cheonggukjang.
Figure 1. The manufacturing process of traditional Cheonggukjang.
Foods 12 02190 g001
Table 1. Operation conditions of HPLC for biogenic amines analysis.
Table 1. Operation conditions of HPLC for biogenic amines analysis.
InstrumentAgilent 1200 series
(Agilent Technologies, Santa Clara, CA, USA)
ColumnCapcellPak C18 column
DetectorDAD detector (254 nm)
Mobile phaseA: 0.1% formic acid in H2O
B: 0.1% formic acid in ACN
Gradients conditionA:B = 45:55, 0~10 min
A:B = 35:65, 10~15 min
A:B = 20:80, 15~20 min
A:B = 10:90, 20~30 min
A:B = 10:90, >40 min
Flow rate1 mL/min
Temperature40 °C
Injection volume20 µL
Table 2. Composition of the Cheonggukjang pills’ ingredients.
Table 2. Composition of the Cheonggukjang pills’ ingredients.
HTCLTCCC
Content (g)Ratio (%)Content (g)Ratio (%)Content (g)Ratio (%)
Freeze-dried
Cheonggukjang powder
2.97902.97902.9790
Glutinous rice flour0.33100.33100.3310
Total 310031003100
HTC, traditional Cheonggukjang containing a high dose of beneficial microbes; LTC, traditional Cheonggukjang containing a low dose of effective microbes; CC, commercially prepared Cheonggukjang.
Table 3. General characteristics of participants.
Table 3. General characteristics of participants.
ValueGroup
HTC (n = 19) LTC (n = 20)CC (n = 20) p-Value
Sex (M/F)9/1010/1011/70.675
Drinking (n)10 (52.6)7 (35.0)11 (61.1)0.256
Smoking (n)2 (10.5)2 (10.0)3 (16.7)0.790
Age38.00 ± 10.5241.80 ± 12.6441.80 ± 12.640.213
Weight78.33 ± 12.9875.31 ± 12.9780.74 ± 14.150.458
BMI28.17 ± 3.3927.98 ± 2.9128.25 ± 2.510.958
HTC, traditional Cheonggukjang containing a high dose of beneficial microbes; LTC, traditional Cheonggukjang containing a low dose of effective microbes; CC, commercially prepared Cheonggukjang; M, male; F, female; BMI, body mass index. Values are presented as the mean ± standard deviation or number (percentage).
Table 4. Biogenic amine contents in Cheonggukjang products.
Table 4. Biogenic amine contents in Cheonggukjang products.
SampleBiogenic Amine (mg/kg)Total
Contents
(mg/kg)
PUTCADHISSERTYRSPDNORDOPSPM
HTCND (1)96.28 ± 2.7 (2)619.34 ± 1.5NDND56.35 ± 1.1NDNDND771.91 ± 5.0
LTCND207.75 ± 2.791.35 ± 0.9NDND40.26 ± 0.2NDNDND339.36 ± 3.2
CCND164.55 ± 1.2157.87 ± 1.1NDND43.80 ± 1.9NDNDND366.23 ± 2.8
HTC, traditional Cheonggukjang containing a high dose of beneficial microbes; LTC, traditional Cheonggukjang containing a low dose of effective microbes; CC, commercially prepared Cheonggukjang; PUT, putrescine; CAD, cadaverine; HIS, histamine; SER, serotonin; TYR, tyramine; SPD, spermidine; NOR, noradrenaline; DOP, dopamine; SPM, spermine. (1) Not Detected. (2) mean ± SD (standard deviation).
Table 5. Efficacy evaluation between the three groups.
Table 5. Efficacy evaluation between the three groups.
ValueGroup
HTC (n = 19) LTC (n = 20) CC (n = 20)
BeforeAfterp-ValueBeforeAfterp-
Value
BeforeAfterp-
Value
HC103.03 ± 6.64102.85 ± 6.560.128101.33 ± 6.25101.04 ± 5.950.429103.42 ± 5.57103.31 ± 5.390.497
WHR0.91 ± 0.050.91 ± 0.050.8710.91 ± 0.051.01 ± 0.450.3300.91 ± 0.050.92 ± 0.050.96
TC203.21 ± 25.83209.37 ± 27.10.239206.25 ± 26.54208.9 ± 29.050.686207.17 ± 27.9204.11 ± 31.040.363
LDL-C121.79 ± 29.37125.05 ± 32.910.563132.45 ± 22.6131.05 ± 22.930.809129.28 ± 23.3126.39 ± 27.320.494
HDL-C51.89 ± 13.1454.32 ± 13.90.20847.1 ± 11.1249 ± 9.820.23548.78 ± 14.3850.39 ± 11.410.384
Triglyceride130.21 ± 111.54127.95 ± 122.360.918132.95 ± 69.38134.1 ± 52.850.906155.06 ± 97.32134 ± 84.130.304
NonHDL-C151.32 ± 30.54155.05 ± 32.060.394159.15 ± 26.22159.9 ± 29.610.901158.39 ± 28.85153.72 ± 30.330.214
WC93.79 ± 7.0793.89 ± 6.990.36192.3 ± 7.6192.14 ± 7.490.76294.08 ± 7.894.78 ± 7.50.125
IL-61.70 ± 0.721.82 ± 0.780.5141.91 ± 1.021.88 ± 0.840.8922.21 ± 1.671.82 ± 0.970.292
Haptoglobin103.68 ± 48.32100.21 ± 45.000.252113.65 ± 51.17112.15 ± 51.990.83495.72 ± 59.49102.00 ± 47.350.431
VF128.8 ± 64.71122.91 ± 68.340.176135.8 ± 55.43137.84 ± 53.560.690143.85 ± 83.68141.12 ± 80.540.601
SF229.37 ± 86.49222.47 ± 85.380.218217.55 ± 69.03213.35 ± 68.250.381203.87 ± 65.9211.1 ± 68.750.242
V/S0.65 ± 0.490.64 ± 0.510.7990.67 ± 0.350.68 ± 0.280.8210.75 ± 0.540.7 ± 0.490.283
LAP47.75 ± 33.1648.3 ± 39.850.93147.81 ± 25.8148.37 ± 26.360.85456.81 ± 32.1149.28 ± 28.550.219
VAI1.93 ± 1.562.08 ± 2.40.7152.13 ± 1.382.05 ± 1.360.6422.37 ± 1.61.96 ± 1.340.156
GGT29.63 ± 18.5929.32 ± 21.560.82828.85 ± 16.4527.6 ± 16.970.64235.28 ± 27.1830.17 ± 20.20.048
AST25.11 ± 11.8124.79 ± 11.530.86024.5 ± 6.1826.1 ± 6.660.20827.28 ± 13.7923.72 ± 8.810.049
ALT24.89 ± 20.9224.42 ± 23.030.82726.8 ± 14.5328.05 ± 15.270.58531.33 ± 24.5326.72 ± 22.030.030
BUN12.74 ± 3.2812.06 ± 2.990.37012.85 ± 2.8711.92 ± 2.390.17212.92 ± 3.5913.49 ± 3.270.311
Cr0.83 ± 0.170.82 ± 0.180.2770.83 ± 0.140.83 ± 0.140.9700.84 ± 0.20.9 ± 0.30.324
Uric acid6 ± 1.745.78 ± 1.430.1625.88 ± 1.475.87 ± 1.520.9766.59 ± 1.716.76 ± 1.680.390
Glucose101.11 ± 7.32101.21 ± 6.40.945103.6 ± 8.44105.7 ± 10.60.110101.56 ± 9.26103.06 ± 9.380.433
Insulin8.91 ± 4.88.31 ± 4.540.3768.58 ± 5.877.28 ± 2.910.19011.67 ± 9.499.06 ± 5.390.051
HOMA_IR2.25 ± 1.232.08 ± 1.150.3562.19 ± 1.441.89 ± 0.740.2523.03 ± 2.632.34 ± 1.430.075
QUICKI0.35 ± 0.040.35 ± 0.040.6060.35 ± 0.020.35 ± 0.020.4430.35 ± 0.050.35 ± 0.040.629
hs-CRP1.19 ± 0.832.56 ± 6.190.3322.14 ± 2.271.78 ± 1.550.2871.65 ± 1.92.7 ± 4.180.282
HTC, traditional Cheonggukjang containing a high dose of beneficial microbes; LTC, traditional Cheonggukjang containing a low dose of effective microbes; CC, commercially prepared Cheonggukjang; HC, hip circumference; WC, waist circumference; WHR, waist-hip ratio; TC, total cholesterol; LDL-C, low-density cholesterol; HDL-C, high-density cholesterol; TG, triglycerides; NonHDL-C, NonHDL-Cholesterol; VF, visceral fat; SF, subcutaneous fat; V/S, visceral fat/subcutaneous fat ratio; GGT, gamma-GT; AST, aspartate transaminase; ALT, alanine transaminase; BUN, blood urea nitrogen; Cr, creatinine; glucose; hs-CRP, high-sensitivity C-reactive protein. Values are presented as the mean ± SD.
Table 6. Microbiome analysis of feces.
Table 6. Microbiome analysis of feces.
ValueHTCLTCCC
BeforeAfterp-ValueBeforeAfterp-ValueBeforeAfterp-Value
Firmicutes (%)60.91 ± 9.7964.96 ± 11.400.23562.65 ± 11.7460.40 ± 9.050.51163.06 ± 10.8062.11 ± 10.610.785
Bacteroidetes (%)28.06 ± 12.7924.34 ± 14.410.86424.12 ± 12.4529.69 ± 9.070.12324.73 ± 14.7726.87 ± 11.350.621
F/B2.172.67 2.602.03 2.552.31
Beneficial Bacteria 28.52 ± 10.5031.30 ± 11.870.06131.90 ± 11.0229.96 ± 11.570.23033.70 ± 7.6931.80 ± 9.700.411
Harmful Bacteria3.10 ± 2.473.43 ± 2.730.6152.87 ± 2.912.44 ± 1.660.5172.92 ± 2.413.44 ± 1.370.301
Others68.38 ± 11.6965.26 ± 13.200.06365.23 ± 11.1867.59 ± 11.660.17263.38 ± 9.2264.76 ± 10.130.570
HTC, traditional Cheonggukjang containing a high dose of beneficial microbes; LTC, traditional Cheonggukjang containing a low dose of effective microbes; CC, commercially prepared Cheonggukjang.
Table 7. The concentration of short-chain fatty acids in feces.
Table 7. The concentration of short-chain fatty acids in feces.
AcidHTCLTCCC
BeforeAfterp-ValueBeforeAfterp-ValueBeforeAfterp-Value
Acetic 46.66 ± 34.333.1 ± 26.590.12349.39 ± 30.3240.68 ± 24.830.34151.98 ± 29.457.90 ± 47.810.568
Propionic 34.61 ± 25.4926.97 ± 31.540.29928.79 ± 18.4520.85 ± 14.270.12836.14 ± 24.4935.00 ± 23.400.824
Butyric 26.36 ± 15.8124.05 ± 18.570.63926.58 ± 16.6826.63 ± 15.670.99327.86 ± 14.7936.34 ± 26.290.232
Total107.63 ± 71.7084.12 ± 73.880.228104.76 ± 59.7988.16 ± 46.840.369115.97 ± 62.06129.23 ± 90.810.508
HTC, traditional Cheonggukjang containing a high dose of beneficial microbes; LTC, traditional Cheonggukjang containing a low dose of effective microbes; CC, commercially prepared Cheonggukjang.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Han, A.L.; Jeong, S.-J.; Ryu, M.-S.; Yang, H.-J.; Jeong, D.-Y.; Seo, Y.-B. Evaluation of Body Changes and the Anti-Obesity Effect after Consumption of Korean Fermented Food, Cheonggukjang: Randomized, Double-Blind Clinical Trial. Foods 2023, 12, 2190. https://doi.org/10.3390/foods12112190

AMA Style

Han AL, Jeong S-J, Ryu M-S, Yang H-J, Jeong D-Y, Seo Y-B. Evaluation of Body Changes and the Anti-Obesity Effect after Consumption of Korean Fermented Food, Cheonggukjang: Randomized, Double-Blind Clinical Trial. Foods. 2023; 12(11):2190. https://doi.org/10.3390/foods12112190

Chicago/Turabian Style

Han, A Lum, Su-Ji Jeong, Myeong-Seon Ryu, Hee-Jong Yang, Do-Youn Jeong, and Yoo-Bin Seo. 2023. "Evaluation of Body Changes and the Anti-Obesity Effect after Consumption of Korean Fermented Food, Cheonggukjang: Randomized, Double-Blind Clinical Trial" Foods 12, no. 11: 2190. https://doi.org/10.3390/foods12112190

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop