Next Article in Journal
Autoantibodies versus Skin Fibrosis Extent in Systemic Sclerosis: A Case-Control Study of Inverted Phenotypes
Previous Article in Journal
Squamous Cell Carcinoma Antigen: Clinical Application and Research Status
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Forrest Classification for Bleeding Peptic Ulcer: A New Look at the Old Endoscopic Classification

1
Department of Internal Medicine, Division of Gastroenterology, Changhua Christian Hospital, Changhua 500209, Taiwan
2
General Education Center, Chienkuo Technology University, Changhua 500020, Taiwan
3
Department of Electrical Engineering, Chung Yuan Christian University, Taoyuan 320314, Taiwan
4
Department of Post-Baccalaureate Medicine, College of Medicine, National Chung Hsing University, Taichung 400, Taiwan
5
Technology Translation Center for Medical Device, Chung Yuan Christian University, Taoyuan 320314, Taiwan
6
Department of Biomedical Engineering, Chung Yuan Christian University, Taoyuan 320314, Taiwan
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Diagnostics 2022, 12(5), 1066; https://doi.org/10.3390/diagnostics12051066
Submission received: 8 April 2022 / Revised: 20 April 2022 / Accepted: 20 April 2022 / Published: 24 April 2022
(This article belongs to the Topic Medical Image Analysis)

Abstract

:
The management of peptic ulcer bleeding is clinically challenging. For decades, the Forrest classification has been used for risk stratification for nonvariceal ulcer bleeding. The perception and interpretation of the Forrest classification vary among different endoscopists. The relationship between the bleeder and ulcer images and the different stages of the Forrest classification has not been studied yet. Endoscopic still images of 276 patients with peptic ulcer bleeding for the past 3 years were retrieved and reviewed. The intra-rater agreement and inter-rater agreement were compared. The obtained endoscopic images were manually drawn to delineate the extent of the ulcer and bleeding area. The areas of the region of interest were compared between the different stages of the Forrest classification. A total of 276 images were first classified by two experienced tutor endoscopists. The images were reviewed by six other endoscopists. A good intra-rater correlation was observed (0.92–0.98). A good inter-rater correlation was observed among the different levels of experience (0.639–0.859). The correlation was higher among tutor and junior endoscopists than among experienced endoscopists. Low-risk Forrest IIC and III lesions show distinct patterns compared to high-risk Forrest I, IIA, or IIB lesions. We found good agreement of the Forrest classification among different endoscopists in a single institution. This is the first study to quantitively analyze the obtained and explain the distinct patterns of bleeding ulcers from endoscopy images.

1. Introduction

Peptic ulcer bleeding is a common gastrointestinal emergency that requires prompt endoscopic diagnosis and treatment [1,2,3]. Significant progress has been made since the development of various endoscopic therapeutic techniques after the introduction of modern endoscopy [4,5]. Forrest [6] was the first to propose a classification scheme for describing the evolution of such bleeding in 1974. The Forrest classification facilitates communication between different endoscopists and helps in choosing the appropriate endoscopic intervention. However, there is a paucity of data on the performance of interobserver or intra-observer agreement of the old classification. One study conducted in Italy reported high interobserver agreement for Forrest IA/B lesions but low agreement for Forrest II/III lesions [7] utilizing 25 videotapes. As the current endoscopy systems are equipped with high-definition resolution and the images could be stored as digitally captured images, they should be clearer and more suitable for training young endoscopists.
Current guidelines [3,8,9] suggest that patients with high-risk ulcers such as active spurting (Forrest IA), active oozing (Forrest IB), and nonbleeding visible vessel (Forrest IIA) ulcers should undergo endoscopic therapy. Peptic ulcers with adherent clots (Forrest IIB lesion) should be subjected to endoscopic clot removal to decide on further treatment plans. Ulcers with red spots (Forrest IIC) or a clean base (Forrest III) can be observed without endoscopic therapy. However, the Canadian registry of patients with upper gastrointestinal bleeding reported that only 47.8% of patients with high-risk stigmata underwent endoscopic therapy, whereas 9.8% of those with low-risk stigmata underwent endoscopic therapy [10], showing the inconsistency of endoscopist practice in the real world despite the widespread use of the Forrest classification since its introduction.
Thus, in this study, we aimed to compare the intra-rater and inter-rater correlation of the Forrest classification in a modern endoscopy unit. A pixel-by-pixel approach to the obtained endoscopy images was utilized to explore their relationship for the different stages of the Forrest classification.

2. Materials and Methods

2.1. Patients and Data Preparation

The endoscopy records of patients who underwent endoscopic examinations between January 2017 and January 2020 at the endoscopy center of the Changhua Christian Hospital were retrospectively reviewed. The images were reviewed and retrieved for subsequent analysis by two expert endoscopists (tutors) with 15 years of experience in therapeutic endoscopy. The tutor endoscopists were also involved in training junior endoscopists in the unit. The inclusion criteria for the analysis of the images were (a) images from patients with symptoms of gastrointestinal bleeding, i.e., hematemesis, anemia, or tarry stool; (b) bleeders were attributed to a peptic ulcer disease, i.e., gastric, or duodenal ulcers; and (c) endoscopy performed with an Olympus 260 or 290 series system with digitally stored images.
The study complied with the World Medical Association Declaration of Helsinki for medical research involving human subjects, including research on identifiable human material and data, and was approved by the institutional review board of the Changhua Christian Hospital (approval number: CCH IRB 200906, Approval date: 19 October 2020).

2.2. Process of Peptic Ulcer Image Segmentation

The obtained endoscopy images were first cropped in to 476 × 416 pixels per image containing only the endoscopic information of the image. The ulcerated area was defined from the base of the ulcer to its margin (Figure 1). The bleeding area was defined as the culprit bleeder and blood clots adjacent to the bleeder. The area of the ulcer per lesion was defined as the ulcer area/(the ulcer plus bleeder area); the area of bleeder per lesion was defined as the bleeder area/(the ulcer plus bleeder area); and the area of the ulcer and bleeder per lesion was defined as (the ulcer and bleeder area)/(the ulcer plus bleeder area). The region of interest of the ulcer and bleeding area of each obtained image was further drawn with the Fotografix V102 (Available online: https://www.ilsitoblu.com/semplice-alternativa-a-photoshop-fotografix/fotografix102 (accessed on 1 March 2022) and calculated. Two expert endoscopists performed image segmentation.

2.3. Evaluation of the Forrest Classification of Peptic Ulcers

The endoscopic images of the bleeding peptic ulcers were first classified according to the Forrest classification, i.e., Forrest I, bleeding or oozing ulcer; Forret IIA, nonbleeding visible vessel, Forrest IIB, bleeding ulcer with adherent blood clots; Forrest IIC, ulcer with pigmentation, and Forrest III, ulcer with a clean ulcer base. The obtained images were reviewed by two expert endoscopists with more than 10 years of experience in therapeutic endoscopy and four junior endoscopists with less than 5 years of experience in the same domain to classify the endoscopy images according to the Forrest classification.

2.4. Statistics

Statistical analyses were performed using MedCalc Version 19.8 (2021 MedCalc Software Ltd. 8400 Ostend, Belgium) for interobserver agreement assessments with kappa statistics. The results were classified as follows: poor, ≤0.2; mild, 0.2 to 0.4; moderate, 0.4 to 0.6; good, 0.6 to 0.8; and excellent, 0.8 to 1. A nonparametric test using intraclass correlation was conducted to evaluate the intra-rater agreement. The Kruskal–Wallis test was utilized to compare continuous data with skewed distributions. Results were considered statistically significant if the p-value was <0.05.

3. Results

3.1. Intra-Observer and Interobserver Agreement of the Obtained Images

A total of 112 images, including Forrest I (13.4%), IIA (17%), IIB (6.2%), IIC (21.4%). and III (42%) were utilized for intra-rater agreement for analysis. A total of 276 images, including Forrest I (19.6%), IIA (15.9%), IIB (6.5%), IIC (19.2%), and III (38.8%) were enrolled for interobserver agreement analysis. All the images were stored in a test folder on the desktop and the studying endoscopist separated these images into different Forrest classes during classification.
The intra-rater agreement of the Forrest classification was high for both experienced and junior endoscopists, ranging from 0.92 to 0.97 (Table 1).
The inter-rater agreement of the Forrest classification was good (Table 2), ranging from 0.67 to 0.86. A higher inter-rater agreement was found between tutors and junior endoscopists than between other groups (0.78 vs. 0.68, p = 0.01).

3.2. Quantitative Analysis Comparing Endoscopic Images from Different Forrest Classifications

Figure 2 illustrates the representative images from Forrest I, IIB, and IIC lesions with the segmented endoscopy images. The ulcerated area was defined from the base of the ulcer to its margin (Figure 1) and the area of the bleeder (i.e., the areas of bleeding vessels and areas of bloody streaks or blood clots) were manually delineated by two experts (Figure 2).
Table 3 illustrates the results of a quantitative analysis of the 276 images. Forrest I, IIA, and IIB have a high bleeder area in the endoscopic image compared with those of low-risk ulcers, i.e., Forrest IIC and III (Figure 3). The clean-based ulcer (Forrest III lesion) contained no bleeder area, whereas the active-bleeding ulcer (Forrest I lesion) contained the highest bleeder area in the obtained endoscopy image. The presence of “adherent blood clots” on Forrest IIB lesions meant a higher bleeder area than that of Forrest IIA lesions with “nonbleeding visible vessels” (68.55% vs. 26.88%, p < 0.001). In terms of the overlapping area of the ulcer and bleeder (Figure 4), Forrest I, IIA, and IIB lesions had a similar pattern to that of low-risk ulcers, i.e., Forrest IIC and III.

4. Discussion

In this study, we utilized images captured via modern endoscopy to evaluate the performance of the Forrest classification for patients with bleeding peptic ulcers. We found a higher intra-rater agreement of the current system (with an overall mean kappa of 0.71) than was previously described [7]. The inter-rater agreement was higher between tutor endoscopists and junior endoscopists, which could be explained by the teaching effect during the training process [11]. To the best of our knowledge, we are the first to quantitively describe captured endoscopy images of bleeding peptic ulcers and describe their differences. This work paves the way for further development of computer-aided software programs for the endoscopic management of bleeding peptic ulcers in the future.
The Forrest classification was utilized to describe the stigmata of the recent hemorrhage of endoscopic features identified in bleeding peptic ulcers [6]. These endoscopic signs represent different phases of the ulcer in progress. It has a predictive value for the risk of further bleeding, which helps the clinician determine which patients should undergo endoscopic therapy [12]. After moving to the 21st century, there is a significant improvement in medical therapy, such as the widespread use of proton pump inhibitors [13,14,15] and the eradication of Helicobacter pylori infections that have led to a decrease in the prevalence of peptic ulcer disease and its complications such as bleeding, perforation, or obstruction [16,17]. A survey conducted in the UK demonstrated that the experience of trainee endoscopists has reduced over the past two decades from 76% in 1996 to 15% in 2011 [2]. Although hemostatic skills such as injection, coagulation, or clipping could be acquired and improved by utilizing ex vivo models [18], experience in determining the optimal management for a bleeding peptic ulcer can typically only be acquired during daily practice in most endoscopy units or offered by some dedicated developed training courses [19,20,21,22]. However, in 1997 Lau [23] reported low agreement between 14 international experts with a weighted kappa of 0.43 on utilizing 100 consecutive edited videotape records from patients with bleeding peptic ulcers. Bour et al. [24] utilized 91 consecutive endoscopic video recordings of adult patients. Nine endoscopists reviewed the videos and the intra-observer agreement was good (kappa = 0.60). These studies were performed in the late 20th century, an era during which the resolution of endoscopy system is low, and the images were only obtained with the use of video tapes or printed images. As far as we know, our study was the first in the 21st century to re-assess the performance of the Forrest classification utilizing a large set of obtained endoscopy images. Both the intra-observer agreement (which ranged from 0.92 to 0.97) and the inter-rater agreement (which ranged from 0.67 to 0.86) of the Forrest classification were higher than previously reported [23,24]. This finding may imply that the superiority of the quality of modern endoscopy images compared to old-fashioned 35-mm slides or videotapes [25] has improved endoscopy training in the 21st century.
One importance of the present study is that we are the first to provide quantitively analyze the different classes of peptic ulcer bleeding. In addition to the patient’s clinical characteristics, the endoscopic appearance of the ulcer provides useful prognostic information on further bleeding [4,12,26]. He et al. [27] recently described the endoscopy morphology change of 298 patients with bleeding gastric ulcer. The study described the size, location and bleeding pattern are significantly correlated with those the stage of the ulcers. Identification of the protruded non-bleeding visible vessel among Forrest IIA ulcer was found to be an independent risk factor of peptic ulcer rebleeding [28]. The endoscopic Forrest classification of artificial gastric ulcers following endoscopic submucosal dissection was useful predicting delayed bleeding [29]. Therefore, careful observation of endoscopic features of all bleeding peptic ulcers helps clinicians in the triage of patients for further treatment plans or, in some cases, in determining the need for surgical interventions.
The difference in the interpretation of endoscopy images highlighted the difference in the perception of each endoscopist’s eyes [13]. To our knowledge, no previous study has attempted to explain the differences in images taken from the different stages of bleeding peptic ulcer. It is impossible to conduct the analysis when the endoscopy images were not electronically captured, and it requires additional manpower to label endoscopy images for analysis. In the present study, we found a distinct pattern of high-risk (Forrest I, IIA, and IIB) and low-risk ulcers (Forrest IIC and III lesions) while analyzing the relationship between the ulcer and bleeder in individual endoscopy images. The ratio of the lowest proportion area of bleeders among Forrest III lesions to the highest proportion area of bleeders among Forrest I lesions corresponds to the evolution of the bleeding ulcer. In addition, Forrest IIB lesions with adherent blood clots appeared to have a higher proportion of bleeder areas than Forrest IIA lesions but like that of Forrest I lesions. This finding provides an explanation of the need to remove adherent blood clots or further clinical decision-making during emergency endoscopy [3,8,9]. Our previous work reported the use of whole endoscopic image to develop an classification deep learning model and found the use of such model have the potential to perform a better prediction than young endoscopist [5]. The present work is the first work of endoscopy image segmentation work for the relationship of bleeding areas and ulcer areas [30,31]. To develop a reliable artificial intelligence system during diagnostic endoscopy, the first work is delineate the lesion for model training [32]. This study of the captured images paves the way for further study on the applications of deep learning methods in this field, i.e., automatic identification possible bleeder, quantification of the ulcer areas or automatic classification of the Forrest classification during endoscopic examination [4,33,34].
However, our study has some limitations. First, all study data came from one hospital in the past five years and only images from the Olympus endoscope system were analyzed. Future studies, including use of the FujiFilm systems will be required to make the study result more generalized and reliable. Second, the classification of the obtained images was done mainly by two tutor endoscopists in our institution, which may not reflect the opinions of other experts from other institutions. Part of patients were assigned to different classes of risk according to the Forrest classification even in expert hands. This may significantly change the prognosis and require further clinical and endoscopically follow-up. Third, unlike endoscopy images taken during screening [31], those from patients with bleeding peptic ulcers are usually taken in an emergency and with less preparation. The obtained images are frequently disturbed by blood clots, food debris, or air bubbles that interfere with the performance of emergency endoscopy. The process of defining an ulcer or bleeder area is sometimes not clear-cut, and we tried to avoid inconsistencies by having two tutor endoscopists review the obtained results in this study.

5. Conclusions

We found good agreement in the Forrest classification between endoscopists in a single center. The agreement rate is higher than the ones that were previously reported while utilizing modern high-resolution endoscopy. Our study provides a quantitative analysis of the distinct patterns of bleeding ulcers based on their Forrest classification.

Author Contributions

Conceptualization and design of the study, H.-H.Y., P.-Y.W. and K.-P.L.; drafting of the manuscript, H.-H.Y., P.-Y.W., Y.-Y.C. and K.-P.L.; data collection, T.-L.W., S.-P.H., M.-F.C., W.-C.L. and C.-L.T.; revision and editing of the manuscript, H.-H.Y. and P.-Y.W. All authors have read and agreed to the published version of the manuscript.

Funding

The authors received funding from the Changhua Christian Hospital (109-CCH-CYCU-001, 109-CCH-IRP-008 and 110-CCH-IRP-020) for this study.

Institutional Review Board Statement

The study was performed following the principles outlined in the Helsinki Declaration, and it was approved by the institutional review board of the Changhua Christian Hospital (IRB Number: 200906, Approval Date: 19 October 2020).

Informed Consent Statement

Not applicable.

Data Availability Statement

The data is available on reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Waddell, K.M.; Stanley, A.J.; Morris, A.J. Endoscopy for upper gastrointestinal bleeding: Where are we in 2017? Frontline Gastroenterol. 2017, 8, 94–97. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Penny, H.A.; Kurien, M.; Wong, E.; Ahmed, R.; Ejenavi, E.; Lau, M.; Romaya, C.; Gohar, F.; Dear, K.L.; Kapur, K.; et al. Changing trends in the UK management of upper GI bleeding: Is there evidence of reduced UK training experience? Frontline Gastroenterol. 2016, 7, 67–72. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Gralnek, I.M.; Dumonceau, J.M.; Kuipers, E.J.; Lanas, A.; Sanders, D.S.; Kurien, M.; Rotondano, G.; Hucl, T.; Dinis-Ribeiro, M.; Marmo, R.; et al. Diagnosis and management of nonvariceal upper gastrointestinal hemorrhage: European Society of Gastrointestinal Endoscopy (ESGE) Guideline. Endoscopy 2015, 47, a1–a46. [Google Scholar] [CrossRef] [Green Version]
  4. Yen, H.H.; Wu, P.Y.; Chen, M.F.; Lin, W.C.; Tsai, C.L.; Lin, K.P. Current Status and Future Perspective of Artificial Intelligence in the Management of Peptic Ulcer Bleeding: A Review of Recent Literature. J. Clin. Med. 2021, 10, 3527. [Google Scholar] [CrossRef] [PubMed]
  5. Yen, H.-H.; Wu, P.-Y.; Su, P.-Y.; Yang, C.-W.; Chen, Y.-Y.; Chen, M.-F.; Lin, W.-C.; Tsai, C.-L.; Lin, K.-P. Performance Comparison of the Deep Learning and the Human Endoscopist for Bleeding Peptic Ulcer Disease. J. Med. Biol. Eng. 2021, 41, 504–513. [Google Scholar] [CrossRef]
  6. Forrest, J.A.; Finlayson, N.D.; Shearman, D.J. Endoscopy in gastrointestinal bleeding. Lancet 1974, 2, 394–397. [Google Scholar] [CrossRef]
  7. Mondardini, A.; Barletti, C.; Rocca, G.; Garripoli, A.; Sambataro, A.; Perotto, C.; Repici, A.; Ferrari, A. Non-variceal upper gastrointestinal bleeding and Forrest’s classification: Diagnostic agreement between endoscopists from the same area. Endoscopy 1998, 30, 508–512. [Google Scholar] [CrossRef]
  8. Barkun, A.N.; Almadi, M.; Kuipers, E.J.; Laine, L.; Sung, J.; Tse, F.; Leontiadis, G.I.; Abraham, N.S.; Calvet, X.; Chan, F.K.L.; et al. Management of Nonvariceal Upper Gastrointestinal Bleeding: Guideline Recommendations From the International Consensus Group. Ann. Intern. Med. 2019, 171, 805–822. [Google Scholar] [CrossRef] [Green Version]
  9. Sung, J.J.; Chiu, P.W.; Chan, F.K.L.; Lau, J.Y.; Goh, K.L.; Ho, L.H.; Jung, H.Y.; Sollano, J.D.; Gotoda, T.; Reddy, N.; et al. Asia-Pacific working group consensus on non-variceal upper gastrointestinal bleeding: An update 2018. Gut 2018, 67, 1757–1768. [Google Scholar] [CrossRef]
  10. Lu, Y.; Barkun, A.N.; Martel, M.; REASON Investigators. Adherence to guidelines: A national audit of the management of acute upper gastrointestinal bleeding. The REASON registry. Can. J. Gastroenterol. Hepatol. 2014, 28, 495–501. [Google Scholar] [CrossRef]
  11. Laine, L.; Freeman, M.; Cohen, H. Lack of uniformity in evaluation of endoscopic prognostic features of bleeding ulcers. Gastrointest. Endosc. 1994, 40, 411–417. [Google Scholar] [CrossRef]
  12. Freeman, M.L. Value of stigmata in decision-making in gastrointestinal haemorrhage. Best Pract. Res. Clin. Gastroenterol. 2000, 14, 411–425. [Google Scholar] [CrossRef] [PubMed]
  13. Wu, T.-L.; Chou, K.-C.; Yen, H.-H. Stevens-Johnson syndrome: A rare complication of esomeprazole. Adv. Dig. Med. 2022, 9, 57–60. [Google Scholar] [CrossRef]
  14. Yen, H.H.; Yang, C.W.; Su, W.W.; Soon, M.S.; Wu, S.S.; Lin, H.J. Oral versus intravenous proton pump inhibitors in preventing re-bleeding for patients with peptic ulcer bleeding after successful endoscopic therapy. BMC Gastroenterol. 2012, 12, 66. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Bitar, S.M.; Moussa, M. The risk factors for the recurrent upper gastrointestinal hemorrhage among acute peptic ulcer disease patients in Syria: A prospective cohort study. Ann. Med. Surg. 2022, 74, 103252. [Google Scholar] [CrossRef]
  16. Hsiao, S.W.; Chen, M.W.; Yang, C.W.; Lin, K.H.; Chen, Y.Y.; Kor, C.T.; Huang, S.P.; Yen, H.H. A Nomogram for Predicting Laparoscopic and Endoscopic Cooperative Surgery during the Endoscopic Resection of Subepithelial Tumors of the Upper Gastrointestinal Tract. Diagnostics 2021, 11, 2160. [Google Scholar] [CrossRef]
  17. Chua, B.Q.Y.; Chong, V.W.S.; Teng, T.Z.J.; Chia, C.T.W.; Aung, M.O.; Shelat, V.G. Does technology-enhanced communication improve Helicobacter pylori eradication outcomes?—A meta-analysis. In Helicobacter; Wiley Online Library: New York, NY, USA, 2022; p. e12890. [Google Scholar] [CrossRef]
  18. Wang, T.E.; Wang, H.Y.; Lin, C.C.; Chen, T.Y.; Chang, C.W.; Chen, C.J.; Chen, M.J. Simulating a target lesion for endoscopic submucosal dissection training in an ex vivo pig model. Gastrointest. Endosc. 2011, 74, 398–402. [Google Scholar] [CrossRef]
  19. Mehta, V.; Kang, S.; Thoufeeq, M. The Role of Haemostasis Course in Increasing Knowledge and Skills in Managing Upper Gastrointestinal Bleed of the Delegates: A British Society of Gastroenterology’s Endoscopy Quality Improvement Programme, Yorkshire Project. Cureus 2021, 13, e15511. [Google Scholar] [CrossRef]
  20. Al-Rifaie, A.; Min, T.; Allam, D.; Smith, K.; Hurlstone, D.P.; Abdo, A.; Said, E.; Donnelly, M. Endoscopy training in upper GI bleeding for UK trainees in Khartoum, Sudan: South Yorkshire experience. Frontline Gastroenterol. 2020, 11, 496–497. [Google Scholar] [CrossRef]
  21. Lee, D.S.; Ahn, J.Y.; Lee, G.H. A Newly Designed 3-Dimensional Printer-Based Gastric Hemostasis Simulator with Two Modules for Endoscopic Trainees (with Video). Gut Liver 2019, 13, 415–420. [Google Scholar] [CrossRef] [Green Version]
  22. Siau, K.; Hawkes, N.D.; Dunckley, P. Training in Endoscopy. Curr. Treat. Options Gastroenterol. 2018, 16, 345–361. [Google Scholar] [CrossRef] [PubMed]
  23. Lau, J.Y.; Sung, J.J.; Chan, A.C.; Lai, G.W.; Lau, J.T.; Ng, E.K.; Chung, S.C.; Li, A.K. Stigmata of hemorrhage in bleeding peptic ulcers: An interobserver agreement study among international experts. Gastrointest. Endosc. 1997, 46, 33–36. [Google Scholar] [CrossRef]
  24. Bour, B.; Person, B.; Cales, P.; Blanchi, A.; Burtin, P.; Oberti, F.; Boyer, J.; Kaassis, M.; Joundy, N.; Fort, J. Interobserver agreement on endoscopic diagnosis of bleeding peptic ulcers. Gastrointest. Endosc. 1997, 46, 27–32. [Google Scholar] [CrossRef]
  25. Freeman, M.L. Training endoscopists to recognize the stigmata of hemorrhage in bleeding ulcers. Endoscopy 1995, 27, 90–92. [Google Scholar] [CrossRef]
  26. de Groot, N.L.; van Oijen, M.G.; Kessels, K.; Hemmink, M.; Weusten, B.L.; Timmer, R.; Hazen, W.L.; van Lelyveld, N.; Vermeijden, R.R.; Curvers, W.L.; et al. Reassessment of the predictive value of the Forrest classification for peptic ulcer rebleeding and mortality: Can classification be simplified? Endoscopy 2014, 46, 46–52. [Google Scholar] [CrossRef]
  27. Xiaohua, H. Correlation between Endoscopic Morphology and Bleeding of Gastric Ulcer. J. Healthc. Eng. 2022, 2022, 2169551. [Google Scholar] [CrossRef]
  28. Lan, T.; Tong, H.; Qian, S.; Wei, B.; Huang, Z.; Wu, H.; Tan, Q.; Gao, J.; Bai, S.; Gong, H.; et al. Prophylactic transcatheter angiographic embolization reduces Forrest IIa ulcer rebleeding: A retrospective study. Medicine 2021, 100, e23855. [Google Scholar] [CrossRef]
  29. Kim, D.S.; Jung, Y.; Rhee, H.S.; Lee, S.J.; Jo, Y.G.; Kim, J.H.; Park, J.M.; Chung, I.K.; Cho, Y.S.; Lee, T.H.; et al. Usefulness of the Forrest Classification to Predict Artificial Ulcer Rebleeding during Second-Look Endoscopy after Endoscopic Submucosal Dissection. Clin. Endosc. 2016, 49, 273–281. [Google Scholar] [CrossRef] [Green Version]
  30. Abdelrahim, M.; Saiga, H.; Maeda, N.; Hossain, E.; Ikeda, H.; Bhandari, P. Automated sizing of colorectal polyps using computer vision. Gut 2022, 71, 7–9. [Google Scholar] [CrossRef]
  31. Jha, D.; Ali, S.; Hicks, S.; Thambawita, V.; Borgli, H.; Smedsrud, P.H.; de Lange, T.; Pogorelov, K.; Wang, X.; Harzig, P.; et al. A comprehensive analysis of classification methods in gastrointestinal endoscopy imaging. Med. Image Anal. 2021, 70, 102007. [Google Scholar] [CrossRef]
  32. Ebigbo, A.; Mendel, R.; Probst, A.; Meinikheim, M.; Byrne, M.F.; Messmann, H.; Palm, C. Multimodal imaging for detection and segmentation of Barrett’s esophagus-related neoplasia using artificial intelligence. Endoscopy, 2021; online ahead of print. [Google Scholar] [CrossRef] [PubMed]
  33. Chang, Y.Y.; Li, P.C.; Chang, R.F.; Chang, Y.Y.; Huang, S.P.; Chen, Y.Y.; Chang, W.Y.; Yen, H.H. Development and validation of a deep learning-based algorithm for colonoscopy quality assessment. Surg. Endosc. 2022; online ahead of print. [Google Scholar] [CrossRef] [PubMed]
  34. Chang, Y.Y.; Li, P.C.; Chang, R.F.; Yao, C.D.; Chen, Y.Y.; Chang, W.Y.; Yen, H.H. Deep learning-based endoscopic anatomy classification: An accelerated approach for data preparation and model validation. Surg. Endosc. 2021; online ahead of print. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Illustration of Peptic Ulcer Image Processing. The regions of ulcers or bleeders were delineated by two endoscopists. Proportion of Ulcer Area = (Yellow + Orange)/(Yellow + Orang + Pink) × 100%. Proportion of Bleeder Area = (Pink + Orange)/(Yellow + Orang + Pink) × 100%. Proportion of the overlapping area of ulcer/bleeder = (Orange)/(Yellow + Orang + Pink) × 100%.
Figure 1. Illustration of Peptic Ulcer Image Processing. The regions of ulcers or bleeders were delineated by two endoscopists. Proportion of Ulcer Area = (Yellow + Orange)/(Yellow + Orang + Pink) × 100%. Proportion of Bleeder Area = (Pink + Orange)/(Yellow + Orang + Pink) × 100%. Proportion of the overlapping area of ulcer/bleeder = (Orange)/(Yellow + Orang + Pink) × 100%.
Diagnostics 12 01066 g001
Figure 2. Illustration of the image analysis work of different peptic ulcer images. (a). Forrest, I lesion, actively bleeding ulcer. Original image (left), image segmented into ulcer/bleeder areas (middle), combined image (right). (b). Forrest IIB lesion, ulcer with adherent clots. Original image (left), image segmented into ulcer/bleeder areas (middle), combined image (right). (c). Forrest IIc lesion, ulcer with red spots. Original image (left), image segmented into ulcer/bleeder areas (middle), combined image (right).
Figure 2. Illustration of the image analysis work of different peptic ulcer images. (a). Forrest, I lesion, actively bleeding ulcer. Original image (left), image segmented into ulcer/bleeder areas (middle), combined image (right). (b). Forrest IIB lesion, ulcer with adherent clots. Original image (left), image segmented into ulcer/bleeder areas (middle), combined image (right). (c). Forrest IIc lesion, ulcer with red spots. Original image (left), image segmented into ulcer/bleeder areas (middle), combined image (right).
Diagnostics 12 01066 g002
Figure 3. Proportions of bleeding areas in the different stages of the Forrest classification.
Figure 3. Proportions of bleeding areas in the different stages of the Forrest classification.
Diagnostics 12 01066 g003
Figure 4. Proportions of overlapping areas of ulcers and bleeders in the different stages of the Forrest classification.
Figure 4. Proportions of overlapping areas of ulcers and bleeders in the different stages of the Forrest classification.
Diagnostics 12 01066 g004
Table 1. Intra-rater agreement of the Forrest classification.
Table 1. Intra-rater agreement of the Forrest classification.
RaterIntraclass Correlation95% Confidence INTERVAL
Experienced 10.950.94 to 0.97
Experienced 20.950.93 to 0.97
Junior 10.910.87 to 0.93
Junior 20.920.89 to 0.94
Junior 30.960.95 to 0.98
Junior 40.970.95 to 0.98
Table 2. Inter-rater and intra-rater agreements of the Forrest classification.
Table 2. Inter-rater and intra-rater agreements of the Forrest classification.
Experienced 1Experienced 2Junior 1Junior 2Junior 3Junior 4
Tutor a0.670.680.740.790.770.79
Experienced 1 0.670.660.640.720.71
Experienced 2 0.680.640.650.71
Junior 1 0.670.670.76
Junior 2 0.860.74
Junior 3 0.73
a The consensus result of two expert endoscopists (tutors).
Table 3. Comparison of bleeder patterns among different Forrest classes of the endoscopy images.
Table 3. Comparison of bleeder patterns among different Forrest classes of the endoscopy images.
All Patients (n = 276)Forrest I (n = 54)Forrest IIA (n = 44)Forrest IIB (n = 18)Forrest IIC (n = 53)Forrest III (n = 107)
Area of bleeder,%,
median (IQR)
4.56 (0–46.33)85.67 (40.97–99.23)26.88 (9.99–39.61)68.55 (40.52–92.4)4.11 (0–19.87)0 (0–0)
ComparisonForrest I vs. Forrest IIAForrest I vs. Forrest IIBForrest I vs. Forrest IICForrest I vs. Forrest IIIForrest IIA vs. Forrest IIB
p-value a0.0881.000<0.001<0.001<0.001
ComparisonForrest IIA vs. Forrest IICForrest IIA vs. Forrest IIIForrest IIB vs. Forrest IICForrest IIB vs. Forrest IIIForrest IIC vs. Forrest III
p-value a0.019<0.001<0.001<0.001<0.001
Overlapping area of ulcer and bleeder,%,
median (IQR)
4.22 (0–35.07)39.38 (17.4–54.19)26.88 (9.99–38.94)50.57 (34.22–69.94)4.11 (0–19.87)0 (0–0)
ComparisonForrest I vs. Forrest IIAForrest I vs. Forrest IIBForrest I vs. Forrest IICForrest I vs. Forrest IIIForrest IIA vs. Forrest IIB
p-value a1.0001.000<0.001<0.0010.536
ComparisonForrest IIA vs. Forrest IICForrest IIA vs. Forrest IIIForrest IIB vs. Forrest IICForrest IIB vs. Forrest IIIForrest IIC vs. Forrest III
p-value a0.007<0.001<0.001<0.001<0.001
a With Dunn-Bonferroni post hoc method to compare the p value between five different Forrest classification. The p value was <0.001 of the five Forrest classification tested by Kruskal-Wallis Test.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yen, H.-H.; Wu, P.-Y.; Wu, T.-L.; Huang, S.-P.; Chen, Y.-Y.; Chen, M.-F.; Lin, W.-C.; Tsai, C.-L.; Lin, K.-P. Forrest Classification for Bleeding Peptic Ulcer: A New Look at the Old Endoscopic Classification. Diagnostics 2022, 12, 1066. https://doi.org/10.3390/diagnostics12051066

AMA Style

Yen H-H, Wu P-Y, Wu T-L, Huang S-P, Chen Y-Y, Chen M-F, Lin W-C, Tsai C-L, Lin K-P. Forrest Classification for Bleeding Peptic Ulcer: A New Look at the Old Endoscopic Classification. Diagnostics. 2022; 12(5):1066. https://doi.org/10.3390/diagnostics12051066

Chicago/Turabian Style

Yen, Hsu-Heng, Ping-Yu Wu, Tung-Lung Wu, Siou-Ping Huang, Yang-Yuan Chen, Mei-Fen Chen, Wen-Chen Lin, Cheng-Lun Tsai, and Kang-Ping Lin. 2022. "Forrest Classification for Bleeding Peptic Ulcer: A New Look at the Old Endoscopic Classification" Diagnostics 12, no. 5: 1066. https://doi.org/10.3390/diagnostics12051066

APA Style

Yen, H. -H., Wu, P. -Y., Wu, T. -L., Huang, S. -P., Chen, Y. -Y., Chen, M. -F., Lin, W. -C., Tsai, C. -L., & Lin, K. -P. (2022). Forrest Classification for Bleeding Peptic Ulcer: A New Look at the Old Endoscopic Classification. Diagnostics, 12(5), 1066. https://doi.org/10.3390/diagnostics12051066

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop