Next Article in Journal
A Deep Learning-Based Decision Support Tool for Plant-Parasitic Nematode Management
Next Article in Special Issue
Radiomics Texture Analysis of Bone Marrow Alterations in MRI Knee Examinations
Previous Article in Journal
Scalable Optical Convolutional Neural Networks Based on Free-Space Optics Using Lens Arrays and a Spatial Light Modulator
Previous Article in Special Issue
Content-Based Image Retrieval for Traditional Indonesian Woven Fabric Images Using a Modified Convolutional Neural Network Method
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Assessing Acetabular Index Angle in Infants: A Deep Learning-Based Novel Approach

by
Farmanullah Jan
1,
Atta Rahman
1,*,
Roaa Busaleh
1,
Haya Alwarthan
1,
Samar Aljaser
1,
Sukainah Al-Towailib
1,
Safiyah Alshammari
1,
Khadeejah Rasheed Alhindi
1,
Asrar Almogbil
1,
Dalal A. Bubshait
2 and
Mohammed Imran Basheer Ahmed
3
1
Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
2
Department of Orthopedics, College of Medicine, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
3
Department of Computer Engineering, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31441, Saudi Arabia
*
Author to whom correspondence should be addressed.
J. Imaging 2023, 9(11), 242; https://doi.org/10.3390/jimaging9110242
Submission received: 30 September 2023 / Revised: 25 October 2023 / Accepted: 2 November 2023 / Published: 6 November 2023
(This article belongs to the Special Issue Advances in Image Analysis: Shapes, Textures and Multifractals)

Abstract

:
Developmental dysplasia of the hip (DDH) is a disorder characterized by abnormal hip development that frequently manifests in infancy and early childhood. Preventing DDH from occurring relies on a timely and accurate diagnosis, which requires careful assessment by medical specialists during early X-ray scans. However, this process can be challenging for medical personnel to achieve without proper training. To address this challenge, we propose a computational framework to detect DDH in pelvic X-ray imaging of infants that utilizes a pipelined deep learning-based technique consisting of two stages: instance segmentation and keypoint detection models to measure acetabular index angle and assess DDH affliction in the presented case. The main aim of this process is to provide an objective and unified approach to DDH diagnosis. The model achieved an average pixel error of 2.862 ± 2.392 and an error range of 2.402 ± 1.963° for the acetabular angle measurement relative to the ground truth annotation. Ultimately, the deep-learning model will be integrated into the fully developed mobile application to make it easily accessible for medical specialists to test and evaluate. This will reduce the burden on medical specialists while providing an accurate and explainable DDH diagnosis for infants, thereby increasing their chances of successful treatment and recovery.

1. Introduction

Developmental dysplasia of the hip (DDH) is the most common musculoskeletal developmental disorder that affects newborns and is regarded as the primary cause of around 25% to 43% of end-stage hip arthroplasty cases [1,2]. DDH poses a significant risk to the quality of life for patients from an early age and could persist into adulthood without proper treatment [3]. Failure to recognize and diagnose DDH in its early stages can lead to functional impairment, chronic hip pain, progressive hip degeneration, and accelerated osteoarthritis that necessitates surgical intervention later in life [4].
DDH occurs when the femoral head does not fit into the socket due to an abnormal hip joint, leading to limited hip range of motion, and noticeable gait abnormalities. Early identification through reliable hip diagnostic screening is crucial for timely intervention [5]. Detecting DDH at an early age significantly reduces risks of long-term complications.
The current clinical approach for diagnosing DDH involves manual measurements of various anatomical characteristics from pelvic radiographs, followed by assessment by experienced clinicians or radiologists. However, this process lacks standardization and heavily relies on subjective metrics, demanding a greater degree of knowledge and clinical experience. Recent advancement in computer-aided medical diagnosis (CAD) supplemented with pattern recognition techniques have made it feasible to incorporate these technologies into practical solutions that offer an automated, standardized, and reliable diagnosis of DDH in infants. These solutions utilize the acetabular index angle measurement (AcI) as a clinically established radiographic measurement for assessing the severity of DDH in individual cases (Figure 1). AcI is measured by calculating the angle between two lines. The first line extends from the medial edge to the most lateral aspect of the acetabular sourcil, which refers to the inner rim of the acetabulum. The second line, known as Hilgenreiner’s line, or H-line, runs horizontally on the pelvis. The degree of the angle formed by their intersection indicates the range within which the acetabular index falls. An increased acetabular inclination range is indicative of the presence of DDH [6].
The objective of this study is to present and investigate a pipelined deep-learning framework for diagnosing DDH. The proposed framework leverages Detectron2 Mask RCNN for accurate image segmentation. Subsequently, the segmented images are processed through a keypoint detection network to identify the relevant landmarks required for calculating the AcI and assessing the severity of DDH. It is noteworthy that DDH occurrence cannot be prevented, though an early diagnostic can help decrease the complications. Moreover, mass screening is difficult since not everyone can read or understand it. To the best of our knowledge, there is a need for an automated software tool for assessing DDH in clinical practice. Hence, the implementation of the proposed framework in a fully-fledged mobile application should be of great use to hospitals worldwide.

1.1. Related Literature

There have already been several advances in utilizing CAD to assess DDH in the last decades. The first attempt to automatically detect relevant landmarks from medical images of the infant pelvis could be traced back to 1997, when Overhoff et al. [8], introduced an image processing-based approach to determine the region of interest (ROI) of the acetabulum and approximate the sphere of the femoral head in 3D ultrasound images. The findings of the study were further extended [9] to detect the acetabular landmarks used to assess the relevant angle measurements. More image processing-based algorithms such as the Hough transform were proposed [10] to offer a fully automated approach for the measurement of the acetabular cartilage in MRI medical images. Moreover, in a more recent study, Hough transform was paired with canny edge detection to assess relevant landmarks on the pelvic X-ray images [11].

1.1.1. Detection & Diagnosis Software Tools

Many medical professionals use CAD-based tools to make assessments in clinical settings for DDH diagnosis and AcI quick measurement. Acetabular Index, an application for portable devices, calculates the index via manually detected landmarks. It measures angles in X-ray images through the aid of a circular transparent template, where the points of interest are marked accurately. The lines automatically formed between points serve to measure the angles of interest. Although an abundance of research attempts to propose a reliable method for automating medical diagnosis, few are deployed and utilized in professional environments. BoneView is a good representation of a fully-fledged medical software powered by AI that offers diagnostic features for bone lesions, fractures, and dislocations detection for bone trauma X-rays. Techniques used in BoneView include a ‘Detectron 2’-based diffusion-convolutional neural network (DCNN) model developed for image training. In addition, it applies natural language processing (NLP) algorithms to infer diagnostic interpretations from radiologists’ reports [12]. Similarly, ImageBiopsy Lab launched several software products to detect anomalies in the musculoskeletal system. One product is IB Lab LAMA for automating the assessment of pre-and post-total knee arthroplasty (TKA) lower limb alignment using AI methodologies in addition to “HIPPO” for hip angles and morphology assessments [13,14,15,16,17].

1.1.2. Research Utilizing ML/DL-Based Methodologies

Although traditional image processing-based CAD approaches have achieved acceptable results, they struggle upon implementation with larger and more diverse datasets. In addition, they have a lengthy processing procedure that is impractical in medical environments. That is where artificial intelligence (AI) concepts such as machine learning (ML) and deep learning (DL) come into the picture with a variety of algorithms and frameworks that had been implemented for several purposes such as classification, object detection, instance segmentation, and keypoint detection. Several ML- and DL-based solutions have been utilized in anatomical landmark detection and segmentation in the medical X-ray imaging of the pelvis. Thompson et al. [18] utilized a random-forest-based method for measuring the radiograph’s angular parameters (AcI, RMP) based on automatically detected anatomical landmarks. The proposed system was tested and validated on a clinical dataset of 200 cases. Another ML model was proposed by Jiang et al. [19] using a computer-aided system (CAD) to semi-automatically measure the Tönnis angle, Sharp angle, and CE angle following the bone contours of the hip joint. The CAD system consists of four stages that involve manual bone outlining, automatic landmarks extraction, automatic angle measurement, and hip development assessment and classification using a machine-learning modal support vector machine (SVM). The dataset consisted of 248 X-ray images from Zhongshan Hospital of Dalian University, China.
Using a dataset of 9369 images for patients aged from 0.1 to 14 years, Jingyuan Xu et al. [20] used an hourglass network with an encoder–decoder architecture to generate the heatmap for landmark detection of the pelvic images. The landmarks detected were then used to calculate the acetabular index angle and the age of the femoral head. Similarly, Li Q et al. [21] utilized 11,574 orthotopic anterior pelvic X-ray images to train and test a deep-learning model that consists of a modified Mask R-CNN built on FPN and ResNet101. The model detects four key points of sharp angles from pelvic X-ray images and is later used to automate the calculation of the acetabular angle. Mask RCNN architecture has yet another use case where it was implemented by Xu et al. [22] for image segmentation of the pelvis as the first part of a three-stage pipeline. The second stage was built using HRNet to extract the four relevant DDH landmarks. The final stage was a ResNet model providing a binary diagnosis, which was compared with the judgment of three surgeons to evaluate the AI performance on a dataset of 1398 cases. Additionally, Lee et al. [23] used a Mask RCNN model on ultrasound images to segment the shapes formed by the ilium and acetabular head, then assessed two points on the ilium and three points for calculating the α and β, angles using a dataset of 321 ultrasound scans. Zhang et al. [24] built an FR-DDH deep-learning network with baseline of ResNet101 model to extract feature maps and generate potential neighborhood regions to assess the relevant landmarks and calculate the necessary measurements. The study used 10,219 anteroposterior pelvic radiographs from children aged 10 days to 10 years with a mean age of 1.5 years.
Several research in the literature aimed to implement a classification model for diagnosing DDH directly. For instance, in a similar study by [25], authors utilized 13 deep learning CNN pre-trained models to individually perform binary classification of DDH with different input sizes, widths, and depths using the ImageNet dataset fine-tuned on a custom dataset with a size of 354 images. Out of the 13 pre-trained deep-transfer models, DarkNet53 achieved the highest performance with an overall accuracy of 96.3%, equating to 95%, 90.6%, 100% and 94.3% for the F1 score, precision, sensitivity, and specificity, respectively. Park et al. [26] constructed a dataset of 5076 cropped unilateral hip joint images and developed a customized CNN binary classifier to evaluate the abnormality of the extracted unilateral hip joints from AP radiographs.
Similarly, in [27] authors developed an AI-based clinical decision support system in association with non-expert clinical DDH ultrasound staff. In the workflow experiment, the AI-based app exhibited 100% specificity and recommended follow-ups with relatively fewer errors. In [28], authors presented a novel deep learning-based approach to DDH diagnosis by misshapen pelvis landmark detection using local–global feature learning. The technique was name as Pyramid Non-local UNet (PN-UNet). The scheme exhibited good average point-to-point error. In this regard, a self-created dataset comprising 10,000 X-ray images was investigated. Earlier, the same authors presented a similar work on the same dataset but using spatial local correlation mining with CNN. Nonetheless, the later scheme was better in terms of mean absolute error (MAE) [29].
Such types of automated and AI-based studies have been promising in contrast to the general practitioners’ assessments and surveillance which requires mass screening which is laborious as well as erroneous [30].
Likewise, there are several applications of numerical and deep-learning approaches to solve problems in interdisciplinary areas such as physics [31], hyperphysical [32] and healthcare sectors [33,34,35].

1.1.3. Research Gap

Several deep-learning approaches have been utilized to automate DDH diagnosis from medical imaging. Some researchers developed tools to help professionals diagnose DDH by calculating the related clinical measurement, while others aimed to fully automate the process and offer direct binary classification. Nonetheless, a recurrent theme in the literature is primarily observed in the diversity of bone morphology in the imagery dataset due to the large age range in contrast to other factors such as gender and ethnicity. This could be remedied by restricting the ages of the included instances to make it simpler for the deep-learning models to recognize patterns, especially as the available datasets in this scope are of a small size. The lack of practical implementation of the research findings is another identified drawback in the earlier studies. Many have suggested developing applications for portable devices to better aid clinicians in various healthcare domains. However, there have been no advances in that area yet.
Only a few application or software tools are available. These are usually owned by a facility or practice and not available for public use by the physicians. Table 1 presents a comparative analysis of various state-of-the-art methods in landmark detection.
The rest of the paper is organized as: Section 2 presents the materials & methods. Section 3 is dedicated to experimental results. Section 4 provides discussion on the results, while Section 5 concludes the paper.

2. Materials and Methods

The dataset used in detecting developmental dysplasia of the hip (DDH) was obtained by the authors of [25] from King Abdullah University Hospital, Jordan University of Science and Technology in Jordan. The dataset included 354 radiograph images of the pelvic area in infants with a mean age of 4.5 ± 0.83, maximizing at 7 months. The dataset format sourced from the main authors is divided into two labels including 120 instances for DDH classified cases, and 234 images of normal condition cases. Nonetheless, the divergence of the use case in this paper calls for additional data annotation measures of the major landmarks in the pelvis guided by experienced radiologists.

2.1. Data Annotation

The tool CVAT [36] was utilized to annotate the X-ray images. CVAT is an open-source video and image annotation tool. It offers various annotation features for object detection, semantic segmentation, and classification. First, the four landmarks that lie on the Hilgenreiner line and the lateral aspect of the acetabulum roof that passes through the acetabular sourcil’s medial edge were annotated as one object. Each point was labeled according to its position in the X-ray image (left up, left down, right up, right down) indicating the left and right side of the acetabulum superolateral margin and tri-radiate cartilage center. Additionally, the X-ray images were labeled for image segmentation in polygons. The ilium is the upper bone, the pubis, the ischium is the middle bone, and lastly, the femur is the lower bone using the polygon tool. Figure 2 shows the instance segmentation and keypoint labeling.

2.2. Statistical Analysis of the Dataset

Given the four pelvis landmarks, a measurement of the acetabular index angle can be calculated using the following formulas:
H = ( RD , LD ) ,
R = ( RU , RD ) ,
L = ( RU , LD ) ,
θ M = tan 1 H . M d e t ( H , M )
where H represents the Hilgenreiner line, R and L represent the side of the line passing through the lateral aspect of the acetabulum to the acetabular sourcil’s medial edge in the respective side, where   M { R , L } . Each of the landmarks (RU, RD, LU, LD) represent the co-ordinates of the right side lateral acetabular edge, right-side triradiate cartilage, left-side lateral acetabular edge and left-side triradiate cartilage.
Statistical analysis of the acetabular index angle measurement was conducted on all images within the dataset. The analysis utilizes five number summaries for each class: median, minimum (Min), first quartile (Q1), third quartile (Q3), and maximum (Max). Table 2 enlists the five number summary of acetabula index angle classes in the dataset.
Statistical analysis tools can show the presence of outliers in the data. The findings show a mean of 20.0° for acetabular index angle measurement in normal patients. The cases afflicted with DDH however obtained a mean of 30°. The box plot for Normal cases and the DDH cases are shown in Figure 3.

2.3. Operationl Framework

Landmark detection is the most critical step for assessing the acetabular index angle in X-ray images and diagnosing DDH afterwards. This research proposes a software tool to fully automate the process of identifying the relevant landmarks in pelvic anatomy and eliminate the need for human intervention.
Nonetheless, choosing the best strategy for a particular task poses a significant challenge that calls for extensive investigation of the most optimized technique to deploy. This project approaches this problem by utilizing the concepts of convolutional neural networks (CNNs). The rationale for this decision is that a CNN is purportedly the most convenient technique to handle computer vision tasks with imagery data as presented in the literature [37,38,39]. CNN is a standardized type of feed-forward neural network that discovers feature space inherently by optimizing the filters. Moreover, the famous vanishing and exploding gradients that are mainly observed during backpropagation-based neural networks are adequately prevented by utilizing the standardized weights over limited connections [40,41].

2.4. Experemintal Setup

For developing the pipelined landmarks detection model, the Python programming language was used. The model was trained using Pytorch and Detectron2 frameworks on a Windows workstation equipped with an AMD Ryzen 7 5800X CPU and a 12 GB Nvidia GeForce 3060 GPU. The dataset was randomly split into 70% for the training, 10% for the validation, and 20% for testing.

3. Results

In this work, two main approaches were implemented. Namely the baseline landmark detection, and the pipeline-based approach that consists of stacked-up instance segmentation and landmark detection models.

3.1. Baseline Landmarks Detection

Landmarks detection describes locating the spatial places and points that are prominent in an image. For assessing the acetabular index angle (AcI), four landmarks within the pelvic X-ray image must be detected: the left and right tri-radiate cartilage center, in addition to the left and right acetabulum superolateral margin. This work utilizes two keypoint detection network architectures and a ResNet50-based model that was fine-tuned to the dataset to produce a final layer with eight outputs. Moreover, Keypoint RCNN architecture was implemented in Detectron2, a Python-based platform for several computer vision tasks. It is a deep neural network used for detecting and localizing human body keypoints based on the Mask R-CNN network architecture proposed by the Facebook research team [42]. Minor changes to the architecture included the addition of a new keypoint head consisting of eight 3 × 3 512-d convolutional layers, followed by a deconvolution layer and 2× bilinear upscaling, producing an output resolution of 56 × 56. This network was adopted and trained with optimal hyperparameters.

3.2. Pipeline Landmark Detection

The recognition of anatomical landmarks is made more difficult by the temporal variability and clinical deformity in the medical imaging of infants. Thus, we have attempted to make it smoother for a neural network model to detect edges and locate the landmarks’ positions in a precise manner. Driven by the effectiveness of image segmentation tools to aid medical imaging by providing a more thorough analysis of anatomical data, a pipeline technique was proposed to boost the performance of the landmark detection network. The process to design a pipelined keypoint detection model included constructing a different dataset where all images are already segmented. This dataset was directly exported from CVAT with COCO 1.0 annotation format, then processed using the Detectron2 Visualizer class to generate a customized segment.

3.2.1. First Stage: Instance Segmentation

Image segmentation refers to the task of dividing an image into segments where each pixel in the image is assigned to an object. There are various types of image segmentation tasks including instance segmentation, panoptic segmentation, and semantic segmentation. The scope of this study is concerned solely with implementing the instance segmentation model, where the main aim is to detect the instance of an object and outline its boundaries along with classifying them and applying binary masking as a preparation measure for the upcoming stage.
The technique utilized for this task is implementing Mask R-CNN, a CNN architecture that extends the findings of its predecessors, namely R-CNN, Fast R-CNN, and faster R-CNN. It introduces significant concepts that were proven efficient in object detection fields, such as region proposal network (RPN) and region of interest pooling (ROI pooling) [36]. The basic architecture of MASK R-CNN consists of a backbone, an RPN, a region of interest alignment layer (RoIAlign), a bounding-box object detection head, and a mask generation head. This work utilizes the official Mask RCNN implementation in Detectron2 for instance segmentation. The optimal parameters used to train this network were set to be identical to the baseline Keypoint RCNN described in Table 3.

3.2.2. Second Stage: Landmark Detection

The network architecture of the second stage is identical to the baseline Keypoint RCNN. The main difference is the data it expects to receive have a format of binary masked images because of visualizing the segmented polygons annotations in the training phase. However, the inference pipeline uses the output generated by passing the instance segmentation model as input to detect the four landmarks. Figure 4 depicts the pipeline segmentation and keypoint detection process.

3.2.3. Performance Metrics

The performance of the model for landmarks detection on the test was evaluated using root mean squared error (RMSE), according to the following equation [43]:
R M S E = i = 1 n ( y i ^ y i ) 2 n
In addition, to present more perceptible results that can be evaluated by medical specialists, metrics such as the acetabular index error rate, and the pixel error were added as well, calculated according to the following equations:
A c e t a b u l a r   I n d e x   A n g l e   E r r o r = i = 1 n | A c I i ^ A c I i | n
P i x e l   E r r o r = i = 1 n ( x ^ i x i ) 2 + ( y i ^ y i ) 2 n
A comparison between the proposed pipelined technique and the baseline landmarks detection models was carried out as part of the experiments. Additionally, based on the generated acetabular index (AcI) angle measurement in comparison to the ground truth labels obtained from the original dataset, a diagnosis of DDH was made. The RMSE and ACI error rate values for the test dataset before and after prior segmentation are shown in Table 4 correspondingly.
As observed, applying segmentation with binary masking on the Keypoint RCNN model yielded the best results yet in the entirety of this study, surpassing the performance of both ResNet50 based network approaches and the baseline Keypoint RCNN model. Table 5 and Table 6 show the detailed results of AcI error and pixel error achieved by the enhanced Keypoint RCNN detection model.
Tracking the loss in the model training process is crucial in building deep-learning models. It ensures that the training is going in the right direction. This was positively verified in training the Pipelined Keypoint RCNN model as shown in Figure 5.

4. Discussion

Although X-ray imaging is regarded as a reliable tool for DDH diagnosis, a challenge can be presented in relation to the age of screening. The femoral head nuclei start to appear between 4 to 7 months, giving the X-ray imaging screened at that age more ambiguous bone definition, which consequently affect the judgment of the radiologists diagnosing the presented case [44]. Nonetheless, the error rate produced from the AI diagnosis is noticeably low in this study as it achieved a pixel error in landmarks detection of 2.862 ± 2.392 and AcI measurement error of 2.402 ± 1.963°. The highest performance achieved in the literature for landmarks detection used a random forest regression voting model with a point-to-point error of 2.72 mm. For the AcI calculation, the multi-task hourglass network achieved the lowest error in the prior work with an ACI angle error of 2.776 ± 2.381° [20]. The slight performance boost in this study, despite the small size of the dataset, could be attributed to adopting a multistage pipeline where detecting the landmarks is preceded by segmenting the images. Moreover, with a dataset of similar bone morphology, AI models are more inclined to recognize a pattern with less error rate. Nonetheless, it can be observed that the performance metrics of the prior works are of high divergence. Thus, standardized evaluation methods are highly capable of comparing the performance of works within the same scope.
This study has a few limitations including the small-sized dataset and the low quality of images in addition to ensuring the reliability of labeling in the utilized open-sourced dataset by experienced radiologists. Moreover, the lack of patient clinical data in each case such as age, gender, and ethnicity can affect the final judgment of DDH affliction, which currently is solely dependent on the anatomical landmarks on the medical image. Additionally, more radiographic measurement can be taken into consideration besides acetabular index angle, namely the sharp angle and lateral center-edge angle for supportive assessment of the case.
To address these issues, future work can extend the findings of this study by including more radiographical measurements to cover more pelvis related diseases in conjunction with transfer learning [45]. Additionally, utilizing online deployed models to continuously feed the model with new data that are validated by the medical professionals of the system will improve the long-term performance of the automatic DDH diagnosis. Moreover, the authors intend to deploy the deep-learning model in a working mobile application to be released soon and adopted by local hospitals in Saudi Arabia.

5. Conclusions

This study introduces the pipeline landmarks detection technique, a novel method for detecting DDH, which involves applying binary masked image segmentation before passing the data to the landmark’s detection network. The landmarks detection model based on the Detectron2 implementation was trained on the considered diverse open dataset, achieving 2.402 ± 1.963° for the acetabular angle measurement relative to the ground truth annotation and pixel error of 2.862 ± 2.392 for the landmarks. These values indicate an error range that is acceptable in medical and professional fields. The contributions this work has made included:
  • Fully annotating an open-source dataset [7] for instance segmentation and landmarks detection, which was published solely for binary classification task.
  • Building an efficient deep-learning landmarks detection model with error margin of 2.402 ± 1.963° for the acetabular index angle measurement.
Overall, the proposed methodology in this work can serve as a useful reference and be used broadly to a variety of anatomical landmark identification problems on a larger scale and more reliable dataset with high potential of boosting the current performance. In the future, we intend to investigate further deep-learning paradigms such as transfer learning etc. in conjunction with image-processing approaches to improve the performance and make it robust against potential changes in the dataset type.

Author Contributions

Conceptualization, A.R. and D.A.B.; Data curation, R.B., H.A., S.A. (Samar Aljaser), S.A.-T. and S.A. (Safiyah Alshammari); Formal analysis, F.J., A.A. and M.I.B.A.; Funding acquisition, M.I.B.A.; Investigation, K.R.A. and A.A.; Methodology, A.R., H.A. and D.A.B.; Project administration, R.B.; Software, R.B., H.A., S.A. (Samar Aljaser), S.A.-T. and S.A. (Safiyah Alshammari); Supervision, F.J., A.R., K.R.A. and A.A.; Validation, F.J., K.R.A., D.A.B. and M.I.B.A.; Writing—original draft, R.B., H.A., S.A. (Samar Aljaser), S.A.-T. and S.A. (Safiyah Alshammari); Writing—review & editing, F.J. and A.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data is available with the corresponding author and can be provided on reasonable request.

Acknowledgments

The authors greatly appreciate the domain knowledge and the idea provided by College of Medicines, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Gambling, T.S.; Long, A. Psycho-social impact of developmental dysplasia of the hip and of differential access to early diagnosis and treatment: A narrative study of young adults. SAGE Open Med. 2019, 7, 2050312119836010. [Google Scholar] [CrossRef] [PubMed]
  2. Pun, S. Hip dysplasia in the young adult caused by residual childhood and adolescent-onset dysplasia. Curr. Rev. Musculoskelet. Med. 2016, 9, 427–434. [Google Scholar] [CrossRef] [PubMed]
  3. Sadat-Ali, M. Developmental Dysplasia of the Hip (DDH) in Saudi Arabia: Time to Wake up. A Systematic Review (1980–2018). Open J. Epidemiol. 2020, 10, 125. [Google Scholar] [CrossRef]
  4. Nandhagopal, T.; De Cicco, F.L. Developmental Dysplasia of the Hip–NCBI Bookshelf; StatPearls: St. Petersburg, FL, USA, 2023; Available online: https://www.ncbi.nlm.nih.gov/books/NBK563157/ (accessed on 25 September 2022).
  5. AAOS. Developmental Dislocation (Dysplasia) of the Hip (DDH). 2022. Available online: https://orthoinfo.aaos.org/en/diseases--conditions/developmental-dislocation-dysplasia-of-the-hip-ddh/ (accessed on 28 August 2023).
  6. Chmiel-Nowak, M. Acetabular Index. Radiology Reference Article. 2022. Available online: https://radiopaedia.org/articles/acetabular-index?lang=gb (accessed on 6 October 2022).
  7. Fraiwan, M.; Al-Kofahi, N.; Hanatleh, O.; Ibnian, A. A Dataset of DDH X-ray Images. Available online: https://data.mendeley.com/datasets/jf3pv98m9g/2 (accessed on 15 June 2023).
  8. Overhoff, H.M.; Lazovic, D.; Franke, J.; Jan, U.V. Automatic determination of the newborn’s femoral head from three-dimensional ultrasound image data. In Lecture Notes in Computer Science; Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics; Springer: Berlin/Heidelberg, Germany, 1997. [Google Scholar] [CrossRef]
  9. Overhoff, H.M.; Lazovic, D.; von Jan, U.; Heinze, P. Computer-based determination of the newborn’s femoral head coverage using three-dimensional ultrasound scans. In Lecture Notes in Computer Science; Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics; Springer: Berlin/Heidelberg, Germany, 1998. [Google Scholar] [CrossRef]
  10. Nishii, T.; Sugano, N.; Sato, Y.; Tanaka, H.; Miki, H.; Yoshikawa, H. Three-dimensional distribution of acetabular cartilage thickness in patients with hip dysplasia: A fully automated computational analysis of MR imaging. Osteoarthr. Cartil. 2004, 12, 650–657. [Google Scholar] [CrossRef] [PubMed]
  11. Al-Bashir, A.K.; Al-Abed, M.; Sharkh, F.M.A.; Kordeya, M.N.; Rousan, F.M. Algorithm for automatic angles measurement and screening for Developmental Dysplasia of the Hip (DDH). In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, Milan, Italy, 25–29 August 2015. [Google Scholar] [CrossRef]
  12. BoneView—GLEAMER—Medical-Grade AI for Radiology. GLEAMER—Medical-Grade AI for Radiology. 2022. Available online: https://www.gleamer.ai/solutions/boneview/ (accessed on 4 October 2022).
  13. Carlisle, J.C.; Zebala, L.P.; Shia, D.S.; Hunt, D.; Morgan, P.M.; Prather, H.; Wright, R.W.; Steger-May, K.; Clohisy, J.C. Reliability of various observers in determining common radiographic parameters of adult hip structural anatomy. Iowa Orthop. J. 2011, 31, 52–58. [Google Scholar] [PubMed]
  14. Nguyen, T.; Maarek, R.; Hermann, A.-L.; Kammoun, A.; Marchi, A.; Khelifi-Touhami, M.R.; Collin, M.; Jaillard, A.; Kompel, A.J.; Hayashi, D.; et al. Assessment of an artificial intelligence aid for the detection of appendicular skeletal fractures in children and young adults by senior and junior radiologists. Pediatr. Radiol. 2022, 52, 2215–2226. [Google Scholar] [CrossRef]
  15. IB Lab LAMA CE. 2022. Available online: https://www.imagebiopsy.com/product/lama-ce?utm_lang=en (accessed on 4 October 2022).
  16. IB Lab HIPPO CE. 2022. Available online: https://www.imagebiopsy.com/product/hippo-ce?utm_lang=en (accessed on 4 October 2022).
  17. ImageBiopsy Lab—Products CE, FDA. 2022. Available online: https://www.imagebiopsy.com/products?utm_lang=en (accessed on 4 October 2022).
  18. Thompson, P.; Perry, D.C.; Cootes, T.F.; Lindner, C. Automation of clinical measurements on radiographs of children’s hips. In Proceedings of the Medical Image Computing and Computer Assisted Intervention—MICCAI 2022 25th International Conference, Singapore, 18–22 September 2022. [Google Scholar]
  19. Jiang, Y.; Yang, G.; Liang, Y.; Shi, Q.; Cui, B.; Chang, X.; Qiu, Z.; Zhao, X. Computer-Aided System Application Value for Assessing Hip Development. Front. Physiol. 2020, 11, 587161. [Google Scholar] [CrossRef]
  20. Xu, J.; Xie, H.; Tan, Q.; Wu, H.; Liu, C.; Zhang, S.; Mao, Z.; Zhang, Y. Multi-task hourglass network for online automatic diagnosis of developmental dysplasia of the hip. World Wide Web 2022, 26, 539–559. [Google Scholar] [CrossRef]
  21. Li, Q.; Zhong, L.; Huang, H.; Liu, H.; Qin, Y.; Wang, Y.; Zhou, Z.; Liu, H.; Yang, W.; Qin, M.; et al. Auxiliary diagnosis of developmental dysplasia of the hip by automated detection of Sharp’s angle on standardized anteroposterior pelvic radiographs. Medicine 2019, 98, e18500. [Google Scholar] [CrossRef]
  22. Xu, W.; Shu, L.; Gong, P.; Huang, C.; Xu, J.; Zhao, J.; Shu, Q.; Zhu, M.; Qi, G.; Zhao, G.; et al. A Deep-Learning Aided Diagnostic System in Assessing Developmental Dysplasia of the Hip on Pediatric Pelvic Radiographs. Front. Pediatr. 2022, 9, 785480. [Google Scholar] [CrossRef]
  23. Lee, J.-H. Sensors & Transducers the Novel Computer Aided Diagnostic System on Medical Images for Parameter Calculation. 2021. Available online: http://www.sensorsportal.com (accessed on 30 January 2023).
  24. Zhang, S.C.; Sun, J.; Liu, C.B.; Fang, J.H.; Xie, H.T.; Ning, B. Clinical application of artificial intelligence-assisted diagnosis using anteroposterior pelvic radiographs in children with developmental dysplasia of the hip. Bone Jt. J. 2020, 102, 1574–1581. [Google Scholar] [CrossRef] [PubMed]
  25. Fraiwan, M.; Al-Kofahi, N.; Ibnian, A.; Hanatleh, O. Detection of developmental dysplasia of the hip in X-ray images using deep transfer learning. BMC Med. Inform. Decis. Mak. 2022, 22, 216. [Google Scholar] [CrossRef] [PubMed]
  26. Park, H.S.; Jeon, K.; Cho, Y.J.; Kim, S.W.; Lee, S.B.; Choi, G.; Lee, S.; Choi, Y.H.; Cheon, J.-E.; Kim, W.S.; et al. Diagnostic performance of a new convolutional neural network algorithm for detecting developmental dysplasia of the hip on anteroposterior radiographs. Korean J. Radiol. 2021, 22, 612–623. [Google Scholar] [CrossRef] [PubMed]
  27. Jaremko, J.L.; Hareendranathan, A.; Bolouri, S.E.S.; Frey, R.F.; Dulai, S.; Bailey, A.L. AI aided workflow for hip dysplasia screening using ultrasound in primary care clinics. Sci. Rep. 2023, 13, 9224. [Google Scholar] [CrossRef]
  28. Liu, C.; Xie, H.; Zhang, S.; Mao, Z.; Sun, J.; Zhang, Y. Misshapen Pelvis Landmark Detection with Local-Global Feature Learning for Diagnosing Developmental Dysplasia of the Hip. IEEE Trans. Med. Imaging 2020, 39, 3944–3954. [Google Scholar] [CrossRef]
  29. Liu, C.; Xie, H.; Zhang, S.; Xu, J.; Sun, J.; Zhang, Y. Misshapen Pelvis Landmark Detection by Spatial Local Correlation Mining for Diagnosing Developmental Dysplasia of the Hip. In Proceedings of the Medical Image Computing and Computer Assisted Intervention—MICCAI 2019: 22nd International Conference, Shenzhen, China, 13–17 October 2019; Proceedings, Part VI. Springer: Berlin/Heidelberg, Germany, 2019; pp. 441–449. [Google Scholar] [CrossRef]
  30. Williams, N. Improving early detection of developmental dysplasia of the hip through general practitioner assessment and surveillance. Aust. J. Gen. Pract. 2018, 47, 619–623. [Google Scholar] [CrossRef]
  31. Rahman, A. Memetic computing based numerical solution to Troesch problem. J. Intell. Fuzzy Syst. 2019, 37, 1545–1554. [Google Scholar] [CrossRef]
  32. Musleh, D.; Alotaibi, M.; Alhaidari, F.; Rahman, A.; Mohammad, R.M. Intrusion Detection System Using Feature Extraction with Machine Learning Algorithms in IoT. J. Sens. Actuator Netw. 2023, 12, 29. [Google Scholar] [CrossRef]
  33. Den, H.; Ito, J.; Kokaze, A. Diagnostic accuracy of a deep learning model using YOLOv5 for detecting developmental dysplasia of the hip on radiography images. Sci. Rep. 2023, 13, 6693. [Google Scholar] [CrossRef]
  34. Nasir, M.U.; Khan, S.; Mehmood, S.; Khan, M.A.; Rahman, A.-U.; Hwang, S.O. IoMT-Based Osteosarcoma Cancer Detection in Histopathology Images Using Transfer Learning Empowered with Blockchain, Fog Computing, and Edge Computing. Sensors 2022, 22, 5444. [Google Scholar] [CrossRef]
  35. Rahman, A.U.; Nasir, M.U.; Gollapalli, M.; Zubair, M.; Saleem, M.A.; Mehmood, S.; Khan, M.A.; Mosavi, A. Advance Genome Disorder Prediction Model Empowered with Deep Learning. IEEE Access 2022, 10, 70317–70328. [Google Scholar] [CrossRef]
  36. Computer Vision Annotation Tool. Available online: https://www.cvat.ai/ (accessed on 13 February 2023).
  37. Kannan, A.; Hodgson, A.; Mulpuri, K.; Garbi, R. Uncertainty Estimation for Assessment of 3D US Scan Adequacy and DDH Metric Reliability. In Uncertainty for Safe Utilization of Machine Learning in Medical Imaging, and Graphs in Biomedical Image Analysis: Second International Workshop, UNSURE 2020, and Third International Workshop, GRAIL 2020; Held in Conjunction with MICCAI 2020, Lima, Peru, October 8 2020. Proceedings; Springer-Verlag: Berlin/Heidelberg, Germany, 2020; pp. 97–105. [Google Scholar] [CrossRef]
  38. Alam, E.; Smith, N.; Watson, D.; Hassan, T.; Neupane, K. Early Screening of DDH Using SVM Classification; SoutheastCon: Huntsville, AL, USA, 2019; pp. 1–4. [Google Scholar] [CrossRef]
  39. Ahmed, M.S.; Rahman, A.; AlGhamdi, F.; AlDakheel, S.; Hakami, H.; AlJumah, A.; AlIbrahim, Z.; Youldash, M.; Alam Khan, M.A.; Basheer Ahmed, M.I. Joint Diagnosis of Pneumonia, COVID-19, and Tuberculosis from Chest X-ray Images: A Deep Learning Approach. Diagnostics 2023, 13, 2562. [Google Scholar] [CrossRef] [PubMed]
  40. Lee, S.-W.; Ye, H.-U.; Lee, K.-J.; Jang, W.-Y.; Lee, J.-H.; Hwang, S.-M.; Heo, Y.-R. Accuracy of New Deep Learning Model-Based Segmentation and Key-Point Multi-Detection Method for Ultrasonographic Developmental Dysplasia of the Hip (DDH) Screening. Diagnostics 2021, 11, 1174. [Google Scholar] [CrossRef] [PubMed]
  41. Basheer Ahmed, M.I.; Zaghdoud, R.; Ahmed, M.S.; Sendi, R.; Alsharif, S.; Alabdulkarim, J.; Albin Saad, B.A.; Alsabt, R.; Rahman, A.; Krishnasamy, G. A Real-Time Computer Vision Based Approach to Detection and Classification of Traffic Incidents. Big Data Cogn. Comput. 2023, 7, 22. [Google Scholar] [CrossRef]
  42. He, K.; Gkioxari, G.; Dollár, P.; Girshick, R. Mask R-CNN. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 42, 386–397. [Google Scholar] [CrossRef]
  43. Zhang, D.; Pan, X.; Zhang, H.; Luo, D.; Cheng, H.; Xiao, K. The lateral center-edge angle as radiographic selection criteria for periacetabular osteotomy for developmental dysplasia of the hip in patients aged above 13 years. BMC Musculoskelet Disord. 2020, 21, 493. [Google Scholar] [CrossRef]
  44. Weinstein, S.L.; Dolan, L.A. Proximal femoral growth disturbance in developmental dysplasia of the hip: What do we know? J. Child. Orthop. 2018, 12, 331–341. [Google Scholar] [CrossRef]
  45. Nasir, M.U.; Zubair, M.; Ghazal, T.M.; Khan, M.F.; Ahmad, M.; Rahman, A.-u.; Hamadi, H.A.; Khan, M.A.; Mansoor, W. Kidney Cancer Prediction Empowered with Blockchain Security Using Transfer Learning. Sensors 2022, 22, 7483. [Google Scholar] [CrossRef]
Figure 1. Calculating the AcI, with H-line displayed (Adapted from [7]). Keypoints: LU: Left upper; LD: Left down; RU: Right upper; RD: Right down.
Figure 1. Calculating the AcI, with H-line displayed (Adapted from [7]). Keypoints: LU: Left upper; LD: Left down; RU: Right upper; RD: Right down.
Jimaging 09 00242 g001
Figure 2. Instance Segmentation and Key point labeling (Adapted from [7]).
Figure 2. Instance Segmentation and Key point labeling (Adapted from [7]).
Jimaging 09 00242 g002
Figure 3. (a) Box plot of ACI for Normal infants; (b) Box plot of ACI in DDH patients.
Figure 3. (a) Box plot of ACI for Normal infants; (b) Box plot of ACI in DDH patients.
Jimaging 09 00242 g003
Figure 4. Pipelined segmentation and keypoint detection process.
Figure 4. Pipelined segmentation and keypoint detection process.
Jimaging 09 00242 g004
Figure 5. Training and validation loss in pipelined Keypoint RCNN.
Figure 5. Training and validation loss in pipelined Keypoint RCNN.
Jimaging 09 00242 g005
Table 1. Comparative analysis of different state-of-the-art methods for landmark detection.
Table 1. Comparative analysis of different state-of-the-art methods for landmark detection.
Ref.Dataset SizeMethodsPerformanceLimitation
[18]400Random Forest Regression Voting ModelPoint-to-point error: 2.72 mmLack of implementation details for reproducibility.
[20]9369Multi-Task Hourglass Network with Encoder-DecoderLandmarks Pixel Error: 4.67 ± 5.3
ACI Angle Error: 2.776 ± 2.381°
Extreme diversity of bone morphology in these X-ray images due to large age range
[21]11,574Mask R-CNN built on FPN and ResNet101AI measurement: 40.36 ± 4.15°
Surgeons’ measurement: 39.59 ± 6.87°
Solely assessing sharp angle
[22]1398Mask R-CNN, HRNet, ResNet50 for segmentation, keypoint detection, and classification respectively.Landmarks Mean Euclidean distance error: 4.653Lack of integration with clinical practice
[23]321Mask R-CNN for segmentationBase Angles Difference: 1.81°Solely used Ultrasound scans
Lack of implementation details for keypoint detection model
[24]10,219FR-DDH network with ResNet-101 for feature map and spatial information extractionBland–Altman 95% limits of agreement for AcI: −4.733°Extreme diversity of bone morphology in X-ray images for wide age range
Lack of integration with clinical practice
[28]10,000CNN—Pyramid Non-local UNet (PN-UNet)Average point-to-point error: 9.286 µmLocal dataset with manual annotations
Table 2. Five number summary of acetabular index angle classes.
Table 2. Five number summary of acetabular index angle classes.
Five Number Summary
DDH AngleMinimum16.442
Q124.869
Median28.931
Q347.278
Maximum61.932
IQR22.409
Normal AngleMinimum3.498
Q116.968
Median19.947
Q322.976
Maximum33.479
IQR6.008
Table 3. Optimal hyperparameters for Keypoint RCNN.
Table 3. Optimal hyperparameters for Keypoint RCNN.
Model Hyperparameters
RPN Batch Size256
Roi Heads Batch Size128
Base Learning Rate0.00075
Maximum Iteration2500
Weight Decay0.0001
Batch Size4
Table 4. Comparing the performance of the proposed approaches.
Table 4. Comparing the performance of the proposed approaches.
ModelRMSEAcI ErrorPixel Error
Baseline ResNet507.1084.3705 ± 3.5657.141 ± 6.7355
Pipelined ResNet503.4083.3275 ± 2.944.266 ± 3.545
Baseline Keypoint RCNN2.92.955 ± 2.513.309 ± 2.410
Pipelined Keypoint RCNN2.72.402 ± 1.9632.862 ± 2.392
Table 5. Pixel error of Pipelined Keypoint RCNN.
Table 5. Pixel error of Pipelined Keypoint RCNN.
Pipelined Keypoint RCNN with Binary Mask Segmentation: Pixel Error
MeanStdMedianMean ± Std
Landmark RU2.5821.9082.2042.582 ± 1.908
Landmark RD3.2872.9472.353.287 ± 2.947
Landmark LU3.5843.1072.6563.584 ± 3.107
Landmark LD1.9931.6071.5521.993 ± 1.607
Avg2.8622.3922.1902.862 ± 2.392
Table 6. ACI error of pipelined Keypoint RCNN.
Table 6. ACI error of pipelined Keypoint RCNN.
Pipelined Keypoint RCNN with Binary Mask Segmentation: AcI Measurement Error Rate
MeanStdMedianMean ± Std
Left2.1271.7321.9962.127 ± 1.732
Right2.6762.1942.372.676 ± 2.194
Avg2.4021.9632.1832.402 ± 1.963
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Jan, F.; Rahman, A.; Busaleh, R.; Alwarthan, H.; Aljaser, S.; Al-Towailib, S.; Alshammari, S.; Alhindi, K.R.; Almogbil, A.; Bubshait, D.A.; et al. Assessing Acetabular Index Angle in Infants: A Deep Learning-Based Novel Approach. J. Imaging 2023, 9, 242. https://doi.org/10.3390/jimaging9110242

AMA Style

Jan F, Rahman A, Busaleh R, Alwarthan H, Aljaser S, Al-Towailib S, Alshammari S, Alhindi KR, Almogbil A, Bubshait DA, et al. Assessing Acetabular Index Angle in Infants: A Deep Learning-Based Novel Approach. Journal of Imaging. 2023; 9(11):242. https://doi.org/10.3390/jimaging9110242

Chicago/Turabian Style

Jan, Farmanullah, Atta Rahman, Roaa Busaleh, Haya Alwarthan, Samar Aljaser, Sukainah Al-Towailib, Safiyah Alshammari, Khadeejah Rasheed Alhindi, Asrar Almogbil, Dalal A. Bubshait, and et al. 2023. "Assessing Acetabular Index Angle in Infants: A Deep Learning-Based Novel Approach" Journal of Imaging 9, no. 11: 242. https://doi.org/10.3390/jimaging9110242

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop