Next Article in Journal
Comparison between Automatic and Semiautomatic System for the 3D Echocardiographic Multiparametric Evaluation of RV Function and Dimension
Previous Article in Journal
Myocardial Injuries in COVID-19: More Questions Than Answers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comparison of the Classification Results Accuracy for CT Soft Tissue and Bone Reconstructions in Detecting the Porosity of a Spongy Tissue

1
Department of Electronics and Information Technology, Lublin University of Technology, ul. Nadbystrzycka 38 A, 20-618 Lublin, Poland
2
Department of Biosensors and Processing of Biomedical Signals, Silesian University of Technology, ul. Roosevelta 40, 44-800 Zabrze, Poland
3
Department of Medical Radiology, Medical University of Lublin, ul. Jaczewskiego 8, 20-090 Lublin, Poland
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2022, 11(15), 4526; https://doi.org/10.3390/jcm11154526
Submission received: 12 June 2022 / Revised: 9 July 2022 / Accepted: 31 July 2022 / Published: 3 August 2022
(This article belongs to the Section Nuclear Medicine & Radiology)

Abstract

:
The aim of the study was to compare the accuracy of the classification pertaining to the results of two types of soft tissue and bone reconstructions of the spinal CT in detecting the porosity of L1 vertebral body spongy tissue. The dataset for each type of reconstruction (high-resolution bone reconstruction and soft tissue reconstruction) included 400 sponge tissue images from 50 healthy patients and 50 patients with osteoporosis. Texture feature descriptors were calculated based on the statistical analysis of the grey image histogram, autoregression model, and wavelet transform. The data dimensional reduction was applied by feature selection using nine methods representing various approaches (filter, wrapper, and embedded methods). Eleven methods were used to build the classifier models. In the learning process, hyperparametric optimization based on the grid search method was applied. On this basis, the most effective model and the optimal subset of features for each selection method used were determined. In the case of bone reconstruction images, four models achieved a maximum accuracy of 92%, one of which had the highest sensitivity of 95%, with a specificity of 89%. For soft tissue reconstruction images, five models achieved the highest testing accuracy of 95%, whereas the other quality indices (TPR and TNR) were also equal to 95%. The research showed that the images derived from soft tissue reconstruction allow for obtaining more accurate values of texture parameters, which increases the accuracy of the classification and offers better possibilities for diagnosing osteoporosis.

1. Introduction

A CT image is obtained through transformations and mathematical calculations performed during the measurement process. They are based on an attempt to recreate the damping of a radiation beam in an object through a series of measurements. The process of transforming the primary data into a CT image is known as reconstruction. In order to form a CT image, a computer system assigns a single value in Hounsfield (HU) scale to each pixel. The obtained radiodensity values are a mean from the weakening of radiation beams going through a given point [1,2,3]. Due to the diversity of the structures in the human body, it is necessary to employ various reconstruction filters. While assessing the condition of organs with a high contrast of internal structures, e.g., bones or lungs, the high-resolution bone reconstruction (“hard kernel” algorithm) is carried out, which enhances the edge quality. In the assessment of soft tissues or organs with lower contrast of internal structures, the soft tissue reconstruction (“soft kernel” algorithm) is employed, which reduces noise at the expense of lowering the spatial resolution. Owing to the application of various reconstruction filters, adjustment of the image for further analyses is possible [4,5].
One of the methods for determining the condition of the analyzed tissue is texture analysis [6]. Although this method can be successfully used in many diagnostic processes, new applications are still being sought, which is indicated by numerous scientific publications [7,8,9,10,11,12,13,14,15,16,17,18]. This paper presented the process for the classification of spongy matter images in the L1 lumbar vertebra on the basis of the obtained texture properties. The spongy matter is considered bone tissue; however, their lamellae are arranged loosely, and their mineralization level is approximately a third of that in compact bone. Decreasing the mineral density of the spongy matter leads to porosis, initially in the form of osteopenia and then osteoporosis [19,20,21]. Dual-energy X-ray Absorptiometry (DXA), based on the measurement of bone density, is a commonly employed method for diagnosing osteoporosis. The mineral content in bones governs the number of minerals in the measurement spot, which is divided by the surface, yielding bone mineral density (BMD). Therefore, this technique provides information on the mineral density of the entire examined region without the precise determination of the segment with deficiencies. The index T corresponding to the standard deviation from the reference mineral density is used to classify a patient as healthy or ill. The T = −1 value is considered to be normal; ranges of −1 to 2.4 corresponds to osteopenia, while −2.5 and less are recognized as osteoporosis. Reduced bone mineral density (BMD) identified through DXA requires differential diagnosis to determine its causes. The blood tests and urinalyses are conducted for this purpose [22,23,24].
The course of osteoporosis is symptomless in its early stages. It is usually diagnosed in the advanced stage, when osteoporotic fractures may occur, even without injuries. Therefore, preventive examinations, aiming at detecting the condition at an early stage and mitigating its consequences, are essential [22,24]. For this reason, new diagnostic solutions enabling the diagnosis of osteoporosis at an early stage are being sought. The literature contains descriptions of numerous experiments connected to seeking methods for identifying lesions in bone regions. Mustapha et al. [25,26] and Stanley et al. [27] presented the method for identifying lesions in neck vertebrae. Mustapha et al. [25] describe a method for AOs (classes and severity) classification of cervical radiography by designing a fuzzy decision tree (FDT) model. The results obtained on a set of 400 cervical vertebrae radiography images indicate the classification rate of 93.09%. Stanley et al. [27], based on the size invariant descriptor (SID), K-means (Km), and nearest neighbor methods (NN), the obtained classification rate reached 84.44%. In turn, Mustapha et al. in [26] the employing region-based (RB) fracture characterization as well as five-fold cross-validation (5FCV), and an efficiency of 87.58% was achieved. Lespessailles et al. [28] show clinical interest in bone texture analysis with a new high-resolution X-ray device. The studies indicated that the combination of BMD and texture parameter values provided a better assessment of the fracture risk than that obtainable solely by BMD measurement. The texture analysis also found an application in the diagnostic of pelvic bones, which was described in [29] by Gaidel et al. It was demonstrated that the covariance features were the most efficient—the diagnostic error probability of 0.2 was obtained. Similar findings were also presented in Chappard et al. [30] and Lespessailles et al. [31]. These works also demonstrated the relationship between BMD and texture parameters.
During the assessment of the spongy matter, both by radiologists during the standard diagnostic assessment and in the majority of papers on this subject [32,33], the images from bone reconstruction are used. Due to the atypical character of the spongy matter, which was mentioned above, two types of image reconstruction were employed, i.e., soft and hard kernel reconstruction. The main aim of the study was to verify which type or reconstructed images enable obtaining the texture and allow for a more precise classification of the tissue condition.

2. Materials and Methods

2.1. Material

The imaging examinations considered in the paper were carried out in a hospital (Samodzielny Szpital Kliniczny nr 4) in Lublin. Patients were referred to the lumbosacral spine examination from an orthopaedic clinic and ER. The examination involved the analysis of the lumbosacral spine CT of 100 patients. The control group comprised 50 individuals without the symptoms of osteoporosis or osteopenia. The same number of patients constituted the group of people with osteoporosis. The control group included 26 women and 24 men aged 53 to 77. Each of the patients was examined by means of 32-row CT by GE in a standard protocol for lumbosacral spine examinations. The examination was performed in the spiral acquisition and assessed using multi-surface and three-dimensional reconstructions. The layers of the soft kernel and hard kernel reconstructions corresponded were 2.5 mm and 1.25 mm, respectively. The exposure parameters were adjusted in the range from 85 mA to 700 mA (median = 181) for the intensity and two values—120 kV or 140 kV in the case of voltage.
The assignment of patients to both groups was performed on the basis of the radiology report and the measurement of radiological densities of the spongy matter of the first vertebra of the lumbar spine (L1). On the basis of the literature [34], the border value of tissue density of 120 Hounsfield Units (HU) was assumed. The patients in whom the density was greater than the limit value and the report did not indicate lesions in the spongy matter were assigned to the control group (HEALTHY class). In turn, the patients who did not meet the criteria were assigned to the osteoporotic group (OSTEOPOROSIS class).

2.2. Image Preprocessing

The source data saved in the DICOM standard contained RGB images in the 512 × 512 resolution. The images which show the interior of the vertebra along with the spongy matter were selected (Figure 1).
The images on the same vertebra level were selected for soft tissue and bone reconstruction. Since the thickness of layers for bone reconstruction was halved, every other layer of a given vertebra cross-section was analyzed. The images selected for further studies were saved in BMP format and converted from 24-bit RGB to 8-bit greyscale. The extraction of the regions of interest (ROI) was performed manually (Figure 2). The size of the extracted samples was selected to use the textured surface, potentially containing the information in the image of the transverse vertebra section, to the maximum extent. This resulted in samples with a size of 50 × 50 pixels (Figure 3).
During the preprocessing, the image histogram normalization process was omitted because the available results indicate that this operation deteriorates the classification accuracy in the range from 4% for the TPR coefficient (classification sensitivity) to 14% for ACC (overall classification accuracy) [35].

2.3. Estimation of Texture Parameters

The prepared samples were subjected to tissue image texture analysis. The image analysis was conducted using the MaZda software (version 4.6) developed in the Institute of Electronics of Lodz University of Technology (Lodz, Poland) [36]. This software was made available online for free for scientific purposes. It enables the analysis of greyscale texture images and indicates the numerical values of the image features. A detailed description of these features can be found in [37,38,39,40], as well as in the MaZda manual. The advantage of this software is the fact that apart from the statistical approach to the image analysis, it also employs a mathematical model (autoregression model) and a transformation approach (wavelet transform).
The set of features has been obtained on the basis of:
  • Histogram (9 features): histogram mean, histogram variance, histogram skewness, histogram kurtosis, percentiles 1%, 10%, 50%, 90%, and 99%;
  • Gradient (5 features): absolute gradient mean, absolute gradient variance, absolute gradient skewness, absolute gradient kurtosis, percentage of pixels with a nonzero gradient;
  • Run length matrix (5 features × 4 various directions): run length nonuniformity, grey level nonuniformity, long run emphasis, short run emphasis, the fraction of image in runs;
  • Co-occurrence matrix (11 features × 4 various directions × 5 between-pixels distances) angular second moment, contrast, correlation, sum of squares, inverse difference moment, sum average, sum variance, sum entropy, entropy, difference variance, difference entropy;
  • Autoregressive model (5 features): parameters Θ1, Θ2, Θ3, Θ4, standard deviation.
  • Haar wavelet (24 features): wavelet energy (features are computed at 6 scales within 4 frequency bands LL, LH, HL, and HH).
The available research results show that the textural features obtained with the above-mentioned methods allowed for high classification accuracy of the ultrasound and radiographic images [41,42].

2.4. Data Preprocessing

Two sets of observations were used in the studies; the first contained the images produced through bone reconstruction, while the other used those from soft-tissue reconstruction. For both types of reconstruction, a full set comprised 400 observations, 200 per class. At the beginning of preprocessing, both sets were divided randomly into learning and testing sets. The division was performed in such a way that 70% constituted the learning set and 30%—the test set. As a result, the learning set comprised 280 observations (137 healthy cases and 143 osteoporosis cases), while the test set involved 120 observations (63 healthy cases and 57 osteoporosis cases).
Due to the fact that the feature descriptors were measured at different scales (interval scale, ratio scale), the features were scaled through standardization [43]:
z i j = ( x i j x ¯ j ) / s j ,
where xij—value of feature j for observation i; zij—standardized value for feature j for observation i; x ¯ j —arithmetical mean for feature j; sj—standard deviation for feature j. Following standardization, the interval measurement scale and normal distribution N(0, 1) were used for all features. Scaling was performed once for the learning data. Then, the test sets were transformed in a similar manner. The vectors of mean values and variance obtained during the standardization of learning sets were used for each feature.
In the following step, the four-stage data cleansing procedure was carried out:
  • Removal of features with constant values (variance equal to 0).
  • Removal of features with nearly constant values (variance lower than 0.01).
  • Removal of duplicated features.
  • Removal of correlated features
The Pearson correlation coefficient (r), which detects linear dependencies and assumes the normality of their distribution, was employed. The features for which |r| > 0.9—indicating strong correlation—were removed.
As a result of data cleansing, the number of features was reduced from 290 to 32 for the bone reconstruction and from 290 to 18 for the soft-tissue reconstruction. The data preprocessing was carried out with the scikit-learn library and Python programming language, which was also employed in the further stages of the study.

2.5. Data Reduction

The study involved the reduction of the data through feature selection. Generally, the aim of the selection is to limit the initial (complete) set of features to a certain subset, containing the features that are important from the point of view of the applied criterion. In the course of the data cleansing process, the complete set of 290 features was greatly reduced—to 32 for bone reconstruction and 18 for soft-tissue reconstruction. This mainly had an influence on the occurrence of features with a strong correlation (|r| > 0.9). Therefore, the additional reduction was omitted, and the creation of a ranking list by each of the employed methods was set as a goal. The ranking list contained a set of features in the order reflecting their significance in terms of discrimination of observations belonging to different classes. The choice of an optimal number of features for each of the employed selection methods was made in the following stage, which involved training the classification model. In order to avoid overtraining the classifiers, the selection of features was carried out only in relation to the training sets. Then, its results were employed for the transformation of test sets. The selection of features was performed with scikit-learn, scikit-feature, ReliefF, MLxtend, and LightGBM libraries.
Nine methods belonging to the three following groups were used:
  • Filter methods:
    • Univariate—Fisher’s method (FISHER) and variance analysis method (ANOVA);
    • Multivariate—Relief method (RELIEF).
  • Wrapper methods:
    • Sequential Forward Selection (SFS);
    • Sequential Backward Selection (SBS);
    • Recursive Feature Elimination along with LogisticRegression estimator (RFE).
  • Embedded methods:
    • SelectFromModel meta-transformer and logistic regression estimator (LR);
    • SelectFromModel meta-transformer and AdaBoost estimator (ADA);
    • SelectFromModel meta-transformer along with LightGBM estimator (LGBM).

2.6. Training the Classification Models

The training of the classification models aimed to obtain the most efficient model as well as an optimal subset of features for each of the employed selection methods. In the course of this process, the number of features of the learning set changed in accordance with the ranking list. For bone reconstruction, the number of features changed from 2 to 32, except for the methods employing the logistic regression model and AdaBoost model, for which the number of features changed from 2 to 12. In the case of soft-tissue reconstruction, the number of features changed from 2 to 18. The exceptions included the methods based on the logistic regression model and AdaBoost model, for which the number of features changed from 2 to 5 and from 2 to 9, respectively. In the training process, optimal hyperparameter values for a given model were determined in accordance with the grid search method. The GridSearchCV method was employed for this purpose, available in the model_selection module of the scikit-learn library. The model assessment was carried out on the basis of 10-fold cross-validation. Each model considered optimal for a given number of features was saved as a file on the disc. Then, the best model, i.e., the one which ensured the highest classification accuracy at a minimum number of features, was selected from this set. The selection of the best model enabled the unequivocal determination of the optimal set of features that were applied by that model. The above-mentioned procedure was employed for all filter and wrapper methods. In the case of the embedded methods, only the classifiers employed in the selection process were built and adjusted.
Eleven classification methods were used for the features selected by means of the filter and wrapper methods. They were: linear and quadratic discriminant analysis (LDA, QDA), gaussian naive Bayes (BAYES), support vector machines (SVM) that uses regularization parameter C), support vector machines (NuSVM) that uses a parameter to control the number of support vectors nu), K-nearest neighbors (KNN), decision tree (DT), multi-layer perceptron (MLP) and three ensemble methods—random forest (RF), gradient boosting (GRAD), AdaBoost (ADA). In turn, three classification methods have been used for the features selected by means of the embedded methods: AdaBoost, logistic regression (LR), and LightGBM (LGBM). All algorithms of the applied machine learning methods (except LightGBM) are implemented in the scikit-learn library.
Figure 4 presents an exemplary course of model learning and validation for the set of features obtained with the Fisher method for soft-tissue reconstruction. In turn, Table 1 shows the exemplary results of hyperparametric optimization with the grid search method for the Fisher method and the same type of reconstruction.
The exemplary results in Table 1 indicate that the highest validation accuracy (0.96) is provided by the SVM, NuSVM, and MLP models. However, due to the lowest number of the training set features (7), the MLP model was assumed as the best for the set of features obtained with the Fisher method (grey background).

3. Results

Table 2 shows the complete results pertaining to the selection of the optimal models for all feature selection methods and both types of reconstruction. The information in the table contains the symbols of the employed classification method and the selection method applied for building the feature ranking, as well as the number of features used for model construction and its validation accuracy.
The evaluation of the optimal methods was carried out through independent test sets. As a result, the most efficient selection method, optimal feature subset indicated with this method, and the best classifiers were obtained. The applied classification quality measures included overall accuracy (ACC), true positive rate (TPR), and true negative rate (TNR). For bone reconstruction (Figure 5a), the highest accuracy (ACC = 92%) was obtained by models no. 1, 2, 3, and 5 (Table 2), at the same validation accuracy of 94%. In the case of the soft-tissue reconstruction (Figure 5b), the highest accuracy (ACC = 95%) was obtained for models no. 2, 4, 5, 8, and 9 (Table 2). The validation accuracy for these models amounted to 96%.
Figure 6 shows more information on the model evaluation results. Apart from the total classification accuracy, it also presents the true positive rate (sensitivity) and true negative rate (specificity). In the case of bone reconstruction, Figure 6a shows the value of TPR and TNR for models no. 1, 2, 3, and 5, for which ACC = 92%. In turn, for the soft-tissue reconstruction (Figure 6b), the information on TPR and TNR pertains to models no. 2, 4, 5, 8, and 9, which achieved ACC = 95%. In the case of the same ACC value, the TPR value was assumed as the criterion for the selection of the best model due to the medical benefits of such an approach. Therefore, model no. 5 turned out to be the most efficient in bone reconstruction, achieving a TPR of 95%. This model was built with the K-nearest neighbors method (for K = 1), employing nine features obtained with the SBS method. In the case of soft-tissue reconstruction, all models (2, 4, 5, 8, and 9) were similarly effective. They achieved the same values of TPR and TNR indices, equal to 95%. Detailed data on the structure of the models are presented in Table 3, whereas the confusion matrices of the most effective models for both types of reconstruction are presented in Figure 7.

4. Discussion

The quality of the built models should be assessed as high. In the case of bone reconstruction, four models (1, 2, 3, and 5) achieved the maximum accuracy for the test set (ACC = 92%); model no. 5 was characterized by the greatest sensitivity (TPR = 95%) at specificity TNR = 89%. In turn, for the soft-tissue reconstruction, the highest accuracy (ACC = 95%) was obtained for five models (2, 4, 5, 8, and 9). The remaining quality indices of these models, i.e., TPR and TNR, were equal to 95%. It should be emphasized that for both types of reconstruction, the majority of the models are characterized by relatively high validation accuracy. In turn, for the best models, the testing accuracy is only slightly lower than the validation accuracy. For bone reconstruction, this difference amounts only to 2%, and for soft-tissue reconstruction—1%. Such a situation indicates high quality, both of the models themselves, as well as the data used in the course of their training. The disadvantage of this method is that the extraction of the regions of interest was carried out manually. However, this problem requires separate investigations; therefore, it will be the topic of further research. The obtained results were compared with the results from the papers on a similar matter conducted by other authors (Table 4). Taking into account the total classification accuracy (ACC), it can be seen that the obtained result is one of the highest and is only 1.6% lower than the results achieved in [45,46], where it amounted to 96.6%. However, the majority of results presented in the table are much lower, and in the case of Andersen et al. [47], it amounts only to 71.3%. Other parameters also approximate the best results. While analyzing the data, it can be stated that the presented method stands out from similar investigations and exhibits high diagnostic potential.
Figure 8 shows the general scheme of a system for the prediction of new images with the constructed models. Initially, ROI extraction is conducted, and the 24-bit RGB type is changed to an 8-bit greyscale. The next stage is the determination of the feature descriptors, which were significant in the training process. The K-NN classifier (K = 1), considered the best for bone reconstruction, involves nine features that are obtained with the SBS method. In the case of soft-tissue reconstruction, a set of 17 or 18 features has to be determined in accordance with the applied classifier and selection method (Table 3). Then, the important features were scaled (standardization) with vectors of mean values and variance of features obtained during the scaling of training sets. Classification is the final step. On the basis of the classification model and the values of feature descriptors, the class is assigned to the analyzed image (prediction). Figure 9 shows prospective prediction results for exemplary images obtained through soft-tissue reconstruction. The presented results were obtained with a prototype system for diagnosing osteoporosis, which employs model no. 4 for prediction (Table 3).

5. Conclusions

The results of studies indicate that in the case of texture analysis, soft-tissue reconstruction is characterized by a higher classification accuracy (ACC = 95%) than bone reconstruction (ACC = 92%), which is usually employed for the spongy matter examination. Due to the atypical character of the examined tissue, exhibiting lower mineral density than in compact bone, the image from soft-tissue reconstruction contains a more accurate range of values pertaining to texture features. In that case, as many as five classifiers obtained the same maximum values of index quality (ACC = TPR = TNR = 95%). This justifies the usefulness of the conducted studies and indicates new possibilities stemming from an alternative approach to the analyzed tissue. The high efficiency of feature selection using the ANOVA, RELIEF, and RFE methods was observed as well. In combination with SVM and NuSVM classifiers, they enable achieving high classification accuracy. Studies showed that while designing a system for the automatic identification of osteoporotic bone fractures based on spinal CT, the application of soft-tissue reconstruction yields better results than bone reconstruction. It achieves 3% better classification accuracy than the traditional approach to the analysis of bone reconstruction images. Further investigations will focus on the development of an algorithm for automatic ROI extraction and testing the system utilizing a greater number of observations.

Author Contributions

Conceptualization, R.D. and S.U.; Data curation, S.U.; Methodology, R.D. and Z.O.; Project administration, R.D.; Software, Z.O.; Validation, R.D.; Visualization, Z.O.; Writing—original draft, R.D. and Z.O.; Writing—review & editing, E.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Ministry of Education and Science—Poland, grant number FD-20/EE-2/302 and FD-20/EE-2/315.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Prakash, P.; Kalra, M.K.; Digumarthy, S.R.; Hsieh, J.; Pien, H.; Singh, S.; Gilman, M.D.; Shepard, J.-A.O. Radiation Dose Reduction with Chest Computed Tomography Using Adaptive Statistical Iterative Reconstruction Technique: Initial Experience. J. Comput. Assist. Tomogr. 2010, 34, 40–45. [Google Scholar] [CrossRef] [PubMed]
  2. Silva, A.C.; Lawder, H.J.; Hara, A.; Kujak, J.; Pavlicek, W. Innovations in CT Dose Reduction Strategy: Application of the Adaptive Statistical Iterative Reconstruction Algorithm. AJR Am. J. Roentgenol. 2010, 194, 191–199. [Google Scholar] [CrossRef] [PubMed]
  3. Solomon, J.; Samei, E. Quantum Noise Properties of CT Images with Anatomical Textured Backgrounds across Reconstruction Algorithms: FBP and SAFIRE. Med. Phys. 2014, 41, 091908. [Google Scholar] [CrossRef] [PubMed]
  4. Andersen, A.H. Algebraic Reconstruction in CT from Limited Views. IEEE Trans. Med. Imaging 1989, 8, 50–55. [Google Scholar] [CrossRef] [PubMed]
  5. Huda, W.; Ogden, K.M.; Samei, E.; Scalzetti, E.M.; Lavallee, R.L.; Roskopf, M.L.; Groat, G.E. Reconstruction Filters and Contrast Detail Curves in CT. In Proceedings of the Medical Imaging 2008: Image Perception, Observer Performance, and Technology Assessment; International Society for Optics and Photonics, San Diego, CA, USA, 6 March 2008; Volume 6917, p. 691710. [Google Scholar]
  6. Shahabaz; Somwanshi, D.K.; Yadav, A.K.; Roy, R. Medical Images Texture Analysis: A Review. In Proceedings of the 2017 International Conference on Computer, Communications and Electronics (Comptelix), Jaipur, India, 1–2 July 2017. [Google Scholar] [CrossRef]
  7. Blair, J.P.; Bierma-Zeinstra, S.; Nielsen, H.B.; Bay-Jensen, A.-C.; Dam, E.B. Texture Analysis of Knee Pathology for the Diagnosis of Radiographic Osteoarthritis. Osteoarthr. Cartil. 2018, 26, S436. [Google Scholar] [CrossRef]
  8. Fan, J.; Min, B.; Xu, F.; Yang, P.; Ye, H.; Feng, Y.; Shen, Y.; Xu, C.; Zhou, W.; Ren, X. Clinical Diagnosis of Pancreatic Cancer Using Texture Analysis in Endoscopic Ultrasonography. J. Med. Imaging Health Inform. 2019, 9, 1844–1848. [Google Scholar] [CrossRef]
  9. Fujima, N.; Homma, A.; Harada, T.; Shimizu, Y.; Tha, K.K.; Kano, S.; Mizumachi, T.; Li, R.; Kudo, K.; Shirato, H. The Utility of MRI Histogram and Texture Analysis for the Prediction of Histological Diagnosis in Head and Neck Malignancies. Cancer Imaging 2019, 19, 5. [Google Scholar] [CrossRef]
  10. Gilanie, G.; Bajwa, U.I.; Waraich, M.M.; Habib, Z. Computer Aided Diagnosis of Brain Abnormalities Using Texture Analysis of MRI Images. Int. J. Imaging Syst. Technol. 2019, 29, 260–271. [Google Scholar] [CrossRef]
  11. Li, Z.; Yu, L.; Wang, X.; Yu, H.; Gao, Y.; Ren, Y.; Wang, G.; Zhou, X. Diagnostic Performance of Mammographic Texture Analysis in the Differential Diagnosis of Benign and Malignant Breast Tumors. Clin. Breast Cancer 2018, 18, e621–e627. [Google Scholar] [CrossRef]
  12. Manabe, O.; Ohira, H.; Hirata, K.; Hayashi, S.; Naya, M.; Tsujino, I.; Aikawa, T.; Koyanagawa, K.; Oyama-Manabe, N.; Tomiyama, Y.; et al. Use of 18F-FDG PET/CT Texture Analysis to Diagnose Cardiac Sarcoidosis. Eur. J. Nucl. Med. Mol. Imaging 2019, 46, 1240–1247. [Google Scholar] [CrossRef]
  13. Mitrea, D.; Nedevschi, S.; Mitrea, P.; Brehar, R.; Vancea, F.I.; Platon(lupşor), M.; Ştefănescu, H.; Badea, R. Advanced Texture Analysis and Classification Methods for the Automatic Diagnosis of the Hepatocellular Carcinoma. Appl. Med. Inform. 2019, 41, 17–18. [Google Scholar]
  14. WANG Minhong, Z.L.; WANG Minhong, Z.L. Value of Conventional MRI Texture Analysis in Differential Diagnosis of Glioblastomas and Primary Central Nervous System Lymphoma. China Oncol. 2019, 29, 284–288. [Google Scholar] [CrossRef]
  15. Wang, X.; Suo, S.; Zhu, J.; Feng, Q.; Hua, X.; Wang, W.; Gong, J.; Liu, J.; Lu, Q. Application of intestinal CT texture analysis and nonlinear discriminant analysis in differential diagnosis of colorectal cancer and ulcerative colitis. J. Shanghai Jiaotong Univ. 2018, 38, 624. [Google Scholar] [CrossRef]
  16. Masci, G.M.; Ciccarelli, F.; Mattei, F.I.; Grasso, D.; Accarpio, F.; Catalano, C.; Laghi, A.; Sammartino, P.; Iafrate, F. Role of CT Texture Analysis for Predicting Peritoneal Metastases in Patients with Gastric Cancer. Radiol. Med. 2022, 127, 251–258. [Google Scholar] [CrossRef]
  17. Nagawa, K.; Suzuki, M.; Yamamoto, Y.; Inoue, K.; Kozawa, E.; Mimura, T.; Nakamura, K.; Nagata, M.; Niitsu, M. Texture Analysis of Muscle MRI: Machine Learning-Based Classifications in Idiopathic Inflammatory Myopathies. Sci. Rep. 2021, 11, 9821. [Google Scholar] [CrossRef]
  18. Cavallo, A.U.; Troisi, J.; Forcina, M.; Mari, P.-V.; Forte, V.; Sperandio, M.; Pagano, S.; Cavallo, P.; Floris, R.; Garaci, F. Texture Analysis in the Evaluation of COVID-19 Pneumonia in Chest X-Ray Images: A Proof of Concept Study. Curr. Med. Imaging Rev. 2021, 17, 1094–1102. [Google Scholar] [CrossRef]
  19. Downey, P.A.; Siegel, M.I. Bone Biology and the Clinical Implications for Osteoporosis. Phys. Ther. 2006, 86, 77–91. [Google Scholar] [CrossRef] [Green Version]
  20. Marcus, R.; Dempster, D.; Cauley, J.; Feldman, D. Osteoporosis, 4th ed.; Academic Press: Cambridge, MA, USA, 2013; ISBN 978-0-12-415853-5. [Google Scholar]
  21. Ebeling, P.R.; Nguyen, H.H.; Aleksova, J.; Vincent, A.J.; Wong, P.; Milat, F. Secondary Osteoporosis. Endocr. Rev. 2022, 43, 240–313. [Google Scholar] [CrossRef]
  22. Kanis, J.A. Diagnosis of Osteoporosis and Assessment of Fracture Risk. Lancet 2002, 359, 1929–1936. [Google Scholar] [CrossRef]
  23. Klibanski, A.; Adams-Campbell, L.; Bassford, T.; Blair, S.N.; Boden, S.D.; Dickersin, K.; Gifford, D.R.; Glasse, L.; Goldring, S.R.; Hruska, K.; et al. Osteoporosis Prevention, Diagnosis, and Therapy. JAMA 2001, 285, 785–795. [Google Scholar]
  24. Orimo, H.; Hayashi, Y.; Fukunaga, M.; Sone, T.; Fujiwara, S.; Shiraki, M.; Kushida, K.; Miyamoto, S.; Soen, S.; Nishimura, J.; et al. Diagnostic Criteria for Primary Osteoporosis: Year 2000 Revision. J. Bone Miner. Metab. 2001, 19, 331–337. [Google Scholar] [CrossRef]
  25. Mustapha, A.; Hussain, A.; Zulkifley, M.A.; Zaki, W.M.D.W.; Husain, H.; Abdul Hamid, H.B. Anterior Osteoporosis Classification in Cervical Vertebrae Using Fuzzy Decision Tree. Multimed. Tools Appl. 2017, 77, 4011–4045. [Google Scholar] [CrossRef]
  26. Mustapha, A.; Hussain, A.; Samad, S.; Zulkifley, M.; Diyana Wan Zaki, W.; Hamid, H. Design and Development of a Content-Based Medical Image Retrieval System for Spine Vertebrae Irregularity. Biomed. Eng. Online 2015, 14, 6. [Google Scholar] [CrossRef] [Green Version]
  27. Stanley, R.J.; Antani, S.; Long, R.; Thoma, G.; Gupta, K.; Das, M. Size-Invariant Descriptors for Detecting Regions of Abnormal Growth in Cervical Vertebrae. Comput. Med. Imaging Graph. 2008, 32, 44–52. [Google Scholar] [CrossRef] [PubMed]
  28. Lespessailles, E.; Gadois, C.; Kousignian, I.; Neveu, J.P.; Fardellone, P.; Kolta, S.; Roux, C.; Do-Huu, J.P.; Benhamou, C.L. Clinical Interest of Bone Texture Analysis in Osteoporosis: A Case Control Multicenter Study. Osteoporos. Int. 2008, 19, 1019–1028. [Google Scholar] [CrossRef]
  29. Gaidel, A.; Khramov, A. Application of Texture Analysis for Automated Osteoporosis Diagnostics by Plain Hip Radiography. Pattern Recognit. Image Anal. 2015, 25, 301–305. [Google Scholar] [CrossRef]
  30. Chappard, D.; Pascaretti-Grizon, F.; Gallois, Y.; Mercier, P.; Baslé, M.F.; Audran, M. Medullar Fat Influences Texture Analysis of Trabecular Microarchitecture on X-Ray Radiographs. Eur. J. Radiol. 2006, 58, 404–410. [Google Scholar] [CrossRef]
  31. Lespessailles, E.; Gadois, C.; Lemineur, G.; Do-Huu, J.P.; Benhamou, L. Bone Texture Analysis on Direct Digital Radiographic Images: Precision Study and Relationship with Bone Mineral Density at the Os Calcis. Calcif. Tissue Int. 2007, 80, 97–102. [Google Scholar] [CrossRef] [Green Version]
  32. Bar, A.; Wolf, L.; Bergman Amitai, O.; Toledano, E.; Elnekave, E. Compression Fractures Detection on CT. In Proceedings of the Medical Imaging 2017: Computer-Aided Diagnosis, Orlando, Fl, USA, 3 March 2017; Armato, S.G., Petrick, N.A., Eds.; SPIE: Bellingham, WC, USA, 2017; Volume 10134. [Google Scholar]
  33. Roth, H.R.; Wang, Y.; Yao, J.; Lu, L.; Burns, J.E.; Summers, R.M. Deep Convolutional Networks for Automated Detection of Posterior-Element Fractures on Spine CT. In Proceedings of the Medical Imaging 2016: Computer-Aided Diagnosis, International Society for Optics and Photonics, San Diego, CA, USA, 24 March 2016; SPIE: Bellingham, WC, USA, 2016; Volume 9785, p. 97850. [Google Scholar]
  34. Emohare, O.; Cagan, A.; Morgan, R.; Davis, R.; Asis, M.; Switzer, J.; Polly, D.W. The Use of Computed Tomography Attenuation to Evaluate Osteoporosis Following Acute Fractures of the Thoracic and Lumbar Vertebra. Geriatr. Orthop. Surg. Rehabil. 2014, 5, 50–55. [Google Scholar] [CrossRef]
  35. Dzierżak, R.; Omiotek, Z.; Tkacz, E.; Kępa, A. The Influence of the Normalisation of Spinal CT Images on the Significance of Textural Features in the Identification of Defects in the Spongy Tissue Structure. In Proceedings of the Innovations in Biomedical Engineering, Katowice, Poland, 18–20 October 2018; Tkacz, E., Gzik, M., Paszenda, Z., Piętka, E., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 55–66. [Google Scholar]
  36. Oprogramowanie --> Program MaZda. Available online: http://www.eletel.p.lodz.pl/programy/cost/progr_mazda.html (accessed on 3 May 2020).
  37. Haralick, R.M. Statistical and Structural Approaches to Texture. Proc. IEEE 1979, 67, 786–804. [Google Scholar] [CrossRef]
  38. Haralick, R.M.; Shanmugam, K.; Dinstein, I. Textural Features for Image Classification. IEEE Trans. Syst. Man Cybern. 1973, SMC-3, 610–621. [Google Scholar] [CrossRef] [Green Version]
  39. Hu, Y.; Dennis, T.J. Textured Image Segmentation by Context Enhanced Clustering. IEE Proc. Vis. Image Signal Process. 1994, 141, 413–421. [Google Scholar] [CrossRef]
  40. Lerski, R.A.; Straughan, K.; Schad, L.R.; Boyce, D.; Blüml, S.; Zuna, I. MR Image Texture Analysis—An Approach to Tissue Characterization. Magn. Reson. Imaging 1993, 11, 873–887. [Google Scholar] [CrossRef]
  41. Omiotek, Z. Improvement of the Classification Quality in Detection of Hashimoto’s Disease with a Combined Classifier Approach. Proc. Inst. Mech. Eng. Part H J. Eng. Med. 2017, 231, 774–782. [Google Scholar] [CrossRef]
  42. Omiotek, Z.; Stepanchenko, O.; Wójcik, W.; Legieć, W.; Szatkowska, M. The Use of the Hellwig’s Method for Feature Selection in the Detection of Myeloma Bone Destruction Based on Radiographic Images. Biocybern. Biomed. Eng. 2019, 39, 328–338. [Google Scholar] [CrossRef]
  43. Dzierżak, R. Comparison of the influence of standardization and normalization of data on the effectiveness of spongy tissue texture classification. Inform. Control Meas. Econ. Environ. Prot. 2019, 9, 66–69. [Google Scholar] [CrossRef]
  44. Scikit-Learn: Machine Learning in Python—Scikit-Learn 0.22.2 Documentation. Available online: https://scikit-learn.org/stable/ (accessed on 3 May 2020).
  45. Hassani, A.S.E.B.E.; Hassouni, M.E.; Houam, L.; Rziza, M.; Lespessailles, E.; Jennane, R. Texture Analysis Using Dual Tree M-Band and Rényi Entropy. Application to Osteoporosis Diagnosis on Bone Radiographs. In Proceedings of the 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI), Barcelona, Spain, 2–5 May 2012. [Google Scholar] [CrossRef]
  46. Singh, A.; Dutta, M.K.; Jennane, R.; Lespessailles, E. Classification of the Trabecular Bone Structure of Osteoporotic Patients Using Machine Vision. Comput. Biol. Med. 2017, 91, 148–158. [Google Scholar] [CrossRef]
  47. Zheng, K.; Makrogiannis, S. Bone Texture Characterization for Osteoporosis Diagnosis Using Digital Radiography. Conf Proc IEEE Eng. Med. Biol. Soc. 2016, 2016, 1034–1037. [Google Scholar] [CrossRef] [Green Version]
  48. Areeckal, A.S.; Kamath, J.; Zawadynski, S.; Kocher, M.; Sumam, D.S. Combined Radiogrammetry and Texture Analysis for Early Diagnosis of Osteoporosis Using Indian and Swiss Data. Comput. Med. Imaging Graph. 2018, 68, 25–39. [Google Scholar] [CrossRef]
  49. Omiotek, Z.; Dzierżak, R.; Uhlig, S. Fractal Analysis of the Computed Tomography Images of Vertebrae on the Thoraco-Lumbar Region in Diagnosing Osteoporotic Bone Damage. Proc. Inst. Mech. Eng. H 2019, 233, 1269–1281. [Google Scholar] [CrossRef]
  50. Yger, F. Challenge IEEE-ISBI/TCB: Application of Covariance Matrices and Wavelet Marginals. arXiv 2014, arXiv:1410.2663. [Google Scholar]
  51. Houam, L.; Hafiane, A.; Boukrouche, A.; Lespessailles, E.; Jennane, R. One Dimensional Local Binary Pattern for Bone Texture Characterization. Pattern Anal. Appl. 2014, 17, 179–193. [Google Scholar] [CrossRef]
  52. Tafraouti, A.; Hassouni, M.E.; Toumi, H.; Lespessailles, E.; Jennane, R. Osteoporosis Diagnosis Using Frequency Separation and Fractional Brownian Motion. In Proceedings of the 2017 International Conference on Wireless Networks and Mobile Communications (WINCOM), Rabat, Morocco, 1–4 November 2017; pp. 1–4. [Google Scholar]
  53. Oulhaj, H.; Rziza, M.; Amine, A.; Toumi, H.; Lespessailles, E.; El Hassouni, M.; Jennane, R. Anisotropic Discrete Dual-Tree Wavelet Transform for Improved Classification of Trabecular Bone. IEEE Trans. Med. Imaging 2017, 36, 2077–2086. [Google Scholar] [CrossRef]
  54. Oulhaj, H.; Rziza, M.; Amine, A.; Toumi, H.; Lespessailles, E.; Jennane, R.; Hassouni, M.E. Trabecular Bone Characterization Using Circular Parametric Models. Biomed. Signal Process. Control 2017, 33, 411–421. [Google Scholar] [CrossRef]
  55. Harrar, K.; Jennane, R.; Zaouchi, K.; Janvier, T.; Toumi, H.; Lespessailles, E. Oriented Fractal Analysis for Improved Bone Microarchitecture Characterization. Biomed. Signal Process. Control 2018, 39, 474–485. [Google Scholar] [CrossRef]
  56. Lee, S.; Lee, J.W.; Jeong, J.-W.; Yoo, D.-S.; Kim, S. A Preliminary Study on Discrimination of Osteoporotic Fractured Group from Nonfractured Group Using Support Vector Machine. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2008, 2008, 474–477. [Google Scholar] [CrossRef]
Figure 1. The arrangement of the axis in the center of one of the vertebrae (image in three projections).
Figure 1. The arrangement of the axis in the center of one of the vertebrae (image in three projections).
Jcm 11 04526 g001
Figure 2. Manual selection of the spongy matter region.
Figure 2. Manual selection of the spongy matter region.
Jcm 11 04526 g002
Figure 3. Spongy matter structure in soft-tissue (Type 1) and bone reconstruction (Type 2).
Figure 3. Spongy matter structure in soft-tissue (Type 1) and bone reconstruction (Type 2).
Jcm 11 04526 g003
Figure 4. Exemplary process of the model learning and validation for a set of features obtained with the Fisher method (soft-tissue reconstruction) for different classification methods. The graph shows that—for instance—the optimal number of features for the MLP model is 7.
Figure 4. Exemplary process of the model learning and validation for a set of features obtained with the Fisher method (soft-tissue reconstruction) for different classification methods. The graph shows that—for instance—the optimal number of features for the MLP model is 7.
Jcm 11 04526 g004
Figure 5. Results of testing the models considered optimal for particular feature selection methods: (a) bone reconstruction; (b) soft tissue reconstruction.
Figure 5. Results of testing the models considered optimal for particular feature selection methods: (a) bone reconstruction; (b) soft tissue reconstruction.
Jcm 11 04526 g005
Figure 6. The sensitivity (TPR) and specificity (TNR) of the models that have reached the highest value of the overall classification accuracy (ACC): (a) bone reconstruction; (b) soft-tissue reconstruction.
Figure 6. The sensitivity (TPR) and specificity (TNR) of the models that have reached the highest value of the overall classification accuracy (ACC): (a) bone reconstruction; (b) soft-tissue reconstruction.
Jcm 11 04526 g006
Figure 7. Confusion matrices: (a) model 5 for bone reconstruction; (b) models 2, 4, 5, 8 and 9 for soft tissue reconstruction.
Figure 7. Confusion matrices: (a) model 5 for bone reconstruction; (b) models 2, 4, 5, 8 and 9 for soft tissue reconstruction.
Jcm 11 04526 g007
Figure 8. Process flow during the prediction of a class of new images.
Figure 8. Process flow during the prediction of a class of new images.
Jcm 11 04526 g008
Figure 9. Various prediction results of sample images using soft tissue reconstruction.
Figure 9. Various prediction results of sample images using soft tissue reconstruction.
Jcm 11 04526 g009
Table 1. Results of hyperparametric optimization with the grid search method for the set of features obtained with the Fisher method (soft-tissue reconstruction). The criterion assumed for the selection of an optimal model for a given classification method involved achieving maximum validation accuracy with minimum number of training set features. The grey background was used to emphasize the model, which proved the best among the employed classification methods for the Fisher method. The meaning of parameters of individual classification models can be found in the scikit-learn library documentation [44].
Table 1. Results of hyperparametric optimization with the grid search method for the set of features obtained with the Fisher method (soft-tissue reconstruction). The criterion assumed for the selection of an optimal model for a given classification method involved achieving maximum validation accuracy with minimum number of training set features. The grey background was used to emphasize the model, which proved the best among the employed classification methods for the Fisher method. The meaning of parameters of individual classification models can be found in the scikit-learn library documentation [44].
Classification
Method
Validation AccuracyOptimal Features NumberOptimal Model Parameters
LDA0.9212solver = ‘svd’
QDA0.9412tol = 1 × 10−5
BAYES0.9111var_smoothing = 0.1
SVM0.9616C = 1.0, gamma = ‘scale’, kernel = ‘rbf’
NuSVM0.9616gamma = ‘scale’, kernel = ‘rbf’, nu = 0.3
KNN0.9514n_neighbors = 5
DT0.9110criterion = ‘gini’, max_depth = 3
MLP0.967activation = ‘relu’, alpha = 0.1, solver = ‘lbfgs’, max_iter = 1000,
hidden_layer_sizes = (3,)
RF0.9414max_depth = 5, n_estimators = 20
GRAD0.9316loss = ‘deviance’, n_estimators = 50
ADA0.9515n_estimators = 50
Table 2. Basic information about optimal models for particular feature selection methods.
Table 2. Basic information about optimal models for particular feature selection methods.
Model NumberBone ReconstructionSoft Tissue Reconstruction
Classification MethodFeature Selection MethodThe Number of FeaturesValidation Accuracy (%)Classification MethodFeature Selection MethodThe Number of FeaturesValidation Accuracy (%)
1NuSVMFISHER1394MLPFISHER796
2RFANOVA2694NuSVMANOVA1796
3SVMRELIEF2794MLPANOVA1796
4NuSVMSFS694SVMRELIEF1896
5KNNSBS994NuSVMRELIEF1896
6RFSBS994KNNSFS596
7MLPRFE1895KNNSBS596
8ADA 993SVMRFE1896
9LR1093NuSVMRFE1896
10LGBM389ADA 895
11 LR491
12 LGBM288
Table 3. Information on the structure of models considered most effective for soft-tissue reconstruction.
Table 3. Information on the structure of models considered most effective for soft-tissue reconstruction.
Model NumberClassification MethodFeature Selection MethodThe Number of FeaturesModel Parameters
2NuSVMANOVA17gamma = ‘scale’, kernel = ‘rbf’, nu = 0.3
4SVMRELIEF18C = 1.0, gamma = ‘scale’, kernel = ‘rbf’
5NuSVMRELIEF18gamma = ‘scale’, kernel = ‘rbf’, nu = 0.3
8SVMRFE18C = 1.0, gamma = ‘scale’, kernel = ‘rbf’
9NuSVMRFE18gamma = ‘scale’, kernel = ‘rbf’, nu = 0.3
The meaning of the model parameters in Table 3: gamma—kernel coefficient; kernel—specifies the kernel type to be used in the algorithm; nu—an upper bound on the fraction of training errors and a lower bound of the fraction of support vectors; C—regularization parameter. The other model parameters, not listed in Table 3, take default values.
Table 4. Summary of results of similar bone texture analysis tests [48].
Table 4. Summary of results of similar bone texture analysis tests [48].
No. in Ref.Texture FeaturesROI
Segmentation
DatasetClassifierTPRTNRPPVNPVACCF1-Score
Own resultsHistogram, Gradient, Run length matrix, Cooccurrence, Autoregressive, Haar waveletManual50 cases & 50 controlsSVM NuSVM9595--95-
[49]power spectral density, triangular prism surface area and variation, box counting,Manual11 cases & 13 controlsK-NN7890907781-
[50]Wavelet Marginals-HaarCalcaneal (Manual)58 cases & 58 controlsSVM62.165.564.363.363.863.2
[51]1D LBPCalcaneal (Manual)39 cases & 41 controlsKNN-43.9--71.377.2
[47]Fractal dimension, wavelet analysis, Gabor, LBP, DFT, DCT, Laws masks, edge histogram and GLCMCalcaneal (Manual)58 cases & 58 controlsRF74.174.1--74.1-
[52]1D projection modeled as fractional Brownian motionCalcaneal (Manual)-SVM96.997.6--94.594.3
[45]Fractional Brownian model and Rao geodesic distanceCalcaneal348 cases & 348 controlsKNN97.895.4--96.696.5
[46]Histogram and GLCM and PCA analysisCalcaneal (Manual)87 cases & 87 controlsSVM97.795.495.597.796.696.6
[53]Anisotropic discrete dual-tree wavelet transformCalcaneal (Manual)87 cases & 87 controlsSVM-93.192.991.091.991.9
[54]Wavelet decomposition and parametric circular
models
Calcaneal (Manual)87 cases & 87 controlsSVM10092.591.910095.995.8
[55]Oriental fractal analysisCalcaneal (Manual)87 cases & 87 controls-72.071.072.071.071.872.2
[56]BMD, fractal, histomorphometric and skeletal measuresDistal radius87 cases & 87 controlsSVM79.066.0----
[48]Cortical, histogram, GLCM and MGMDistal radius (Automated)60 cases & 60 controlsSVM86.765.071.283.075.878.2
[48]Cortical and LLBPDistal radius (Automated)60 cases & 60 controlsSVM88.366.772.685.177.579.7
[48]Cortical and hLLBPDistal radius (Automated)60 cases & 60 controlsLR81.776.777.880.779.279.7
[48]Cortical and vLLBPDistal radius (Automated)60 cases & 60 controlsSVM88.360.068.883.774.277.4
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Dzierżak, R.; Omiotek, Z.; Tkacz, E.; Uhlig, S. Comparison of the Classification Results Accuracy for CT Soft Tissue and Bone Reconstructions in Detecting the Porosity of a Spongy Tissue. J. Clin. Med. 2022, 11, 4526. https://doi.org/10.3390/jcm11154526

AMA Style

Dzierżak R, Omiotek Z, Tkacz E, Uhlig S. Comparison of the Classification Results Accuracy for CT Soft Tissue and Bone Reconstructions in Detecting the Porosity of a Spongy Tissue. Journal of Clinical Medicine. 2022; 11(15):4526. https://doi.org/10.3390/jcm11154526

Chicago/Turabian Style

Dzierżak, Róża, Zbigniew Omiotek, Ewaryst Tkacz, and Sebastian Uhlig. 2022. "Comparison of the Classification Results Accuracy for CT Soft Tissue and Bone Reconstructions in Detecting the Porosity of a Spongy Tissue" Journal of Clinical Medicine 11, no. 15: 4526. https://doi.org/10.3390/jcm11154526

APA Style

Dzierżak, R., Omiotek, Z., Tkacz, E., & Uhlig, S. (2022). Comparison of the Classification Results Accuracy for CT Soft Tissue and Bone Reconstructions in Detecting the Porosity of a Spongy Tissue. Journal of Clinical Medicine, 11(15), 4526. https://doi.org/10.3390/jcm11154526

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop