1. Introduction
The modern level of knowledge in the field of information technologies allows creating quite effective tools for optimizing the processes of medical diagnosis and treatment, in particular, the diagnosis of glaucoma. However, in order to increase the effectiveness and reliability of support for decision-making about the level of pathology in the diagnosis of glaucoma, it is necessary to create automated systems based on a wide range of modern mathematical and optimization methods, systems theory and system analysis, in particular, the use of the fuzzy set method. Today, this problem in medical practice is quite non-trivial, since the factor of subjectivity enters the decision-making process, which leads to a decrease in the reliability of the established diagnosis. An early diagnosis of eye pathologies is the most important stage in the treatment of eye diseases, in particular, fundus, glaucoma, etc. At the same time, inaccurate vision test results can lead to the appointment of inappropriate treatment, and instead of helping and restoring vision, it will only worsen it.
When experts form a reference sample of images of fundi, conflicts may arise due to ambiguities in the images. Practice has shown that even the same expert can differently assess whether the same image displays glaucoma or not at different times (after a week, a month, etc.). It is natural that different experts often have different opinions about the presence of glaucoma in images of fundi. Therefore, when forming a knowledge base using an expert system, it is necessary to provide procedures for assessing the convergence and reproducibility of the results of creating a reference sample [
1,
2,
3].
The result of the work on an optical–electronic expert system is a conclusion about the presence of glaucoma of a certain type with an indication of its probability. The latter requires the creation of a representative reference sample of images of a necessary volume [
4,
5,
6].
A feature of the considered expert system is that, along with the knowledge of experts accumulated in it, a database is created based on the results of measuring quantitative features through automated image processing. Next, a conclusion is formed based on the assessment of the probability of the considered image exhibiting a type of glaucoma belonging to a list of possible types [
2,
7,
8,
9].
Since conclusions based on the results of drug research using expert systems are formed based on the results of computer image processing, it is necessary to consider the factors affecting the accuracy of the measurements performed in the system [
10,
11,
12,
13].
For the considered task of automating the analysis of fundi, in the first stage, image improvement procedures are performed; these are associated with the suppression of image-distorting factors (filtering of obstacles, elimination of lighting irregularities, etc.). In the description stage, the characteristic features of an object are calculated; on this basis, in the third stage, the object is assigned to a class. The key to these three stages is the description stage. The recognition result depends on the choice of features and their informativeness (the ability to attribute an object to a class based on the value of the features). We can distinguish two groups of factors that influence the recognition result; the first group is that of the properties of the object itself (images of fundi are very diverse), while the second group is that of the image formation conditions (sensor noise, uneven illumination of the object, etc.) [
14,
15].
The purpose of this work is to develop a conceptual model of an optical–electronic expert system for the diagnosis of glaucoma using computer processing methods, as well as to analyze the influences of factors on the results of fundus image recognition [
16,
17,
18].
2. Methods
The proposed approach to the recognition of images of fundi is based on the use of the knowledge of specialists in the field of ophthalmology and consists of creating an expert system for the diagnosis of glaucoma. The basis of the system is a reference sample of digital images, the description of which is stored in the knowledge base. An important component of the system is the analytical subsystem, which includes many rules by which decisions are made (
Figure 1) [
19,
20,
21,
22].
There are factors that have a dominant influence on the correctness of image recognition. As a result of the research conducted here, several factors that had the most significant impacts on the accuracy of the measurement results were identified, and they were divided into three groups based on the type of source (instrumental, methodical, subjective user errors).
For the considered system, instrumental factors can be classified into two groups; the first is that of factors that are due to physical processes in the equipment used, while the second is that of factors that are due to the influence of external conditions. The first group of instrumental factors includes the noise of the image sensor, color distortions of the camera, brightness distortions, diffraction effects of the optical system, uneven spectral characteristics of the illuminator in the ophthalmoscope, uneven illumination of the drug in the field of view of the camera, etc. The factors of the second group include factors determined by the external conditions of the system’s application [
23,
24,
25].
So, for example, an image registered in the system can be affected by factors such as the presence of bright external lighting (sunlight), which can decrease the contrast of the image. In addition, the external factors include surface vibration (this can lead to image distortion when using large exposures) [
26,
27].
First, the methodological factors include the measurement model and mathematical methods of image processing that are implemented in the system software, as well as the discretization and quantization operations that are carried out when forming a digital image.
A group of factors that depend on the user is related to the setting of the ophthalmoscope (the choice of the lens, the position of the condenser, field, and aperture diaphragm, the voltage of the lamp, and light flux correction filters, position of the lens focus). Along with these, this group includes factors related to the selection of the field for research and the positioning of the research object in the field of view of the camera, as well as factors that depend on the user in the interactive mode of image processing (when the processing parameters are specified by the user when implementing the processing in the application software).
3. Recommendations for the Implementation of the Optical–Electronic Expert System for the Proceeding of Images of the Retina of the Eye
To implement the tasks, the architecture of the optical–electronic expert system shown in
Figure 2 was implemented.
The user receives the data to be processed as a result of diagnostics based on a modern fundus camera. An interface for entering information and its pre-processing has been developed, which allows you to process images and accurately distinguish pathological zones.
In the future, the received processed image must be recorded in the knowledge base replenishment block, for the sake of correct interpretation when the dynamics of progress or regression of this or that pathology is carried out.
The block of formation of knowledge bases is responsible for the preservation of all previously obtained data and existing standards regarding the norms and pathologies of the fundus of the eye.
4. Realization of Expert System for Diagnosing Glaucoma Based on Fuzzy Logic
A conceptual model of an expert system for diagnosing glaucoma is proposed to reduce the ambiguity of the interpretation of research objects. Factors affecting the correctness of the recognition of complex objects (images of fundi) using an expert system based on methods of computer ophthalmoscopy were considered (
Table 1).
Mathematical equations for classification of the level of pathology are formed from the data in
Table 1 (Rotshtein A. Design and Tuning of Fussy IF–THEN Vuly for Medical Didicol Diagnosis).
5. Algorithmic Software Implementation for Processing Biomedical Images
During the analysis of the characteristics of a fundus, the reliability of the final assessment of the images therein should be increased by using expert methods. The proposed approach to the recognition of images of fundi is based on the use of the knowledge of specialists in the field of ophthalmology and consists of creating an expert system for the diagnosis of glaucoma. The basis of this system is a reference sample of digital images, the description of which is stored in a knowledge base. An important component of the system is the analytical subsystem, which includes many rules by which decisions are made.
To obtain a diagnosis with the help of an expert database, we suggest using elements of fuzzy logic. We built a model on the basis of actual data (
Table 1).
Using an algorithm from a processing method based on the fuzzy logic apparatus, we obtain the following.
When saving the data, i.e., entering the lower and upper values, we can enter the patient’s data.
Having obtained the result, we can conclude that the patient has glaucoma of the third degree (
Figure 4).
6. Physical Modeling of the Optical–Electronic System for Researching Pathologies of Fundi
Physical modeling of the optical–electronic system for researching pathologies of fundi performed for the formation of an optical–electronic system for entering biomedical information.
The optical–electronic system for obtaining images of the retina of an eye is related to medicine, namely, to devices for examining fundi, and it can be used in ophthalmology to conduct medical and biological research and, specifically, to fix images of retinas. The optical channel is realized as follows.
The radiation flow coming from the radiating surface of the source to the remote illuminating surface can be calculated as follows (1):
where
L is the brightness of the emitting surface; S
source is the area of the radiating surface; S
sq is the area of the illuminating surface;
β1 is the angle between the direction of radiation propagation and the normal to the radiating surface;
β2 is the angle between the direction of radiation propagation and the normal to the illuminating surface; and
l is the distance between the surfaces.
If the lighting system directs radiation into the eye through a pupil area with an area Ssource, then this area can be considered as a light-emitting surface, the brightness of which L
laser due to the transition of light rays from the air to the eye is related to the brightness of the source—the LED L
diode—according to the following Expressions (1) and (2):
where
Neye is the average refractive index of eye tissues.
Taking Expression (2) and the transmission coefficient of the optical system of the eye
τeye into account, Expression (1) for the light flux falling on the retina can then be written in the following form:
where
Seye′ is the area of the retina; and
leye is the distance between the pupil and the retina.
When the light flux spreads along the optical axis of the eye, which is assumed to be perpendicular to the planes of the pupil and retina (
β1 =
β2 = 0), the illumination of the retina will be
Expression (4) is true for the illumination of a retinal point lying on the optical axis of the eye. However, since the fundus is a sphere and due to the multiple reflections of light rays inside the eye, it can be assumed that the illumination of the entire retina is uniform and is determined by Expression (4).
A uniformly illuminated retina, diffusely reflecting the light stream falling on it, represents a secondary light source, the brightness of which will be equal to
where
ρ is the diffusion reflection coefficient.
Illumination of the retinal image takes place on the photomatrix, which is built with the following optical system:
where
τos is the transmission coefficient of the optical system;
n′ is the refractive index of the medium in the image space (n′ = 1);
n is the index of refraction of the medium in the space of objects (n = noka);
D is the diameter of the entrance pupil of the optical system;
f′ is the focal length of the optical system;
βp is the linear increase in the optical system in the pupils; and
β is the linear increase in the optical system.
Substituting (5) into (6) and assuming a linear increase in the pupils
βp = 1, for the illumination of the retinal image on the photomatrix, we obtain
Let us assume that
τeye = 0.5,
τos = 0.9,
ρ = 0.2,
leye = 24, and diameter = 24 mm. The maximum brightness of the light source that can be transmitted when directly observed is 7500 cd/m
2. So that patients would not feel discomfort, as an illuminator, we chose an LED; Lsd = 7000 cd/m
2. Let us also assume that the projection of the source onto the pupil of the eye occupies 50% of its area. In this case, with a pupil diameter of 6 mm, S
d.pup = 14.13 mm. To perceive the image, we used the 6.6 Megapixel CMOS photomatrix NOII4SM6600A, the main indicators of which are as follows:
Dimensional capacity | 2210 × 3002 |
Optical format, inches | 1 |
Range of spectral sensitivity, nm, hm | 400…1000 |
Apparent sensitivity, V/(lx/s) | 2.01 |
Dark signal, mV/s | 3.37 |
The required linear increase β in the optical system can be determined by the ratio that corresponds to the condition under which the retinal image occupies the largest part of the photomatrix area:
where
Hphm is the height of the photomatrix; and D
retina is the diameter of the retina.
The optical matrix format of 1 inch corresponds to the size of 12.8 × 9.6 mm. The diameter of the human retina is 22 mm. Then,
By substituting numerical values for the definition in Expression (7), we obtain
To carry out further calculations, we will determine the illumination of the photomatrix E′ at which the value of the useful output signal will be comparable to the dark one. The minimum illumination of the image at which it is indistinguishable from the background noise is found using the sensitivity of the photomatrix and the value of the dark signal:
To obtain a good image of the retina, the illumination of the photomatrix must be at least 10 times higher than this value. Therefore,
Then, using Expression (9) for the geometric luminous intensity of the optical system, we have
In order to use the entire field of the optical system, the entrance pupil must be aligned with the plane of the eye pupil. In this case, the field aperture will be the frame of the photomatrix, and with the linear magnification selected in accordance with Expression (8), the image of the entire retina will be formed on the photomatrix. The diameter of the entrance pupil of the optical system D is chosen to be equal to 3 mm. As a result, the area of the entrance pupil of the optical system is equal to 7.065 mm
2, which is 25% of the area of the pupil of the eye with a pupil diameter of 6 mm. Then, from Expression (10), for the focal length of the optical system, we obtain
When calculating the focal length of the optical system, the linear increase in the pupils
βp was taken to be equal to 1. This corresponds to the case when the distance −
zp from the front focus of the optical system to the input pupil is equal to the front focal length of the optical system:
The distance from the front focus to the retina is equal to
The distance z′ from the back focus to the retinal image formed in the photomatrix plane is determined using the linear magnification of the optical system β:
7. Evaluation of Metrological Indicators
For most medical and biological studies, the degree of probability of an error-free forecast equal to 95% is considered sufficient, and the number of cases of the general population in which deviations from the patterns established during a sample study may be observed should not exceed 5%. In a number of studies related, for example, to the use of highly toxic substances, vaccines, and surgical treatments, as a result of which serious diseases, complications, and fatal consequences are possible, the degree of probability p = 99.1% is used, i.e., in no more than in 1% of cases of the general population, deviations from the regularities established in the sample population are possible.
The given degree of probability (p) of an error-free forecast corresponds to a certain value of the criterion t substituted into the formula, which also depends on the number of observations.
When n > 30, the degree of probability of an error-free forecast (p = 99.1%) corresponds to the value of t = 3, and when p = 97.2%, this corresponds to a value of t = 2.
When n < 30, the value of t at the appropriate degree of probability of an error-free forecast is determined according to a special table (N.A. Plokhinsky).
We determined the error of representativeness (mp) and the confidence limits of the relative indicator of the general population (R
gen) in relation to the table of results obtained through diagnosis by an ophthalmologist and with the help of an expert database (See
Table 2).
A group of glaucoma patients consisting of 126 people aged 50–65 years but with different stages was used.
The representativeness error of the relative indicators was determined according to the diagnoses of an ophthalmologist.
The error of representativeness of the relative indicators was determined according to the diagnoses obtained with the help of the expert database.
The confidence limits of the average values of the general population (Rgen) were calculated as follows:
- -
It was necessary to set the degree of probability of an error-free forecast (p = 95%).
- -
At a given degree of probability and with a number of observations of more than 30, the value of the criterion t was equal to 2 (t = 2).
Then, = Pchoice ± tm = 43% ± 2 × 7.64 = 43% ± 15.28%.
Then, = Pchoice ± tm = 14% ± 2 × 5.35 = 14% ± 10.70%.
Then, = Pchoice ± tm = 43% ± 2 × 7.64 = 43% ± 15.28%.
Then, P1c = Pchoice ± tm = 40% ± 2 × 7.56 = 40% ± 15.12%.
Then, P2c = Pchoice ± tm = 12% ± 2 × 5.01 = 12% ± 10.02%.
Then, P3c = Pchoice ± tm = 48% ± 2 × 7.71 = 48% ± 15.42%.
Taking the results of the calculation of the confidence limits of the average value of the general population (Rgen) into account, we established with the probability of an error-free forecast (p = 95%) that the frequency of detection of stage I glaucoma at the age of 50–65 years was in the range from 27.72% to 58.28% of cases (diagnosis by an ophthalmologist) and from 24.88% to 55.12% (diagnosis obtained using an expert database). The frequency of detection of stage II glaucoma at the age of 50–65 years ranged from 3.30% to 24.70% of cases (diagnosis by an ophthalmologist) and from 1.98% to 22.02% (diagnosis obtained with an expert database). The frequency of detection of stage III glaucoma at the age of 50–65 years ranged from 27.72% to 58.28% of cases (diagnosis by an ophthalmologist) and from 32.58% to 63.42% (diagnosis obtained with an expert database).
The main purpose of this study is to diagnose glaucoma and to assess whether the disease has affected people. The model can generate either positive or negative results depending on whether the glaucoma disease impact assessment is achieved.
The ability of a model to correctly predict the behavior of a subset is known as its accuracy. Efficiency is calculated using it during the classification process. Its purpose is to give a rough idea of how often both positive and negative changes are needed. In the classification of glaucoma fundus images, it was demonstrated that the training and testing of the proposed model was more accurate than previous models. The results of this study are shown in
Table 3.
When evaluating a model, its F-measure, accuracy, precision, and specificity are all considered. Inception additional deep learning models, such as ResNet, ResNet 152v4, DenseNet-169, and VGG-19, CNN are now being utilized to analyze Proposed Model Fuzzy Logic classification findings.
For example, in glaucoma fundus image classification, training and testing using the proposed model turned out to be more accurate than other models previously. The results of this study are shown in
Figure 5 and
Table 3.
Compared to previous methods, this increased training accuracy from an average of 1.09 percent to 3.96 percent. Compared to other considered models, the tests are 97.2 percent accurate, which means a performance gain of 0.3 to 5.56 percent.
In the future, the received data will be processed by blocks of fuzzy logic, which will make it possible, having in its resource the data of the knowledge base and the received image of a specific patient, to conduct an analysis and give a result about this or that disease. This will enable the doctor to make a correct conclusion about the condition of the fundus during the diagnosis of glaucoma.
8. Conclusions
This paper proposes a deep method based on fuzzy sets for glaucoma assessment and prediction. The glaucoma dataset was used to train a glaucoma image analysis learning model. To detect glaucoma, the images were classified using a deep convolutional neural network.
These images of the fundus retina were used to determine whether the patient had glaucoma. The resulting image data were compared to the baseline images of the dataset. The model was used to extract features from segmented images for data processing.
For the first time, mathematical models were obtained for the evaluation of biomedical images using fuzzy set methods on the basis of expert knowledge bases, which made it possible to carry out complex qualitative diagnostics and increase the reliability and efficiency of diagnosis. A methodology for analyzing biomedical images based on the fuzzy set apparatus was formed, which allowed a fuller assessment of the level of disease for glaucoma.
Aspects of the practical implementation of an optical–electronic system of biomedical information processing were considered. An algorithm and an optical–electronic system for biomedical image analysis were proposed, and they were used to increase the informativeness and reliability of the diagnosis of eye pathologies—in particular, glaucoma. Compared to previous methods, this increased training accuracy from an average of 1.09 percent to 3.96 percent. Compared to other considered models, the tests are 97.2 percent accurate, which means a performance gain of 0.3 to 5.56 percent.
On the basis of the developed model and algorithms, a hardware and software implementation was created, and experimental and medical studies of the obtained system indicators were conducted.
Examples of practical applications of the developed optical–electronic system for the analysis of eye pathologies are given. The main practical result is that the expediency and reliability of such an optical–electronic system were practically confirmed.
The results of this study can be generalized to a variety of imaging modalities. The proposed method of transfer of learning has an additional advantage, as it can be applied in various areas of medicine and biology.