Abstract
Multilevel thresholding is one of the most effective image segmentation methods, due to its efficiency and easy implementation. This study presents a new multilevel thresholding method based on a modified artificial ecosystem-based optimization (AEO). The differential evolution (DE) is applied to overcome the shortcomings of the original AEO. The main idea of the proposed method, artificial ecosystem-based optimization differential evolution (AEODE), is to employ the operators of the DE as a local search of the AEO to improve the ecosystem of solutions. We used benchmark images to test the performance of the AEODE, and we compared it to several existing approaches. The proposed AEODE achieved a high performance when evaluated by the structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), and fitness values. Moreover, the AEODE outperformed the basic version of the AEO concerning SSIM and PSNR by 78% and 82%, respectively, which reserves the best features for each of AEO and DE.
1. Introduction
Image segmentation is one of the primary and essential operations for pattern recognition and image analysis. Over the past years, various segmentation techniques have been introduced to improve the segmentation processes, such as fuzzy c-means, fuzzy clustering algorithms, and mean-shift analysis. The image thresholding approach is a successful and standard image segmentation method among other similar segmentation techniques. This is because of its clarity, robustness, and efficiency, which transforms a gray level image into a binary level image [1]. It is the process of partitioning an image into its component objects or regions based on color, size, shape, position, or texture [2].
There are several image segmentation techniques. However, multilevel thresholding is the most successful technique employed for segmentation purposes of different types of images out of all the current techniques [3]. The motivations behind the widespread application of multilevel thresholding are due to its simplicity and computation efficiency. It is employed to recognize and obtain a target from the image background depending on the allocation of gray levels or texture in image components (objects). So, understanding or interpretation of a given image needs to precisely segment it into vital regions [4]. Therefore, it plays a vital role in computer vision domains.
Thresholding methods are divided into local and global methods. The global methods are arranged in terms of the clustering-based information into spatial-based, entropy-based, object attribute-based, and histogram shape-based methods [5]. These methods are usually divided into two types: bi-level and multilevel [6]. In the bi-level, the image is divided into two categories [7]. In contrast, multilevel is utilized for detailed image segmentation because it provides multiple levels, such as quad-level or tri-level, and breaking pixels into multilevel depending on the image’s pixels. Therefore, image segmentation by multilevel thresholding has drawn more consideration because of its various applications in different fields [8]. However, determining the optimal threshold value is still the most challenging problem encountered in thresholding techniques, and it needs further investigation.
For a precise description of the thresholds, different variance measures as the entropy are employed. Two conventional techniques are the intra-class variance [9] and Kapur’s entropy [10]. These techniques are beneficial in obtaining a single threshold. However, conventional techniques suffer from some limitations, such as computational time. In addition to that, the complexity rises considerably when dividing the image into more than two classes is necessary. The applications of meta-heuristic optimization methods were proposed in many studies to address this problem, which presented good results [11].
Optimization algorithms are promising mechanisms to perform complicated optimization tasks with a high level of accuracy [12]. In the published literature, several methods were proposed for multilevel thresholding, such as the stochastic fractal search (SFS) algorithm, spherical search optimization (SSO) algorithm, artificial bee colony (ABC) algorithm, sine–cosine algorithm (SCA), differential evolution (DE) algorithm, multi-verse optimization (MVO) algorithm, particle swarm optimization (PSO) algorithm, whale optimization algorithm (WOA), genetic algorithm (GA), social spider optimization (SSO), honey bee mating optimization (HBMO), flower pollination algorithm (FPA) algorithm, crow search algorithm (CSA), and world cup optimization (WCO) algorithm [13]. However, as every image is considered an optimization problem, not all optimization algorithms give precise results by applying the Otsu and Kapur as objective functions. In particular, an algorithm can obtain the optimal configuration of thresholds for a particular image but not for all given images.
Zhao et al. in [14] proposed a new optimization algorithm inspired by nature, called artificial ecosystem-based optimization (AEO). This algorithm is a warm-based search method driven by the flow of power in an environment on the ground, and it simulates three different styles of living organisms: production, consumption, and decomposition. The authors experimented using different test functions and optimization tasks. The results showed that the AEO has an advantage over other equivalents. AEO is superior to other comparative algorithms in both computational cost and convergence speed, particularly for engineering applications. In general, the AEO is prevalent, which motivates us to employ it for solving multilevel thresholding problems.
This paper develops an efficient image segmentation method depending on a modified version of the AEO, using the differential evolution (DE) strategy. The proposed method, called AEODE, intends to evade the shortcomings of the conventional AEO by applying the operators of DE as an exploitation strategy (local search) to enhance the ecosystem of solutions. The power of these combined algorithms is employed for enhancing the performance of the multilevel thresholds image segmentation. DE is a search method that optimizes the given problem by iteratively working to enhance a solution concerning the fitness function [15]. This method was used before in many engineering problems and applications, such as engineering problems, numerical function optimization, feature selection, big data optimization problems, text clustering, reactive power dispatch problem, solar photovoltaic and wind energy, multilevel image thresholding, optimal power flow, and continuous optimization problems.
Generally, the proposed AEODE method works on calculating the histogram of the provided image. Then, it creates random candidate solutions subject to the minimum and maximum histogram values. Each candidate solution includes a collection of position values that design the threshold values. The fuzzy entropy is employed as a fitness function to assess the quality of the candidate solutions, and the best-obtained solution has the most significant fitness value. After that, the current candidate solutions are updated according to a condition with a random value to operate the AEO or DE. After completing the updating procedure for the given solutions, the terminal criteria are checked to verify whether they are satisfied or not, so the preceding steps are executed again. We implement extensive experiments, using benchmark images to evaluate the AEODE method; then, we compare it to many existing optimization methods.
Our main contribution can be summarized as follows:
- Propose an alternative multilevel thresholding image segmentation method based on hybrid AEO and DE algorithms.
- Blend the strength of the AEO and the DE to develop the proposed AEODE method for optimizing the thresholding value.
- Evaluate the efficiency of the AEODE, using a set of benchmark images.
- Compare the proposed image segmentation method with the state-of-the-art methods published in that domain.
The remainder of this paper is presented as follows. Section 2 presents the related works that studied the image segmentation problems, using optimization techniques. Section 3 presents the preliminaries of the methods. The description of the AEODE method is presented in Section 4. The experiment and comparisons are described in Section 5. Section 6 concludes the paper.
2. Literature Review
One of the most vital techniques utilized in the computer vision domain is multilevel thresholding. Conventional segmentation techniques suffer from difficulties in settling the proper threshold values; hence, meta-heuristic (MH) algorithms are successfully applied to address these difficulties. Generally, meta-heuristic algorithms are introduced by mimicking natural behaviors of groups in the environment, such as wild animals, flying animals, science, theories, and others. In [16], a new multilevel thresholding approach was presented based on a new version of the spherical search optimization (SSO) algorithms, called SSOSCA. The proposed method used operators from the components of the conventional SCA to improve the exploitation searchability of the conventional SSO algorithm. Fuzzy entropy was employed as the leading fitness function to assess the nature of candidate solutions of the SSOSCA. In the experiments, several images were taken from Berkeley benchmark datasets to analyze and test the performance of the SSOSCA. The results showed that the SSOSCA achieved competitive performance, compared to several existing algorithms based on various image segmentation metrics.
Horng in [17] presented a multilevel maximum entropy thresholding method, using the ABC algorithm, called (MEABCT). Four approaches were compared to the MEABCT algorithm: the PSO algorithm, cooperative–comprehensive PSO, HBMO, and Fast Otsu’s approach. The evaluation results showed that the MEABCT could explore multiple threshold values near the optimal value observed by the optimization method. The segmentation results of the MEABCT algorithm are better than the other methods; nevertheless, the computation time by utilizing the proposed MEABCT is less than that of the other comparative algorithms.
Yousri et al. [18] proposed a new method to improve the search abilities of the FPA. Accordingly, fractional-order (FO) calculus characteristics were utilized to improve the exploitation searchability of the conventional FPA and adaptively enhance the harmonization parameter between the FPA exploitation and exploration search. It was tested on different test functions with various dimensions. In addition, it was compared with similar established techniques in the literature, using different statistical evaluation measures and non-parametric analyses. Moreover, it was implemented for a real-word image segmentation purposes, and the obtained results were compared to several existing methods.
Forouzanfar et al. in [19] proposed a study to examine the potential of the GA and PSO algorithms to determine the optimum value of the degree of attraction of the segmentation processes. The GA showed better performance in determining a close-optimal solution; however, it had an issue in obtaining an exact solution, while the PSO algorithm enhanced the exploration for finding the optimal solution. Consequently, vital changes are expected by utilizing a hybrid method by combining the PSO with GA algorithms. In this way, the hybrid GA-PSO algorithm is used to find the optimum degree of attraction in the image segmentation process. The quantitative and qualitative analyses are conducted on image benchmark datasets and brain MR images with various noise shapes. The results showed unique enhancements in segmentation results matched to other fuzzy c-means methods.
In [20], the authors presented a clustering approach, using PSO for image segmentation, called divergent–convergent PSO (DCPSO). The DCPSO automatically manages the number of groups and concurrently gathers the dataset with the smallest user interference. The DCPSO begins by clustering the dataset into many clusters to minimize the impacts of initial shapes. The optimal number of clusters is selected by using the binary PSO. Then, the K-means clustering algorithm perfects the centers of the determined clusters. The proposed algorithm was tested on both natural and synthetic image datasets. The results revealed that the DCPSO algorithm obtained the optimal number of clusters on the experimented image datasets, compared to other similar methods, such as GA and the conventional PSO algorithm.
In [21], a new image segmentation method is presented, using many-objective optimization: knee evolutionary algorithm (KnEA) is one of the best multi-objective methods utilized to determine solutions, using seven functions to improve the effectiveness of the segmentation process. The KnEA was assessed, utilizing several images tested at six various threshold levels, and the results were compared to several existing many-objective optimization techniques. Comparison of the results showed that the KnEA performs better in estimating the optimal solutions than other methods in terms of the computational time, and the segmented quality, such as SSIM, PSNR, coverage, hypervolume, and spacing indicators.
Smith in [22] proposed a segmentation method, using the RFC algorithm. The proposed method quantitatively assesses various possible image segmentation alternatives to distinguish the segmentation scale(s). The selection process of the image segmentation rule was utilized to distinguish between three basic image object rules after combination. Then, the RFC algorithm was applied to determine the land cover classes to 11 gray-scale images of SPOT satellite imagery. The results showed that the RFC algorithm achieved better performance with an average accuracy of 85.2%. In another study, Shahrezaee [23] proposed an image segmentation approach based on the WCO algorithm. The proposed approach used the WCO to analyze the original pixels of images into various groups. The performance of the WCO was evaluated and compared to several existing approaches, such as Otsu, GA, and PSO, and it achieved good performance.
In [24], the authors proposed a multi-objective optimization method, using the MVO algorithm for gray-scale image segmentation by multi-thresholding values. An approximate Pareto-optimal set was involved in increasing the Otsu and Kapur objective functions in their method. These functions are usually employed in solving image segmentation through bi-level and multi-level thresholding. Nevertheless, each function has specific conditions and properties. Several optimization algorithms were introduced to optimize these functions in terms of efficiency independently. In contrast, just a few multi-objective methods have investigated the advantages of utilizing a combination of Otsu and Kapur. However, the computational damage of Otsu and Kapur is extensive, and their efficiency needs to be enhanced. Eleven gray-scale images were utilized to test the multi-objective MVO. Moreover, it was compared with three different multi-objective methods, and it obtained significant performance.
In conclusion, we notice that optimization-based multilevel thresholding image segmentation is considered an emerging research field with new and exciting theories and strategies. It is also recognized as a critical problem to employ various techniques with various objective functions over varying models of images.
3. Background
3.1. Problem Definition
In this section, we briefly define the problem of multilevel thresholding. If we have I gray-scale image, it will have classes. For dividing the I image into classes, we need the values of k thresholds , and this can be formulated as follows [25]:
in which L is the maximum gray levels, and is a kth class of the I. The is the k-th threshold, where is a gray level at -th pixel. Moreover, a multilevel thresholding problem is defined as a maximization problem that is employed to find the optimal threshold, as given by Equation (2):
where represents the objective function. In this paper, we use fuzzy entropy [9] as the objective function. Fuzzy entropy was used in various segmentation approaches [26,27], and it can be formulated as follows:
where is the probability distribution, which is computed as (). and represent pixel numbers for the corresponding gray level L and total pixel numbers of the I. Furthermore, represent the fuzzy parameters, and . Then . The relevant fitness value is the highest one.
3.2. Differential Evolution (DE)
Storn and Price [15] presented the DE as a first attempt in 1997 for solving several optimization problems. DE is distinguished by its flexibility, short execution time, rabid acceleration trend, and its fast and precise local operator for selection. The optimization process in DE starts with a random set of solutions for discovering most of the points in the search space (initialization phase). After that, the solutions can be modified based on a set of operators, which are mutation and crossover, and then the agent solution is upgraded when the newly generated solution achieves a better objective value. The mathematical model of the mutation operator can be implemented for the current individual as below:
where , and are random indexes that are varied from the current index i. F is the mutation scaling factor, and it has a value greater than 0. The symbol of t refers to the iteration number.
For the crossover operator, Equation (8), below, illustrates that during the crossover process, a new solution vector is created based on the mutated individual and the solutions vector . The crossover process is accounted for as a mixture between vectors and , where the diversity of the agents is enhanced.
where is a random value in the [0, 1] interval, and is the crossover probability.
The final phase in the DE algorithm is upgrading the agents’ solutions based on the attained objective values, where the generated individual is exchanged with the current individual if it has a better objective as follows:
These steps are repeated until the stopping criteria are met.
3.3. Artificial Ecosystem-Based Optimization
AEO is a new optimization method inspired by the chain energy transfer among living organisms [14]. This process happens through three sequential processes: production, consumption, and decomposition. Zhao et al. [14] represented these processes mathematically to achieve optimal solutions for several optimization problems; thus, the AEO optimizer was proposed. The production process is responsible for improving the balance among the diversification and intensification perspectives in AEO, whereas for discovering the total search space, the consumption operator is implemented (diversification perspective). The intensification perspective can be excluded in the decomposition process. In AEO, the producer (plants) and decomposer (fungi and bacteria) are only one agent, while the rest of the agents can be considered consumers that can be classified based on their diet. These animal types are (1) herbivores (eat plants), (2) omnivores (eat plants and other animals), and (3) carnivores (eat only other animals). The agents in this hierarchy update their positions, according to the following equations.
- Production process: Zhao et al. [14] considered the producer as the worst agent in the populations. In AEO, the producer updates its location depending on randomly selected individual in the search space, as well as the decomposed (best agent) as presented below:where and are the upper and lower boundaries of the search space, respectively. t and refer to the iteration number and the maximum number of iterations, respectively. and represent random values withdrawn from the [0, 1] interval, and d represents a weight coefficient.
- Consumption process: in this stage, the consumer feeds on another consumer with a lower level of energy or on a producer. For the consumer classes, carnivores, herbivores, and omnivores, each one has its specific tactic for updating the location as illustrated below:
- (a)
- Herbivore consumers update their locations depending on the producers only (feed on the producers).where producer represents the producer location, and G represents a consumption factor, which is computed using levy flight as follows:where represents the normal distribution with zero mean and unit variance.
- (b)
- Carnivore consumers update their locations using a random consumer with high-level energy with an index , as carnivores feed on other animals only as mentioned earlier. The carnivore location can be formulated as follows:
- (c)
- Omnivore consumers update their locations depending on the producer and randomly selected consumer with index with a higher level of energy as modeled below:
- Decomposition process: this is the final process of the ecosystem as each individual in the agent dies, and the decomposer starts breaking down its remains. Zhao et al. [14] considered it to be the intensification phase of AEO and modeled it as follows:where the decomposition factor is represented by D, and weight parameters are represented by e and q.
4. The Proposed AEODE
The structure of the proposed method based on modified the AEO using DE is given in Figure 1. The developed AEODE uses the operators of DE to enhance the exploitation of AEO. It has the largest effect on AEO performance and provides it with suitable operators to avoid the attractiveness to a local point.
Figure 1.
The flowchart of the AEODE.
In general, the developed AEODE begins by using Equation (25) to generate the initial population X as shown in the following equation:
In Equation (25), the value of and represent the maximum and minimum gray value of I at dimension j, respectively, whereas is the dimension of each solution (here K refers to the threshold levels used to segment I). Therefore, the best solution is allocated, followed by updating the value of other solutions.
The process of updating solutions is implemented, using the operators of the traditional AEO algorithm during the exploration. However, in the case of the solutions that go through the exploitation phase, they will be updated using either the operators of AEO or DE, using the following equation:
In Equation (26), is the probability of each and it depends on the fitness value (, which is defined in Equation (3). The formulation of is given as follows:
where
The main objective of using is a variable that controls the process of using the operators of DE and AEO. To avoid the problem of making it a constant value since it is expected that the value of is increased with excess iterations, the operators of AEO are used only, especially at the end of iterations. Therefore, we update dynamically the value of according to the probability of each solution. This gives the developed AEODE high flexibility in switching between AEO and DE.
The next process in AEODE is to check the terminal criteria and return by the best solution when they are reached (i.e., here, the maximum number of iterations), followed by extracting the threshold values from as .
Complexity of AEODE
The complexity of the AEODE, in general, depends on the complexity of traditional AEO, quick sort (QS), and DE. Since the complexity of DE is given as
Therefore, the complexity of AEODE is given as follows:
In the best case of QS, the complexity of AEODE is given as follows:
In the worst case of QS, the complexity of AEODE is given as follows:
where is the number of solutions updated, using DE.
5. Evaluation Experiment
We compare the proposed AEODE method with relevant approaches to segment 10 standard test images, as shown in Figure 2. In addition, the histogram of each image is given in Figure 2 which indicates the characteristic of each image. Swarm parameters are adjusted to their original implementations [28]. The number of population is set to 20, while the dimension equals the threshold level. Moreover, the iteration number is set to 100, and all parameters are selected, depending on the recommendation by the authors of [29].
Figure 2.
Tested images with their histograms.
Several threshold values were adopted to test the proposed approach (i.e., 6, 8, 15, 17, 19, and 25). The performance of the AEODE was obtained by applying it on several images that are variant in shape, morphology, and contents. The experiments were implemented, using Matlab 2014b on a computer “Core i5 and 8 GB of RAM running on MS Windows 10”.
5.1. Performance Measures
We evaluate the performance of the AEODE using three performance measures, called the fitness function value, the structural similarity index (SSIM), and the peak signal-to-noise ratio (PSNR). SSIM and PSNR are computed by the following equations:
where () and () represent images’ mean intensity of and I, respectively. defines the covariance of I and . and are equal to 6.5025 and 58.52252, respectively [30].
where refers to the root mean-squared error.
5.2. Results and Discussion
The proposed AEODE method is tested besides other optimization algorithms, such as the basic artificial ecosystem-based optimization (AEO), marine predators algorithm (MPA), gray wolf optimization (GWO), spherical search optimization (SSO), cuckoo search (CS), and grasshopper optimization algorithm (GOA). The results can be divided mainly into three main categories, as follows.
5.2.1. Performance Measure by Structural Similarity Index (SSIM)
Figure 3 and Table 1 show the results of our AEODE method, compared to the most recent optimization algorithms based on SSIM measure.
Figure 3.
SSIM at different threshold levels.
Table 1.
SSIM results for all algorithms (bold means the best value).
Figure 3 shows that the AEODE performs better in both of the low thresholding levels (i.e., 5 and 6) and also in the higher thresholding levels (i.e., 19 and 25), while GOA shows the lowest performance among other optimization algorithms.
Table 1 shows the SSIM values performed by each optimization algorithm for each image with different threshold levels. From Table 1, we see that the AEODE method allocates the first rank (the highest SSIM values at 25 cases), followed by MPA and CS algorithms (eight highest SSIM values for each), which provide better results than others. Additionally, AEODE achieved good SSIM values in all threshold levels.
Figure 4 summarizes the average SSIM values with different threshold levels. From Figure 4, we notice that the AEODE outperforms other algorithms, such as AEO, MPA, CS, GWO, GOA, and SSO, by achieving the highest average of SSIM with different threshold levels, with a slight advantage over MPA and SSO.
Figure 4.
Average SSIM values for all algorithms’ overall images.
5.2.2. Performance Measure by Peak Signal-to-Noise Ratio (PSNR)
Table 2 and Figure 5 present the performance of the AEODE, compared to other recent optimization algorithms based on PSNR measured with different threshold values.
Table 2.
PSNR results for all algorithms (bold means the best value).
Figure 5.
PSNR at different threshold levels.
It can be noticed from Figure 3 that the proposed AEODE outperforms other optimization algorithms at most threshold levels (except at level 8). Table 2 shows the PSNR values performed by the proposed method and other optimization algorithms for each image with all threshold levels.
From Table 2, it is noticed that the proposed AEODE method allocates the first rank with the highest PSNR values at 23 cases, while SSO and CS are in second and third ranks with the highest 13 and 12 PSNR values, respectively. According to Table 2, the proposed AEODE method performs better with higher thresholding levels (at level 17 and higher) than lower levels.
Figure 6 summarizes the average PSNR values with all threshold levels. Figure 6 shows that our proposed method outperforms other optimization algorithms by achieving the highest average of PSNR with different threshold levels for all images. GOA achieves the worst performance, putting it last.
Figure 6.
PSNR values of AEODE and other optimization algorithms.
5.2.3. Performance Measure by Fitness Function
Figure 7 and Table 3 show the fitness function values of AEODE method and other optimization algorithms with different threshold levels.
Figure 7.
Fitness values of AEODE and other optimization algorithms.
Table 3.
Fitness function results for all algorithms (bold means the best value).
Based on Figure 7, the proposed AEODE method outperforms other optimization algorithms in all threshold levels, while GOA shows the lowest fitness values in all threshold levels.
Table 3 shows that all optimization algorithms achieve acceptable fitness values with all threshold levels. There is a slight advantage (in decimal levels) between each one. All optimization algorithms achieve higher fitness values along with higher thresholding levels. The higher the thresholding value, the better the fitness value obtained. Applying the 6, 8, 15, 17, 19, and 25 threshold levels achieves fitness values of 17, 20, 29, 32, 34, and 41, respectively. Figure 8 summarizes the average fitness values with all threshold levels. Based on Figure 8, AEODE, MPA, and AEO came in the first, second, and third ranks, respectively, while GOA is ranked last.
Figure 8.
Average fitness values of AEODE and other optimization algorithms.
Figure 9 and Figure 10 show the segmented image I10 and image I7, respectively, while their histograms at threshold value 19 are given in Figure 11 and Figure 12 respectively. Both figures show that the proposed method has successfully determined the best threshold value to segment several types of images. Moreover, Figure 13 illustrates the quality of segmented image I1 at level 19. It can be noticed from this figure that the quality of AEODE is decreased in this case since its obtained threshold values do not cover the whole search space (as shown in Figure 14) and its feasible region does not contain the optimal threshold values, which affects the performance of the final output.
Figure 9.
Segmentation results at threshold level 19 for the images I10.
Figure 10.
Segmented image I7 at threshold level 19.
Figure 11.
The threshold values at level 19 over the histogram of I10.
Figure 12.
The threshold values at level 19 over the histogram of image I7.
Figure 13.
Segmented image I1 at threshold level 19.
Figure 14.
The threshold values at level 19 over the histogram of image I1.
Moreover, the improvement rate between the proposed method and other methods according to each performance measure is computed as follows:
where and S denote the values obtained by AEODE and values obtained by other methods, respectively.
Table 4 shows the IR for the three measures (i.e., PSNR, SSIM, and fitness value). From this table, it can be noticed that AEODE provides a high IR rate in terms of PSNR, which is better than AEO, MPA, CS, GWO, GOA, and SSO with 47, 46, 44, 44, 55, and 46. In terms of SSIM as well, it provides results better than AEO, MPA, CS, GWO, GOA, and SSO with 49, 56, 37, 51, 53, and 39. However, the IR of the developed AEODE in terms of the fitness value is better than AEO and MPA with only 5 and 3 cases. However, with other methods, it still provides better fitness values of 41, 37, 37, and 42 for CS, GWO, GOA, and SSO.
Table 4.
Improvement ratio for developed method with other methods (bold means the best value).
5.3. Statistical Results
In this section, we apply the Friedman test to evaluate the robustness of the algorithms based on all measures. This test statistically ranks the methods, where the highest Friedman’s value is the best.
From Table 5, it can be seen that the AEODE achieved the highest mean rank compared to all methods in both SSIM and PSNR measures, followed by AEO, MPA, CS, and GWO, respectively, where the GOA ranked last in the PSNR measure. In the SSIM measure, the AEO, CS, and SSO ranked second, third, and fourth, respectively, followed by MPA and GWO. The GOA also came in last. However, the AEODE obtained the best values in the PSNR and SSIM measure, and it achieved the fourth rank after AEO, MPA, and GOA in the fitness function measure. This can be due to the fact that the fitness function did not measure the quality of the image like the other two measures. Therefore, we can conclude that the AEODE can effectively segment images better than the compared methods.
Table 5.
Results of the Friedman test for all measures (bold means the best value).
The proposed AEODE achieved higher performance in both measures, SSIM and PSNR, for most threshold levels, whereas it obtained good results in terms of fitness values. It outperformed the basic version of AEO, as it combines and reserves the best features for each of AEO and DE. It also shows advantages in SSIM, PSNR, and fitness values, compared to other optimization algorithms, such as MPA, CS, GWO, SSO, and GOA, which means high efficiency of exploring problem space. The proposed method achieves two main tasks; avoiding stacking at a local point (and consequently being trapped) and increasing the convergence ability. We believe that achieving acceptable performance with a small (compared to other algorithms) number of parameters, which imply a relatively simple implementation task, is considered a great advantage. The hybridization of swarm algorithms is aligned with other literature, as they showed advantages toward solving complex problems, such as determining an optimal threshold value for image segmentation.
6. Conclusions and Future Work
The segmentation process is the primary step in the image processing field, as it is employed in different computer vision applications. Multilevel thresholding techniques have confirmed their efficiency in solving image segmentation problems. This paper presents a new multilevel thresholding method based on a modified artificial ecosystem-based optimization (AEO) algorithm, using differential evolution (DE), called AEODE. The AEO is a recently proposed optimization algorithm inspired by the chain of energy transfer among living organisms, and it was successfully applied to address various optimization problems. However, it suffers from some limitations, such as stacking at the local optima. Therefore, in this paper, the DE was employed to overcome the drawbacks of the AEO. It was applied as a local search for the AEO to improve the ecosystem of the solutions. A set of images was applied to evaluate the performance of the AEODE using three measures, namely structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), and fitness function values. The AEODE was compared with seven well-known optimization algorithms, including the traditional AEO, gray wolf optimization (GWO), marine predators algorithm (MPA), spherical search optimization (SSO), grasshopper optimization algorithm (GOA), and cuckoo search (CS) algorithm. The evaluation outcomes confirmed the competitive performance of the proposed AEODE, which outperformed the traditional AEO and other compared algorithms on different tests. Furthermore, to evaluate the robustness of the AEODE method and the compared algorithms, we applied a well-known statistical test, called the Friedman test. The AEODE obtained the highest mean rank.
In future work, the proposed AEODE can be applied in different optimization applications, such as parameter estimation, feature selection, and data clustering. Moreover, other recent optimizers can be applied to find alternative solutions to the multilevel thresholding image segmentation problem, such as the arithmetic optimization algorithm (AOA).
Author Contributions
A.A.E.: Conceptualization, supervision, methodology, formal analysis, resources, data curation, and writing—original draft preparation. L.A.: Conceptualization, supervision, methodology, formal analysis, resources, data curation, and writing—original draft preparation. D.Y.: Writing—review and editing. A.T.S.: Writing—review and editing. M.A.A.A.-q.: Writing—review and editing. S.A.: Writing—review and editing, supervision, project administration, and funding acquisition. M.A.E.: supervision and writing—review and editing, methodology, formal analysis, resources, data curation. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by the Deanship of Scientific Research at Princess Nourah Bint Abdulrahman University through the Fast-track Research Funding Program.
Acknowledgments
This research was funded by the Deanship of Scientific Research at Princess Nourah bint Abdulrahman University through the Fast-track Research Funding Program.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Sathya, P.; Kayalvizhi, R. Modified bacterial foraging algorithm based multilevel thresholding for image segmentation. Eng. Appl. Artif. Intell. 2011, 24, 595–615. [Google Scholar] [CrossRef]
- Patra, D.K.; Si, T.; Mondal, S.; Mukherjee, P. Breast DCE-MRI segmentation for lesion detection by multi-level thresholding using student psychological based optimization. Biomed. Signal Process. Control 2021, 69, 102925. [Google Scholar] [CrossRef]
- Bhandari, A.K.; Singh, V.K.; Kumar, A.; Singh, G.K. Cuckoo search algorithm and wind driven optimization based study of satellite image segmentation for multilevel thresholding using Kapur’s entropy. Expert Syst. Appl. 2014, 41, 3538–3560. [Google Scholar] [CrossRef]
- Zhang, Z.; Yin, J. Bee Foraging Algorithm Based Multi-Level Thresholding For Image Segmentation. IEEE Access 2020, 8, 16269–16280. [Google Scholar] [CrossRef]
- Tan, K.S.; Isa, N.A.M. Color image segmentation using histogram thresholding–Fuzzy C-means hybrid approach. Pattern Recognit. 2011, 44, 1–15. [Google Scholar]
- Zhou, C.; Tian, L.; Zhao, H.; Zhao, K. A method of two-dimensional Otsu image threshold segmentation based on improved firefly algorithm. In Proceedings of the 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), Shenyang, China, 8–12 June 2015; pp. 1420–1424. [Google Scholar]
- Xing, Z. An improved emperor penguin optimization based multilevel thresholding for color image segmentation. Knowl.-Based Syst. 2020, 194, 105570. [Google Scholar] [CrossRef]
- Arora, S.; Acharya, J.; Verma, A.; Panigrahi, P.K. Multilevel thresholding for image segmentation through a fast statistical recursive algorithm. Pattern Recognit. Lett. 2008, 29, 119–125. [Google Scholar] [CrossRef] [Green Version]
- Otsu, N. A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 1979, 9, 62–66. [Google Scholar] [CrossRef] [Green Version]
- Kapur, J.N.; Sahoo, P.K.; Wong, A.K. A new method for gray-level picture thresholding using the entropy of the histogram. Comput. Vis. Graph. Image Process. 1985, 29, 273–285. [Google Scholar] [CrossRef]
- Maitra, M.; Chatterjee, A. A hybrid cooperative–comprehensive learning based PSO algorithm for image segmentation using multilevel thresholding. Expert Syst. Appl. 2008, 34, 1341–1350. [Google Scholar] [CrossRef]
- Abualigah, L.; Diabat, A.; Mirjalili, S.; Abd Elaziz, M.; Gandomi, A.H. The arithmetic optimization algorithm. Comput. Methods Appl. Mech. Eng. 2020, 376, 113609. [Google Scholar] [CrossRef]
- Garcia-Lamont, F.; Cervantes, J.; López, A.; Rodriguez, L. Segmentation of images by color features: A survey. Neurocomputing 2018, 292, 1–27. [Google Scholar] [CrossRef]
- Zhao, W.; Wang, L.; Zhang, Z. Artificial ecosystem-based optimization: A novel nature-inspired meta-heuristic algorithm. Neural Comput. Appl. 2020, 32, 9383–9425. [Google Scholar] [CrossRef]
- Storn, R.; Price, K. Differential evolution—A simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim. 1997, 11, 341–359. [Google Scholar] [CrossRef]
- Naji Alwerfali, H.S.; Al-qaness, M.A.; Abd Elaziz, M.; Ewees, A.A.; Oliva, D.; Lu, S. Multi-Level Image Thresholding Based on Modified Spherical Search Optimizer and Fuzzy Entropy. Entropy 2020, 22, 328. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Horng, M.H. Multilevel thresholding selection based on the artificial bee colony algorithm for image segmentation. Expert Syst. Appl. 2011, 38, 13785–13791. [Google Scholar] [CrossRef]
- Yousri, D.; Abd Elaziz, M.; Mirjalili, S. Fractional-order calculus-based flower pollination algorithm with local search for global optimization and image segmentation. Knowl.-Based Syst. 2020, 197, 105889. [Google Scholar] [CrossRef]
- Forouzanfar, M.; Forghani, N.; Teshnehlab, M. Parameter optimization of improved fuzzy c-means clustering algorithm for brain MR image segmentation. Eng. Appl. Artif. Intell. 2010, 23, 160–168. [Google Scholar] [CrossRef]
- Omran, M.G.; Salman, A.; Engelbrecht, A.P. Dynamic clustering using particle swarm optimization with application in image segmentation. Pattern Anal. Appl. 2006, 8, 332. [Google Scholar] [CrossRef]
- Elaziz, M.A.; Lu, S. Many-objectives multilevel thresholding image segmentation using knee evolutionary algorithm. Expert Syst. Appl. 2019, 125, 305–316. [Google Scholar] [CrossRef]
- Smith, A. Image segmentation scale parameter optimization and land cover classification using the Random Forest algorithm. J. Spat. Sci. 2010, 55, 69–79. [Google Scholar] [CrossRef]
- Shahrezaee, M. Image segmentation based on world cup optimization algorithm. Majlesi J. Electr. Eng. 2017, 11. Available online: http://mjee.iaumajlesi.ac.ir/index/index.php/ee/article/view/2213 (accessed on 14 September 2021).
- Elaziz, M.A.; Oliva, D.; Ewees, A.A.; Xiong, S. Multi-level thresholding-based grey scale image segmentation using multi-objective multi-verse optimizer. Expert Syst. Appl. 2019, 125, 112–129. [Google Scholar] [CrossRef]
- Chakraborty, R.; Verma, G.; Namasudra, S. IFODPSO-based multi-level image segmentation scheme aided with Masi entropy. J. Ambient. Intell. Humaniz. Comput. 2021, 12, 7793–7811. [Google Scholar] [CrossRef]
- Versaci, M.; Morabito, F.C. Image edge detection: A new approach based on fuzzy entropy and fuzzy divergence. Int. J. Fuzzy Syst. 2021, 1–19. [Google Scholar] [CrossRef]
- Bhandari, A.K. A novel beta differential evolution algorithm-based fast multilevel thresholding for color image segmentation. Neural Comput. Appl. 2020, 32, 4583–4613. [Google Scholar] [CrossRef]
- Xing, Z.; Jia, H. Modified thermal exchange optimization based multilevel thresholding for color image segmentation. Multimed. Tools Appl. 2020, 79, 1137–1168. [Google Scholar] [CrossRef]
- Sepas-Moghaddam, A.; Yazdani, D.; Shahabi, J. A novel hybrid image segmentation method. Prog. Artif. Intell. 2014, 3, 39–49. [Google Scholar] [CrossRef]
- Mahajan, S.; Mittal, N.; Pandit, A.K. Image segmentation using multilevel thresholding based on type II fuzzy entropy and marine predators algorithm. Multimed. Tools Appl. 2021, 80, 19335–19359. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).













