Next Article in Journal
Dynamics Analysis for the Random Homogeneous Biased Assimilation Model
Next Article in Special Issue
Integration of the Wang & Mendel Algorithm into the Application of Fuzzy Expert Systems to Intelligent Clinical Decision Support Systems
Previous Article in Journal
A K-SVD Based Compressive Sensing Method for Visual Chaotic Image Encryption
Previous Article in Special Issue
A Fuzzy-Based Fast Feature Selection Using Divide and Conquer Technique in Huge Dimension Dataset
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Fuzzy Rule Based Adaptive Block Compressive Sensing for WSN Application

1
School of Electronics Engineering, KIIT Deemed to be University, Bhubaneswar 751024, Odisha, India
2
School of Computer Science & Engineering, VIT-AP University, Amaravati 522237, Andhra Pradesh, India
*
Author to whom correspondence should be addressed.
Mathematics 2023, 11(7), 1660; https://doi.org/10.3390/math11071660
Submission received: 17 February 2023 / Revised: 25 March 2023 / Accepted: 26 March 2023 / Published: 30 March 2023

Abstract

:
Transmission of high volume of data in a restricted wireless sensor network (WSN) has come up as a challenge due to high-energy consumption and larger bandwidth requirement. To address the issues of high-energy consumption and efficient data transmission adaptive block compressive sensing (ABCS) is one of the optimum solution. ABCS framework is well capable to adapt the sampling rate depending on the block’s features information that offers higher sampling rate for less compressible blocks and lower sampling rate for more compressible blocks In this paper, we have proposed a novel fuzzy rule based adaptive compressive sensing approach by leveraging the saliency and the edge features of the image making the sampling rate selection completely automatic. Adaptivity of the block sampling ratio has been decided based on the fuzzy logic system (FLS) by considering two important features i.e., edge and saliency information. The proposed framework is experimented on standard dataset, Kodak data set, CCTV images and the Set5 data set images. It achieved an average PSNR of 34.26 and 33.2 and an average SSIM of 0.87 and 0.865 for standard images and CCTV images respectively. Again for high resolution Kodak data set and Set 5 dataset images, it achieved an average PSNR of 32.95 and 31.72 and SSIM of 0.832 and 0.8 respectively. The experiments and the result analysis show that proposed method is efficacious than the state of the art methods in both subjective and objective evaluation metrics.

1. Introduction

The wireless sensor network have been successfully applied to different fields, such as disaster management, medical investigation, military battlefield, surveillance and home automation [1,2,3]. However, the WSN lags in handling huge amount of image data due to the bandwidth and energy limitation as higher the complexity of the process greater the energy requirement [1,3]. To avoid the large data transmission efficient compression is very much essential which will be suitable for WSN application. Compressive sensing (CS) based compression is most widely used compression technique in the WSN [4,5,6,7]. In contrast to the scalar data such as temperature, soil moisture etc. image data put much more burden in the WSN transmission and also poses the challenges due to their restricted resources. Therefore, the compression of the raw image is highly required to save the energy and space. Different image compression algorithms, which are based on the transform based approach and follow the Nyquist sampling theorems (i.e., JPEG [8], JPEG2000 [9]), are not applicable for the restricted WSN application. JPEG [8] and JPEG2000 [9] are not preferable in the restricted WSN because of its coding complexity, power consumption and channel errors. The Compressive sensing (CS) [10] is a decade old technique, which doesn’t follow the Nyquist sampling theorem and is suitable for both data acquisition and compression. The CS provides sampling and compression as a related process rather than the two separate process. The study of CS revealed that the signal can still be recovered even from a lower number of samples. At the time of transmission data loss occur in WSN due to the multi path processing. However with CS the complete data can be recovered from the insufficient data with minimal loss [4,5,6]. This sampled data recovery system of CS and advantages of adaptive BCS have motivated us to design an automatic and adaptive block image compression algorithm based on CS for WSNs.
Since CS based approach deals with vectored representation of the image, it becomes difficult to handle the complete image at a time. The solution is to use block-based approach of compressive sensing through BCS [11] instead of processing the complete image in one go. Due to block-based processing, the size of the sampling matrix is also small that lead to lower computational complexity. Here the sampling matrix size is fixed for all the blocks. Since, the image blocks are varying according to their feature content, applying a fixed sampling ratio for all the blocks is not an optimum choice. Considering this, Adaptive Block Compressive Sensing (ABCS) [12] technique is developed where the blocks with higher feature content block should be compressed at lower rate than the blocks with lower feature content to maintain the clarity of the reconstructed image and to restore the data loss. In the ABCS method, the selection of the blocks was done by using a threshold value depending on the feature content of the block.

2. Related Work

This section describes the literature review related to different CS based approaches for image compression. Monika, et al. [12] proposed a review on ABCS method which gives the detailed description regarding the challenges and different adaptivity consideration for block selection. Zha, et al. [13] proposed Discrete Cosine Transform (DCT) based sparsity computation followed by sparsity dependent ABCS method. Here the sampling rate output will be any of the four predetermined levels. Therefore, it is not completely automatic image adaptive sampling ratio detection method. Monika, et al. [14] proposed coefficient permuted ABCS method suitable for under water WSN using fewer samples. Xu, et al. [15] proposed an adaptive perceptual BCS scheme which combines sparsity and perceptual sensibility to decide the sampling rate allocation of the blocks. Heng, et al. [16] proposed a fuzzy logic based ABCS method by considering the standard deviation and sparsity of the image block. The authors have also developed a fuzzy based recovery algorithm that maintains the quality of the reconstruction. This method is efficient in terms of quality of the reconstruction. However the authors are silent about the complexity analysis. Sum, et al. [17] proposed texture feature based approach for adaptivity of the blocks which may not be suitable for all varieties of images. Many saliency based the ABCS approaches [18,19,20] can be found in the literature, where the authors used saliency information for deciding adaptivity of the blocks. Different saliency detection approaches can be found in the literature [21,22,23] which are used for wild life monitoring.
In the literature authors have applied different features such as entropy [24], wavelet co-efficient [25], standard deviation [26] to find the adaptive sampling ratio of the blocks suitable for gray scale images. These methods were successful in maintaining the quality of the reconstructed image. Zhao, et al. [27] proposed gradient based ABCS method However it suffers from blocking artifacts in the reconstructed image. Zhao, et al. [28] proposed multi shaped block strategies based adaptive block sampling ratio for real time application on IoT. Due to the use of different block sizes, it increases the burden on the processor. Canh, et al. [29] proposed an edge preserving CS recovery technique by considering the nonlocal and the histogram information of the image in the form of gradient. The method doesn’t have much significant improvement over existing methods [12]. Li, et al. [30] proposed an adaptive block sampling rate detection method by considering the error between the blocks. However, reconstructed image has poor quality. Monika, et al. [31] proposed an energy adaptive block selection based ABCS method. As this method has less energy consumption, hence suitably applied for underwater based IoT images. Gambhir, et al. [32] proposed the edge and fuzzy transform based image compression using the standard deviation and the saliency information of the blocks. Wang, et al. [33] proposed an adaptive rate compressive sensing method by considering the statistical data analysis for the sparsity calculation. The performance of the method is better, but statistical data analysis increases the execution time and power [34]. Kazemi, et al. [35] proposed a multi focus based image fusion technique by using the adaptive sampling rate. The adaptivity of the block is decided by using textural information. Multi focus fusion approach of images increases the complexity of the method [36].
Most of the methods found in the literature have considered only single feature based approach for the adaptive sampling measurement and only few have considered dual feature based approach, some have experimented on gray images, some have the limitation of higher energy consumption and some have the limitation of higher delay and power requirements [34]. Moreover, most of the methods are non-automatic sampling allocation schemes except the fuzzy based approach.
Therefore, motivated by the state of the requirements and advantages of fuzzy based approach we have designed a fuzzy based ABCS model. Towards this goal we have proposed a novel fuzzy rule based approach for finding the adaptive sampling value selection by using Mamdani fuzzy rule approach. Because of which the sampling rate allocation is completely automatic. Since the proposed work considers two features, it can be better capture the image features for finding the adaptive sampling value.
The contribution of the paper are as follows:
  • A novel fuzzy rule based compressive sensing technique for WSN application.
  • An automatic threshold generation technique for adaptive sampling by considering two important features.
  • Probability based saliency map detection
  • Simple provision for handling oversampling cases.
The remainder of this paper are arranged as follows. Section 3 focusses on the proposed method in detail, Section 4 deals with the experiments and result analysis and finally Section 5 concludes the paper.

3. Proposed Method

In this section we have described about proposed fuzzy logic based adaptive sampling rate generation system by considering two important features i.e., edge and saliency information of the block). The proposed method is divided into 4 different stages. The different stages are as in Section 3.1. Block selection and Feature Extraction, Section 3.2. Adaptive sampling phase, Section 3.3. CS measurement phase, Section 3.4. Reconstruction phase. The architecture diagram of the proposed work flow is shown in the Figure 1. The detailed description of the individual stages are described in the following subsection.

3.1. Block Selection and Feature Extraction

Literature review revealed that the block-based processing for measuring matrix selection has the advantage of less execution time and lower memory requirement in contrast to the traditional CS. However, selection of block size is the key component in BCS approach. The size of the block not only decides the sampling rate and the measuring matrix but also improves the reconstructed image quality. Again, assigning the fixed measuring matrix or the sampling ratio to all the blocks without consideration of different feature content is not an optimal solution. Some image blocks may contain more crucial information while others may not. Therefore, to achieve an effective compression, adaptive sampling rate allocation is highly preferable.
With the aim of maintaining the quality of reconstruction, we have considered two main features i.e., edge and the saliency of the blocks. In this work, the adaptiveness of sampling ratio is decided based on the combination of the edge features and the salient feature data of the block. In this subsection, we primarily discuss about block size selection and suitable feature extraction. Neither a very small size nor a very large size of the block is suitable for optimum feature extraction. Here, the image is divided into 16 × 16 or 32 × 32, equal sized non overlapping blocks for feature extraction.

3.1.1. Saliency Detection

The image has been considered as a combination of the different saliency information. Here the saliency map detection is based on the high probability pixels of an image. In this method we have considered the histogram of the image, which gives idea about the probability of occurrence of the image pixels. From the probability information based on histogram data the high probability pixels are obtained as follows.
The threshold value t 1 detection in (1) is based on the highest probability value of an image pixel I(x, y), which gives an ideal bench mark for the high probability pixel occurrence criteria.
t 1 = max ( Probability of   a l l pixel ) 2
y 1 ( x 1 ) :   Set of high probability pixels denoted as y 1 ( x 1 )   P ( x , y ) t 1
P(x, y): denotes Probability of a pixel I(x, y) at location (x, y),
Contrast values of the high probability pixels, which are obtained by using the global contrast method are calculated by using (3)
D ( x 1 , x 1 N 1 ) = x , y = 1 i , j a b s ( y 1 ( x 1 ) I ( x , y ) )
where, I ( x , y ) is the image pixel value at location ( x , y ) , N 1 is the total number of pixels in y1.
The threshold value is obtained based on the sum of average of all contrast values depending upon the number of high probability pixel values in an image. The saliency can be detected based on the threshold as given in (4)
T s = i = 1 N 1 D ( x 1 i ) N 1
The saliency map ( S m a p ( x , y ) ) is obtained using (5)
S m a p ( x , y ) = 1 D ( x 1 ) > T s 0 o t h e r w i s e
By counting the number of 1′s the block wise saliency percentage ( P s ) is obtained as given in (6)
P s ( % ) = Total   count   of   1 B   ×   B × 100
where, B is size of image block.

3.1.2. Edge Detection

The edge map of the image is obtained by Canny Edge detection algorithm [37]. Canny edge detection algorithm proceeds through a number of stages to get wide range of edges in an optimal way. The first stage of the algorithm is primarily for smoothening of images, as it reduces the noise level by using the Gaussian filter. In the second stage, the intensity of gradient of the pixel values and the edge thinning technique has been applied to prevent from maximum suppression. Edge map is obtained by double thresholding and connectivity analysis. The edge map is divided into non-overlapping blocks of size B × B. In each block the percentage of 1′s denoted as P e is evaluated as given in (7)
P e ( % ) = Total   count   of   1 B   ×   B × 100
The proposed method developed an automatic sampling rate allocation by considering dual feature based fuzzy logic.
For the visual reference saliency map and the edge map of Lena image are shown in Figure 2. The evaluation of saliency feature ( P s ) and edge feature ( P s ) of the block was done from the saliency map and the edge map as shown in Figure 1. After evaluation of the ( P s ) and ( P e ) the adaptive sampling of the block was carried out by fuzzy rule based approach, using fuzzy inferencing system described in next subsection.

3.2. Adaptive Sampling Phase

In this phase, a feature based adaptive allocation of the sampling rate has been carried out. The adaptive sampling rate allocation was done using fuzzy logic system. This phase is having different decision sub-stages such as designing of fuzzy logic system, adaptive sampling rate allocation by using fuzzy rules, and over sampling correction.

3.2.1. Fuzzy Logic System

L. Zadeh has developed fuzzy logic system, which is a convenient technique in improving the decision making in resource constraint networks i.e., WSN due to its conservation of the resources and operative performance. FLS provide much intelligent solution in the regulator problems by imitating the human thought process. As shown below the FLS has four main components; those are fuzzifier, an inference engine, fuzzy rules, and a defuzzifier. In the fuzzification process, the fuzzifier converts the crisps data into fuzzy sets (linguistic terms are low, medium, high etc.) by considering a membership function. The membership function map the non-fuzzy input into the fuzzy linguistic terms and vice-versa. This process enables the knowledge of the linguistic terms. So many different memberships functions have been developed and deployed in the literature include triangular, trapezoidal, Gaussian, piecewise linear and singleton function. The choice of the membership function has done based on their experience and assessment of the researcher. The membership functions are useful in both the fuzzification and defuzzification process. Fuzzification is followed by fuzzy inferencing process via fuzzy if-then rule base with condition and conclusions. FLS gives the defuzzified membership function as output. Defuzzification process gives the crisp output.

3.2.2. Adaptive Sampling Rate Allocation by Using Fuzzy Rules

In this work a fuzzy rule-based approach has been applied for deciding adaptive sampling of the blocks in an automatic way. The primary motivation to design fuzzy rule based approach for deciding adaptive sampling value is to make the process fully automatic. In this regard, the authors took the advantage of the feature content of each block and the sampling ratio (SR) to decide the adaptive sampling value of the blocks via fuzzy rule-based approach. The feature content of the blocks are captured by the saliency percentage ( P s ) and the edge percentage ( P e ) of the blocks as described in Section 3.1.1 and Section 3.1.2 respectively. Our proposed FLS has three inputs and one output as illustrated in Figure 3. The fuzzy rules are created by carrying out number of experiments on different images. The fuzzy rules have been framed and put in a tabular form in Table 1. While designing the fuzzy rules, care has been taken to maintain the minimum reconstruction quality of the blocks by applying a fixed sampling value. Therefore, irrespective of the feature content of the blocks, a minimum amount of sampling ratio has been assigned to avoid the blocking artifacts. The details of the mamdani based Fuzzy rules are given in Table 1 using various linguistic variables for all inputs and outputs. The triangular and trapezoidal membership functions are studied for representation of the linguistic variables for input and output and the best one is selected. Various possible combination of rules have been exercised and 65 rules have generated and out of those rule 40 basic rules are shown in Table 1. The range of the values of the each and every graph is decided after carrying number of tests upon the image dataset. The proposed fuzzy rule-based approach is well capable to reduce the computation burden by using FLS design. The output value of the FLS is decided by considering the saliency, edge percentage and the sampling ratio.

3.2.3. Over Sampling Corrections

The output of the FLS is optimum. However, in some cases the adaptive sampling value exceeds the block size, where the block is processed as an uncompressed block. This condition is known as oversampling of the blocks. Oversampling can lead to lower performance of the compression algorithm therefore it must be avoided. To avoid this condition, the oversampling of the blocks is checked after generation of the output of the FLS. In case the block suffers from oversampling a corrective measure, need to be taken. To deal with the oversampling, first the oversampled value is obtained by subtracting the block size from the adaptive measured sampling data. Subsequently the oversampled values are distributed among all the non-over sampled blocks as per an algorithm discussed below.
Let B s : denotes the block size, Am denotes adaptively measured sampling value, N b : denotes total number of blocks, A s : denotes adaptive sampling, O s denotes over sampling value and n denotes as the number of non over sampling blocks. Using these notations the algorithm to handle the oversampling of the blocks is given as follows in Algorithm 1.
Algorithm 1: Over Sampling Corrections
F o r   i = 1 : N b         O s = 0 ; n = 0 ; I f A m i > = B s #     o v e r   s a m p l e d   b l o c k     T h e n   O s i = A m i B s ;         A s i = A m i O s i ; O s = O s ( i ) + O s ; n = n + 1 ; E l s e #   N o n   o v e r s a m p l e d   b l o c k       A s i = A m i + O s / n ; E n d   i f E n d   f o r

3.3. Compressive Sensing Measurement Phase

In the proposed approach, the adaptive sampling is followed by compressive sensing for the encoding and decoding of the image data. In this section a detailed description of the CS and BCS have been given. According to conventional CS theory an image can be reconstruct from few linear measurements if the signal is sparse enough. A signal is sparse in the transform domain if most of the elements are zero and nearly sparse if prominent feature portions are zero or nearly zero. The basic idea in the CS is that a signal can be recovered from very less decoded information. Suppose, x represents a signal of length L and K sparse in the transform domain, ψ represents the transform basis of x of size L × L . θ gives the transform domain representation of the x having only K coefficients. x is represented as x = θ ψ . The linear transform process of getting the value of y (size M < L) from x is known as the CS sampling. The linear equation illustrating CS sampling is given in (8).
y i = Φ x = Φ θ ψ
Here, Φ: represents random measuring matrix of size M × L . Then x can be recovered completely by considering M = O ( Klog L K ) measurements and by solving the convex optimization problem. To make the signal reconstruction easier x represented in the l1 norm form as in (11).
x = arg min min x : y = ϕ x x 1
The 2D image signal has converted into the 1D signal, followed by conversion into sparse signal by using transforms such as DCT [Discrete Cosine Transform] or DWT [Discrete wavelet Transform]. Further, the l1-minimization process for the 1-D signal reconstruction.

Block Compressive Sensing Method for Image Compression

The CS based approach for compressive sensing is very impressive in terms of performance. However, the major issue is pertaining to the reconstruction of the large sized image with lower computational complexity. Moreover, handling the entire image data, requires large size measuring matrix or sampling matrix which leads to undesirable increase in the complexity and larger storage requirement. To mitigate these issues BCS scheme has been proposed.
In BCS, image is divided into B × B non-overlapping blocks and each block is then considered as a 2D signal. A fixed sampling rate r is applied to the image block x i and the sampled value acquired denoted as y i are related as given in (10).
y i = Φ ( B ) x i = Φ ( B ) ψ ( B ) X i
Here the Φ ( B ) = n B × B 2 represents the measuring matrix of the image block, which is constructed by selecting n B = ( r × B 2 ) , rows from a matrix of size ( B 2 × B 2 ) and the transform matrix ψ ( B ) of size ( B 2 × B 2 ) . Both the transform matrix and the sparse vector will form x i = ψ ( B ) X i . The computation of sampling matrix for the image block is space and time saving process than the entire image sampling matrix calculation. The encoded signal is transmitted through the transmitter by having all the adaptive sampling information.

3.4. Reconstruction Phase [10]

In this phase the decoding of the compressed data is carried out. For the image reconstruction many different techniques can be found in the literature. However, l1-minimization based technique for the image reconstruction is preferable owing to its higher accuracy [4]. The BCS-SPL approach has attracted attention of many researchers due to incomplete data handling and lower reconstruction artifacts, which is suitable for real time application. In this work, we have built a fuzzy rule based adaptive sampling design approach for BCS-SPL algorithm.

4. Experimental Design and Result Analysis

To evaluate the proposed method we have experimented on four different types of dataset. In the first phase we have considered 6 different.tiff standard colour images i.e., Lena, Zelda, Couple, House, Baboon, Peppers image. In the second phase, we have considered Kodak dataset [38] comprising of 25 colour images. In the third phase, we have considered the low resolution real life CCTV images [39] collected from the National park surveillance system. To evaluate the performance of the proposed method for different resolution of the images here we have considered some high resolution images from the Set5 dataset [40]. All the images considered above are resized to a size of 256 × 256. To evaluate the performance of the method both subjective and objective evaluation has been performed. The subjective analysis has been done based on the perceptual view whereas, objective analysis has been done based on suitable performance parameters evaluation such as PSNR (Peak Signal to Noise Ratio) and Structural similarity Index matrix measurement (SSIM) [41]. All simulations are carried out considering non overlapping blocks of size 16 × 16. The objective evaluation of the proposed method has been given in Table 2, based on PSNR [13] and SSIM [41] comparison of different state of the art methods such as BCS-SPL [11], ENT-ABCS [6], STD_BCS-SPL [26] and EABCS [31] with proposed FABCS approach. Although different reconstruction approaches can be found in the literature [10,12,31], but l1-minimization based reconstruction approach has reduced blocking artifacts with superior reconstruction image quality [10]. Therefore, to do a fair comparison l1 minimization based reconstruction approach is applied for all the methods.
The subjective evaluation is made based on the visual quality of the reconstructed image. For all the considered methods the reconstructed images of standard dataset are shown in Figure 4. Figure 4a illustrates the original images of Lena, Zelda, Couple, Baboon and House. Figure 4b–f indicate the reconstructed images using BCS-SPL, STD-BCS-SPL, ENT-ABCS, EABCS and FABCS at a SR of 0.5. From Figure 4 it is found that the perceptual quality of the proposed FABCS method is the best among all the approaches considered for evaluation. Out of all the methods considered for evaluation, the BCS-SPL [9] method is based on a fixed compression rate for all the blocks of image. Which is having a restriction to enhance the reconstruction quality based on block feature content. The STD-BCS-SPL [26] framework considered the standard deviation as a threshold to extract the block wise information content. The higher the information content of the block, the lesser is the sampling ratio and the lower the information content of the block, higher is the sampling ratio. The STD-BCS-SPL method is applicable for restricted WSN application [26]. It has lower computational complexity with better-reconstruction quality of the image. However, Due to the manual calculation the sampling rate allocation is time consuming. In ENT-ABCS [6] method, the entropy of the block was selected to generate the threshold for deciding the adaptive sampling. It relied only on one feature for finding the block adaptivity. In the EABCS method [30] the energy of the block was considered for the adaptive sampling rate selection suitable for IoUT (under water based Internet on things) application. All the state of art methods discussed above have considered only single feature for deciding adaptive sampling. In the proposed approach the dual feature combination can capture even the finer details of the block. The bold faced value in each row of Table 2 indicates the highest value of the performance parameters of corresponding image. It is observed from Table 2 that the proposed method out performed all the other existing methods based on average PSNR and SSIM values for all the images considered for evaluation. Moreover, the fuzzy rule-based evaluation of the adaptive sampling is well capable to provide an automatic image adaptive sampling ratio generation to reduce the computation with better PSNR and SSIM values than the state-of-the-art methods as depicted in the Table 2.
Table 2. Performance comparison of different state of the art methods based on PSNR and SSIM parameters for different state of the art methods at 0.3, 0.4, and 0.5 SR.
Table 2. Performance comparison of different state of the art methods based on PSNR and SSIM parameters for different state of the art methods at 0.3, 0.4, and 0.5 SR.
ImagesBCS-SPL [11]ENT-ABCS [6]STD_BCS-SPL [26]EABCS [31]FABCS
PSNRSSIMPSNRSSIMPSNRSSIMPSNRSSIMPSNRSSIM
0.3Zelda300.75132.20.81132.30.838320.7533.410.8565
Couple310.74232.60.79732.80.80932.30.7732.880.8345
House300.73532.20.75632.50.764320.7432.70.8125
Baboon250.57428.90.56328.80.52228.90.5530.560.6788
Lena290.81231.90.778310.7531.30.7533.410.8342
Average28.90.72331.560.74131.490.736631.280.713232.7920.8031
0.4Zelda310.86132.90.84633.40.87132.80.833.890.8641
Couple320.85533.40.83333.70.8464330.8134.470.8568
House320.82232.90.78433.90.844132.60.7834.340.8588
Baboon290.62629.30.67330.30.698729.30.5731.030.7837
Lena310.84132.60.817330.8417320.7934.030.8723
Average30.80.80132.240.790732.80.8203831.940.749633.5520.8471
0.5Zelda310.88933.50.867340.88633.40.8234.990.9029
Couple330.883340.85634.40.869333.40.8335.520.9152
House320.8533.50.80734.50.871133.10.8135.110.8704
Baboon310.75630.50.717310.741229.60.6131.230.8032
Lena320.88133.20.84433.60.864232.70.8234.490.8881
Average320.85232.930.81833.50.84632.40.77834.270.876
The second experiment was done for the real-life low resolution original CCTV images [39]. The evaluation of the FABCS performance using CCTV images are presented in the Table 3 and compared with four state of the art methods. Figure 5 shows the reconstructed CCTV images by different methods. It is observed from Figure 5 that the dual features consideration of the proposed approach is well capable to maintain the reconstruction quality even for the low resolution CCTV images. Dual feature selection scheme ensures better feature extraction and hence the higher PSNR and SSIM values as compared to the state of the art methods. Table 3 represents the comparison of the state-of-the-art methods with proposed FABCS method by using the real life CCTV image from a National Park [36]. The bold faced value in each of Table 3 indicates the highest values of the performance parameters of corresponding image. The Table 3 shows that the proposed method has higher PSNR and SSIM values than the other methods. The SSIM and the PSNR values of the FABCS indicate that it has restored more features during reconstruction phase than other state of the art approaches. The subjective evaluation is made based on the visual quality of the reconstructed image and shown in Figure 4 and Figure 5 respectively.
The proposed FABCS method outperformed the other ABCS methods in terms of both subjective and objective evaluation metrics. In the proposed method the adaptive sampling allocation has been done by using the Fuzzy Logic System. Further experiments were carried out to study the effect of variation of SR values on the performance parameter PSNR and SSIM and placed in Figure 6. Figure 6a–e illustrate the statistical representation of average PSNR and SSIM values of the FABCS method with other state of the art methods at SR value of 0.3, 0.4 and 0.5 respectively for standard data set images (i.e., Lena, Zelda, Couple, Baboon and House).
Table 3. Performance comparison of the state of the art methods at 0.5 SR on CCTV images.
Table 3. Performance comparison of the state of the art methods at 0.5 SR on CCTV images.
ImagesBCS-SPL [11]ENT-ABCS [6]STD-ABCS [26]EABCS [31]FABCS
PSNRSSIMPSNRSSIMPSNRSSIMPSNRSSIMPSNRSSIM
Deer31.840.82320.8532.70.8631.990.8533.050.9
Leopard127.890.70829.630.7829.60.78930.650.81231.920.83
Leopard231.320.82132.380.8133.230.8430.240.82833.680.869
Leopard332.130.83831.710.8333.440.8531.230.80633.820.878
Leopard431.420.82732.440.8532.580.84232.10.8532.730.85
Leopard530.560.8132.560.8532.820.86529.840.79533.180.86
Average30.860.8320.8232.010.8431.010.8333.060.86
From the image wise analysis it is observed from Figure 6 that the baboon image has the lowest SSIM and PSNR values due to the less sharp features. Couple, House and Lena have SSIM and PSNR values close to each other. The Zelda has the highest SSIM and PSNR values among all the five images as the image has high information content. From the image wise performance analysis, it can be concluded that the proposed method outperformed the state of the art methods. Figure 6g,h illustrate the average PSNR and SSIM comparison of different state of the art methods with FABCS method at 0.3, 0.4 and 0.5 sampling rates for standard dataset images. Figure 6i,j illustrate the average PSNR and SSIM comparison of different state of the art methods with FABCS method at 0.3, 0.4 and 0.5 sampling rates for Kodak dataset.
To check the performance of the algorithm in the real time image some CCTV images have been taken into consideration. The performance comparison has illustrated in Figure 7. The Figure 7a–f illustrate the detail analysis of the proposed FABCS method over the state of the art methods for CCTV images for different sampling rates at 0.3, 0.4, and 0.5 respectively. The average PSNR and SSIM value are shown in Figure 7g,h which indicate that the proposed FABCS method has the highest PSNR and SSIM than all the state of the art methods by using real time images.
In order to study the performance of the proposed algorithm on high resolution images we have also experimented on Set5 dataset and the results are placed in Figure 8. It is apparent from Figure 8 that FABCS has also performed well for high resolution images in terms of higher PSNR and SSIM values than the state of the art methods.
Figure 9 shows the performance comparison of the fuzzy based adaptive sampling method with the non-fuzzy based adaptive sampling method. For the comparison purpose we have computed the sampling value of the proposed method with and without fuzzy based approach followed by BCS. The performance is evaluated for standard dataset images and the average value is considered. Average PSNR and SSIM value of the fuzzy based ABCS method is 2% higher than the non-fuzzy based ABCS method. The performance of the fuzzy method is higher due to better and a balanced distribution of the sampling rate allocation for the blocks.
We have tested our algorithm performance with the 4 different images data set and the statistical analysis of the PSNR and SSIM evaluation has been depicted in the Figure 6, Figure 7 and Figure 8. Table 4 shows the comparison of average execution time (ET) of different algorithms for standard images of block size (16 × 16).
It is evident from Table 4 that the proposed FABCS method has less ET than the BCS_SPL for a block size of 16 × 16 block size. The FABCS has ET lesser than BCS-SPL [11] and slightly more ET than the other state of art methods, due to consideration of dual features and 65 fuzzy rules for automation of the process.
Table 4. Comparison of the ET of different methods in second.
Table 4. Comparison of the ET of different methods in second.
MethodsBCS-SPL [11]ENT-ABCS [6]STD_BCS-SPL [26]EABCS [31]FABCS
ET (s)0.3760.2450.260.2520.32
Result analysis shows that the proposed FABCS is efficient in terms of better performance measure parameters. The main attraction is the consideration of dual feature selection to capture the content of the images and simple l1 minimization based image reconstruction approach. The fuzzy based block sampling ratio detection has made the algorithm automatic and more effective. Moreover, the proposed approach is followed by a corrective action which ensured that the algorithm should not over sample the block data.

5. Conclusions

The proposed FABCS method is an efficient approach to give a better alternative solution to deal with the practical problem of the data transmission in a wireless sensor network. The proposed method has reduced the computational burden by introducing the fuzzy based adaptive sampling ratio selection in an automatic way. Dual feature selection for threshold detection ensures minimal data loss. The proposed method performed equally well for all variety of test images including standard dataset image, low resolution CCTV image and high resolution Set5 dataset images. The proposed method achieved an average PSNR of 34.26 and average SSIM if 0.87 standard test images. Similarly, it has achieved an average PSNR of 33.2 and SSIM of 0.865 for CCTV images. However, the proposed method can still be improved by considering other features like colour, texture etc. and optimizing the fuzzy rules.

Author Contributions

Conceptualization, D.N. and T.K.; Methodology, D.N. and S.N.M.; Software, D.N. and T.K.; Validation, T.K.; Formal analysis, K.R. and T.K.; Investigation, S.N.M.; Resources, K.R.; Writing—original draft, D.N.; Writing—review & editing, D.N.; Supervision, K.R. and S.N.M.; Funding acquisition, S.N.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Acknowledgments

Article Processing Charge is supported by VIT-AP University Amaravati, Andhra Pradesh INDIA.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Majid, M.; Habib, S.; Javed, A.R.; Rizwan, M.; Srivastava, G.; Gadekallu, T.R.; Lin, J.C.-W. Applications of Wireless Sensor Networks and Internet of Things Frameworks in the Industry Revolution 4.0: A Systematic Literature Review. Sensors 2022, 22, 2087. [Google Scholar] [CrossRef]
  2. Tavli, B.; Bicakci, K.; Zilan, R.; Barcelo-Ordinas, J.M. A survey of visual sensor network platforms. Multimedia Tools Appl. 2011, 60, 689–726. [Google Scholar] [CrossRef]
  3. Charalampidis, P.; Fragkiadakis, A.G.; Tragos, E.Z. Rate-Adaptive Compressive Sensing for IoT Applications. In Proceedings of the 2015 IEEE 81st Vehicular Technology Conference (VTC Spring), Glasgow, UK, 11–14 May 2015; pp. 1–5. [Google Scholar] [CrossRef]
  4. Fayed, S.; Youssef, S.M.; El-Helw, A.; Patwary, M.; Moniri, M. Adaptive compressive sensing for target tracking within wireless visual sensor networks-based surveillance applications. Multimedia Tools Appl. 2015, 75, 6347–6371. [Google Scholar] [CrossRef]
  5. Li, R.; Duan, X.; Li, X.; He, W.; Li, Y. An Energy-Efficient Compressive Image Coding for Green Internet of Things (IoT). Sensors 2018, 18, 1231. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Rippel, O.; Bourdev, L. Real-time adaptive image compression. In Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia, 6–11 August 2017; Volume 70, pp. 2922–2930. [Google Scholar]
  7. Zammit, J.; Wassell, I.J. Adaptive Block Compressive Sensing: Toward a Real-Time and Low-Complexity Implementation. IEEE Access 2020, 8, 120999–121013. [Google Scholar] [CrossRef]
  8. Xiao, W.; Wan, N.; Hong, A.; Chen, X. A Fast JPEG Image Compression Algorithm Based on DCT. In Proceedings of the 2020 IEEE International Conference on Smart Cloud (SmartCloud), Washington, DC, USA, 6–8 November 2020; pp. 106–110. [Google Scholar] [CrossRef]
  9. Gungor, M.A.; Gencol, K. Developing a Compression Procedure based on the Wavelet Denoising and Jpeg2000 Compression. Optik 2020, 218, 164933. [Google Scholar] [CrossRef]
  10. Donoho, D.L. Compressed sensing. IEEE Trans. Inf. Theory 2006, 52, 1289–1306. [Google Scholar] [CrossRef]
  11. Gan, L. Block compressed sensing of natural images. In Proceedings of the 2007 15th International Conference on Digital Signal Processing, Cardiff, UK, 1–4 July 2007; pp. 403–406. [Google Scholar]
  12. Monika, R.; Samiappan, D.; Kumar, R. Adaptive block compressed sensing—A technological analysis and survey on challenges, innovation directions and applications. Multimedia Tools Appl. 2020, 80, 4751–4768. [Google Scholar] [CrossRef]
  13. Zha, Z.; Liu, X.; Zhang, X.; Chen, Y.; Tang, L.; Bai, Y.; Wang, Q.; Shang, Z. Compressed sensing image reconstruction via adaptive sparse nonlocal regularization. Vis. Comput. 2016, 34, 117–137. [Google Scholar] [CrossRef]
  14. Monika, R.; Dhanalakshmi, S.; Kumar, R.; Narayanamoorthi, R. Coefficient Permuted Adaptive Block Compressed Sensing for Camera Enabled Underwater Wireless Sensor Nodes. IEEE Sens. J. 2021, 22, 776–784. [Google Scholar] [CrossRef]
  15. Xu, J.; Qiao, Y.; Fu, Z. Adaptive Perceptual Block Compressive Sensing for Image Compression. IEICE Trans. Inf. Syst. 2016, 99, 1702–1706. [Google Scholar] [CrossRef] [Green Version]
  16. Heng, S.; Aimtongkham, P.; Vo, V.N.; Nguyen, T.G.; So-In, C. Fuzzy Adaptive-Sampling Block Compressed Sensing for Wireless Multimedia Sensor Networks. Sensors 2020, 20, 6217. [Google Scholar] [CrossRef]
  17. Sun, F.; Xiao, D.; He, W.; Li, R. Adaptive Image Compressive Sensing Using Texture Contrast. Int. J. Digit. Multimedia Broadcast. 2017, 2017, 3902543. [Google Scholar] [CrossRef] [Green Version]
  18. Gao, X.; Zhang, J.; Che, W.; Fan, X.; Zhao, D. Block-Based Compressive Sensing Coding of Natural Images by Local Structural Measurement Matrix. In Proceedings of the 2015 Data Compression Conference, Snowbird, UT, USA, 7–9 April 2015; pp. 133–142. [Google Scholar] [CrossRef]
  19. Yu, Y.; Wang, B.; Zhang, L. Saliency-Based Compressive Sampling for Image Signals. IEEE Signal Process. Lett. 2010, 17, 973–976. [Google Scholar] [CrossRef]
  20. Zhang, Z.; Bi, H.; Kong, X.; Li, N.; Lu, D. Adaptive compressed sensing of color images based on salient region detection. Multimedia Tools Appl. 2019, 79, 14777–14791. [Google Scholar] [CrossRef]
  21. Feng, W.; Zhang, J.; Hu, C.; Wang, Y.; Xiang, Q.; Yan, H. A novel saliency detection method for wild animal monitoring im-ages with WMSN. J. Sens. 2018, 2018, 3238140. [Google Scholar] [CrossRef] [Green Version]
  22. Liu, W.; Liu, H.; Wang, Y.; Zheng, X.; Zhang, J. A novel extraction method for wildlife monitoring images with wireless mul-timedia sensor networks (WMSNS). Appl. Sci. 2019, 9, 2276. [Google Scholar] [CrossRef] [Green Version]
  23. Liu, G.; Zheng, X. Fabric defect detection based on information entropy and frequency domain saliency. Vis. Comput. 2020, 37, 515–528. [Google Scholar] [CrossRef]
  24. Li, R.; Duan, X.; Guo, X.; He, W.; Lv, Y. Adaptive Compressive Sensing of Images Using Spatial Entropy. Comput. Intell. Neurosci. 2017, 2017, 9059204. [Google Scholar] [CrossRef] [Green Version]
  25. Xin, L.; Junguo, Z.; Chen, C.; Fantao, L. Adaptive sampling rate assignment for block compressed sensing of images using wavelet transform. Open Cybern. Syst. J. 2015, 9, 683–689. [Google Scholar] [CrossRef] [Green Version]
  26. Zhang, J.; Xiang, Q.; Yin, Y.; Chen, C.; Luo, X. Adaptive compressed sensing for wireless image sensor networks. Multimedia Tools Appl. 2016, 76, 4227–4242. [Google Scholar] [CrossRef]
  27. Zhao, H.H.; Rosin, P.L.; Lai, Y.-K.; Zheng, J.-H.; Wang, Y.-N. Adaptive gradient-based block compressive sensing with sparsity for noisy images. Multimedia Tools Appl. 2019, 79, 14825–14847. [Google Scholar] [CrossRef]
  28. Zhao, H.H.; Rosin, P.L.; Lai, Y.K.; Zheng, J.H.; Wang, Y.N. Adaptive block compressive sensing for noisy images. In International Symposium on Artificial Intelligence and Robotics; Springer: Berlin/Heidelberg, Germany, 2018; pp. 389–399. [Google Scholar]
  29. Canh, T.N.; Dinh, K.Q.; Jeon, B. Edge-preserving nonlocal weighting scheme for total variation based compressive sensing recovery. In Proceedings of the 2014 IEEE International Conference on Multimedia and Expo (ICME), Chengdu, China, 14–18 July 2014; pp. 1–5. [Google Scholar] [CrossRef]
  30. Li, R.; Duan, X.; Lv, Y. Adaptive compressive sensing of images using error between blocks. Int. J. Distrib. Sens. Netw. 2018, 14, 1550147718781751. [Google Scholar] [CrossRef]
  31. Monika, R.; Samiappan, D.; Kumar, R. Underwater image compression using energy based adaptive block compressive sensing for IoUT applications. Vis. Comput. 2020, 37, 1499–1515. [Google Scholar] [CrossRef]
  32. Gambhir, D.; Rajpal, N. Edge and Fuzzy Transform Based Image Compression Algorithm: EdgeFuzzy. In Artificial Intelligence and Computer Vision; Studies in Computational Intelligence; Lu, H., Li, Y., Eds.; Springer: Cham, Switzerland, 2017; Volume 672. [Google Scholar] [CrossRef]
  33. Wang, J.; Wang, W.; Chen, J. Adaptive Rate Block Compressive Sensing Based on Statistical Characteristics Estimation. IEEE Trans. Image Process. 2021, 31, 734–747. [Google Scholar] [CrossRef]
  34. Ferrigno, L.; Marano, S.; Paciello, V.; Pietrosanto, A. Balancing computational and transmission power consumption in Wireless Image Sensor Networks. In Proceedings of the 2005 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems, Messina, Italy, 18–20 July 2005; pp. 61–66. [Google Scholar]
  35. Kazemi, V.; Shahzadi, A.; Bizaki, H.K. Multifocus image fusion using adaptive block compressive sensing by combining spatial frequency. Multimedia Tools Appl. 2022, 81, 15153–15170. [Google Scholar] [CrossRef]
  36. Liu, Y.; Wang, L.; Cheng, J.; Li, C.; Chen, X. Multi-focus image fusion: A Survey of the state of the art. Inf. Fusion 2020, 64, 71–91. [Google Scholar] [CrossRef]
  37. Mathews, J.; Nair, M.S. Adaptive block truncation coding technique using edge-based quantization approach. Comput. Electr. Eng. 2015, 43, 169–179. [Google Scholar] [CrossRef]
  38. Kodak Lossless True Color Image Suite. Available online: http://www.r0k.us/graphics/Kodak (accessed on 11 October 2022).
  39. CCTV Image of Leopard and Deer Images from Sanjay Gandhi National Park—Bing Images—Search. Available online: https://www.bing.com/images/feed (accessed on 1 February 2023).
  40. Available online: https://github.com/ChaofWang/Awesome-Super-Resolution/blob/master/dataset.md (accessed on 10 December 2022).
  41. Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image Quality Assessment: From ErroVisibility to Structural Similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef] [Green Version]
Figure 1. The Proposed Model.
Figure 1. The Proposed Model.
Mathematics 11 01660 g001
Figure 2. Saliency and Edge Map Representation.
Figure 2. Saliency and Edge Map Representation.
Mathematics 11 01660 g002
Figure 3. Graphical representation of Input and Output membership function.
Figure 3. Graphical representation of Input and Output membership function.
Mathematics 11 01660 g003aMathematics 11 01660 g003b
Figure 4. Reconstructed Lena, Zelda, Couple, Baboon and House image by using different ABCS methods (a) original image, (b) BCS-SPL, (c) STD-BCS-SPL, (d) ENT-ABCS, (e) EABCS, (f) FABC at 0.5 sampling rate.
Figure 4. Reconstructed Lena, Zelda, Couple, Baboon and House image by using different ABCS methods (a) original image, (b) BCS-SPL, (c) STD-BCS-SPL, (d) ENT-ABCS, (e) EABCS, (f) FABC at 0.5 sampling rate.
Mathematics 11 01660 g004
Figure 5. Reconstructed Deer, Leopards images at SR of 0.5 for different methods. (a) Original image, (b) BCS-SPL, (c) STD-BCS-SPL, (d) ENT-ABCS, (e) EABCS, (f) FABCS.
Figure 5. Reconstructed Deer, Leopards images at SR of 0.5 for different methods. (a) Original image, (b) BCS-SPL, (c) STD-BCS-SPL, (d) ENT-ABCS, (e) EABCS, (f) FABCS.
Mathematics 11 01660 g005
Figure 6. (af) Performance comparison of different algorithms on Standard images and (g,h), (i,j) average PSNR and SSIM for standard images and Kodak dataset images.
Figure 6. (af) Performance comparison of different algorithms on Standard images and (g,h), (i,j) average PSNR and SSIM for standard images and Kodak dataset images.
Mathematics 11 01660 g006aMathematics 11 01660 g006b
Figure 7. Performance comparison of different algorithms on CCTV images based on PSNR and SSIM.
Figure 7. Performance comparison of different algorithms on CCTV images based on PSNR and SSIM.
Mathematics 11 01660 g007aMathematics 11 01660 g007b
Figure 8. Performance comparison of different algorithms on Set5 Test images based on (a) Average PSNR and (b) Average SSIM.
Figure 8. Performance comparison of different algorithms on Set5 Test images based on (a) Average PSNR and (b) Average SSIM.
Mathematics 11 01660 g008
Figure 9. Performance comparison of the Fuzzy and Non fuzzy based approach in terms of (a) PSNR and (b) SSIM.
Figure 9. Performance comparison of the Fuzzy and Non fuzzy based approach in terms of (a) PSNR and (b) SSIM.
Mathematics 11 01660 g009
Table 1. Illustration of the Fuzzy Rules.
Table 1. Illustration of the Fuzzy Rules.
Fuzzy Rules
Sampling RateSaliency Percentage
(Ps)
Edge Percentage
(Pe)
Adaptive Sampling Values
(Th)
HiVlVlLow
HiVlMedLow
HiVlLowLow
HiVlHiMed
HiLowLowMed
HiLowHiMed
HiLowMedMed
HiLowVlMed
HiHi-MedMedMed
HiHi-MedLowMed
HiHi-MedHiHi
HiHi-MedVlMed
HiLow-MedHiMed
HiLow-MedLowMed
HiMed-HiVlMed
HiMed-HiMedHi
HiMed-HiLowMed
MedVlVlVl
MedVlMedVl
MedVlLowVl
MedVlHiLow
MedLowLowLow
MedLowHiMed
MedLowMedLow
MedLowVlLow
MedHi-MedMedLow
MedHi-MedLowLow
MedHi-MedHiMed
MedHi-MedVlLow
MedLow-MedHiMed
MedLow-MedLowLow
LowHi-MedVlLow
LowLow-MedHiLow
LowLow-MedLowLow
LowMed-HiVlLow
LowMed-HiMedLow
LowMed-HiLowLow
LowMed-HiHiLow
LowLow-HiVlVl
LowLow-HiLowVl
LowLow-HiHiLow
Vl = Very low, Med = Medium, Hi = High, Med-Hi = Medium High, Low-Med = Low Medium, Hi-Med = High medium.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Nayak, D.; Ray, K.; Kar, T.; Mohanty, S.N. Fuzzy Rule Based Adaptive Block Compressive Sensing for WSN Application. Mathematics 2023, 11, 1660. https://doi.org/10.3390/math11071660

AMA Style

Nayak D, Ray K, Kar T, Mohanty SN. Fuzzy Rule Based Adaptive Block Compressive Sensing for WSN Application. Mathematics. 2023; 11(7):1660. https://doi.org/10.3390/math11071660

Chicago/Turabian Style

Nayak, Dibyalekha, Kananbala Ray, Tejaswini Kar, and Sachi Nandan Mohanty. 2023. "Fuzzy Rule Based Adaptive Block Compressive Sensing for WSN Application" Mathematics 11, no. 7: 1660. https://doi.org/10.3390/math11071660

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop