Next Article in Journal
Adiabatic Shortcuts Completion in Quantum Field Theory: Annihilation of Created Particles
Previous Article in Journal
Informational Resilience in the Human Cognitive Ecology
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Complex-Valued Gaussian Measurement Matrix for Image Compressed Sensing

School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China
*
Author to whom correspondence should be addressed.
Entropy 2023, 25(9), 1248; https://doi.org/10.3390/e25091248
Submission received: 11 July 2023 / Revised: 20 August 2023 / Accepted: 20 August 2023 / Published: 22 August 2023
(This article belongs to the Section Signal and Data Analysis)

Abstract

:
The measurement matrix used influences the performance of image reconstruction in compressed sensing. To enhance the performance of image reconstruction in compressed sensing, two different Gaussian random matrices were orthogonalized via Gram–Schmidt orthogonalization, respectively. Then, one was used as the real part and the other as the imaginary part to construct a complex-valued Gaussian matrix. Furthermore, we sparsified the proposed measurement matrix to reduce the storage space and computation. The experimental results show that the complex-valued Gaussian matrix after orthogonalization has better image reconstruction performance, and the peak signal-to-noise ratio and structural similarity under different compression ratios are better than the real-valued measurement matrix. Moreover, the sparse measurement matrix can effectively reduce the amount of calculation.

1. Introduction

Due to the continuous development of the digital age, massive images have become increasingly challenging to store and transmit. To effectively address the transmission of such image data, compressed sensing is widely employed in image transmission to reduce the bandwidth required for transmission [1,2,3]. By combining the process of sampling and compression, compressed sensing can acquire a signal at a lower sampling rate and accurately recover the original signal, thereby substantially reducing the overhead of data acquisition and storage. After long-term development, compressed sensing has found widespread application in numerous domains, including wireless communication [4], medical imaging [5], smart city construction [6], and video codec [7,8]. Compressed sensing theory primarily consists of three components: the sparse representation of the signal, the measurement matrix’s design, and the reconstruction algorithm’s design. How to choose the measurement matrix will directly affect the quality of image reconstruction. At present, the majority of research on measurement matrix design focuses on real-valued measurement matrices, such as Gaussian random matrix [9], Bernoulli matrix [10], and partial Hadamard matrix [11], while research using a complex-valued matrix as a measurement matrix is relatively few. To further enhance image reconstruction quality in compressed sensing, we used two different Gaussian random matrices to construct a complex-valued measurement matrix.

1.1. Related Work

In reference [12], the authors first generated a logistic chaotic sequence and then constructed a measurement matrix through the chaotic sequence. The feasibility of the measurement matrix was verified via theory and experimental analysis. In reference [13], the authors proposed a measurement matrix based on a Chebyshev chaotic sequence and proved the feasibility of the proposed measurement matrix. In reference [14], the author proposed using a Chebyshev–Vandermonde-like matrix as the measurement matrix, which also achieved good results. In reference [15], the authors used a Toeplitz matrix and a circulant matrix to construct the measurement matrix. This construction method reduced the difficulty of hardware implementation to a certain extent, but the reconstruction accuracy was generally not high. In reference [16], the authors used the semi-tensor product to construct a measurement matrix, which reduced the storage space required for the measurement matrix and reduced the reconstruction time via parallel reconstruction. In reference [17], a binarized Chebyshev chaotic map and an improved logistic chaotic map were used to construct a mixed chaotic sequence through the XOR operation, thereby improving the reconstructed image’s performance.
Most compressed sensing schemes usually use a real-valued matrix as the measurement matrix. However, in reference [18], the authors used a complex-valued Hadamard matrix instead of a real-valued measurement matrix and implemented the block method to reduce the complexity. The authors found that using the complex-valued measurement matrix resulted in better image reconstruction than the real-valued matrix. In reference [19], the authors proposed using a complex-valued Zadoff–Chu (ZC) matrix as the measurement matrix and employed a block measurement scheme to reduce complexity. The simulation results indicated that the Zadoff–Chu matrix yielded better reconstruction than the real-valued measurement matrix.

1.2. Contributions

To enhance the image reconstruction performance in compressed sensing, as inspired by references [18,19], a novel complex-valued measurement matrix was proposed in this work. This work used two Gaussian matrices, which were Schmidt orthogonalized respectively, to form a complex-valued measurement matrix and compared its reconstruction performance with that of the real-valued measurement matrix. It is found that the orthogonal complex-valued Gaussian matrix has better image reconstruction performance.
The main contributions of this work are as follows:
  • We constructed a complex-valued Gaussian matrix as the measurement matrix using two real-valued Gaussian matrices. The results illustrate that the reconstructed image quality is superior when using the complex-valued matrix compared to the real-valued measurement matrix.
  • To enhance the performance of compressed sensing reconstruction, we performed Gram–Schmidt orthogonalization on the two real-valued matrices that make up the complex-valued Gaussian matrix. Based on our experiments, this orthogonalized measurement matrix can significantly enhance the reconstructed image quality.
  • We applied a sparsification operation to the proposed complex-valued measurement matrix to save storage space and reduce the calculation amount during image compression. Our analysis indicates that this sparsification operation effectively reduces the calculation amount required and computational complexity.

2. Concepts and Theoretical Basis

2.1. Compressed Sensing

In the theoretical model of compressed sensing, if x is a non-sparse signal, the signal x must first be sparsely represented to obtain sparse coefficients. Then, the sparse coefficients are compressed and reconstructed. The process of compression is to project the signal x into a low-dimensional space containing the measurement matrix ϕ of size M × N ( M < N ) and obtain the measurement y of length M . This process can be expressed using Equation (1):
y = ϕ ψ x = ϕ s
In the above equation, s is a sparse vector that is K -sparse on the transform domain ψ . There are only K ( K N ) non-zero numbers, and s 0 = K . ψ is also called a sparse basis of size N × N .
When the compressed signal is reconstructed, Equation (1) is an underdetermined system with infinite solutions since the length of the measured value y is smaller than the length of the original signal. If one wants to reconstruct the sparse coefficients s from the measurements y , then the sensing matrix θ = ϕ ψ needs to satisfy the RIP property, which is expressed as follows:
( 1 δ k ) s 2 2 θ s 2 2 ( 1 + δ k ) s 2 2
where 0 < δ k < 1 , k represents the number of non-zero elements of the sparse coefficient s . Only when the above properties are satisfied that the reconstruction algorithm can reconstruct the original signal with high probability. The mathematical model of the reconstructed signal is as follows:
s ^   = arg min s 0 s . t .   y = θ s
Equation (3) is an l 0 optimization problem. However, the l 0 optimization problem is an NP-complete problem. To solve it, it can be transformed into an easy-to-solve l 1 optimization problem, or to solve the problem by approaching l 0 . After calculating s ^ according to the above equation, we can obtain the reconstructed image signal x ^ by computing x ^ = ψ 1 s ^ . At present, some commonly used reconstruction algorithms include the OMP algorithm [20], SAMP algorithm [21], SL0 algorithm [22], and ISTA algorithm [23]. For reconstruction, we utilized the SL0 algorithm in this work, which reconstructs the image by approximating the l 0 norm.

2.2. Gaussian Random Matrix

Gaussian random matrix is a widely employed measurement matrix in compressed sensing. The design method of this matrix is to construct a matrix of size M × N so that each element of this matrix independently follows a Gaussian distribution with a mean of zero and variance 1 / M as follows:
ϕ N ( 0 , 1 M )
Gaussian random measurement matrix is highly random. It can satisfy the RIP condition with a high probability when the number of measurements M satisfies the inequality M c K log ( N / K ) , where c is a small positive constant and K is the signal sparsity [24]. Therefore, it is highly probable that the compressed image can be reconstructed using a Gaussian random measurement matrix.

2.3. Gram–Schmidt Orthogonalization

Gram–Schmidt orthogonalization is a classical basis orthogonalization method [25]. Its basic idea is to use the projection principle to construct a new orthogonal basis based on the existing orthogonal basis. Let V n be an n -dimensional Euclidean space, α and β be the vectors in V n , while ( α , β ) denotes as the inner product of α and β , the projection of α onto β is p r o j β α = ( α , β ) β , β β , and the subspace spanned by the vector group α 1 , α 2 , , α m is span α 1 , α 2 , , α m . Let α V n , V m be an m-dimensional subspace of V n with orthonormal bases α 1 , α 2 , , α m , and α not in V m . Based on the projection principle, the difference between α and its projection onto the V m subspace is as follows:
β = α i = 1 m proj α α i = α i = 1 m ( α , α i ) α i
Moreover, β is orthogonal to the subspace V m , that is, orthogonal to the orthogonal basis α 1 , α 2 , , α m . In this case, β can be obtained via unitization as follows:
α m + 1 = β β = β ( β , β )
Then, α 1 , α 2 , , α m , α m + 1 is the orthonormal basis of the subspace span α 1 , α 2 , , α m that is extended by V m on α .
According to the above analysis, for span α 1 , α 2 , , α m , by starting from the one-dimensional subspace spanned by one of the vectors and repeating the above process of expanding the construction of an orthogonal basis, a set of orthogonal bases for V m can be obtained, which is the idea of Schmidt’s orthogonalization. Schmidt orthogonalization proceeds as follows for m linearly dependent vectors α 1 , α 2 , , α m of n -dimensional Euclidean space:
(1)
Orthogonalization
β 1 = α 1
β 2 = α 2 ( α 2 , β 1 ) β 1 , β 1 β 1
β 3 = α 3 ( α 3 , β 1 ) β 1 , β 1 β 1 ( α 3 , β 2 ) β 2 , β 2 β 2
β m = α m ( α m , β 1 ) β 1 , β 1 β 1 ( α m , β 2 ) β 2 , β 2 β 2 ( α m , β m 1 ) β m 1 , β m 1 β m 1
(2)
Unitization
η 1 = β 1 β 1 , η 2 = β 2 β 2 , , η m = β m β m
The above steps can provide a set of orthogonal bases β 1 , β 2 , , β m and orthonormal bases η 1 , η 2 , , η m on span α 1 , α 2 , , α m .

3. Compressed Sensing Scheme

3.1. Design of Measurement Matrix

To construct an orthogonal complex-valued Gaussian measurement matrix, we started by generating two Gaussian matrices with a mean of zero and a variance of one. We then applied the Gram–Schmidt orthogonalization to each matrix to orthogonalize them. One matrix was used as the real part, and the other was used as the imaginary part. Here, the real part of the measurement matrix was generated as an example, and the imaginary part was generated in the same way. The pseudocode is described below, where Mtx represents the Gaussian matrix, Mtx_orth represents the matrix after Gram–Schmidt orthogonalization, n represents the number of columns of Mtx, and (:, i) represents the ith column of the matrix. The primary step is to iterate over the first i 1 columns, compute the projection of the current column with each of the previous columns, and subtract the projection from the current column to eliminate the correlation and make them orthogonal (Algorithm 1).
Algorithm 1: Generate the real part of complex-valued measurement matrix
Input: The size of measurement matrix
Output: The real part of the complex-valued measurement matrix
  1  Begin
  2    Initialize a Gaussian random matrix Mtx
  3    Initialize an all-zero matrix Mtx_orth
  4    Mtx_orth(:, 1) = Mtx(:, 1)
  5    for i = 2 to n do
  6      for j = 1 to i − 1 do
  7        Mtx_orth(:, i) = Mtx_orth(:, i) − dot(Mtx(:, i), Mtx_orth(:, j))/
           dot(Mtx_orth(:, j), Mtx_orth(:, j)) * Mtx_orth(:, j)
  8      end
  9      Mtx_orth(:, i) = Mtx_orth(:, i) + Mtx(:, i);
  10     end
  11  end
The above method can construct the complex-valued measurement matrix by adding two orthogonal Gaussian matrices. In reference [26], the authors used Gram–Schmidt orthogonalization to optimize real-valued Gaussian random matrices. In the process of Gram–Schmidt orthogonalization, each time the β i vector is calculated, the projection of the first i 1 vectors on β i is subtracted from the current vector α j . That is, the information of other column vectors is subtracted. After this operation, the independence of the column vector β i is gradually enhanced. For the measurement matrix, this method can maximize the incoherence of the column vectors to improve the performance of compressed sensing reconstruction.
Compressed sensing can be regarded as extracting features from images for compression purposes. This work constructed a complex-valued measurement matrix using two orthogonal Gaussian matrices to achieve this. Using this measurement matrix for image compression is equivalent to extracting double the number of image features of a real-valued measurement matrix. This approach provides more comprehensive image information, resulting in better reconstruction performance.

3.2. Compressed Sensing with Complex-Valued Measurement Matrix

Below is an overview of our proposed image-compressed-sensing scheme, which uses a complex-valued measurement matrix. The diagram below shows the framework of the scheme (Figure 1):
  • Step 1: Image sparsification. Use Discrete Cosine Transform (DCT) to make the image sparse.
  • Step 2: Construct the measurement matrix. Two Gaussian matrices are orthogonalized via Gram–Schmidt orthogonalization, respectively. Then, one is used as the real part of the measurement matrix, and the other is used as the imaginary part.
  • Step 3: Image compression. Apply the measurement matrix to compress the image.
  • Step 4: Image reconstruction. Use the SL0 algorithm to reconstruct the sparse signal of the original image in the DCT domain.
  • Step 5: Inverse sparsification. Use inverse sparsification operation to obtain the original image from the sparse signal in the DCT domain.

4. Experimental Analysis

This work implemented all simulation experiments via Matlab2021a, using a computer with Intel Core i5-6300HQ CPU at 2.30 GHz, 12 GB memory, and Windows 10 operating system. We chose images of various sizes for the experiment and used DCT as the sparse basis. The reconstruction algorithm we utilized was the SL0 [22] algorithm; the source code can be obtained from the author’s home page (http://ee.sharif.ir/~SLzero/ (accessed on 10 July 2023), and the sigma_min was set to 0.01. In the following section, M and N denote the original image’s size, and if the compression ratio (CR) is mentioned in the description, M is the size of the compressed image, that is, M = C R × M . To compare the performance of the reconstructed images, in this work, the Gaussian matrix [9], Bernoulli matrix [10], partial real-valued Hadamard matrix [11], mixed chaotic–Bernoulli (MB) matrix [17], sequency-ordered complex Hadamard transform (SCHT) matrix [27], Zadoff–Chu matrix [19], and orthogonal complex-valued Gaussian matrix were used as measurement matrices for comparison. The images used in the experiments are shown in Figure 2.

4.1. Peak Signal-to-Noise Ratio Analysis

The peak signal-to-noise ratio [28] (PSNR) is a commonly utilized standard for evaluating the quality of image reconstruction. Essentially, a higher PSNR value means that the difference between the original and reconstructed images is smaller, which translates to greater accuracy in reconstruction. The formula for calculating the PSNR for image reconstruction evaluation is as follows:
P S N R = 10 lg 255 × 255 ( 1 M × N ) i = 1 M j = 1 N ( X ( i , j ) Y ( i , j ) ) 2
where X ( i , j ) is the value of the pixel at the corresponding position of the original image, and Y ( i , j ) is the value of the pixel at the corresponding position of the reconstructed image.
We compared our proposed measurement matrix to other commonly used ones to analyze its performance. Specifically, we evaluated the effectiveness of our complex-valued measurement matrix by comparing it to several other matrices, including the Gaussian random measurement matrix, Bernoulli matrix, partial real-valued Hadamard matrix, MB matrix, SCHT matrix, and ZC matrix when the compression ratio was 0.2 and 0.5. To ensure accuracy, we conducted ten experiments and averaged the results, which are presented in Table 1 and Table 2. The tables show the reconstruction performance of the “Lena”, “Peppers”, “Woman”, and “Boats” images. From the results in Table 1, we observed that the complex-valued Gaussian matrix performed similarly to the other two complex-valued measurement matrices and outperformed the real-valued measurement matrices. Compared to the real-valued matrices, the average PSNR of the complex-valued Gaussian matrix improved by 2~3 dB. It even obtained a 4.35 dB boost on the “Woman” image. After Gram–Schmidt orthogonalization, the performance of the reconstructed image was greatly improved again.
To verify that our proposed measurement matrix has better reconstruction results than other matrices at varying compression ratios and image sizes, we tested it on images of “Peppers” and “Woman” with sizes of 256 × 256 and 512 × 512 . The results are presented in Figure 3, Figure 4, Figure 5 and Figure 6.
Figure 3, Figure 4, Figure 5 and Figure 6 clearly show that all measurement matrices’ reconstruction quality steadily improves. For instance, Figure 6 illustrates that the reconstruction performance of various measurement matrices becomes better with an increase in compression ratio. The Gaussian matrix, Bernoulli matrix, and partial real-valued Hadamard matrices have very similar reconstruction performance, and the mixed chaotic–Bernoulli matrix has the best performance among these real-valued measurement matrices. The SCHT matrix and ZC matrix improve the reconstruction performance by approximately 3 dB compared to the previous four real-valued matrices. The complex-valued Gaussian matrix performs similarly to the SCHT matrix and ZC matrix. After Gram–Schmidt orthogonalization, the complex-valued Gaussian matrix has an improved reconstruction performance of about 5.7 dB on average compared to other complex-valued measurement matrices. Figure 3, Figure 4, Figure 5 and Figure 6 also show that the orthogonal Gaussian matrix has the best reconstruction performance, whether under the 256 × 256 size images or 512 × 512 size images.

4.2. Structural Similarity Analysis

In addition to PSNR, structural similarity [29] (SSIM) can also be used to evaluate the performance of a reconstructed image using the two measurement matrices. The value of SSIM ranges from 0 to 1, and the larger the value of SSIM, the better the quality of the reconstructed image. The calculation formula is as follows:
SSIM ( a , b ) = ( 2 μ a μ b + c 1 ) ( 2 σ a b + c 2 ) ( μ a 2 + μ b 2 + c 1 ) ( σ a 2 + σ b 2 + c 2 )
Here, μ a and μ b represent the mean values of X and Y ; σ a 2 and σ b 2 represent the variances of a and b ; σ a b is the covariance of a and b ; c 1 = ( k 1   L ) 2 and c 2 = ( k 2   L ) 2 are the constants used to maintain stability; L is the dynamic range of pixel values, and k 1 and k 2 are small constants.
In Figure 7 and Figure 8, we can see the reconstructed images of “Lena” and “Livingroom” of 256 × 256 in size at a compression ratio of 0.5 using different measurement matrices. These measurement matrices can reconstruct the image well, but the reconstructed image using the measurement matrices shown in (a) to (d) appears fuzzy in the detailed part. In contrast, it is hard for the human eye to distinguish the details in the reconstructed image using the measurement matrices shown in (e) to (h). Therefore, we can assess the effectiveness of the measurement matrices by computing the SSIM value.
Table 3 displays the SSIM values calculated using Equation (13). For instance, when analyzing the “Lena” image, the first four measurement matrices yield SSIM values between 0.6 and 0.7. However, using the complex-valued Hadamard matrix, the SSIM value increases to 0.8378, and the ZC matrix further improves the value. Compared to the ZC matrix, the SSIM value of the orthogonal complex-valued Gaussian matrix proposed in this work is further improved, reaching 0.9731. The reconstruction performance of our measurement matrix is also optimal for several other images.

4.3. Comparison of Different Algorithms

In this work, the Lena image with the size of 256 × 256 was used to verify the performance of the proposed orthogonal complex-valued Gaussian matrix under different reconstruction algorithms, such as SL0, OMP, SAMP, and ISTA. In addition, the recovery scheme based on the Haar wavelet transform with Noiselet transform, as in reference [8], was also considered, as shown in Figure 9. It can be seen that different reconstruction algorithms have almost identical performance when the compression ratio is lower than 0.6. For a higher compression ratio, the reconstruction performance of OMP becomes worse, while the other reconstruction algorithms still maintain good performance.

4.4. Sparsity Analysis of the Measurement Matrix

Since the use of a complex-valued measurement matrix would increase the computational complexity, for the sake of reducing the computational complexity in the measurement process and saving the storage space required for the measurement matrix storage, we performed a sparsification operation [30] on the measurement matrix. Firstly, we started by selecting a matrix of the same size as the measurement matrix and set all values to 1. For each column of the measurement matrix, d ( d < < M ) values were randomly reserved, and the values of the remaining positions were set to zero to obtain a sparse matrix. Then, the sparse measurement matrix was obtained by multiplying the measurement matrix with the corresponding position of the sparse matrix. This work explored the reconstruction performance of the “Lena” and “Cameraman” images of size 256 × 256 and 512 × 512 when the values of d are 3, 4, 8, 12, and 16, respectively.
Figure 10, Figure 11, Figure 12 and Figure 13 show that the largest performance loss occurs when d is set to 3. The reconstruction performance improves as the value of d increases to 4, 8, 12, and 16, with very minimal difference in the PSNR value. Compared to not using sparsification, the performance loss is less than 1 dB. Assuming the measurement matrix size is M × N ( M = C R × M ) and the image size is N × N , compressing the image requires 2 × N × M × N multiplications and 2 ( N 1 ) × M × N + M N additions if the measurement matrix is without sparsification. Using the sparsified measurement matrix, when the sparsity is d ( d < < M ) , only 2 × N × d × N multiplications and 2 × ( N 1 ) × d × N + M N additions are needed when performing image compression, so a large part of the computational complexity is reduced. The loss of less than 1 dB in performance is acceptable relative to the reduced computational complexity.
Table 4 shows the addition and multiplication complexity of several different matrices during the measurement process. In references [7,8], the Haar wavelet transform and the Noiselet transform were used to realize compression. For these two cases, the Haar wavelet transform only needs to multiply 1 2 , which can be realized via a simple shift operation, and the Noiselet transform only needs addition operations. When using a partial Hadamard matrix for compression [11], no multiplication operation is needed because the partial Hadamard matrix is composed of 1 and −1, and the multiplication operation for −1 can be realized via a simple shift operation. For general real-valued measurement matrices, the matrix operations during compression require ( N 1 ) M N addition operations and M N 2 multiplications, while the complex-valued measurement matrix requires twice the number of calculations. However, the computational complexity of the complex-valued measurement matrix after sparsification can be significantly reduced, and the performance loss after sparsification is entirely acceptable.

5. Conclusions

We proposed an orthogonal complex-valued Gaussian measurement matrix constructed by using two Gaussian matrices after Gram–Schmidt orthogonalization as the real and the imaginary parts, respectively. The simulation results demonstrate that using the complex-valued measurement matrix significantly enhances the reconstruction quality of images compared to using the real-valued measurement matrix. We then sparsified the measurement matrix and analyzed its calculation and reconstruction performance. The results show that the sparsified measurement matrix can effectively reduce the calculation amount with only a small loss in reconstruction performance. In addition, we compared the performance of our proposed orthogonal complex-valued Gaussian measurement matrix, real-valued measurement matrix, and other complex-valued measurement matrices on reconstructed images using different compression ratios and image sizes. The results show that the proposed complex-valued measurement matrix has better reconstruction effects. This work has implications for using complex-valued matrices as measurement matrices in compressed sensing.

Author Contributions

Conceptualization, Z.W. and L.X.; Methodology, Y.W. and Y.Y.; Software, Y.W.; Validation, L.X. and Z.W.; Formal analysis, Z.W.; Investigation, L.X. and Y.W.; Data curation, Y.W. and Y.Y.; Writing—original draft preparation, Y.W.; Writing—review and editing, Z.W. and L.X. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Natural Science Foundation of Zhejiang University of Science and Technology under grant no. 2023QN110, by the Zhejiang Provincial Key Natural Science Foundation of China under grant no. LZ21F010001, by the State Key Laboratory of Millimeter Waves, Southeast University, China, under grant no. K202212, and by the National Natural Science Foundation of China under grant no. 61405178.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

The data presented in this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Donoho, D.L. Compressed sensing. IEEE Trans. Inform. Theory 2006, 52, 1289–1306. [Google Scholar] [CrossRef]
  2. Al-Hayani, B.; Ilhan, H. Efficient cooperative image transmission in one-way multi-hop sensor network. Int. J. Electr. Eng. Educ. 2020, 57, 321–339. [Google Scholar] [CrossRef]
  3. Li, L.; Fang, Y.; Liu, L.; Peng, H.; Kurths, J.; Yang, Y. Overview of Compressed Sensing: Sensing Model, Reconstruction Algorithm, and Its Applications. Appl. Sci. 2020, 10, 5909. [Google Scholar] [CrossRef]
  4. Qie, Y.; Hao, C.; Song, P. Wireless Transmission Method for Large Data Based on Hierarchical Compressed Sensing and Sparse Decomposition. Sensors 2020, 20, 7146. [Google Scholar] [CrossRef] [PubMed]
  5. Chakraborty, P.; Tharini, C. An Efficient Parallel Block Compressive Sensing Scheme for Medical Signals and Image Compression. Wirel. Pers. Commun 2022, 123, 2959–2970. [Google Scholar] [CrossRef]
  6. Wang, H.; Wu, Y.; Xie, H. Secure and Efficient Image Transmission Scheme for Smart Cities Using Sparse Signal Transformation and Parallel Compressive Sensing. Math. Probl. Eng. 2021, 2021, 5598009. [Google Scholar] [CrossRef]
  7. Belyaev, E. An Efficient Compressive Sensed Video Codec with Inter-Frame Decoding and Low-Complexity Intra-Frame Encoding. Sensors 2023, 23, 1368. [Google Scholar] [CrossRef]
  8. Belyaev, E.; Codreanu, M.; Juntti, M.; Egiazarian, K. Compressive sensed video recovery via iterative thresholding with random transforms. IET Image Process. 2020, 14, 1187–1199. [Google Scholar] [CrossRef]
  9. Tsaig, Y.; Donoho, D.L. Extensions of compressed sensing. Signal Process. 2006, 86, 549–571. [Google Scholar] [CrossRef]
  10. Zhang, G.; Jiao, S.; Xu, X.; Wang, L. Compressed sensing and reconstruction with bernoulli matrices. In Proceedings of the 2010 IEEE International Conference on Information and Automation, Harbin, China, 20–23 June 2010. [Google Scholar]
  11. Zhou, N.; Zhang, A.; Wu, J.; Pei, D.; Yang, Y. Novel hybrid image compression–encryption algorithm based on compressive sensing. Optik 2014, 125, 5075–5080. [Google Scholar] [CrossRef]
  12. Yu, L.; Barbot, J.P.; Zheng, G.; Sun, H. Compressive Sensing with Chaotic Sequence. IEEE Signal Process. Lett. 2010, 17, 731–734. [Google Scholar] [CrossRef]
  13. Gan, H.; Li, Z.; Li, J.; Wang, X.; Cheng, Z. Compressive sensing using chaotic sequence based on Chebyshev map. Nonlinear Dynam 2014, 78, 2429–2438. [Google Scholar] [CrossRef]
  14. Arjoune, Y.; Hu, W.C.; Kaabouch, N. Chebyshev Vandermonde-like Measurement Matrix Based Compressive Spectrum Sensing. In Proceedings of the 2019 IEEE International Conference on Electro Information Technology (EIT), Brookings, SD, USA, 20–22 May 2019. [Google Scholar]
  15. Bajwa, W.U.; Haupt, J.D.; Raz, G.M.; Wright, S.J.; Nowak, R.D. Toeplitz-Structured Compressed Sensing Matrices. In Proceedings of the 2007 IEEE/SP 14th Workshop on Statistical Signal Processing, Madison, WI, USA, 26–29 August 2007. [Google Scholar]
  16. Wang, J.; Xu, Z.; Wang, Z.; Xu, S.; Jiang, J. Rapid compressed sensing reconstruction: A semi-tensor product approach. Inf. Sci. 2020, 512, 693–707. [Google Scholar] [CrossRef]
  17. Li, X.; Ling, Y. Research on the construction algorithm of measurement matrix based on mixed chaotic. Microelectron. Comput. 2021, 38, 23–30. [Google Scholar]
  18. Xue, L.; Wang, Y.; Wang, Z. Secure image block compressive sensing using complex Hadamard measurement matrix and bit-level XOR. IET Inf. Secur. 2022, 16, 417–431. [Google Scholar] [CrossRef]
  19. Xue, L.; Qiu, W.; Wang, Y.; Wang, Z. An Image-Based Quantized Compressive Sensing Scheme Using Zadoff–Chu Measurement Matrix. Sensors 2023, 23, 1016. [Google Scholar] [CrossRef] [PubMed]
  20. Tropp, J.A.; Gilbert, A.C. Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit. IEEE Trans. Inform. Theory 2007, 53, 4655–4666. [Google Scholar] [CrossRef]
  21. Do, T.T.; Gan, L.; Nguyen, N.; Tran, T.D. Sparsity adaptive matching pursuit algorithm for practical compressed sensing. In Proceedings of the 2008 42nd Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA, 26–29 October 2008. [Google Scholar]
  22. Mohimani, H.; Babaie-Zadeh, M.; Jutten, C. A Fast Approach for Overcomplete Sparse Decomposition Based on Smoothed ℓ0 Norm. IEEE Trans. Signal Process. 2009, 57, 289–301. [Google Scholar] [CrossRef]
  23. Beck, A.; Teboulle, M. A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems. SIAM J. Imaging Sci. 2009, 2, 183–202. [Google Scholar] [CrossRef]
  24. Candès, E.J.; Romberg, J.K.; Tao, T. Stable Signal Recovery from Incomplete and Inaccurate Measurements. Commun. Pure Appl. Math. A J. Issued Courant Inst. Math. Sci. 2006, 8, 1207–1223. [Google Scholar] [CrossRef]
  25. Cai, G. A Note and Application of the Schmidt Orthogonalization. J. Anqing Teach. Coll. (Nat. Sci. Ed.) 2015, 21, 106–108. [Google Scholar] [CrossRef]
  26. Wei, C. Research on Construction and Optimization of Measurement Matrix in Compressed Sensing. Master’s Thesis, Nanjing University of Posts and Telecommunications, Nanjing, China, 2016. [Google Scholar]
  27. Aung, A.; Ng, B.P.; Rahardja, S. Sequency-Ordered Complex Hadamard Transform: Properties, Computational Complexity and Applications. IEEE Trans. Signal Process. 2008, 56, 3562–3571. [Google Scholar] [CrossRef]
  28. Mahdaoui, A.E.; Ouahabi, A.; Moulay, M.S. Image Denoising Using a Compressive Sensing Approach Based on Regularization Constraints. Sensors 2022, 22, 2199. [Google Scholar] [CrossRef]
  29. Chen, Z.; Huang, C.; Lin, S. A new sparse representation framework for compressed sensing MRI. Knowl.-Based Syst. 2020, 188, 104969. [Google Scholar] [CrossRef]
  30. Gilbert, A.; Indyk, P. Sparse Recovery Using Sparse Matrices. Proc. IEEE 2010, 98, 937–947. [Google Scholar] [CrossRef]
Figure 1. Framework of the compressed sensing scheme.
Figure 1. Framework of the compressed sensing scheme.
Entropy 25 01248 g001
Figure 2. Experimental images.
Figure 2. Experimental images.
Entropy 25 01248 g002
Figure 3. The PSNR values of the reconstructed “Peppers” image with the size of 256 × 256 using different measurement matrices. The first six measurement matrices in the figure are from references [9,10,11,17,19,27].
Figure 3. The PSNR values of the reconstructed “Peppers” image with the size of 256 × 256 using different measurement matrices. The first six measurement matrices in the figure are from references [9,10,11,17,19,27].
Entropy 25 01248 g003
Figure 4. The PSNR values of the reconstructed “Woman” image with the size of 256 × 256 using different measurement matrices. The first six measurement matrices in the figure are from references [9,10,11,17,19,27].
Figure 4. The PSNR values of the reconstructed “Woman” image with the size of 256 × 256 using different measurement matrices. The first six measurement matrices in the figure are from references [9,10,11,17,19,27].
Entropy 25 01248 g004
Figure 5. The PSNR values of the reconstructed “Peppers” image with the size of 512 × 512 using different measurement matrices. The first six measurement matrices in the figure are from references [9,10,11,17,19,27].
Figure 5. The PSNR values of the reconstructed “Peppers” image with the size of 512 × 512 using different measurement matrices. The first six measurement matrices in the figure are from references [9,10,11,17,19,27].
Entropy 25 01248 g005
Figure 6. The PSNR values of the reconstructed “Woman” image with the size of 512 × 512 using different measurement matrices. The first six measurement matrices in the figure are from references [9,10,11,17,19,27].
Figure 6. The PSNR values of the reconstructed “Woman” image with the size of 512 × 512 using different measurement matrices. The first six measurement matrices in the figure are from references [9,10,11,17,19,27].
Entropy 25 01248 g006
Figure 7. Comparison of reconstructed details of the “Lena” image with size 256 × 256 using different measurement matrices when the compression ratio is 0.5.
Figure 7. Comparison of reconstructed details of the “Lena” image with size 256 × 256 using different measurement matrices when the compression ratio is 0.5.
Entropy 25 01248 g007
Figure 8. Comparison of reconstructed details of the “Livingroom” image with size 512 × 512 using different measurement matrices when the compression ratio is 0.5.
Figure 8. Comparison of reconstructed details of the “Livingroom” image with size 512 × 512 using different measurement matrices when the compression ratio is 0.5.
Entropy 25 01248 g008
Figure 9. Performance comparison of reconstructed images using different algorithms. These five algorithms correspond to references [8], [20], [21], [22], and [23], respectively.
Figure 9. Performance comparison of reconstructed images using different algorithms. These five algorithms correspond to references [8], [20], [21], [22], and [23], respectively.
Entropy 25 01248 g009
Figure 10. Impact of different sparsity on reconstruction performance using the “Lena” image of size 256 × 256 .
Figure 10. Impact of different sparsity on reconstruction performance using the “Lena” image of size 256 × 256 .
Entropy 25 01248 g010
Figure 11. Impact of different sparsity on reconstruction performance using the “Cameraman” image of size 256 × 256 .
Figure 11. Impact of different sparsity on reconstruction performance using the “Cameraman” image of size 256 × 256 .
Entropy 25 01248 g011
Figure 12. Impact of different sparsity on reconstruction performance using the “Lena” image of size 512 × 512 .
Figure 12. Impact of different sparsity on reconstruction performance using the “Lena” image of size 512 × 512 .
Entropy 25 01248 g012
Figure 13. Impact of different sparsity on reconstruction performance using the “Cameraman” image of size 512 × 512 .
Figure 13. Impact of different sparsity on reconstruction performance using the “Cameraman” image of size 512 × 512 .
Entropy 25 01248 g013
Table 1. When the compression ratio is 0.2, and under the image size of 256 × 256 , the PSNR of the reconstructed image using different measurement matrices is compared. The value in bold is the best.
Table 1. When the compression ratio is 0.2, and under the image size of 256 × 256 , the PSNR of the reconstructed image using different measurement matrices is compared. The value in bold is the best.
Measurement MatrixLenaPeppersWomanBoats
Gaussian Matrix [9]19.1517.2819.1617.78
Bernoulli Matrix [10]19.3217.8319.1617.88
Partial Real-Valued Hadamard Matrix [11]19.3317.8419.5617.85
Mixed Chaotic-Bernoulli Matrix [17]20.2317.8618.9918.51
SCHT Matrix [27]22.0320.6123.3520.90
Zadoff–Chu Matrix [19]22.0920.4723.5520.84
Complex-Valued Gaussian Matrix22.0120.4622.9320.59
Orthogonal Complex-Valued Gaussian Matrix28.6427.9233.9529.12
Table 2. When the compression ratio is 0.5, and under the image size of 256 × 256 , the PSNR of the reconstructed image using different measurement matrices is compared. The value in bold is the best.
Table 2. When the compression ratio is 0.5, and under the image size of 256 × 256 , the PSNR of the reconstructed image using different measurement matrices is compared. The value in bold is the best.
Measurement MatrixLenaPeppersWomanBoats
Gaussian Matrix [9]26.3025.1231.0426.42
Bernoulli Matrix [10]26.2525.1831.0126.56
Partial Real-Valued Hadamard Matrix [11]26.3425.1831.0326.56
Mixed Chaotic–Bernoulli Matrix [17]26.5225.0530.8826.94
SCHT Matrix [27]30.4029.1635.9632.09
Zadoff–Chu Matrix [19]30.1629.0135.6632.02
Complex-Valued Gaussian Matrix30.4929.3436.1032.33
Orthogonal Complex-Valued Gaussian Matrix36.8535.3843.2142.23
Table 3. Comparison of SSIM values of different reconstructed images when the original image size is 256 × 256 , and the compression ratio is 0.5. The value in bold is the best.
Table 3. Comparison of SSIM values of different reconstructed images when the original image size is 256 × 256 , and the compression ratio is 0.5. The value in bold is the best.
Measurement MatrixLenaPeppersWomanBoats
Gaussian Matrix [9]0.66280.60670.79430.6865
Bernoulli Matrix [10]0.66670.60840.79650.6886
Partial Real-Valued Hadamard Matrix [11]0.66740.61200.79870.6930
Mixed Chaotic–Bernoulli Matrix [17]0.68170.65580.83350.7271
SCHT Matrix [27]0.83780.78830.92320.8784
Zadoff–Chu Matrix [19]0.85290.82960.93600.8936
Complex-Valued Gaussian Matrix0.82350.78140.91910.8699
Orthogonal Complex-Valued Gaussian Matrix0.97310.96810.98790.9863
Table 4. Comparison of process complexity of different measurement matrices.
Table 4. Comparison of process complexity of different measurement matrices.
Measurement MatrixAddition ComplexityMultiplication
Complexity
Haar + Noiselet [7] O ( 17 2 M N + 2 M N × log 2 ( M N 1 ) 2 M + N ) 0
Haar + Noiselet [8] O ( 7 2 M N + 2 M N × log 2 ( M N 1 ) ) 0
Gaussian Matrix [9] O ( ( N 1 ) M N ) O ( M N 2 )
Bernoulli Matrix [10] O ( ( N 1 ) M N ) O ( M N 2 )
Partial Real-Valued Hadamard Matrix [11] O ( ( N 1 ) M N ) 0
Mixed Chaotic–Bernoulli Matrix [17] O ( ( N 1 ) M N ) O ( M N 2 )
SCHT Matrix [27] O ( ( 2 N 1 ) M N ) O ( 2 M N 2 )
Zadoff–Chu Matrix [19] O ( ( 2 N 1 ) M N ) O ( 2 M N 2 )
Complex-Valued Gaussian Matrix O ( ( 2 N 1 ) M N ) O ( 2 M N 2 )
Orthogonal Complex-Valued Gaussian Matrix O ( ( 2 N 1 ) M N ) O ( 2 M N 2 )
Sparse Orthogonal Complex-Valued Gaussian Matrix O ( ( 2 N 1 ) d N ) O ( 2 d N 2 )
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, Y.; Xue, L.; Yan, Y.; Wang, Z. A Novel Complex-Valued Gaussian Measurement Matrix for Image Compressed Sensing. Entropy 2023, 25, 1248. https://doi.org/10.3390/e25091248

AMA Style

Wang Y, Xue L, Yan Y, Wang Z. A Novel Complex-Valued Gaussian Measurement Matrix for Image Compressed Sensing. Entropy. 2023; 25(9):1248. https://doi.org/10.3390/e25091248

Chicago/Turabian Style

Wang, Yue, Linlin Xue, Yuqian Yan, and Zhongpeng Wang. 2023. "A Novel Complex-Valued Gaussian Measurement Matrix for Image Compressed Sensing" Entropy 25, no. 9: 1248. https://doi.org/10.3390/e25091248

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop