Next Article in Journal
SHG in Micron-Scale Layers of Glasses: Electron Beam Irradiation vs. Thermal Poling
Previous Article in Journal
High Harmonic Generation Driven by Counter-Rotating Bicircular Laser Fields from Polar Chemical Bonds in h-BN
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Design and Dispersion Calibration of Direct-Vision Push-Broom Compressive Double-Amici-Prism Hyperspectral Imager

1
College of Sciences, National University of Defense Technology, Changsha 410073, China
2
Basic Department, Army Academy of Artillery and Air Defense, Hefei 230031, China
3
School of Computer Science and Technology, Xidian University, Xi’an 710071, China
4
Hunan Institute of Traffic Engineering, Hengyang 421099, China
*
Authors to whom correspondence should be addressed.
Photonics 2022, 9(10), 732; https://doi.org/10.3390/photonics9100732
Submission received: 7 September 2022 / Revised: 27 September 2022 / Accepted: 1 October 2022 / Published: 6 October 2022

Abstract

:
The design and calibration of the dispersive device in a hyperspectral imager significantly affect the performance of hyperspectral imaging, especially the spectral accuracy. To achieve high-accuracy hyperspectral imaging over the visible band, firstly, the geometric and dispersive parameters of the double Amici prism (DAP) that serves as a dispersive device in the direct-vision push-broom compressive hyperspectral imager (PBCHI) are designed and optimized; secondly, a calibration method based on the numerical calculation of the DAP model is put forward, which can turn the conventional pixel-wise dispersive shift calibration by a monochromator into a group of numerical calculations; lastly, a PBCHI prototype is built to test the performances of the designed and calibrated DAP and the hyperspectral imager. The calibration experiments demonstrate that the mean squared error (MSE) of the dispersive pixel shifts calibrated by the proposed numerical method is 0.1774, which indicates the calibration result of the proposed method is consistent with the directly calibrated result. Furthermore, after this numerical calculation, the spectral signatures of the reconstructed cubes of the DAP-based PBCHI system show consistency with the ground truth. This work will benefit the design and calibration of the DAP-based hyperspectral imager.

1. Introduction

With the superior characteristics of high spectral and spatial resolution, the traditional slit-based hyperspectral imagers have become significant instruments for many applications, including ecology [1,2,3,4], geology [5,6], agriculture [7,8,9,10], military [11,12], and so on. However, the widespread usages of the traditional slit-based hyperspectral imager are still limited by the well-known annoying issues, such as the enormous quantity of the captured data, which makes transmission and storage overloaded, and the contradiction between the system resolution and the signal-to-noise ratio. Fortunately, the compressive hyperspectral imagers (CHIs) [13,14,15,16,17,18,19,20,21] were developed. In a typical CHI system, a three-dimensional hyperspectral scene, i.e., hyperspectral data cube, can be modulated by an encoding mask and then projected onto a two-dimensional detector array to generate a spatio-spectral multiplexed measurement [22,23], which can significantly reduce the data volume and enlarge the light flux; after that, the hyperspectral data cube can be reconstructed via various reconstruction algorithms [24,25,26].
Gratings and prisms are the most commonly used dispersive elements in a CHI system. Generally, the gratings are distinguished with high performance in linear dispersion; however, they suffer from low energy efficiency, complicated fabrication processes, high cost, and high-order harmonic distortion within broadband [27]. On the contrary, the prisms exhibit high optical efficiency, low fabrication complexity, low cost, and large bandwidth but large nonlinear dispersion [28,29] that leads to extra complexity and incompact layout. An abundance of efforts have been exploited to figure out the nonlinearity and deflection issues of prisms, among which the double Amici prisms (DAP) [30,31,32], with properties of nearly linear dispersion and direct-vision, have been widely recognized as a versatile solution for the prism-based spectral imaging systems. In the process of hyperspectral imaging, a rigorous calibration strategy for DAP is necessary to improve the quality of spectral image estimates. The procedure was performed to capture multiframe monochromatic images of the encoding mask at different wavelengths in 1 nm increments within the bandpass of the system [20]. Obviously, if the bandpass or the focal length of the lens of the push-broom compressive hyperspectral imager (PBCHI) system is changed, the calibration will need to be repeated, which will complicate the calibration of the DAP.
Herein, to satisfy the requirements of hyperspectral imaging in the visible bands, with respect to the direct-vision PBCHI, the geometric and dispersive parameters of DAP are, firstly, designed and optimized; secondly, a calibration method, which is based on the numerical calculation of the DAP model rather than the pixel-wise direct calibration by a monochromator, is put forward to simplify the calibration process and ensure the calibration accuracy; lastly, a DAP-based PBCHI prototype is built, and a series of experiments are conducted to test the proposed calibration method and the performances of the designed and calibrated DAP.

2. Design of Double Amici Prism and Push-Broom Compressive Hyperspectral Imager

For the common single prisms, a certain input collimated light beam will be dispersed with different spectral resolutions over the visible (VIS) region (400 nm∼700 nm); the difference of spectral resolutions between long-wave and short-wave is usually more than one order of magnitude. Therefore, the single prisms are not actually suitable for the push-broom compressive hyperspectral imager (PBCHI) system in which the hyperspectral cube will be very difficult to be resolved accurately. Nevertheless, the dispersion of the double Amici prism (DAP) is more linear, which makes them considered as suitable dispersive devices for PBCHI systems.
A DAP and a corresponding PBCHI prototype were designed and fabricated as shown in Figure 1. Figure 1a represents a ray tracing through a DAP, Figure 1b shows our fabricated DAP, and Figure 1c displays the direct-vision PBCHI system. In our PBCHI system, the slit in the conventional slit-based hyperspectral imager was replaced by a 2D random encoding mask. The PBCHI prototype was mainly composed of six parts including the imaging lens (L 1 ), an encoding mask, the relay lens (L 2 ) (1:1 imaging), the dispersion device (our fabricated DAP), the relay lens (L 3 ) (1:1 imaging), and the imaging sensor. In more detail, the encoding mask was set at the primary imaging plane of L 1 and the front focal plane of L 2 , our designed DAP as the dispersive device was located between L 2 and L 3 , the imaging sensor was set at the back focal plane of L 3 , and the encoding mask was imaging 1:1 on the image sensor. A hyperspectral target scene was, firstly, modulated by a binary random matrix encoding mask; then, the modulated data cube was dispersed by our designed DAP and projected onto a detector array to generate spatio-spectral multiplexed measurements.
For a DAP, the angles follow the modern sign convention [33] as shown in Figure 1a. Based on the ray tracing, the refraction of a ray with a wavelength of λ through a DAP is given by applying Snell’s law at each interface:
i 1 ( λ ) = i 0 ( λ ) β 1 , r 1 ( λ ) = arcsin n 0 × sin i 1 ( λ ) n 1 ( λ ) i 2 ( λ ) = r 1 ( λ ) α 1 , r 2 ( λ ) = arcsin n 1 ( λ ) × sin i 2 ( λ ) n 2 ( λ ) i 3 ( λ ) = r 2 ( λ ) α 2 , r 3 ( λ ) = arcsin n 2 ( λ ) × sin i 3 ( λ ) n 1 ( λ ) i 4 ( λ ) = r 3 ( λ ) α 1 , r 4 ( λ ) = arcsin n 1 ( λ ) × sin i 4 ( λ ) n 0 i 5 ( λ ) = r 4 ( λ ) β 1 .
Here we assume that the optical axis is parallel to the prism base shown as the red dashed line in Figure 1a, α 1 is the apex angle of Glass1 and Glass3, α 2 is the apex angle of Glass2, and Glass1 and Glass3 are identical and symmetrical about Glass2. By making a vertical line from the apex angle of Glass1 to divide α 1 into β 1 and γ 1 , where β 1 = α 1 α 2 2 , and combining Equation (1), the deflection angle δ ( λ ) of a light beam with a wavelength of λ through the DAP can be calculated by
δ ( λ ) = i 0 ( λ ) i 5 ( λ ) = i 0 ( λ ) r 4 ( λ ) + β 1 .
The difference in deviation angle between the two extreme wavelengths transmitted by the prism is the dispersion angle Δ :
Δ = δ λ max δ λ min = r 4 λ max r 4 λ min ,
here, λ m i n = 400 nm, λ m a x = 700 nm.
Usually, the designed parameters of the DAP depend on the requirements of the spectral band numbers, the imaging sensor specifications, and some other optical elements inside of the systems. The dispersion can also be expressed as:
Δ = arctan d λ max f + arctan d λ min f ,
where d λ max denotes the distance between the convergence point of wavelength λ max = 700 nm and that of the central wavelength λ 0 = 550 nm on the imaging sensor, and d λ min denotes the distance between the convergence point of wavelength λ min = 400 nm and that of the central wavelength λ 0 = 550 nm on the imaging sensor. Here, f = 50 mm represents the focal length of L 3 . To meet the spectral resolution requirements for achieving hyperspectral imaging in all VIS light bands, the dispersion is calculated as Δ 1.13° by combining Equation (4) with the system parameters of imaging sensor pixel size p = 5.5 μ m and a spectral band number of 60. Usually, a higher spectral resolution can be achieved at a larger dispersion Δ ; however, as an oversized dispersion, Δ will cause spatial and spectral distortion, so the dispersion Δ should not be set too large. Therefore, Δ = 1.2° is chosen as the dispersion angle of our designed DAP.
The linearity of the dispersion is another key characteristic of the designed parameters of the DAP, which can be characterized by standard deviation (SD) and spectral sampling rate (SSR) as follows:
S D = i = 1 n d δ λ i d λ i d δ ( λ ) d λ min 2 n ,
S S R = max d δ ( λ ) d λ / min d δ ( λ ) d λ ,
where the gradient of the deviation angle d δ ( λ ) / d λ gives the spectral dispersion per unit wavelength and n represents the number of bands between 400 nm and 700 nm by step of 0.1 nm, i.e., n = 3000 for the design. Generally, smaller indices of SD and SSR imply better linearity of the DAP, which can be minimized during the design process. For the designed goal of δ (550 nm) = 0 and Δ = 1.2°, i.e., a direct-vision wavelength of 550 nm and a dispersion angle of 1.2°, we input the parameters of all glasses listed in a standard optical materials catalog, supplied by CDGM Glass Company and SCHOTT, into the above equations to achieve the optimization of the glass group. As a result, the configuration parameters of the designed DAP are listed in Table 1, which achieve the best performance with the most linear dispersion and the most compact layout.
Here, F2, SF10, and N-BK7 are common materials for dispersive prisms. As listed in Table 1, comparing the 1st row configuration parameters (H-LAK54 and H-FK95N) with the 2nd configuration (H-FK95N and H-LAK54), the SD and SSR values of these two DAPs are approximately equal, while the apex angle of the 2nd configuration is less than 65° to allow sufficient design flexibility; moreover, comparing the 2nd configuration (H-FK95N and H-LAK54) with the 7th configuration (H-FK95N and SF10), the SD and SSR values of the 2nd configuration are smaller than the 7th, which indicates that the linearity of the DAP with the 2nd configuration is better.
According to the Schott formula in ZEMAX, six constant coefficients, i.e., a i (0 i 5), are needed to calculate the refractive index of arbitrary wavelength:
( n ( λ ) ) 2 = a 0 + a 1 λ 2 + a 2 λ 2 + a 3 λ 4 + a 4 λ 6 + a 5 λ 8 .
In line with the six constant coefficients of the five materials listed in Table 1, the variations of refractive index with wavelength are shown in Figure 2. In fact, the refractive index of H-LAK54 and SF10 are similar (see Figure 2), while the linearity of H-LAK54 (green curve) is better than that of SF10 (black curve), which implies that H-LAK54 can realize the better dispersion linearity of the DAP. As a result, we choose the 2nd configuration for our designed DAP, i.e., materials of H-FK95N and H-LAK54 and apex angles of 54.76° and −62.16°. In addition, the materials H-FK95N and H-LAK54 have moisture resistance and water resistance which are suitable for processing the DAP.
The deflection angles δ ( λ ) after passing through the DAP vary with the incident wavelengths λ , as shown in Figure 3a; here, the relationship between the deflection angle of incident wavelength λ and the incident angle i 0 ( λ ) is discussed. As the incident angle i 0 changes, the variation of the deflection angle for different wavelengths is shown in Figure 3. As can be seen from Figure 3a,c, for the case of λ < 550 nm (such as λ = 400 nm, λ = 450 nm, and λ = 500 nm), the deflection angle increases with the incident angle from −20° to 0°, while the deflection angle decreases with the increasing incident angle from 0° to 20°, and there exists a maximum deflection angle at i 0 = 0. As shown in Figure 3a,b,d, when λ 550 nm (such as λ = 550 nm, λ = 600 nm, λ = 650 nm, and λ = 700 nm), there exists a minimum deflection angle at i 0 = 0; in addition, the minimum deflection angle at the central wavelength of 550 nm is 0°.

3. Dispersion Calibration

We propose a novel calibration method based on the numerical calculation of the DAP model. For a DAP-based PBCHI system, the calibration is performed by tracking a distinguishable point of the encoding mask in the direction of dispersion. As shown in Figure 4, the calibration process consists of the following steps: Step1, the pixel coordinate of the tracked point in the PBCHI system without DAP is first recorded as the reference position x r e on the imaging sensor. Step2, the fabricated DAP is accurately fixed in the PBCHI system to achieve a system optical axis parallel to the prism base by searching for the minimum (or maximum) deflection angle. The actual dispersion angle can be calibrated according to Equation (4) by illuminating with the wavelength of λ min and λ max , respectively. The actual direct-vision wavelength can be found by adjusting the incident wavelength from λ min + λ max 2 Δ λ to λ min + λ max 2 + Δ λ in a step of 1nm to find the wavelength whose dispersion shift is 0 relative to the reference position x r e , where Δ λ represents the wavelength scan range and is usually set to 20 nm. Step3, the actual apex angles α 1 and α 2 of the fabricated DAP can be calculated from the above-calibrated dispersion angle and direct-vision wavelength together with the parameters of the DAP glass materials. Step4, combining Equations (1) and (7), the dispersion shift N C of the DAP at different wavelengths λ can be calculated by the DAP apex angles α 1 and α 2 , the focal length f of the lens L 3 , and the pixel size p of the imaging sensor. Through the above calibration method of numerical calculations combined with simple experimental measurements, the dispersion shift of the fabricated DAP can be calculated, which shows accuracy compared with the direct-measured result. Compared with the traditional calibration method for the dispersion shift at different wavelengths, our calibration method can simplify the calculation process by avoiding a large number of direct measurements, especially in the case that the components in the PBCHI system have been moved or replaced, and realize the calibration of the DAP dispersive parameters.
Due to the fabrication errors in the practical manufacturing processes and the practical material property deviations, the fabricated DAP for practical spectral imagers requires further dispersion calibrations. Based on the PBCHI system as shown in Figure 1c, we performed the dispersion calibration for the DAP. In the calibration, a monochromator working together with a Xenon lamp provided quasi monochromatic light. We first calibrated the apex angles α 1 and α 2 of the DAP by tracking the position of the encoding mask at different wavelengths, i.e., a sign “+” on the encoding mask was selected as the tracked target, as shown in Figure 5a, and then we compared the measured values with the designed values.
It should be pointed out that the position (here, select a certain pixel point) of the tracked target in the PBCHI system without the DAP is considered as the original reference point, whose pixel coordinated along the dispersion direction is x r e = 965, as shown in Figure 5b. Then, the DAP is placed in the PBCHI system and the optical axis of the DAP is coincident with the axis of the PBCHI system. In this process, by adjusting the wavelength of the monochromator to 550 nm and carefully rotating the DAP horizontally to change the incident angle of the light beam, the movement of the tracked point in the dispersion direction on the imaging sensor will help us to calibrate the optical axis of the DAP. When the incident angle changes to a certain value by rotating the DAP horizontally, the tracked point will no longer move toward the same direction; instead, it will move toward the opposite direction if we continue to rotate the DAP in the same direction; at this time, the incident angle implies the maximum (or minimum) deflection angle and i 0 ( λ ) = 0, i.e., the optical axis of the DAP is coincident with the axis of the PBCHI system. After that, the DAP can be fixed.
Then, we try to calibrate the actual direct-vision wavelength of the manufactured DAP. As shown in Figure 5c, when the incident wavelength is set to 550 nm, the pixel coordinate of the tracked position along the dispersion direction is x 550 nm = 971, which shifts six pixels from the original reference coordinate ( x r e = 965, as shown in Figure 5b). By carefully adjusting the wavelength of the monochromator from 530 nm to 570 nm by a step of 1nm, the position of the observation point was recorded to find the direct-vision wavelength. When the wavelength is adjusted to 540 nm, the pixel coordinate of the tracked point in the dispersion direction is x 540 nm = 965, as shown in Figure 5d, which is identical to the reference coordinate and indicates that λ = 540 nm is the actual direct-vision wavelength of the fabricated DAP used in our PBCHI system.
To ensure the spectral accuracy of the reconstructed hyperspectral cube, it is necessary to perform the dispersion angle calibration for the PBCHI. Therefore, we change finely the wavelength from 400 nm to 700 nm by a step of 5 nm to measure the actual dispersion positions of the tracked point for various specific bands of the imager, and the pixel number N shifted from the original reference point ( x r e = 965) is measured and listed in Figure 6. Then, the calibrated dispersion angle Δ C is calculated by Equation (4), which is approximately 0.04° larger than the designed value, i.e., Δ C = 1.24°. According to the calibrated direct-vision wavelength and dispersion angle, combined with Snell’s law, the apex angle α 1 of the DAP in the imager is calculated to be approximately 1.4° larger than the designed value, i.e., α 1 = 56.16°, and α 2 is calculated to be approximately 1.67° smaller than the designed one, i.e., α 2 = −63.83°. The pixel number N can be expressed
N = f · tan i 5 ( λ ) f · tan i 0 ( λ ) p .
Here, i 5 ( λ ) is the beam exit angle which is calculated by Equations (1) and (7), i 5 ( λ ) is related to the apex angle, and p is the pixel size of the imaging sensor.
As shown in Figure 6, the blue solid line represents the theoretical designed value N T , which is calculated by Equation (8) combined with the designed apex angle and dispersion angle before calibration; the red hollow-dotted line represents the experimental measured value N E , and the black solid-dotted line represents the calibrated value N C from the calibrated apex angle and dispersion angle of the DAP according to Equation (8), which is approximately the same as the N E . Moreover, the mean squared error (MSE) was employed to give an evaluation of the difference between the calculated dispersion shifts N C through our method with the direct-measured values N T of different wavelengths. A lower MSE index implies lower difference and higher accuracy. The MSE index between N C and N E is 0.1774, far less than the index between N T and N E that is 24.2134, which demonstrates that our calibration can achieve accuracy.
The pixel shift differences before and after the calibration can be respectively expressed as
Δ N A = N E N T Δ N B = N E N C ,
Before calibration, the pixel shift difference Δ N A is shown by the black dotted line in Figure 7, and the red solid line is the linear fitting line of the Δ N A . It can be seen that Δ N A increases with the wavelength. Δ N B represents the pixel shift difference after calibration as marked by the blue dotted line in Figure 7, and the yellow solid line is the linear fitting line. Obviously, the slope of the linear fitting line of Δ N B is close to 0, and Δ N B can be considered basically unchanged with the increase of the wavelength; that is, the calculated value from calibrated parameters of the DAP is basically consistent with the measured value.

4. Experimental Results

To test the performance of our PBCHI system based on the calibrated DAP as shown in Figure 1c, we constructed a series of push-broom hyperspectral imaging experiments as shown in Figure 8a. The scenes, located about 7 m away from L 1 of the prototype, were illuminated by LED light. The encoding mask in the PBCHI prototype was generated from a Gaussian random matrix with a size of 96 × 48, in which the elements greater than 0 were set to 1 and the elements less than or equal to 0 were all set to 0, and the smallest encoding mask element is four times the size of a single pixel of the imaging sensor. The spectral filtering was performed by a 450–650 nm bandpass filter. We pushed the prototype by a stepper motor and, meanwhile, collected the multi-frame spatio-spectral multiplexed measurements of the scene to achieve a large field of view (FOV), and one frame of measurements by the random-encoding-mask-based PBCHI is shown in Figure 8c.
For comparison, one frame of measurements by the slit-based push-broom hyperspectral imager is shown in Figure 8b, which can be captured by replacing the encoding mask in the PBCHI prototype with a slit. The width of the slit is equal to the single pixel size. As shown in Figure 9, the ground truth with 139 channels of two hyperspectral scenes can be acquired from the measurements by the slit-based push-broom hyperspectral imager. Figure 10 and Figure 11 show the raw cubes with 31 channels reconstructed by compressive algorithm regularized least squares (RLS) [34,35] for the first scene and the second one, respectively. We push the whole PBCHI prototype to acquire a sequence of multiplexed measurements; in detail, the first scene (Figure 10) is reconstructed from 85 frames of multiplexed measurements, while the second scene (Figure 11) is reconstructed from 50 frames of measurements. The compression ratio is about 4.
It is well-known that the PBCHI is rather sensitive to various noises, such as photon shot noise, dark current noise, background noise, and so on. At the same time, the encoding mask processing errors, the residual calibration errors, the push-broom sampling instability, and the sparse reconstruction process will also introduce significant artifacts, which usually turn out to be severe and appear as defects such as stripes and dead pixels. As a result, compared with the ground truths in Figure 9, there are obvious noises and stripes in the raw reconstructed cubes as shown in Figure 10 and Figure 11.
To test the spectral accuracy of the raw reconstructed cubes of the PBCHI prototype, the spectral intensities for different spatial locations of the two scenes are shown in Figure 12. The spectral intensities of the regions marked by the red box in Figure 9a and the corresponding regions in Figure 10 are shown in Figure 12a, and the spectral intensities of the regions marked by the white box in Figure 9b and the corresponding regions in Figure 11 are shown in Figure 12b. Obviously, the spectral signatures of the reconstructed cubes of the PBCHI system show consistency with the ground truth captured by the slit-based push-broom hyperspectral imager, which indicates the spectral accuracy of the DAP-based PBCHI.

5. Conclusions and Discussion

In this paper, firstly, based on the direct-vision push-broom compressive hyperspectral imager (PBCHI), a geometric and dispersive parameter of the double Amici prism (DAP) is optimized to meet the requirements of hyperspectral imaging in the visible bands.
Secondly, a novel calibration method for the dispersion device DAP model is put forward where the apex angles of the fabricated DAP are calibrated; as a result, the dispersion shift of the PBCHI system at different wavelengths can be calculated if the focal length f of the lens L 3 and the pixel size p of the image sensor used in the PBCHI system are known.
Lastly, a PBCHI prototype is built to test the performances of the designed and calibrated DAP and the hyperspectral imager, and it is found that the dispersion performance after calibration is more consistent with the experimental test value than before calibration through the comparison of evaluation index MSE and the differences of the pixel shift. Moreover, the reconstructions cube and the spectral intensity demonstrate that the dispersion calibration achieves the hyperspectral cube accuracy reconstruction especially in spectrum, which indicates the spectral accuracy of the PBCHI system.
This work can simplify the calibrated process and turn the conventional pixel-wise dispersive shift calibration by a monochromator into a group of numerical calculations for the DAP-based hyperspectral imager, and the research will be helpful for promoting PBCHI technologies for achieving further widely used applications.

Author Contributions

Conceptualization, M.Z. and J.Q.; methodology, M.Z. and J.Q.; software, M.Z., W.Y. and J.D.; validation, M.Z. and W.Y.; formal analysis, S.Z. and M.F.; data curation, J.L.; writing—original draft preparation, M.Z. and J.Q.; writing—review and editing, M.Z. and W.Y.; supervision, X.L.; funding acquisition, X.L. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China (62005317, 11704411, 62005207), the Natural Science Foundation of Hunan Province (2019JJ40341, 2021JJ40695), and the National Key Research and Development Program of China (NKRDPC Grant NO. 2020YFA0713504).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Shen, Q.; Li, J.; Zhang, F.; Sun, X.; Li, J.; Li, W.; Zhang, B. Classification of Several Optically Complex Waters in China Using in Situ Remote Sensing Reflectance. Remote Sens. 2015, 7, 14731–14756. [Google Scholar] [CrossRef] [Green Version]
  2. Emmanuel, D.; Kevin, R.T.; Wesley, M.; Victor, V.K.; Tiffany, M.; Marcel, B.; Gerardo, T.; Marie-Hélène, F.; Young-Heon, J. Future retrievals of water column bio-optical properties using the Hyperspectral Infrared Imager (HyspIRI). Remote Sens. 2013, 5, 6812–6837. [Google Scholar]
  3. Lesser, M.P.; Mobley, C.D. Bathymetry, water optical properties, and benthic classification of coral reefs using hyperspectral remote sensing imagery. Coral Reefs 2007, 26, 819–829. [Google Scholar] [CrossRef]
  4. Hochberg, E.J.; Atkinson, M.J. Spectral discrimination of coral reef benthic communities. Coral Reefs 2000, 19, 164–171. [Google Scholar] [CrossRef]
  5. Wang, Q.; Zhang, Z.; Hao, Z.; Liu, B.; Xiong, J. Optical Classification of Coastal Water Body in China Using Hyperspectral Imagery CHRIS/PROBA. In Proceedings of the IOP Conference Series Earth and Environmental Science, Beijing, China, 11–13 December 2020. [Google Scholar]
  6. Kruse, F.A.; Boardman, J.W.; Huntington, J.F. Comparison of airborne hyperspectral data and EO-1 Hyperion for mineral mapping. IEEE Trans. Geosci. Remote Sens. 2003, 41, 1388–1400. [Google Scholar] [CrossRef] [Green Version]
  7. Thorsten, M.; Jonas, F.; Gunter, M. Spectral requirements on airborne hyperspectral remote sensing data for wheat disease detection. Precis. Agric. 2011, 12, 795. [Google Scholar]
  8. Elhadi, A.; Onisimo, M.; Denis, R. Multispectral and hyperspectral remote sensing for identification and mapping of wetland vegetation: A review. Wetl. Ecol. Manag. 2010, 18, 281–296. [Google Scholar]
  9. Jonas, F.; Gunter, M. Multi-temporal wheat disease detection by multi-spectral remote sensing. Precis. Agric. 2007, 8, 161–172. [Google Scholar]
  10. Fitzgerald, G.J. Portable hyperspectral tunable imaging system (phytis) for precision agriculture. Agron. J. 2004, 96, 311–315. [Google Scholar] [CrossRef]
  11. Chen, K. Military Object Detection Using Multiple Information Extracted from Hyperspectral Imagery. In Proceedings of the 2017 International Conference on Progress in Informatics and Computing (PIC), Nanjing, China, 15–17 December 2017. [Google Scholar]
  12. Tiwari, K.C.; Arora, M.K.; Singh, D. An assessment of independent component analysis for detection of military targets from hyperspectral images. Int. J. Appl. Earth Obs. Geoinf. 2011, 13, 730–740. [Google Scholar] [CrossRef]
  13. Kutyniok, G. Theory and Applications of Compressed Sensing. GAMM-Mitteilungen 2013, 36, 79–101. [Google Scholar] [CrossRef] [Green Version]
  14. Eldar, Y.C.; Kutyniok, G. Compressed Sensing: Introduction to Compressed Sensing, 3rd ed.; Cambridge University Press: Cambridge, UK, 2012; pp. 1–64. [Google Scholar]
  15. Cao, X.; Tong, X.; Dai, Q.; Lin, S. High resolution multispectral video capture with a hybrid camera system. In Proceedings of the CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011; pp. 297–304. [Google Scholar]
  16. Xun, C.; Tao, Y.; Xing, L.; Lin, S.; Xin, Y.; Dai, Q.; Carin, L.; Brady, D.J. Computational Snapshot Multispectral Cameras: Toward dynamic capture of the spectral world. IEEE Signal Process. Mag. 2016, 33, 95–108. [Google Scholar]
  17. Willett, R.M.; Duarte, M.F.; Davenport, M.A.; Baraniuk, R.G. Sparsity and Structure in Hyperspectral Imaging: Sensing, Reconstruction, and Target Detection. IEEE Signal Process. Mag. 2014, 31, 116–126. [Google Scholar] [CrossRef] [Green Version]
  18. Arce, G.; Brady, D.; Carin, L.; Arguello, H. Compressive Coded Aperture Spectral Imaging: An Introduction. IEEE Signal Process. Mag. 2014, 31, 105–115. [Google Scholar] [CrossRef]
  19. Willett, M.R.; Marcia, F.R.; Nichols, J.M. compressed sensing for practical optical imaging systems: A tutorial compressed sensing for practical optical imaging systems: A tutorial. Opt. Eng. 2011, 50, 072601. [Google Scholar]
  20. Wagadarikar, A.A.; Pitsianis, N.P.; Sun, X.; Brady, D.J. Video rate spectral imaging using a coded aperture snapshot spectral imager. Opt. Express 2009, 17, 6368–6388. [Google Scholar] [CrossRef]
  21. Saragadam, V.; DeZeeuw, M.; Baraniuk, R.; Veeraraghavan, A.; Sankaranarayanan, A.C. SASSI — Super-Pixelated Adaptive Spatio-Spectral Imaging. IEEE Trans. Pattern Anal. Mach. Intell. 2021, 43, 2233–2244. [Google Scholar] [CrossRef] [PubMed]
  22. Wagadarikar, A.A.; Pitsianis, N.; Sun, X.; Brady, D.J. Spectral image estimation for coded aperture snapshot spectral imagers. In Proceedings of the SPIE—The International Society for Optical Engineering, San Diego, CA, USA, 10 August 2008. [Google Scholar]
  23. Gehm, M.E.; John, R.; Brady, D.J.; Willett, R.M.; Schulz, T.J. Single-shot compressive spectral imaging with a dual-disperser architecture. Opt. Express 2007, 15, 14013–14027. [Google Scholar] [CrossRef] [Green Version]
  24. Fu, Y.; Zhang, T.; Wang, L.; Huang, H. Coded Hyperspectral Image Reconstruction using Deep External and Internal Learning. IEEE Trans. Softw. Eng. 2021, 44, 99. [Google Scholar] [CrossRef]
  25. Tibshirani, R. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B 1996, 58, 267–288. [Google Scholar] [CrossRef]
  26. Wang, J.; Shim, B. On the Recovery Limit of Sparse Signals Using Orthogonal Matching Pursuit. IEEE Trans. Signal Process. 2012, 60, 4973–4976. [Google Scholar] [CrossRef]
  27. Lockwood, R.B.; Cooley, T.W.; Nadile, R.M.; Gardner, J.A.; Armstrong, P.S.; Payton, A.M.; Davis, T.M.; Straight, S.D.; Shen, S.S.; Lewis, P.E. Advanced responsive tactically effective military imaging spectrometer (ARTEMIS): System overview and objectives. In Proceedings of the SPIE Photonic Devices + Applications, San Diego, CA, USA, 26 August 2007. [Google Scholar]
  28. Hagen, N.; Tkaczyk, T.S. Compound prism design principles, I. Appl. Opt. 2011, 50, 4998. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Hagen, N.; Tkaczyk, T.S. Compound prism design principles, II: Triplet and Janssen prisms. Appl. Opt. 2011, 50, 5012–5022. [Google Scholar] [CrossRef]
  30. Lei, W.; Shao, Z.; Tang, W.; Liu, J.; Li, X. Design of direct-vision cyclo-olefin-polymer double Amici prism for spectral imaging. Appl. Opt. 2017, 56, 8430–8435. [Google Scholar]
  31. Cull, C.F.; Choi, K.; Brady, D.J.; Oliver, T. Identification of fluorescent beads using a coded aperture snapshot spectral imager. Appl. Opt. 2010, 49, B59. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Tsai, T.H.; Llull, P.; Yuan, X.; Carin, L.; Brady, D.J. Spectral-temporal compressive imaging. Opt. Lett. 2015, 40, 4054–4057. [Google Scholar] [CrossRef] [PubMed]
  33. Greivenkamp, J.E. Field Guide to Geometrical Optics; SPIE Press: Washington, DC, USA, 2004. [Google Scholar]
  34. Caponnetto, A.; De Vito, E. Optimal rates for the regularized least-squares algorithm. Found. Comput. Math. 2007, 7, 331–368. [Google Scholar] [CrossRef]
  35. Sowmya, V.; Soman, K.P.; Hassaballah, M. Hyperspectral image: Fundamentals and advances. Recent Adv. Comput. Vis. 2019, 804, 401–424. [Google Scholar]
Figure 1. The designed DAP and PBCHI prototype. (a) Ray tracing through a DAP. (b) Photograph of the fabricated DAP. (c) The PBCHI prototype.
Figure 1. The designed DAP and PBCHI prototype. (a) Ray tracing through a DAP. (b) Photograph of the fabricated DAP. (c) The PBCHI prototype.
Photonics 09 00732 g001
Figure 2. The refractive index of the glass materials varies with wavelength.
Figure 2. The refractive index of the glass materials varies with wavelength.
Photonics 09 00732 g002
Figure 3. (a) The deflection angle of different wavelengths varies with the incident angle from −20° to 20°. (bd) Details for λ = 550 nm, λ = 400 nm, and λ = 700 nm, respectively.
Figure 3. (a) The deflection angle of different wavelengths varies with the incident angle from −20° to 20°. (bd) Details for λ = 550 nm, λ = 400 nm, and λ = 700 nm, respectively.
Photonics 09 00732 g003
Figure 4. The flow chart of the calibration method based on the experimental test and numerical calculations of the fabricated DAP.
Figure 4. The flow chart of the calibration method based on the experimental test and numerical calculations of the fabricated DAP.
Photonics 09 00732 g004
Figure 5. (a) The schematic diagram of the encoding mask with sign “+” (near the upper edge). (b) The coordinate of the observation point without DAP. (c) The coordinate of the observation point with DAP while λ = 550 nm. (d) The coordinate of the observation point with DAP while λ = 540 nm.
Figure 5. (a) The schematic diagram of the encoding mask with sign “+” (near the upper edge). (b) The coordinate of the observation point without DAP. (c) The coordinate of the observation point with DAP while λ = 550 nm. (d) The coordinate of the observation point with DAP while λ = 540 nm.
Photonics 09 00732 g005
Figure 6. The pixel shift for various wavelengths. N C represents the calculated value from the calibrated parameters of the DAP. N E represents experimental measured values. N T represents the theoretical designed value.
Figure 6. The pixel shift for various wavelengths. N C represents the calculated value from the calibrated parameters of the DAP. N E represents experimental measured values. N T represents the theoretical designed value.
Photonics 09 00732 g006
Figure 7. The difference of pixel shift for various wavelengths.
Figure 7. The difference of pixel shift for various wavelengths.
Photonics 09 00732 g007
Figure 8. (a) Photograph of the experimental system. (b) One frame of measurements by slit-based push-broom hyperspectral imager. (c) One frame of measurements by our encoding-mask-based PBCHI.
Figure 8. (a) Photograph of the experimental system. (b) One frame of measurements by slit-based push-broom hyperspectral imager. (c) One frame of measurements by our encoding-mask-based PBCHI.
Photonics 09 00732 g008
Figure 9. The ground truth captured by the slit-based push-broom hyperspectral imager. (a) The first scene. (b) The second scene.
Figure 9. The ground truth captured by the slit-based push-broom hyperspectral imager. (a) The first scene. (b) The second scene.
Photonics 09 00732 g009
Figure 10. The raw 31-channel cube of the first scene reconstructed from the PBCHI measurements.
Figure 10. The raw 31-channel cube of the first scene reconstructed from the PBCHI measurements.
Photonics 09 00732 g010
Figure 11. The raw 31-channel cube of the second scene reconstructed from the PBCHI measurements.
Figure 11. The raw 31-channel cube of the second scene reconstructed from the PBCHI measurements.
Photonics 09 00732 g011
Figure 12. Spectral intensities of the hyperspectral data cube at different spatial locations marked by the red box in Figure 9a and marked by the white box in Figure 9b. (a) The first scene. (b) The second scene.
Figure 12. Spectral intensities of the hyperspectral data cube at different spatial locations marked by the red box in Figure 9a and marked by the white box in Figure 9b. (a) The first scene. (b) The second scene.
Photonics 09 00732 g012
Table 1. Configuration lists of the designed DAPs for the best performance. ( δ (550) = 0, Δ = 1.2°, i 0 ( λ ) = 0, 400 nm ≤ λ ≤ 700 nm).
Table 1. Configuration lists of the designed DAPs for the best performance. ( δ (550) = 0, Δ = 1.2°, i 0 ( λ ) = 0, 400 nm ≤ λ ≤ 700 nm).
ConfigurationsGlass1Glass2 α 1 α 2 Δ SD ( 10 5 )SSR
1H-LAK54H-FK95N−27.59114.231.22.65.86
2H-FK95NH-LAK5454.76−62.161.22.635.94
3N-BK7H-LAK5474.09−93.651.22.877.17
4F2H-FK95N−21.463.161.23.147.69
5H-FK95NF231.76−43.941.23.167.76
6SF10H-FK95N−12.843.81.23.518.77
7H-FK95NSF1021.89−25.981.23.528.82
8N-BK7F235.66−58.261.23.449.24
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zhu, M.; Qi, J.; Yi, W.; Du, J.; Fu, M.; Zhu, S.; Liu, J.; Li, X. Design and Dispersion Calibration of Direct-Vision Push-Broom Compressive Double-Amici-Prism Hyperspectral Imager. Photonics 2022, 9, 732. https://doi.org/10.3390/photonics9100732

AMA Style

Zhu M, Qi J, Yi W, Du J, Fu M, Zhu S, Liu J, Li X. Design and Dispersion Calibration of Direct-Vision Push-Broom Compressive Double-Amici-Prism Hyperspectral Imager. Photonics. 2022; 9(10):732. https://doi.org/10.3390/photonics9100732

Chicago/Turabian Style

Zhu, Mengjun, Junli Qi, Wenjun Yi, Junyi Du, Meicheng Fu, Shuyue Zhu, Ju Liu, and Xiujian Li. 2022. "Design and Dispersion Calibration of Direct-Vision Push-Broom Compressive Double-Amici-Prism Hyperspectral Imager" Photonics 9, no. 10: 732. https://doi.org/10.3390/photonics9100732

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop