1. Introduction
With the superior characteristics of high spectral and spatial resolution, the traditional slit-based hyperspectral imagers have become significant instruments for many applications, including ecology [
1,
2,
3,
4], geology [
5,
6], agriculture [
7,
8,
9,
10], military [
11,
12], and so on. However, the widespread usages of the traditional slit-based hyperspectral imager are still limited by the well-known annoying issues, such as the enormous quantity of the captured data, which makes transmission and storage overloaded, and the contradiction between the system resolution and the signal-to-noise ratio. Fortunately, the compressive hyperspectral imagers (CHIs) [
13,
14,
15,
16,
17,
18,
19,
20,
21] were developed. In a typical CHI system, a three-dimensional hyperspectral scene, i.e., hyperspectral data cube, can be modulated by an encoding mask and then projected onto a two-dimensional detector array to generate a spatio-spectral multiplexed measurement [
22,
23], which can significantly reduce the data volume and enlarge the light flux; after that, the hyperspectral data cube can be reconstructed via various reconstruction algorithms [
24,
25,
26].
Gratings and prisms are the most commonly used dispersive elements in a CHI system. Generally, the gratings are distinguished with high performance in linear dispersion; however, they suffer from low energy efficiency, complicated fabrication processes, high cost, and high-order harmonic distortion within broadband [
27]. On the contrary, the prisms exhibit high optical efficiency, low fabrication complexity, low cost, and large bandwidth but large nonlinear dispersion [
28,
29] that leads to extra complexity and incompact layout. An abundance of efforts have been exploited to figure out the nonlinearity and deflection issues of prisms, among which the double Amici prisms (DAP) [
30,
31,
32], with properties of nearly linear dispersion and direct-vision, have been widely recognized as a versatile solution for the prism-based spectral imaging systems. In the process of hyperspectral imaging, a rigorous calibration strategy for DAP is necessary to improve the quality of spectral image estimates. The procedure was performed to capture multiframe monochromatic images of the encoding mask at different wavelengths in 1 nm increments within the bandpass of the system [
20]. Obviously, if the bandpass or the focal length of the lens of the push-broom compressive hyperspectral imager (PBCHI) system is changed, the calibration will need to be repeated, which will complicate the calibration of the DAP.
Herein, to satisfy the requirements of hyperspectral imaging in the visible bands, with respect to the direct-vision PBCHI, the geometric and dispersive parameters of DAP are, firstly, designed and optimized; secondly, a calibration method, which is based on the numerical calculation of the DAP model rather than the pixel-wise direct calibration by a monochromator, is put forward to simplify the calibration process and ensure the calibration accuracy; lastly, a DAP-based PBCHI prototype is built, and a series of experiments are conducted to test the proposed calibration method and the performances of the designed and calibrated DAP.
2. Design of Double Amici Prism and Push-Broom Compressive Hyperspectral Imager
For the common single prisms, a certain input collimated light beam will be dispersed with different spectral resolutions over the visible (VIS) region (400 nm∼700 nm); the difference of spectral resolutions between long-wave and short-wave is usually more than one order of magnitude. Therefore, the single prisms are not actually suitable for the push-broom compressive hyperspectral imager (PBCHI) system in which the hyperspectral cube will be very difficult to be resolved accurately. Nevertheless, the dispersion of the double Amici prism (DAP) is more linear, which makes them considered as suitable dispersive devices for PBCHI systems.
A DAP and a corresponding PBCHI prototype were designed and fabricated as shown in
Figure 1.
Figure 1a represents a ray tracing through a DAP,
Figure 1b shows our fabricated DAP, and
Figure 1c displays the direct-vision PBCHI system. In our PBCHI system, the slit in the conventional slit-based hyperspectral imager was replaced by a 2D random encoding mask. The PBCHI prototype was mainly composed of six parts including the imaging lens (L
), an encoding mask, the relay lens (L
) (1:1 imaging), the dispersion device (our fabricated DAP), the relay lens (L
) (1:1 imaging), and the imaging sensor. In more detail, the encoding mask was set at the primary imaging plane of L
and the front focal plane of L
, our designed DAP as the dispersive device was located between L
and L
, the imaging sensor was set at the back focal plane of L
, and the encoding mask was imaging 1:1 on the image sensor. A hyperspectral target scene was, firstly, modulated by a binary random matrix encoding mask; then, the modulated data cube was dispersed by our designed DAP and projected onto a detector array to generate spatio-spectral multiplexed measurements.
For a DAP, the angles follow the modern sign convention [
33] as shown in
Figure 1a. Based on the ray tracing, the refraction of a ray with a wavelength of
through a DAP is given by applying Snell’s law at each interface:
Here we assume that the optical axis is parallel to the prism base shown as the red dashed line in
Figure 1a,
is the apex angle of Glass1 and Glass3,
is the apex angle of Glass2, and Glass1 and Glass3 are identical and symmetrical about Glass2. By making a vertical line from the apex angle of Glass1 to divide
into
and
, where
, and combining Equation (
1), the deflection angle
of a light beam with a wavelength of
through the DAP can be calculated by
The difference in deviation angle between the two extreme wavelengths transmitted by the prism is the dispersion angle
:
here,
= 400 nm,
= 700 nm.
Usually, the designed parameters of the DAP depend on the requirements of the spectral band numbers, the imaging sensor specifications, and some other optical elements inside of the systems. The dispersion can also be expressed as:
where
denotes the distance between the convergence point of wavelength
= 700 nm and that of the central wavelength
= 550 nm on the imaging sensor, and
denotes the distance between the convergence point of wavelength
= 400 nm and that of the central wavelength
= 550 nm on the imaging sensor. Here,
f = 50 mm represents the focal length of
. To meet the spectral resolution requirements for achieving hyperspectral imaging in all VIS light bands, the dispersion is calculated as
1.13° by combining Equation (
4) with the system parameters of imaging sensor pixel size
p = 5.5
m and a spectral band number of 60. Usually, a higher spectral resolution can be achieved at a larger dispersion
; however, as an oversized dispersion,
will cause spatial and spectral distortion, so the dispersion
should not be set too large. Therefore,
= 1.2° is chosen as the dispersion angle of our designed DAP.
The linearity of the dispersion is another key characteristic of the designed parameters of the DAP, which can be characterized by standard deviation (
SD) and spectral sampling rate (
SSR) as follows:
where the gradient of the deviation angle
gives the spectral dispersion per unit wavelength and
n represents the number of bands between 400 nm and 700 nm by step of 0.1 nm, i.e.,
for the design. Generally, smaller indices of
SD and
SSR imply better linearity of the DAP, which can be minimized during the design process. For the designed goal of
(550 nm) = 0 and
1.2°, i.e., a direct-vision wavelength of 550 nm and a dispersion angle of 1.2°, we input the parameters of all glasses listed in a standard optical materials catalog, supplied by CDGM Glass Company and SCHOTT, into the above equations to achieve the optimization of the glass group. As a result, the configuration parameters of the designed DAP are listed in
Table 1, which achieve the best performance with the most linear dispersion and the most compact layout.
Here, F2, SF10, and N-BK7 are common materials for dispersive prisms. As listed in
Table 1, comparing the 1st row configuration parameters (H-LAK54 and H-FK95N) with the 2nd configuration (H-FK95N and H-LAK54), the SD and SSR values of these two DAPs are approximately equal, while the apex angle of the 2nd configuration is less than 65° to allow sufficient design flexibility; moreover, comparing the 2nd configuration (H-FK95N and H-LAK54) with the 7th configuration (H-FK95N and SF10), the SD and SSR values of the 2nd configuration are smaller than the 7th, which indicates that the linearity of the DAP with the 2nd configuration is better.
According to the Schott formula in ZEMAX, six constant coefficients, i.e.,
(0
5), are needed to calculate the refractive index of arbitrary wavelength:
In line with the six constant coefficients of the five materials listed in
Table 1, the variations of refractive index with wavelength are shown in
Figure 2. In fact, the refractive index of H-LAK54 and SF10 are similar (see
Figure 2), while the linearity of H-LAK54 (green curve) is better than that of SF10 (black curve), which implies that H-LAK54 can realize the better dispersion linearity of the DAP. As a result, we choose the 2nd configuration for our designed DAP, i.e., materials of H-FK95N and H-LAK54 and apex angles of 54.76° and −62.16°. In addition, the materials H-FK95N and H-LAK54 have moisture resistance and water resistance which are suitable for processing the DAP.
The deflection angles
(
) after passing through the DAP vary with the incident wavelengths
, as shown in
Figure 3a; here, the relationship between the deflection angle of incident wavelength
and the incident angle
(
) is discussed. As the incident angle
changes, the variation of the deflection angle for different wavelengths is shown in
Figure 3. As can be seen from
Figure 3a,c, for the case of
550 nm (such as
= 400 nm,
= 450 nm, and
= 500 nm), the deflection angle increases with the incident angle from −20° to 0°, while the deflection angle decreases with the increasing incident angle from 0° to 20°, and there exists a maximum deflection angle at
= 0. As shown in
Figure 3a,b,d, when
550 nm (such as
= 550 nm,
= 600 nm,
= 650 nm, and
= 700 nm), there exists a minimum deflection angle at
= 0; in addition, the minimum deflection angle at the central wavelength of 550 nm is 0°.
3. Dispersion Calibration
We propose a novel calibration method based on the numerical calculation of the DAP model. For a DAP-based PBCHI system, the calibration is performed by tracking a distinguishable point of the encoding mask in the direction of dispersion. As shown in
Figure 4, the calibration process consists of the following steps: Step1, the pixel coordinate of the tracked point in the PBCHI system without DAP is first recorded as the reference position
on the imaging sensor. Step2, the fabricated DAP is accurately fixed in the PBCHI system to achieve a system optical axis parallel to the prism base by searching for the minimum (or maximum) deflection angle. The actual dispersion angle can be calibrated according to Equation (
4) by illuminating with the wavelength of
and
, respectively. The actual direct-vision wavelength can be found by adjusting the incident wavelength from
to
in a step of 1nm to find the wavelength whose dispersion shift is 0 relative to the reference position
, where
represents the wavelength scan range and is usually set to 20 nm. Step3, the actual apex angles
and
of the fabricated DAP can be calculated from the above-calibrated dispersion angle and direct-vision wavelength together with the parameters of the DAP glass materials. Step4, combining Equations (
1) and (
7), the dispersion shift
of the DAP at different wavelengths
can be calculated by the DAP apex angles
and
, the focal length
f of the lens
, and the pixel size
p of the imaging sensor. Through the above calibration method of numerical calculations combined with simple experimental measurements, the dispersion shift of the fabricated DAP can be calculated, which shows accuracy compared with the direct-measured result. Compared with the traditional calibration method for the dispersion shift at different wavelengths, our calibration method can simplify the calculation process by avoiding a large number of direct measurements, especially in the case that the components in the PBCHI system have been moved or replaced, and realize the calibration of the DAP dispersive parameters.
Due to the fabrication errors in the practical manufacturing processes and the practical material property deviations, the fabricated DAP for practical spectral imagers requires further dispersion calibrations. Based on the PBCHI system as shown in
Figure 1c, we performed the dispersion calibration for the DAP. In the calibration, a monochromator working together with a Xenon lamp provided quasi monochromatic light. We first calibrated the apex angles
and
of the DAP by tracking the position of the encoding mask at different wavelengths, i.e., a sign “+” on the encoding mask was selected as the tracked target, as shown in
Figure 5a, and then we compared the measured values with the designed values.
It should be pointed out that the position (here, select a certain pixel point) of the tracked target in the PBCHI system without the DAP is considered as the original reference point, whose pixel coordinated along the dispersion direction is
= 965, as shown in
Figure 5b. Then, the DAP is placed in the PBCHI system and the optical axis of the DAP is coincident with the axis of the PBCHI system. In this process, by adjusting the wavelength of the monochromator to 550 nm and carefully rotating the DAP horizontally to change the incident angle of the light beam, the movement of the tracked point in the dispersion direction on the imaging sensor will help us to calibrate the optical axis of the DAP. When the incident angle changes to a certain value by rotating the DAP horizontally, the tracked point will no longer move toward the same direction; instead, it will move toward the opposite direction if we continue to rotate the DAP in the same direction; at this time, the incident angle implies the maximum (or minimum) deflection angle and
(
) = 0, i.e., the optical axis of the DAP is coincident with the axis of the PBCHI system. After that, the DAP can be fixed.
Then, we try to calibrate the actual direct-vision wavelength of the manufactured DAP. As shown in
Figure 5c, when the incident wavelength is set to 550 nm, the pixel coordinate of the tracked position along the dispersion direction is
= 971, which shifts six pixels from the original reference coordinate (
= 965, as shown in
Figure 5b). By carefully adjusting the wavelength of the monochromator from 530 nm to 570 nm by a step of 1nm, the position of the observation point was recorded to find the direct-vision wavelength. When the wavelength is adjusted to 540 nm, the pixel coordinate of the tracked point in the dispersion direction is
= 965, as shown in
Figure 5d, which is identical to the reference coordinate and indicates that
= 540 nm is the actual direct-vision wavelength of the fabricated DAP used in our PBCHI system.
To ensure the spectral accuracy of the reconstructed hyperspectral cube, it is necessary to perform the dispersion angle calibration for the PBCHI. Therefore, we change finely the wavelength from 400 nm to 700 nm by a step of 5 nm to measure the actual dispersion positions of the tracked point for various specific bands of the imager, and the pixel number
N shifted from the original reference point (
= 965) is measured and listed in
Figure 6. Then, the calibrated dispersion angle
is calculated by Equation (
4), which is approximately 0.04° larger than the designed value, i.e.,
= 1.24°. According to the calibrated direct-vision wavelength and dispersion angle, combined with Snell’s law, the apex angle
of the DAP in the imager is calculated to be approximately 1.4° larger than the designed value, i.e.,
= 56.16°, and
is calculated to be approximately 1.67° smaller than the designed one, i.e.,
= −63.83°. The pixel number
N can be expressed
Here,
is the beam exit angle which is calculated by Equations (
1) and (
7),
is related to the apex angle, and
p is the pixel size of the imaging sensor.
As shown in
Figure 6, the blue solid line represents the theoretical designed value
, which is calculated by Equation (
8) combined with the designed apex angle and dispersion angle before calibration; the red hollow-dotted line represents the experimental measured value
, and the black solid-dotted line represents the calibrated value
from the calibrated apex angle and dispersion angle of the DAP according to Equation (
8), which is approximately the same as the
. Moreover, the mean squared error (MSE) was employed to give an evaluation of the difference between the calculated dispersion shifts
through our method with the direct-measured values
of different wavelengths. A lower MSE index implies lower difference and higher accuracy. The MSE index between
and
is 0.1774, far less than the index between
and
that is 24.2134, which demonstrates that our calibration can achieve accuracy.
The pixel shift differences before and after the calibration can be respectively expressed as
Before calibration, the pixel shift difference
is shown by the black dotted line in
Figure 7, and the red solid line is the linear fitting line of the
. It can be seen that
increases with the wavelength.
represents the pixel shift difference after calibration as marked by the blue dotted line in
Figure 7, and the yellow solid line is the linear fitting line. Obviously, the slope of the linear fitting line of
is close to 0, and
can be considered basically unchanged with the increase of the wavelength; that is, the calculated value from calibrated parameters of the DAP is basically consistent with the measured value.
4. Experimental Results
To test the performance of our PBCHI system based on the calibrated DAP as shown in
Figure 1c, we constructed a series of push-broom hyperspectral imaging experiments as shown in
Figure 8a. The scenes, located about 7 m away from
of the prototype, were illuminated by LED light. The encoding mask in the PBCHI prototype was generated from a Gaussian random matrix with a size of 96 × 48, in which the elements greater than 0 were set to 1 and the elements less than or equal to 0 were all set to 0, and the smallest encoding mask element is four times the size of a single pixel of the imaging sensor. The spectral filtering was performed by a 450–650 nm bandpass filter. We pushed the prototype by a stepper motor and, meanwhile, collected the multi-frame spatio-spectral multiplexed measurements of the scene to achieve a large field of view (FOV), and one frame of measurements by the random-encoding-mask-based PBCHI is shown in
Figure 8c.
For comparison, one frame of measurements by the slit-based push-broom hyperspectral imager is shown in
Figure 8b, which can be captured by replacing the encoding mask in the PBCHI prototype with a slit. The width of the slit is equal to the single pixel size. As shown in
Figure 9, the ground truth with 139 channels of two hyperspectral scenes can be acquired from the measurements by the slit-based push-broom hyperspectral imager.
Figure 10 and
Figure 11 show the raw cubes with 31 channels reconstructed by compressive algorithm regularized least squares (RLS) [
34,
35] for the first scene and the second one, respectively. We push the whole PBCHI prototype to acquire a sequence of multiplexed measurements; in detail, the first scene (
Figure 10) is reconstructed from 85 frames of multiplexed measurements, while the second scene (
Figure 11) is reconstructed from 50 frames of measurements. The compression ratio is about 4.
It is well-known that the PBCHI is rather sensitive to various noises, such as photon shot noise, dark current noise, background noise, and so on. At the same time, the encoding mask processing errors, the residual calibration errors, the push-broom sampling instability, and the sparse reconstruction process will also introduce significant artifacts, which usually turn out to be severe and appear as defects such as stripes and dead pixels. As a result, compared with the ground truths in
Figure 9, there are obvious noises and stripes in the raw reconstructed cubes as shown in
Figure 10 and
Figure 11.
To test the spectral accuracy of the raw reconstructed cubes of the PBCHI prototype, the spectral intensities for different spatial locations of the two scenes are shown in
Figure 12. The spectral intensities of the regions marked by the red box in
Figure 9a and the corresponding regions in
Figure 10 are shown in
Figure 12a, and the spectral intensities of the regions marked by the white box in
Figure 9b and the corresponding regions in
Figure 11 are shown in
Figure 12b. Obviously, the spectral signatures of the reconstructed cubes of the PBCHI system show consistency with the ground truth captured by the slit-based push-broom hyperspectral imager, which indicates the spectral accuracy of the DAP-based PBCHI.
5. Conclusions and Discussion
In this paper, firstly, based on the direct-vision push-broom compressive hyperspectral imager (PBCHI), a geometric and dispersive parameter of the double Amici prism (DAP) is optimized to meet the requirements of hyperspectral imaging in the visible bands.
Secondly, a novel calibration method for the dispersion device DAP model is put forward where the apex angles of the fabricated DAP are calibrated; as a result, the dispersion shift of the PBCHI system at different wavelengths can be calculated if the focal length f of the lens and the pixel size p of the image sensor used in the PBCHI system are known.
Lastly, a PBCHI prototype is built to test the performances of the designed and calibrated DAP and the hyperspectral imager, and it is found that the dispersion performance after calibration is more consistent with the experimental test value than before calibration through the comparison of evaluation index MSE and the differences of the pixel shift. Moreover, the reconstructions cube and the spectral intensity demonstrate that the dispersion calibration achieves the hyperspectral cube accuracy reconstruction especially in spectrum, which indicates the spectral accuracy of the PBCHI system.
This work can simplify the calibrated process and turn the conventional pixel-wise dispersive shift calibration by a monochromator into a group of numerical calculations for the DAP-based hyperspectral imager, and the research will be helpful for promoting PBCHI technologies for achieving further widely used applications.