Next Article in Journal
Lipid Remodeling in the Mitochondria upon Ageing during the Long-Lasting Cultivation of Endomyces magnusii
Previous Article in Journal
Could Gnomoniopsis castaneae Be Used as a Biological Control Agent against Insect Pests?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Temperature Estimation Adaptive to Variables over Distance Using Infrared–LiDAR

Department of Electronic Engineering, Yeungnam University, 280 Daehak-ro, Gyeongsan 38541, Gyeongbuk, Korea
*
Author to whom correspondence should be addressed.
Appl. Sci. 2021, 11(9), 4063; https://doi.org/10.3390/app11094063
Submission received: 23 March 2021 / Revised: 19 April 2021 / Accepted: 26 April 2021 / Published: 29 April 2021
(This article belongs to the Section Electrical, Electronics and Communications Engineering)

Abstract

:
Measuring accurate surface temperature using a long-wave infrared camera and a non-contact thermometer, is very difficult due to variables such as atmospheric transmittance, emissivity, and influences from the environment such as atmosphere, sun, and dust. Conventional approaches use geometric correction or atmospheric transmittance modeling for temperature correction. However, these approaches have limitations in finding an accurate temperature because it is difficult to fully model a physical phenomenon. In this paper, a new temperature estimation method using distance information of LiDAR and digital count of long-wave infrared camera is proposed. The proposed method estimates the temperature by redefining the mapping function between radiation and digital count by distance. Using the proposed method, if the digital count is measured at a specific distance, accurate temperature can be estimated through the redefined Radiation-Digital count mapping function at a specific distance. The most important property of proposed method is that complex physical modeling is complemented by mapping function of specific distances. In addition, digital counts that change according to the distance at the same temperature required for the mapping function are obtained through linear interpolation using digital count of specific distances. Experimental results using a blackbody, long-wave infrared camera and LiDAR verify that the proposed method estimates the precise temperature. In addition, through experiments on humans, it shows the possibility of accurate body temperature measurement through fusion of long-wave infrared cameras and LiDAR in the future. However, as a limitation, a new calibration is required when the temperature and humidity of the atmosphere change.

1. Introduction

Temperature measurement and heat sensing are widely used in various fields, such as military and industrial applications and medical health [1,2,3,4,5,6,7,8]. For temperature measurement, there are two main methods. One is a non-contact thermometer that measures temperature without contact, so it is mainly used for industrial high temperature measurement. The other is a contact thermometer that is primarily used when accurate temperature measurements are required, such as body temperature measurements. However, due to the risk of infection, it is increasingly preferred to use a non-contact thermometers to measure body temperature [9]. In particular, due to the recent spread of the COVID-19 epidemic [10,11,12,13], body temperature measurements using infrared cameras, a non-contact thermometer, is essential in crowded places such as airports and event venues. Therefore, accurate temperature measurement using infrared cameras has become an important challenge.
In long wave infrared cameras, the digital count is obtained through radiation. Therefore, the temperature is estimated through the obtained digital count. In fact, the model for measuring the radiation of an object with a long-wave infrared camera is shown in Equation (1).
L o b s ( λ ) = τ ( λ ) ε ( λ ) L o b j ( λ , T o b j ) + ( 1 ε ( λ ) ) ( L t + L s ) + L s ^ ( λ ) + L t ^ ( λ )
L o b s ( λ ) is the observed at-sensor object radiation; λ is wavelenth; ε ( λ ) is spectral emissivity of object; L o b j ( λ , T o b j ) is the spectral radiation of the object, assuming a blackbody in the Planck function with the object temperature ( T o b j ); τ ( λ ) is the spectral atmospheric transmittance, and L s ^ ( λ ) and L t ^ ( λ ) are the diffuse solar and thermal path radiation, respectively, reaching the sensor. Figure 1 intuitively shows Equation (1). Radiation actually measured is affected by atmospheric and solar noise and atmospheric transmittance according to distance. In fact, according to [14], visible radiation from the sun can be neglected from the mid-wave infrared band (4.2–5.6 μm). Likewise, the 8–14 μm band range in which the long wave infrared camera works, thermal radiation is important and visible radiation from the sun is negligible. Furthermore, emissivity is a very important factor in temperature estimation. Emissivity is the ratio of radiation emitted from a blackbody at the same temperature as the radiation emitted from the surface of an object. The emissivity of an ideal blackbody is 1, and human skin is mainly calculated as 0.98.
In previous studies, temperature measurements attempted to estimate the temperature by calibrating for various variables. In [15], a method for estimating temperature by compensating for the size-of-source effect is proposed. In [16], the effect of the angle of view on the temperature measurement was analyzed using an infrared camera and an infrared radiator. In [17], it attempts to estimate precise temperature based on the nonlinear response of individual pixels. Ref. [18] proposes a method to reduce the influence of atmospheric dust in temperature measurement. In [19], analyzes the effect on atmospheric transmittance, and based on this, [20] proposes a method to reduce the influence of atmospheric transmittance in infrared cameras. In [21], the temperature is estimated as compensation for each effect by analyzing the object temperature, environmental temperature, and atmospheric transmittance according to the distance.
As mentioned above, conventional approaches to temperature estimation have attempted to estimate accurate temperature by means of geometric compensation, compensation for atmospheric transmittance, and compensation for the surrounding environment such as atmosphere, sun, and dust. However, there is a limit to estimating accurate temperature by considering various variables with only the measured digital count.
In this paper, we propose a new method for accurate temperature estimation using long-wave infrared cameras and LiDAR. Unlike previous studies, distance information using LiDAR is additionally required to use the proposed method. The proposed method first obtains a digital count for a specific distance and builds a Radiation-Digital count mapping function for each distance through this. The mapping function constructed by distance reflects the effects of various variables (atmospheric and solar Radiation, emissivity, atmospheric transmittance, etc.) by distance. It is used to estimate the exact temperature by obtaining the distance to the object and the digital count for the object. If an object exists at a specific distance where the mapping function is not established, it is solved through linear interpolation. However, the proposed method also has limitations. In fact, the effects of CO2 absorption and water vapor are large in measurements made by infrared cameras. Therefore, the digital count is affected a lot by the air temperature and water vapor between the object and the camera. Therefore, if these conditions change, there is a limitation that recalibration is required.
The contribution of this paper can be summarized as follows:
(1)
We analyze Radiation-Digital count mapping and blackbody radiation in the long-wave infrared band.
(2)
We propose a method to estimate accurate temperature through Temperature-Radiation and Radiation-Digital mapping by distance.
(3)
We verify that the proposed method accurately estimates the temperature of a blackbody over distance, and through body temperature experiments, we establish the possibility of accurate body temperature measurement with future LiDAR-Infrared camera fusion.
The remainder of this paper is organized as follows. Section 2 explains the Planck’s law and radiation-digital counts mapping function as background knowledge. Section 3 explains the proposed method, a mapping function for each distance, and a mapping function using interpolation. Section 4 evaluates the accuracy of the proposed method for each distance through the temperature of the blackbody, and shows that it is possible to accurately estimate the temperature by fusion of LiDAR-Infrared cameras in the future through the experiment of measuring body temperature according to the distance. The paper concludes in Section 5.

2. Background

In this section, before describing the proposed method, we will examine the Planck’s law [22,23,24] and Radiation-Digital count mapping, which are the background.

2.1. Planck’s Law

Before Planck’s Law in 1900, blackbody radiation consisted of two theories [25]. First, in 1879, with Stefan’s experimental [26] discovery of the relationship between radiant energy and temperature, then in 1884, Boltzmann theoretically summarized Stefan’s experiment [27]. The Stefan–Boltzmann law states that the sum of the energy of all wavelengths emitted per unit time in a unit area of a blackbody at temperature T is proportional to the absolute temperature to the fourth power. Equation (2) is the Stefan–Boltzmann law. σ is a Stefan–Boltzmann constant, σ = 5.6696 × 10 8 W/m2·K4.
L ( T ) = σ T 4
Next, in 1893, Wilhelm Wien summarized that absolute temperature is inversely proportional to the wavelength at which the energy density is at its maximum [28]. Wien’s displacement law is Equation (3). From the Planck curve in Figure 2a, it can be seen that the lower the temperature, the longer the wavelength at the maximum energy. b is a Wien’s constant, b = 2.898 × 10 3 m·K.
λ m a x = b T
In 1900, Planck organized the two previous theories [22,23,24] as Planck’s law. The density of radiant energy emitted at a specific temperature and specific wavelength of an ideal blackbody can be obtained through Planck’s law Equation (4).
L ( λ , T ) = 2 h c 2 λ 5 1 e h c λ k T 1
T is the absolute temperature of the blackbody, k is the Boltzmann constant, k = 1.38 × 10 16 erg/K; h is the Planck constant, h = 6.625 × 10 27 erg-sec; c is the speed of light, c = 3 × 10 8 m/s. Radiation measured at a specific temperature is obtained by integrating the wavelength band that can be measured with an infrared camera. If the infrared camera can measure from λ 1 to λ 2 , you can obtain the radiation corresponding to the temperature by Equation (5).
L ( T ) = λ 1 λ 2 2 h c 2 λ 5 1 e h c λ k T 1 d λ
Furthermore, from Figure 2b, it can be seen that the wavelength at the maximum energy at room temperature is actually located in the long-wave infrared band (8–14 μm). Therefore, it can be seen that the long-wave infrared camera is suitable for room temperature measurement.

2.2. Radiation-Digital Count Mapping

The method of estimating temperature by mapping radiation and digital count obtained from infrared camera was used in [29,30,31,32]. This method of estimating the temperature first calculates the radiation of the temperature range ( T m i n T m a x ) to be measured through Equation (5). In this case, the wavelength range ( λ 1 λ 2 ) is applied to the range that the infrared camera used can measure. Thereafter, as shown in Figure 3, the digital count ( G m i n G m a x ) for T m i n and T m a x obtained through the blackbody and infrared camera and the previously calculated radiation ( L m i n L m a x ) mapping function is obtained. After that, when a specific digital count is obtained through measurement, the radiation is obtained through the mapping function, and the corresponding temperature is estimated by the radiation. For more information, see Figure 4 and the Equations (5)–(8). The Radiation-Digital Count mapping function is expressed in Equation (6) using the relationship curve between the radiation and digital count according to the temperature in Figure 4.
G ( L ) = a [ L L ( T m i n ) ] + G m i n
where a is the slope of the mapping function, obtained by Equation (7):
a = G m a x G m i n L ( T m a x ) L ( T m i n )
Therefore, you can get Equation (6) to obtain a specific L ( G o b j ) through Equation (8):
L ( G o b j ) = G o b j G m i n a + L ( T m i n )
When the digital count is measured, the radiation is obtained through Equation (8), and the temperature of the object ( T o b j ) is determined through the value of T that makes L ( G o b j ) = L ( T ) from L ( T ) previously calculated by Planck’s law.

3. Proposed Method

The proposed temperature estimation process consists largely of three steps. In simple terms, the STEP 1,2 offline process is the process of obtaining distance-specific data through infrared camera and LiDAR in advance. The STEP 3 online process is the process of estimating the temperature through the distance-specific mapping function of the radiation-digital count through the acquired data and the digital count and distance of the measured object. Figure 5 is the flow of the whole process of the proposed method. To estimate the temperature, you can first perform the offline process of steps 1 and 2 at least once, and then continue to estimate the temperature through the online process of 3 steps. This section details the three steps.

3.1. Offline: Data Acquisition and Interpolation

An offline process is required before the process of estimating the temperature. In this process, digital counts for each distance obtained through an infrared camera-LiDAR and radiation according to Planck’s law are used to make radiation-digital count mapping function adaptable to a variable according to distance. Offline process consists of “STEP 1: Data Acquisition” and “STEP 2: Digital Count Interpolation” processes.
The “STEP 1: Data Acquisition” process involves obtaining a digital count for each distance and calculating the radiation through Planck’s law. As shown in Figure 6, the digital count obtains the highest temperature digital count ( G m a x ) and the lowest temperature digital count ( G m i n ) for a specific distance in LiDAR over a range of temperatures to be measured with a blackbody and infrared camera. The reason why it is important to obtain a digital count for each distance is that it is possible to obtain a digital count value that is adapted to the influence of variables such as atmospheric transmittance according to the distance. Figure 7 shows the digital count value that decreases due to the influence of the atmosphere at the same temperature over distance. G m a x and G m i n measured by this process are used in the interpolation of STEP 2. Furthermore, the radiation calculation process obtains the radiation of each temperature through Planck’s law in the temperature range to be measured. The calculated radiation ( L ( T ) ) is then used to obtain the Radiation-Digital Count mapping function for temperature estimation in STEP 3.
However, it is not possible to measure the digital count for all distances in advance. In order to solve this problem, the “STEP 2: Digital Count Interpolation” process obtains G m i n ( x ) and G m a x ( x ) for the distance by linear interpolation of G m i n and G m a x acquired by distance, as shown in Figure 8. As such, the linear interpolation of the digital count according to the distance is equivalent to the following Equations (9)–(11).
D = d 0 , d 1 , , d n 2 , d n 1 G m i n = G m i n d 0 , G m i n d 1 , , G m i n d n 2 , G m i n d n 1 G m a x = G m a x d 0 , G m a x d 1 , , G m a x d n 2 , G m a x d n 1
G m i n ( x ) = x x 1 x 2 x 1 ( G m i n x 2 G m i n x 1 ) + G m i n x 1 , x 1 = m a x d D : d x x 2 = m i n d D : d x
G m a x ( x ) = x x 1 x 2 x 1 ( G m a x x 2 G m a x x 1 ) + G m a x x 1 , x 1 = m a x d D : d x x 2 = m i n d D : d x
The sets of Equation (9) mean the distance obtained in STEP 1 and the corresponding G m i n and G m a x . For example, the minimum and maximum digital counts measured at distance d 0 are G m i n 0 and G m a x 0 . Equations (10) and (11) are interpolation equations used to obtain the digital count at an unmeasured distance. Through this, when measuring an object in STEP 3, as shown in Figure 9, the mapping function according to the distance can be newly defined by newly setting the G m i n and G m a x values according to the distance obtained from LiDAR. The Radiation-Digital count mapping function according to the distance is shown in Figure 10. Therefore, precise temperature estimation is possible through a mapping function that adapts to various variables according to distance.

3.2. Online: Temperature Estimation Using Infrared-LiDAR

After going through the above offline process at least once, the temperature can still be estimated using the online process. In this process, distance and digital count are obtained through LiDAR and Infrared camera for an object, and temperature is estimated by configuring a mapping function.
The “STEP 3: Object Measurement” process uses LiDAR and infrared cameras to measure objects as shown in Figure 11. The distance to the object can be obtained using LiDAR, and the digital count ( G o b j ) by the radiation of the object can be obtained through the infrared camera. The distance(d) obtained through LiDAR is given as input to the linear interpolation functions G m i n ( x ) and G m a x ( x ) previously defined in STEP 2 to obtain the minimum and maximum digital counts ( G m i n , G m a x ) according to a specific distance. Afterwards, the radiation ( L ( T m a x ) , L ( T m i n ) ) calculated in STEP1 and the digital count ( G m a x , G m i n ) of a specific distance obtained through the interpolation function allows the Radiation-Digital count mapping function to be newly defined. L ( G o b j ) can be obtained by applying the digital count ( G o b j ) measured by the infrared camera to a newly defined mapping function, and the value of T that satisfies the pre-calculated L ( T ) = L ( G o b j ) is estimated as the object temperature T o b j .

4. Experimental Results

This section describes equipment for experimentation and data set acquisition scenarios. It also shows the performance of the proposed method and confirms the possibility of LiDAR-Infrared camera fusion in the future through a body temperature measurement experiment.

4.1. Experimental Equipment and Datasets

4.1.1. Equipment

Equipment used in the experiment includes infrared camera, LiDAR, and blackbody. Infrared cameras are used to get a 16-bit digital count according to radiation, and LiDAR is used to get the distance to an object. Furthermore, the blackbody is used to emit the exact radiant energy according to the temperature of T m i n and T m a x .
Infrared camera is a (Figure 12a) FLIR T620, and its main specifications are as Table 1. In particular, the spectral range is 7.8–14 μm. Therefore, in STEP 1 of Figure 5, it is set as λ m i n = 7.8 μm, λ m a x = 14 μm. Therefore, T m a x at T m i n radiation can be calculated by integrating Planck’s law over the [ λ m i n , λ m a x ] interval.
LiDAR is a (Figure 12b) Velodyne VLP-16, and its main specifications are shown in Table 2. LIDAR is a sensor that measures the distance through the reflection of a laser on an object. The distance to an object can be obtained as a distance (Equation (12)) through x, y, z coordinates obtained through LiDAR.
d i s t a n c e = x 2 + y 2 + z 2
The blackbody is shown in Figure 12c, and the main specifications are shown in Table 3. The blackbody emits accurate radiation at a specific temperature, and in STEP 3: Measurements of the Object, the temperature set for the blackbody is used as the ground truth to measure its performance. In practice, the emissivity of an ideal blackbody is 1, but due to hardware limitations, the emissivity of the blackbody used is about 0.96. Therefore, when calculating the radiation, it must be multiplied by 0.96. The emissivity of the skin of a person is about 0.98. Therefore, in the experiment for measuring body temperature, the radiation is multiplied by 0.98.

4.1.2. Datasets

As for the data acquisition environment, as shown in Figure 13a, the digital count and distance of the blackbody were measured using the infrared camera and LiDAR together. Figure 13b shows the LiDAR map. The part marked by the red dot in the center is the location of LiDAR. The distance to the actual object is obtained by applying x, y, z points to Equation (12).
Datasets set the temperature of the blackbody at T m i n = 25 °C and T m a x = 45 °C, and measured T m i n and T m a x in 1 m increments, excluding 0.3 m from about 0.3 m–10 m distance. Since the proposed method uses interpolation, the proposed method can be used if there are data about T m i n and T m a x at appropriate distances. Figure 14 is the thermal image of the blackbody by distance obtained through the infrared camera. Furthermore, to measure the performance of the proposed method, a digital count by distance was obtained for the 5 °C interval temperature between T m i n and T m a x . In addition, additional data on the blackbody at distances of about 3.5 m and 7.5 m were collected. In addition, digital counts for each distance were obtained for humans to ensure that the same temperature estimates were made at each distance for body temperature. Thus, the total acquisition data set was acquired at 5 temperatures at 5 °C intervals from 25 °C to 45 °C and 11 points at 1 m intervals of approximately 0.3 m to 10 m. It was also acquired at two points, 3.5 m and 7.5 m. Thus, 65 data for black bodies and 11 data for humans were obtained.

4.2. Experiment: Performance of the Proposed Method

In this section, temperature estimation for a specific distance is compared through three methods. The first method is the estimation result before temperature correction with a single mapping function at a close distance, the second method is the result of temperature correction through various variables provided by FLIR, and the third is the result through the proposed method. Temperature correction via variables provided by FLIR can be done in FLIR Tools [33] with temperature correction via emissivity, distance, atmospheric temprature, relative humidity, etc. Figure 15 can be obtained through the Table 4, Table 5 and Table 6, which are the results of temperature estimation through each method. It can be seen that the temperature estimation result before correction in Table 4 decreases as the distance increases due to the variable according to the distance. Furthermore, with the FLIR correction in Table 5, it is difficult to estimate the exact temperature because values of various variables are required. It can be seen from Table 6 that the proposed method of obtaining the distance through LiDAR and redefining the mapping function for each distance can accurately estimate the temperature at most distances.
Table 7 shows the estimated results for each temperature at a distance (3.5 m, 7.5 m) not previously measured. In the proposed method, for distances not measured in advance, the temperature is estimated by obtaining a digital count using interpolation and defining a new mapping function. In particular, in this result, it can be seen that the temperature estimation error of the proposed method is low through Mean Square Error (MSE).

4.3. Experiment: Temperature Estimation for a Person

In body temperature measurement, since the exact value of the surface temperature of a person cannot be known, body temperature is estimated similarly at each distance, showing that the proposed method is also suitable for body temperature measurement. It also shows the possibility of estimating body temperature through fusion of infrared cameras and LiDAR in the future. Figure 16 is an image of a person obtained from an infrared camera by distance. Digital count is acquired from the person face area and used for temperature estimation. Furthermore, Figure 17 shows the LiDAR map at 6 m. Distance to a person can be obtained obtained through LiDAR (x, y, z) by distance. Unlike a blackbody, for person measurements, since the exact temperature value cannot be known, the estimated temperature for each distance is similar, confirming the validity of the proposed method. In addition, when estimating the temperature for an object other than a blackbody, the emissivity is an important factor and should be reflected in the radiation. Therefore, in the experiment, the human emissivity is set to 0.98, and the radiation is obtained through L ( G o b j ) e m i s s i v i t y o f b l a c k b o d y e m i s s i v i t y o f o b j e c t and T is estimated through this. As a result of estimating the temperature by defining a new mapping function by obtaining the distance to a person through LiDAR and obtaining a digital count through it, it can be seen that similar temperature for each distance is estimated as shown in Table 8.
Through the proposed method and the fusion of LiDAR and IR cameras, it will be possible to quickly and accurately screen people with fever from the general public by checking the body temperature of many people. Through this, it can be usefully used in airports or buildings with frequent access by people.

5. Conclusions

Temperature estimation is used in a variety of medical, industrial, and military applications. In particular, body temperature measurement has emerged as a very important issue due to a fever-producing disease such as COVID-19. However, it is difficult to accurately estimate temperature due to variables such as atmospheric transmittance. In this study, we propose a method of estimating the temperature for each distance using LiDAR, which can additionally acquire distance information in an infrared camera. The proposed method constructs a digital count-radiation mapping function that reflects the effect of variables by distance, and then, when a digital count value comes in at a specific distance, the accurate temperature is estimated through the mapping function at a specific distance. In addition, the problem of not being able to build a mapping function for all distances in advance is solved through digital count interpolation. The proposed method shows that it is possible to accurately estimate temperature by distance at various temperatures, and also shows the possibility of automating body temperature measurement through Infrared-LiDAR fusion in the future as an experiment on humans. However, changes in atmospheric temperature and humidity conditions are mentioned as limitations. Therefore, it is necessary to study a robust temperature estimation method that reflects air temperature and humidity in addition to distance information.

Author Contributions

Conceptualization, J.K.; methodology, J.K. and S.K.; Software, J.K.; validation, J.K. and S.K.; formal analysis, J.K. and S.K.; data curation, J.K. and S.K.; writing—original draft preparation, J.K.; writing—review and editing, J.K. and S.K.; supervision, S.K.; project administration, S.K.; funding acquisition, S.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by NRF (NRF-2018R1D1A3B07049069), KIAT (P0008473), and 2021 Yeungnam University Research Grants.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The datasets generated during the current study are available from the corresponding author on reasonable request.

Acknowledgments

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2018R1D1A3B07049069). This work was supported by the 2021 Yeungnam University Research Grants. This paper was supported by Korea Institute for Advancement of Technology (KIAT) grant funded by the Korea Government (MOTIE) (P0008473, HRD Program for Industrial Innovation).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hudson, R.; Hudson, J.W. The military applications of remote sensing by infrared. Proc. IEEE 1975, 63, 104–128. [Google Scholar] [CrossRef]
  2. Osornio-Rios, R.A.; Antonino-Daviu, J.A.; de Jesus Romero-Troncoso, R. Recent industrial applications of infrared thermography: A review. IEEE Trans. Ind. Inform. 2018, 15, 615–625. [Google Scholar] [CrossRef]
  3. Jones, B.F. A reappraisal of the use of infrared thermal image analysis in medicine. IEEE Trans. Med. Imaging 1998, 17, 1019–1027. [Google Scholar] [CrossRef] [PubMed]
  4. Ring, E.; Ammer, K. Infrared thermal imaging in medicine. Physiol. Meas. 2012, 33, R33. [Google Scholar] [CrossRef] [PubMed]
  5. Cilulko, J.; Janiszewski, P.; Bogdaszewski, M.; Szczygielska, E. Infrared thermal imaging in studies of wild animals. Eur. J. Wildl. Res. 2013, 59, 17–23. [Google Scholar] [CrossRef] [Green Version]
  6. Lahiri, B.; Bagavathiappan, S.; Jayakumar, T.; Philip, J. Medical applications of infrared thermography: A review. Infrared Phys. Technol. 2012, 55, 221–235. [Google Scholar] [CrossRef] [PubMed]
  7. Ring, E.; Ammer, K. The technique of infrared imaging in medicine. Thermol. Int. 2000, 10, 7–14. [Google Scholar]
  8. Longbottom, J.; Lanham, J. Cutting temperature measurement while machining—A review. Aircr. Eng. Aerosp. Technol. 2005. [Google Scholar] [CrossRef]
  9. Ning, B.; Wu, Y. Research on non-contact infrared temperature measurement. In Proceedings of the 2010 International Conference on Computational Intelligence and Software Engineering, Wuhan, China, 10–12 December 2010; IEEE: Piscataway, NJ, USA, 2010; pp. 1–4. [Google Scholar] [CrossRef]
  10. Khan, S.; Ali, A.; Siddique, R.; Nabi, G. Novel coronavirus is putting the whole world on alert. J. Hosp. Infect. 2020, 104, 252–253. [Google Scholar] [CrossRef] [Green Version]
  11. Ebeid, A.G.; Selem, E.; Abd El-kader, S.M. Early detection of COVID-19 using a non-contact forehead thermometer. In Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2020, Cairo, Egypt, 19–21 October 2020; Springer: Berlin/Heidelberg, Germany, 2020; pp. 314–323. [Google Scholar] [CrossRef]
  12. Velavan, T.P.; Meyer, C.G. The COVID-19 epidemic. Trop. Med. Int. Health 2020, 25, 278. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Notari, A. Temperature dependence of COVID-19 transmission. Sci. Total Environ. 2021, 763, 144390. [Google Scholar] [CrossRef] [PubMed]
  14. Kim, S.; Shin, J.; Kim, S. AT2ES: Simultaneous Atmospheric Transmittance-Temperature-Emissivity Separation Using Online Upper Midwave Infrared Hyperspectral Images. Remote Sens. 2021, 13, 1249. [Google Scholar] [CrossRef]
  15. Saunders, P. Correcting radiation thermometry measurements for the size-of-source effect. Int. J. Thermophys. 2011, 32, 1633–1654. [Google Scholar] [CrossRef]
  16. Litwa, M. Influence of angle of view on temperature measurements using thermovision camera. IEEE Sens. J. 2010, 10, 1552–1554. [Google Scholar] [CrossRef]
  17. Dai, S.S.; Yan, X.H.; Zhang, T.Q. Study on high-precision temperature measurement of infrared thermal imager. Infrared Phys. Technol. 2010, 53, 396–398. [Google Scholar] [CrossRef]
  18. Pan, D.; Jiang, Z.; Gui, W.; Jiang, K.; Maldague, X. Compensation Method for the Influence of Dust in Optical Path on Infrared Temperature Measurement. IEEE Trans. Instrum. Meas. 2020, 70, 1–11. [Google Scholar] [CrossRef]
  19. LaRocca, A.J. Methods of calculating atmospheric transmittance and radiance in the infrared. Proc. IEEE 1975, 63, 75–94. [Google Scholar] [CrossRef]
  20. Zhang, Y.C.; Chen, Y.M.; Fu, X.B.; Luo, C. The research on the effect of atmospheric transmittance for the measuring accuracy of infrared thermal imager. Infrared Phys. Technol. 2016, 77, 375–381. [Google Scholar] [CrossRef]
  21. Zhang, Y.C.; Chen, Y.M.; Fu, X.B.; Luo, C. A method for reducing the influence of measuring distance on infrared thermal imager temperature measurement accuracy. Appl. Therm. Eng. 2016, 100, 1095–1101. [Google Scholar] [CrossRef]
  22. Planck, M. On the law of distribution of energy in the normal spectrum. Ann. Phys. 1901, 4, 1. [Google Scholar]
  23. Planck, M. The Theory of Heat Radiation; Dover Publications: New York, NY, USA, 2013. [Google Scholar]
  24. Planck, M. Über das gesetz der energieverteilung im normalspektrum. In Von Kirchhoff bis Planck; Springer: Berlin/Heidelberg, Germany, 1978; pp. 178–191. [Google Scholar] [CrossRef]
  25. Montambaux, G. Generalized Stefan–Boltzmann Law. Found. Phys. 2018, 48, 395–410. [Google Scholar] [CrossRef] [Green Version]
  26. Stefan, J.; und Staatsdruckerie, K.K.H. Über die Beziehung Zwischen der Wärmestrahlung und der Temperatur; Aus der kk Hof-und Staatsdruckerei: Vienna, Austria, 1879. [Google Scholar]
  27. Boltzmann, L. Ableitung des Stefanschen Gesetzes, 1) betreffend die Abhängigkeit der Wärmestrahlung von der Temperatur aus der elektromagnetischen Lichttheorie. In Von Kirchhoff bis Planck; Springer: Berlin/Heidelberg, Germany, 1978; pp. 152–156. [Google Scholar] [CrossRef]
  28. Baird, J.K.; King, T.R. A wien displacement law for impact radiation. Int. J. Impact Eng. 1999, 23, 39–49. [Google Scholar] [CrossRef]
  29. Kim, B.S.; Kwon, H.J.; Bae, T.W.; Ahn, S.H.; Kim, Y.C.; Sohng, K.I. Wavelength-band Transformation Method of Gray-body Infrared Image Using Surface Temperature Estimation. Int. J. Control Autom. 2013, 6, 151–162. [Google Scholar] [CrossRef]
  30. Bae, T.; Kim, Y.; Ahn, S. IR-band conversion of target and background using surface temperature estimation and error compensation for military IR sensor simulation. Sensors 2019, 19, 2455. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Yun, S.; Kim, S. TIR-MS: Thermal Infrared Mean-Shift for Robust Pedestrian Head Tracking in Dynamic Target and Background Variations. Appl. Sci. 2019, 9, 3015. [Google Scholar] [CrossRef] [Green Version]
  32. Ryu, J.; Kim, S. Heterogeneous Gray-Temperature Fusion-Based Deep Learning Architecture for Far Infrared Small Target Detection. J. Sens. 2019, 2019. [Google Scholar] [CrossRef] [Green Version]
  33. FLIR Tools. FLIR Tools Thermal Analysis and Reporting (Desktop)|FLIR Systems. Available online: https://www.flir.com/products/flir-tools/ (accessed on 29 April 2015).
Figure 1. Principle of the radiation measured by a long-wave infrared camera that intuitively shows Equation (1).
Figure 1. Principle of the radiation measured by a long-wave infrared camera that intuitively shows Equation (1).
Applsci 11 04063 g001
Figure 2. Planck’s curve: (a) from 2000 K to 7000 K, (b) at room temperature.
Figure 2. Planck’s curve: (a) from 2000 K to 7000 K, (b) at room temperature.
Applsci 11 04063 g002
Figure 3. Blackbody T m i n , T m a x measurement.
Figure 3. Blackbody T m i n , T m a x measurement.
Applsci 11 04063 g003
Figure 4. Relation curve of temperature and radiation, radiation and digital count.
Figure 4. Relation curve of temperature and radiation, radiation and digital count.
Applsci 11 04063 g004
Figure 5. Overall process flow of the proposed method.
Figure 5. Overall process flow of the proposed method.
Applsci 11 04063 g005
Figure 6. [STEP 1: Data Acquisition] Obtain G m i n and G m a x by measuring T m i n and T m a x for each distance and calculate T m i n T m a x radiation through Planck’s Law.
Figure 6. [STEP 1: Data Acquisition] Obtain G m i n and G m a x by measuring T m i n and T m a x for each distance and calculate T m i n T m a x radiation through Planck’s Law.
Applsci 11 04063 g006
Figure 7. Dependence on distance of 16-bit digital count.
Figure 7. Dependence on distance of 16-bit digital count.
Applsci 11 04063 g007
Figure 8. [STEP 2: Digital Count Interpolation] Interpolation function is obtained through G m i n and G m a x by distance.
Figure 8. [STEP 2: Digital Count Interpolation] Interpolation function is obtained through G m i n and G m a x by distance.
Applsci 11 04063 g008
Figure 9. Redefined process the Radiation-Digital count mapping function according to distance through the proposed method.
Figure 9. Redefined process the Radiation-Digital count mapping function according to distance through the proposed method.
Applsci 11 04063 g009
Figure 10. Radiation-Digital count mapping curve that changes with distance through actually obtained data.
Figure 10. Radiation-Digital count mapping curve that changes with distance through actually obtained data.
Applsci 11 04063 g010
Figure 11. [STEP 3: Measurements of the Objects and Temperature Estimation] Digital count and distance acquisition for objects using an infrared camera and LiDAR, and temperature estimation using a newly defined mapping function.
Figure 11. [STEP 3: Measurements of the Objects and Temperature Estimation] Digital count and distance acquisition for objects using an infrared camera and LiDAR, and temperature estimation using a newly defined mapping function.
Applsci 11 04063 g011
Figure 12. Experimental equipment: (a) Infrared camera (FLIR T620), (b) LiDAR (Velodyne VLP-16), (c) blackbody.
Figure 12. Experimental equipment: (a) Infrared camera (FLIR T620), (b) LiDAR (Velodyne VLP-16), (c) blackbody.
Applsci 11 04063 g012
Figure 13. Experiment environment: (a) Picture (b) LiDAR map.
Figure 13. Experiment environment: (a) Picture (b) LiDAR map.
Applsci 11 04063 g013
Figure 14. Blackbody thermal image acquired through an infrared camera (about 1–9 m).
Figure 14. Blackbody thermal image acquired through an infrared camera (about 1–9 m).
Applsci 11 04063 g014
Figure 15. Temperature estimation result according to distance by temperature.
Figure 15. Temperature estimation result according to distance by temperature.
Applsci 11 04063 g015
Figure 16. Measurement image of a person at about 6 m, 7 m, 7.5 m, 8 m.
Figure 16. Measurement image of a person at about 6 m, 7 m, 7.5 m, 8 m.
Applsci 11 04063 g016
Figure 17. Measurement LiDAR map for a person at about 6 m.
Figure 17. Measurement LiDAR map for a person at about 6 m.
Applsci 11 04063 g017
Table 1. Infrared camera specifications.
Table 1. Infrared camera specifications.
FLIR T620 Specifications
IR Resolution640 × 480 pixels
Temperature range−4 °F to 302 °F (−20 °C to 150 °C) or 212 °F to 1202 °F (100 °C to 650 °C)
Spectral range7.8–14 m
Thermal sensitivity/NETD<50 mK @ +30 °C (+86 °F)
Field of view (FOV)25° × 19°
Spatial resolution (IFOV)0.68 mrad
Image frequency30 Hz
Table 2. LiDAR specifications.
Table 2. LiDAR specifications.
Velodyne VLP-16 Specifications
Channel16
Measurement range∼100 m
Accuracy±3 cm
Field of view (vertical)30° (+15° to −15°)
Field of view (horizontal/azimuth)360°
Angular resolution (vertical)
Angular resolution (horizontal/azimuth)0.1°–0.4°
Rotation rate5–20 Hz
Table 3. Blackbody specifications.
Table 3. Blackbody specifications.
Blackbody Specifications
Temperature range+5 °C–50 °C
Black target surface diameter80 × 80 mm
Effective emissivity0.96 ± 0.02
Temperature resolution0.01 °C
Temperature measurement accuracy±(0.15 + 0.003|t|) °C
Size/Weight110 × 110 × 190 mm/1.7 kg
Table 4. The temperature estimation result from mapping function at a close distance (before correction).
Table 4. The temperature estimation result from mapping function at a close distance (before correction).
0.3 m1 m2 m3 m4 m5 m6 m7 m8 m9 m10 m
30 °C30.0 °C29.3 °C28.9 °C28.6 °C28.4 °C28.7 °C28.0 °C28.1 °C27.9 °C27.5 °C27.5 °C
35 °C35.1 °C34.2 °C33.7 °C33.3 °C33.2 °C33.0 °C32.7 °C32.6 °C32.5 °C32.4 °C32.2 °C
40 °C40.1 °C39.1 °C38.5 °C38.1 °C37.9 °C37.6 °C37.5 °C37.3 °C37.0 °C36.9 °C36.8 °C
Table 5. The temperature estimation result from FLIR Tools + (FLIR correction).
Table 5. The temperature estimation result from FLIR Tools + (FLIR correction).
0.3 m1 m2 m3 m4 m5 m6 m7 m8 m9 m10 m
30 °C32.2 °C31.5 °C31.0 °C30.7 °C30.6 °C31.0 °C30.1 °C30.3 °C30.0 °C29.6 °C29.6 °C
35 °C37.5 °C36.6 °C36.0 °C35.7 °C35.5 °C35.4 °C35.0 °C34.9 °C34.8 °C34.7 °C34.4 °C
40 °C42.7 °C41.7 °C41.1 °C40.6 °C40.3 °C40.1 °C40.0 °C39.9 °C39.5 °C39.4 °C39.2 °C
Table 6. The temperature estimation result from the proposed method.
Table 6. The temperature estimation result from the proposed method.
0.3 m1 m2 m3 m4 m5 m6 m7 m8 m9 m10 m
30 °C30.0 °C30.0 °C30.0 °C30.2 °C30.2 °C30.5 °C30.1 °C30.3 °C30.1 °C29.9 °C29.9 °C
35 °C35.1 °C35.0 °C35.0 °C35.2 °C35.1 °C35.2 °C35.0 °C35.1 °C35.1 °C35.1 °C34.9 °C
40 °C40.1 °C40.0 °C40.0 °C40.1 °C40.0 °C40.0 °C40.1 °C40.0 °C39.9C40.0 °C39.9 °C
Table 7. Comparison of temperature estimates at approximately 3.5 m and 7.5 m.
Table 7. Comparison of temperature estimates at approximately 3.5 m and 7.5 m.
Before CorrectionFLIR ToolsProposed Method
3.5 m7.5 m3.5 m7.5 m3.5 m7.5 m
30 °C28.3 °C27.7 °C30.4 °C29.8 °C29.9 °C29.9 °C
35 °C33.3 °C32.4 °C35.6 °C34.7 °C35.1 °C34.9 °C
36.5 °C34.4 °C34.0 °C36.8 °C36.3 °C36.4 °C36.6 °C
40 °C37.9 °C37.4 °C40.4 °C39.8 °C39.9 °C40.3 °C
MSE4.95750.12250.0200
Table 8. Body temperature measurement result by distance.
Table 8. Body temperature measurement result by distance.
6 m7 m7.5 m8 m
T (°C)33.62 °C33.57 °C33.55 °C33.50 °C
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kim, J.; Kim, S. Temperature Estimation Adaptive to Variables over Distance Using Infrared–LiDAR. Appl. Sci. 2021, 11, 4063. https://doi.org/10.3390/app11094063

AMA Style

Kim J, Kim S. Temperature Estimation Adaptive to Variables over Distance Using Infrared–LiDAR. Applied Sciences. 2021; 11(9):4063. https://doi.org/10.3390/app11094063

Chicago/Turabian Style

Kim, Jongchan, and Sungho Kim. 2021. "Temperature Estimation Adaptive to Variables over Distance Using Infrared–LiDAR" Applied Sciences 11, no. 9: 4063. https://doi.org/10.3390/app11094063

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop