Next Article in Journal
Evaluating Communication Performance in Rotating Electrical Machines Using RSSI Measurements and Artificial Intelligence
Previous Article in Journal
A Scene Knowledge Integrating Network for Transmission Line Multi-Fitting Detection
Previous Article in Special Issue
Digitizing the Appearance of 3D Printing Materials Using a Spectrophotometer
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Communication

Comparative Analysis of Low-Cost Portable Spectrophotometers for Colorimetric Accuracy on the RAL Design System Plus Color Calibration Target

1
Vets4science d.o.o., 2 Kukovčeva Str., SI-3000 Celje, Slovenia
2
Vetamplify SIA, 57/59—32 Krišjāņa Valdemāra Str., LV-1010 Riga, Latvia
3
VetCyto SIA, 13 Ozolu Str., LV-2008 Jurmala, Latvia
4
Faculty of Electrical Engineering, University of Ljubljana, 25 Tržaška Str., SI-1000 Ljubljana, Slovenia
5
Institute of Atomic Physics and Spectroscopy, University of Latvia, 3 Jelgavas Str., LV-1004 Riga, Latvia
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(24), 8208; https://doi.org/10.3390/s24248208
Submission received: 4 December 2024 / Revised: 19 December 2024 / Accepted: 20 December 2024 / Published: 23 December 2024
(This article belongs to the Special Issue Recent Trends and Advances in Color and Spectral Sensors: 2nd Edition)

Abstract

:
Novel low-cost portable spectrophotometers could be an alternative to traditional spectrophotometers and calibrated RGB cameras by offering lower prices and convenient measurements but retaining high colorimetric accuracy. This study evaluated the colorimetric accuracy of low-cost, portable spectrophotometers on the established color calibration target—RAL Design System Plus (RAL+). Four spectrophotometers with a listed price between USD 100–1200 (Nix Spectro 2, Spectro 1 Pro, ColorReader, and Pico) and a smartphone RGB camera were tested on a representative subset of 183 RAL+ colors. Key performance metrics included the devices’ ability to match and measure RAL+ colors in the CIELAB color space using the color difference CIEDE2000 ΔE. The results showed that Nix Spectro 2 had the best performance, matching 99% of RAL+ colors with an estimated ΔE of 0.5–1.05. Spectro 1 Pro and ColorReader matched approximately 85% of colors with ΔE values between 1.07 and 1.39, while Pico and the Asus 8 smartphone matched 54–77% of colors, with ΔE of around 1.85. Our findings showed that low-cost, portable spectrophotometers offered excellent colorimetric measurements. They mostly outperformed existing RGB camera-based colorimetric systems, making them valuable tools in science and industry.

1. Introduction

Colorimetry quantifies and studies human perception of colors. If two objects are perceived as having the same color, they shall have the same colorimetric value [1]. Conversely, measured color differences should correlate with the visual color difference. Colorimetry is, thus, crucial in industrial quality control, where multiple batches of the same product are manufactured, for example, in textiles, paints, printing, and cosmetics [1].
Color perception depends on (1) a light source, (2) object properties affecting light reflectance or transmittance, and (3) an observer [2,3,4]. Predefined light sources, called standard illuminants, exhibit specified spectral power distribution. Some of the most popular standard illuminants [5] are the International Commission on Illumination’s (CIE) illuminants: A (related to a tungsten filament lamp), D50 (horizon light), and D65 (daylight). The CIE-defined observer (with a 2° or 10° visual field) is based on light-mixing and color-matching experiments [1]. Mathematically, perceived color is a sum of three tristimulus values: X, Y, and Z. Each tristimulus value is a product between a spectral color-matching function of the chosen standard observer ( x ¯ ( λ ) , y ¯ ( λ ) , or z ¯ ( λ ) ), power distribution of the illuminant S(λ), and the object’s reflectance or transmittance spectrum R(λ).
The popular CIELAB color space transforms tristimulus values into coordinates L* (lightness), a* (opponent colors: red-green), and b* (yellow-blue), providing a more visually uniform color space [1]. L* varies between 100 (perfect white) and 0 (perfect black). The value of a* is positive for red and negative for green shades. Similarly, b* is positive for yellow and negative for blue colors. The first attempts to quantify the difference between two colors (ΔE) in the CIELAB color space were based on a simple Euclidian distance: Δ E C I E 76 = Δ L * 2 + Δ a * 2 + Δ b * 2 . However, the CIELAB color space was less perceptually uniform than intended, particularly close to saturated values. Thus, the newest color differences formula of CIEDE2000 (ΔE00) addressed perceptual non-uniformities by replacing the a* and b* coordinates with chroma (C*) and hue (h*), and adding several corrections to better quantify human eye perception [6]. The human eye can spot color differences of 2.3–5.0, called the just-noticeable difference (JND) [7].
To determine a specific color, spectrophotometers acquire missing information, i.e., light reflectance or the transmittance spectrum. The spectrophotometer’s applicability, functionality, and portability are defined by its geometry, specified by the light source and observer’s angles. Most commonly, 45°/0° or 0°/45° geometry is used for matt surfaces due to excluded gloss [8]. An alternative for shiny surfaces is an integrating sphere spectrometer, which provides diffuse illumination and collects the light at an 8° angle (i.e., diffuse/8° or d/8° in short). Finally, multi-angle spectrophotometers are used for more complex surfaces or industrial requirements.
There are several portable spectrophotometers on the market. The scientific community often considers CM-700d (Konica Minolta KK, Tokyo, Japan) a reference when calibrating colorimetric systems or performing colorimetric measurements [9,10]. CM-700d includes the d/8° geometry, pulsed xenon lamp, and 31 light-collecting channels (10 nm steps between 400–700 nm). X-rite (Grand Rapids, MI, USA) is another popular manufacturer of portable spectrophotometers such as Ci64 (d/8°) or eXact™ (45°/0°). The listed inter-instrument agreement of these high-end state-of-the-art spectrophotometers is around 0.2 ΔE00. However, standard spectrophotometers are relatively expensive, with listed prices between USD 5000 and 10,000. Furthermore, they provide an average measurement at a single point, limiting their feasibility in the colorimetric study of an area.
We can also colorimetrically calibrate commercial RGB cameras to achieve lower costs and spatial measurements. Color calibration relies on a model that maps measured (RGB) colors with the standard color space, such as CIELAB. The model is trained on color calibration targets (CCTs) or color reference charts, which can be in a single-page or fan format. The most popular CCTs are ColorChecker Classic (X-rite, Grand Rapids, MI, USA) [11,12], IT8 Targets (LaserSoft Imaging AG, Kiel, Germany) [13], RAL Design System Plus (RAL+, RAL gGmbH, Bonn, Germany, Figure 1) and Pantone (Pantone LLC, Carlstadt, NJ, USA). In biomedicine, various colorimetric systems with calibrated (smartphone) RGB cameras achieved colorimetric accuracy (ΔE) between 2.2 and 8.4 [11,12,14,15,16,17]. The color constancy of the existing systems is not optimal because most of these color differences could be spotted by the human eye [7].
The recently available low-cost (USD < 1200) and portable spectrophotometers could fill the gap between standard spectrophotometers (=high colorimetric accuracy) and RGB camera-based colorimetric systems (=affordability). Popular low-cost spectrophotometers, such as Color Muse (Variable Inc., Chattanooga, TN, USA), Nix Mini 2 or Pro (Nix Sensor Ltd., Hamilton, ON, Canada), and Cube (Palette Pty Ltd., Melbourne, Victoria, Australia), have been applied to the monitoring of food quality, environment, and radiation [18,19,20,21]. Compared to the standard spectrophotometers on food and soil, their colorimetric accuracy (ΔE00) was, on average, between 4.3 and 11.4 [20,21]. The color differences decreased to 2.1–6 and ~1.0–1.7 * (* our estimates) when low-cost spectrophotometers were tested on custom-made and RAL+ CCTs, respectively [22,23].
Most existing studies tested the colorimetric accuracy of low-cost spectrophotometers on non-standardized objects (food, soil, custom-made CCT). Furthermore, new versions of affordable devices like Nix Spectro 2 (Nix Sensor Ltd., Hamilton, ON, Canada) and Spectro 1 Pro (Variable Inc., Chattanooga, TN, USA) feature resolution with 31 channels and low inter-instrument agreements (ΔE00 < 0.35), comparable to the standard spectrophotometers. Therefore, in this study, we tested the colorimetric accuracy of four new low-cost, portable spectrometers in matching and evaluating RAL Design System Plus (RAL+) colors. The results provided important insights into the performance of low-cost, portable spectrophotometers, especially compared to the custom-made colorimetric systems based on the calibrated RGB cameras. This study helps professionals and researchers in fields such as biomedicine, food hygiene, and environmental science find accessible but accurate tools for colorimetry.

2. Materials and Methods

2.1. Spectrophotometers

This study enrolled four spectrophotometers (Table 1, Figure 2), covering a price range between USD 100 and 1200. The devices typically require Bluetooth connection with smartphones to display data and alter spectrophotometer settings. Smartphone applications provide details on colorimetric measurements like color values (e.g., CIELAB, sRGB, etc.) and the closest matches with the corresponding ΔE to standard CCT colors (e.g., RAL, Pantone). This study also included a smartphone Asus Zenfone 8 (ASUSTeK Computer Inc., Taipei, Taiwan) combined with a DermLite DL1 dermatoscope (DermLite LLC, Aliso Viejo, CA, USA) to guarantee stable illumination conditions [11].

2.2. Measurements

Colorimetrical accuracy was tested on RAL+ colors, which are labeled with seven-digit codes (HHH LL CC) representing hue (H), lightness (L), and chroma (C). RAL+ includes 1825 colors, covering most of the CIELAB color space (i.e., H: 0–360°, L: ~20–90, C: ~0–70). However, the RAL+ manufacturer provides only color light reflectance values(LRV) [24], indicating that the “real” RAL+ colors differ from their labeled CIELAB values. Therefore, some portable spectrophotometer manufacturers evaluated actual RAL+ color values independently, and their colorimetric assessments are sometimes directly available in smartphone applications that control the portable spectrometers.
For the sake of clarity, we employ the following terminology for the CIELAB values (L*, a*, b*) of RAL+ colors:
  • Labeled values were calculated from the RAL+ color label (e.g., 010 60 15 translates to 60, 14.8, 2.6),
  • Assessed values are the actual RAL+ color values, as evaluated by the portable spectrophotometer manufacturers (e.g., Spectro 1 Pro manufacturer foresaw 62.1, 14.3, 2.0 for the RAL+ color 010 60 15),
  • Measured values were estimated in this study using portable spectrophotometers or a smartphone (e.g., 59.4 15.2 2.4 for the RAL+ color 010 60 15 by Nix Spectro 2 spectrophotometer),
  • Normalized are measured values, normalized to labeled values (as defined in Section 2.4).
To rationalize measurements, we downsampled the number of enrolled colors to 183. By using random permutation and a 10-fold decrease (randperm function, Matlab R2017b, MathWorks, Natick, MA, USA), we retained the original RAL+ color distribution. Downsampling kept the differences in the L*, a*, and b* value histograms (10-unit wide bins) between entire and downsampled RAL+ colors below 1.1%. On the other hand, we acquired all 1825 RAL+ colors by the smartphone to prevent model overfitting when transforming measured colors into labeled ones (Section 2.4). We also excluded 27 smartphone measurements due to image saturation.
First, we calibrated the spectrophotometers according to the manuals. The color measurements were conducted in the ascending order of H, L, and C values in one continuous session. For each RAL+ color, we recorded (1) the measured CIELAB value, (2) the matched RAL+ color, and (3) ΔE00 to the assessed RAL+ color (the Pico spectrophotometer did not provide ΔE).

2.3. RAL+ Color-Matching Accuracy

The strict RAL+ color-matching accuracy was calculated as a ratio between correctly matched and all enrolled colors (n = 183). For ColorReader, we excluded two faulty measurements from further analysis (n = 181). The Pico spectrophotometer did not offer color matching; thus, we selected the color with a minimal ΔE00 between the measured and labeled RAL+ color values. The same procedure was applied to the smartphone. Since the Spectro 1 Pro did not display information on 19 (assessed) RAL+ colors, we additionally evaluated color-matching accuracies excluding these missing colors. On the other hand, Nix Spectro 2 and ColorReader presumably included all colors.
Loose color-matching accuracy additionally accepted the adjacent RAL+ color as the correct one. We defined an adjacent color as gradually changing in only one coordinate, i.e., hue, lightness, or chroma (for example, 020 30 30 vs. 030 30 30). These looser metrics are practical because most spectrophotometers match RAL+ colors according to their assessed and not labeled values. According to the Spectro 1 Pro database, the median difference between labeled and assessed RAL+ values is larger (ΔE00 = 2.6) than between adjacent RAL+ colors (ΔE00 = 2.1).

2.4. Color Difference

Color differences (ΔE00) were calculated between the measured and (1) labeled or (2) assessed RAL+ color values. However, we should note that the labeled RAL+ CIELAB color values are based on a particular measurement geometry. Therefore, the color difference between the measured and labeled colors cannot be a simple measure of spectrophotometer performance but rather an indicator of similarities between the device and RAL+ measurement geometry. Thus, we additionally normalized the measured against the labeled values and then calculated ΔE00 between them.
Normalization was based on a regression model [11] estimating the relationship between the measured (Cm) and labeled RAL+ CIELAB color values (CRAL):
CRAL = f(Cm), CRAL ∈ {LRAL*, aRAL*, bRAL*}
which served to normalize Cm:
Cm_norm = f(Cm).
The spectrophotometers measured color values (Cm) in the L*, a*, and b* coordinates, while the smartphone retrieved the RGB values. Potential overfitting on only 183 samples was avoided by (1) training and testing the model with a leave-one-out-cross-validation (LOOCV) approach and (2) choosing a simple linear function for f:
CRAL = p0 + p1 Lm* + p2 am* + p3 bm*, CRAL ∈ {LRAL*, aRAL*, bRAL*}.
The LOOCV approach enabled the same 183 RAL+ colors to be used for the regression model’s training and the color difference calculation between the normalized and labeled values.
On the other hand, the smartphone normalization model was trained on 1798 RAL+ colors (27 saturated images were excluded) but tested only on 183 selected colors. Since overfitting was not likely, a more complex polynomial was selected for f:
C R A L = k = 0 3 p k C k + p 11 R G + p 12 R B + p 13 G B ,   C R ,   G ,   B

3. Results and Discussion

3.1. Color-Matching Accuracy

First, we evaluated the accuracy of four spectrophotometers and a smartphone in matching 183 RAL+ colors (Table 2). The strict color-matching accuracies ranged from 47.5 to 98.4%. Nix Spectro 2 performed the best with only three mismatched RAL+ colors. However, strict color-matching criteria could be too rigorous because the median difference between two random adjacent RAL+ colors (i.e., gradually different in only one coordinate) is smaller than that between the labeled and assessed RAL+ colors (see Section 2.3). Therefore, loose color-matching accuracy (i.e., adjacent RAL+ colors are also a correct match) can be considered a more practical measure.
With the loose approach, the color-matching accuracies significantly improved, ranging between 72.1% and 99.5%. Again, Nix Spectro 2 performed the best with almost perfect execution (99.5%). The only mismatched RAL+ color was opulent green, mistaken for intense green, which gradually differs in two coordinates (i.e., 160 20 20 vs. 170 20 15). Since the color difference (ΔE00 = 3.74) between both labeled colors falls in the JND range [7], the color shades would probably be distinct to the human eye. Extrapolating its accuracy to the whole RAL+, Nix Spectro 2 would mismatch around nine RAL+ colors (out of 1825).
On the other hand, Spectro 1 Pro and ColorReader correctly matched ~86% of RAL+ colors. The misidentifications accounted for 25 colors (presumably ~250 in the whole RAL+ range). For these 25 mismatched colors, the median difference between the assessed and measured RAL+ colors was 4.1 for Spectro 1 Pro. The calibrated smartphone camera and Pico mismatched ~25% and ~45% RAL+ colors, respectively. We assume that a matching accuracy of around 75% can also be expected from the other calibrated smartphone- or camera-based colorimetric systems [12,14,16] since all tested smartphone cameras from our previous studies performed similarly [11,25]. Furthermore, Pico does not provide assessed colors. Thus, the color-matching accuracy was calculated according to the labeled RAL+ colors, which can be a contributing factor to an inferior performance.
We shall also alert readers to the proper selection of spectrophotometer settings for color matching. Nix Spectro 2 and Spectro 1 Pro enable different illuminants and observers. For example, when a different illuminant (D65 vs. D50) was selected for Nix Spectro 2, its loose matching accuracy dropped to only 88.0% (161/183), which is significantly worse than with the correct settings (Table 2). Additionally, metamerism may hinder a high-performing spectrophotometer from accurately matching the RAL+ color that visually aligns best with the unknown painted object.

3.2. Accuracy in ΔE00

The most straightforward approach to colorimetrically validate spectrophotometers would be based on the standardized color difference (ΔE00) between the measured and actual RAL+ color values. However, the actual RAL+ color values in the CIELAB color space remain unknown. Although the spectrophotometer’s color-matching capability (Section 3.1, Table 2) can be considered more of a qualitative than quantitative measure, these can serve to estimate an approximate colorimetric accuracy. With the almost perfect color-matching accuracy of the Nix Spectro 2 spectrophotometer, its absolute colorimetric accuracy shall be below ΔE00 = 1.05, that is, 50% of the typical color difference between two RAL+ adjacent colors. Similarly, the equivalent estimate for Spectro 1 Pro was ΔE00 < 1.19, based on 86.3% color matches and 13.7% mismatches exhibiting ΔE00 of 4.1.
In order to verify these estimates further, we calculated median color differences (ΔE00) between the labeled, assessed, measured, and normalized RAL+ CIELAB color values as measured by four spectrophotometers and a smartphone (Table 3). The differences between the measured and labeled ranged between 1.27 and 3.95. The lowest color difference (ΔE00 = 1.27) was provided by the ColorReader spectrophotometer, whose measurements seem adjusted to the labeled RAL+ color values the most. This hypothesis was confirmed by the fact that its color difference increased to 1.39 when the measured and assessed colors were compared. Expectedly, the detected color differences for Nix Spectro 2 and Spectro 1 Pro improved significantly to 0.52 and 1.07, respectively.
Our results showed better performance for the newly tested Nix Spectro 2, while for the other devices, they are consistent with a previous study [23], which reported a colorimetric accuracy of ~1.0–1.7* (*our estimates from ΔECMC) for low-cost spectrophotometers. When devices were tested on visually heterogeneous objects (soil or food), ΔE00 increased to 4.3–11.4 [20,21]. However, there were significant colorimetric disagreements of up to 3.8 even between standard instruments. With deducted inter-instrument color differences, the true colorimetric accuracy was probably lower, assumingly around 0.5–7.6, which is in the range of our results (Table 3).
However, relying solely on the differences between measured, labeled, and assessed colors does not allow for a colorimetric comparison with calibrated RGB cameras. Therefore, we also compared the normalized and labeled RAL+ colors, resulting in a ΔE00 slightly above 1.1 for Nix Spectro 2, Spectro 1 Pro, and ColorReader, and around 1.85 for Pico and smartphone (Table 3(c)). Against the measured–labeled comparison (Table 3(a)), the color accuracy improved for around ~0.2–0.8, which is in line with the study of Kirchner et al. [23], where the normalization model improved the spectrophotometer colorimetric accuracy by ~0.7.
We shall stress that the smartphone’s median colorimetric accuracy ΔE00 of 1.84 is one of the best reported. The other studies, including commercial smartphones or cameras, achieved a colorimetric accuracy above 2.2 [12,14,16]. The improved performance probably resulted from a complex calibration model trained on almost 1800 colors. Despite being effective, this approach was time-consuming and burdensome.

3.3. Overall Performance

The devices enrolled in this study exhibited three distinct colorimetric performances (Table 4). Nix Spetro 2 was the best-performing spectrophotometer, with almost perfect color matching and high colorimetric accuracy in evaluating RAL+ colors (ΔE00 of mostly <1). On the other hand, it comes with the highest price, more than four times that of other spectrophotometers. Moreover, color matching requires a subscription, further widening the device price gap.
Spectro 1 Pro and ColorReader correctly matched around 85% RAL+ colors. However, absolute colorimetric accuracy (ΔE00) is probably slightly above 1. ColorReader could seem the obvious choice between these two devices due to its lower price, but the spectrophotometer stopped working shortly after our study, raising concerns about its durability and quality. On the other hand, Spectro 1 Pro included small magnets near the sensor opening to secure the protective cap. Because the magnets were installed slightly above the casing level, environmental light could penetrate onto firm surfaces like RAL+ sheets.
Pico and a smartphone camera exhibited similar performances—their median colorimetric error was just below JND, and, thus, undetectable by the human eye. Although smartphones are ubiquitous, proper colorimetrical calibration is time-consuming and burdensome, and the process demands add-ons to ensure stable illumination (dermatoscopes) and reference colors (color calibration targets). However, the most significant advantage of commercial (smartphone) cameras is spatial colorimetric imaging, which can reveal colors in smaller areas than the size of a typical spectrophotometer measurement aperture (e.g., the minimal diameter of Nix Spectro 2 opening is 2 mm).

4. Conclusions

In conclusion, our study indicated that the colorimetric performance of low-cost, portable spectrophotometers correlated with their price. Furthermore, cheaper devices (<USD 300) also performed very well, beating the colorimetric accuracy of a calibrated RGB camera. Therefore, instead of relying on custom-made optical setups, future biomedical studies on color measurement shall turn to commercial, low-cost, portable spectrophotometers to achieve optimal color constancy. The notable exception is when spatial measurements are needed. In the latter, color-mapping models shall be performed on numerous CCT colors.

Author Contributions

Conceptualization, B.C. and P.N.; methodology, E.Š. and I.B.; software, J.S.; formal analysis, E.Š. and B.C.; investigation, E.Š., I.B. and J.S.; data curation, J.S.; writing—original draft preparation, B.C. and J.S.; writing—review and editing, I.B., J.S., E.Š., P.N. and B.C.; visualization, B.C.; funding acquisition, B.C., I.B. and P.N. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Public Scholarship, Development, Disability and Maintenance Fund of the Republic of Slovenia within the Public call for applications for co-financing of visiting Slovenian experts from abroad at Slovenian higher education institutions and research organizations, as well as study or scientific visits of students from abroad (349th public tender), the Recovery and Resilience Facility (No. 5.1.1.2.i.0/1/22/A/CFLA/002, 1.12) under the Competence Centre of Electrical and Optical Equipment Production Sector of Latvia (LEOPC) and the Latvian Council of Science (No. lzp-2023/1-0220).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors on request.

Acknowledgments

The authors thank Penn Brafford (Variable Inc., Chattanooga, TN, USA) for providing us with assessed RAL+ color values in tabular form, significantly expediting the processing of the results. We are also grateful to Pierre Jasmin (Virbac SA, Carros, France) for supporting our previous colorimetric work, which led to this study. We thank Meike Kettenuß (RAL gGmbH), Will Sheridan (Nix Sensor Ltd.), Abby Lusk (Variable Inc.), An De Ridder (Datacolor GmbH), and Djordje Dikic (Palette Pty Ltd.) for providing us with images of the devices used in this study.

Conflicts of Interest

Co-authors employed by Vets4science Ltd., Vetamplify Ltd., and VetCyto Ltd. affirm that their affiliations did not influence the design, execution, or reporting of the research. Penn Brafford, chief business officer at Variable Inc. (Chattanooga, TN, USA), manufacturer of the Spectro 1 Pro spectrophotometer used in this study, provided the assessed RAL+ color values. However, Penn Brafford had no role in this study’s design, the collection, analyses, or interpretation of measurements, the writing of the manuscript, or the decision to publish the results.

References

  1. Broadbent, A.D. Colorimetry, Methods. In Encyclopedia of Spectroscopy and Spectrometry, 3rd ed.; Lindon, J.C., Tranter, G.E., Koppenaal, D.W., Eds.; Academic Press: Oxford, UK, 2017; pp. 321–327. [Google Scholar]
  2. Witzel, C.; Gegenfurtner, K.R. Color Perception: Objects, Constancy, and Categories. Annu. Rev. Vis. Sci. 2018, 4, 475–499. [Google Scholar] [CrossRef]
  3. Xiao, B.; Brainard, D.H. Surface Gloss and Color Perception of 3D Objects. Vis. Neurosci. 2008, 25, 371–385. [Google Scholar] [CrossRef] [PubMed]
  4. Emery, K.J.; Webster, M.A. Individual Differences and Their Implications for Color Perception. Vis. Percept. 2019, 30, 28–33. [Google Scholar] [CrossRef]
  5. Gu, H.T.; Pointer, M.R.; Liu, X.Y.; Ronnier Luo, M. Quantifying the Suitability of CIE D50 and a Simulators Based on LED Light Sources. Color Res. Appl. 2017, 42, 408–418. [Google Scholar] [CrossRef]
  6. Gómez-Polo, C.; Muñoz, M.P.; Lorenzo Luengo, M.C.; Vicente, P.; Galindo, P.; Martín Casado, A.M. Comparison of the CIELab and CIEDE2000 Color Difference Formulas. J. Prosthet. Dent. 2016, 115, 65–70. [Google Scholar] [CrossRef] [PubMed]
  7. Mokrzycki, W.; Tatol, M. Color Difference Delta E—A Survey. Mach. Graph. Vis. 2011, 20, 383–411. [Google Scholar]
  8. Anowar Hossain, M. Simulation of Chromatic and Achromatic Assessments for Camouflage Textiles and Combat Background. J. Def. Model. Simul. 2023, 20, 317–332. [Google Scholar] [CrossRef]
  9. Cherubini, F.; Casini, A.; Cucci, C.; Picollo, M.; Stefani, L. Application of a Hyperspectral Camera for Colorimetric Measurements on Polychrome Surfaces in a Controlled Environment and Evaluation of Three Image Processing Software for Displaying Colorimetric Data: Pros and Cons of the Methodology Presented. Color Res. Appl. 2023, 48, 210–221. [Google Scholar] [CrossRef]
  10. Piliero, M.A.; Pupillo, F.; Presilla, S. A Diffuse Reflectance Spectrophotometer for Radiation Dosimetry of EBT3 GAFchromic Films. Radiat. Meas. 2022, 154, 106777. [Google Scholar] [CrossRef]
  11. Cugmas, B.; Štruc, E. Accuracy of an Affordable Smartphone-Based Teledermoscopy System for Color Measurements in Canine Skin. Sensors 2020, 20, 6234. [Google Scholar] [CrossRef]
  12. Abebe, M.; Hardeberg, J.Y.; Vartdal, G. Smartphones’ Skin Colour Reproduction Analysis for Neonatal Jaundice Detection. J. Imaging Sci. Technol. 2021, 65, 060407. [Google Scholar] [CrossRef]
  13. Bernard, G.; Rompré, P.; Tavares, J.R.; Montpetit, A. Colorimetric and Spectrophotometric Measurements of Orthodontic Thermoplastic Aligners Exposed to Various Staining Sources and Cleaning Methods. Head Face Med. 2020, 16, 2. [Google Scholar] [CrossRef] [PubMed]
  14. Cugmas, B.; Olivry, T. Evaluation of Skin Erythema Severity by Dermatoscopy in Dogs with Atopic Dermatitis. Vet. Dermatol. 2020, 32, 183-e46. [Google Scholar] [CrossRef]
  15. Mulcare, D.C.; Coward, T.J. Suitability of a Mobile Phone Colorimeter Application for Use as an Objective Aid When Matching Skin Color during the Fabrication of a Maxillofacial Prosthesis. J. Prosthodont. 2019, 28, 934–943. [Google Scholar] [CrossRef]
  16. Zhang, Y.; Wu, Y.; Zhang, Y.; Ozcan, A. Color Calibration and Fusion of Lens-Free and Mobile-Phone Microscopy Images for High-Resolution and Accurate Color Reproduction. Sci. Rep. 2016, 6, 27811. [Google Scholar] [CrossRef]
  17. Charrière, R.; Hébert, M.; Trémeau, A.; Destouches, N. Color Calibration of an RGB Camera Mounted in Front of a Microscope with Strong Color Distortion. Appl. Opt. 2013, 52, 5262–5271. [Google Scholar] [CrossRef] [PubMed]
  18. Yasuda, H.; Morioka, S. Comparative Study on Measurements of Radiochromic Films Using Portable Colorimeters. Sci. Rep. 2024, 14, 3384. [Google Scholar] [CrossRef] [PubMed]
  19. Domanda, C.; Blanco, I.; Buccolieri, R.; Rustioni, L. Anti-Hail Nets in Viticulture: Do They Affect White Grape Quality in the Mediterranean Region? Agriculture 2024, 14, 1438. [Google Scholar] [CrossRef]
  20. Moritsuka, N.; Kawamura, K.; Tsujimoto, Y.; Rabenarivo, M.; Andriamananjara, A.; Rakotoson, T.; Razafimbelo, T. Comparison of Visual and Instrumental Measurements of Soil Color with Different Low-Cost Colorimeters. Soil Sci. Plant Nutr. 2019, 65, 605–615. [Google Scholar] [CrossRef]
  21. Dang, D.S.; Buhler, J.F.; Stafford, C.D.; Taylor, M.J.; Shippen, J.E.; Dai, X.; England, E.M.; Matarneh, S.K. Nix Pro 2 and Color Muse as Potential Colorimeters for Evaluating Color in Foods. LWT 2021, 147, 111648. [Google Scholar] [CrossRef]
  22. Wheeler, B. Analysis of Low-Cost Color Sensor Device Performance as Compared to Standardized Spectrophotometers. Master’s Thesis, Clemson University, Clemson, SC, USA, 2022. Available online: https://open.clemson.edu/all_theses/3722/ (accessed on 16 December 2024).
  23. Kirchner, E.; Koeckhoven, P.; Sivakumar, K. Improving Color Accuracy of Colorimetric Sensors. Sensors 2018, 18, 1252. [Google Scholar] [CrossRef] [PubMed]
  24. Downloads|RAL Colours. Available online: https://www.ral-farben.de/en/downloads (accessed on 3 September 2024).
  25. Cugmas, B.; Jasmin, P.; Samec, J.; Štruc, E. Repeatability and Inter-Instrument Agreement of Clinically Feasible Skin Color Measurements in Dogs. In Proceedings of the 10th World Congress of Veterinary Dermatology, Boston, MA, USA, 25–29 July 2024; p. P-71. [Google Scholar] [CrossRef]
Figure 1. Color calibration target (CCT) RAL Design System Plus (©RAL gGmbH, Bonn, Germany, reproduced with permission from RAL gGmbH).
Figure 1. Color calibration target (CCT) RAL Design System Plus (©RAL gGmbH, Bonn, Germany, reproduced with permission from RAL gGmbH).
Sensors 24 08208 g001
Figure 2. Spectrophotometers (a) Nix Spectro 2, (b) Spectro 1 Pro, (c) ColorReader, and (d) Pico ((a) ©Nix Sensor Ltd., Hamilton, ON, Canada; (b) ©Variable Inc., Chattanooga, TN, USA; (c) ©Datacolor GmbH, Marl, Germany; (d) ©Palette Pty Ltd., Melbourne, Victoria, Australia; images are reproduced with permissions from Nix Sensor Ltd., Variable Inc., Datacolor GmbH, and Palette Pty Ltd.).
Figure 2. Spectrophotometers (a) Nix Spectro 2, (b) Spectro 1 Pro, (c) ColorReader, and (d) Pico ((a) ©Nix Sensor Ltd., Hamilton, ON, Canada; (b) ©Variable Inc., Chattanooga, TN, USA; (c) ©Datacolor GmbH, Marl, Germany; (d) ©Palette Pty Ltd., Melbourne, Victoria, Australia; images are reproduced with permissions from Nix Sensor Ltd., Variable Inc., Datacolor GmbH, and Palette Pty Ltd.).
Sensors 24 08208 g002
Table 1. Low-cost portable spectrophotometers evaluated in this study.
Table 1. Low-cost portable spectrophotometers evaluated in this study.
SpectrophotometerNix Spectro 2 aSpectro 1 Pro bColorReader cPico d
Price (USD)~1200~300~130~120
Resolution31 channels (10 nm steps between 400–700 nm)31 channels (10 nm steps between 400–700 nm)3 (RGB)3 (RGB)
Geometry45° (ring)/0°Diffuse/0°~35° (ring)/0° e~35°/~35° e
Illumination8 CRI LEDsFull-spectrum LEDs6 CRI LEDs3 (LED) floodlights
IlluminantsA, C, D50, D55, D65, D75, F2, F7, F11A, F2, D50, D65//
Observer2°, 10°2°, 10°//
Calibration steps1311
Claimed average inter-instrument agreement0.35 ΔE000.35 ΔE00/ f/ f
LibrariesSeveral (incl. RAL, Pantone, NCS)Several (incl. RAL, Pantone, NCS)Several (incl. RAL, NCS)Several (incl. RAL, NCS)
a Nix Sensor Ltd., Hamilton, ON, Canada, www.nixsensor.com/nix-spectro-2/, b Variable Inc., Chattanooga, TN, USA, www.variableinc.com/spectro-1-pro.html, c Datacolor GmbH, Marl, Germany, www.datacolor.com/colorreader/products/colorreader, d Palette Pty Ltd., Melbourne, Victoria, Australia, palette.com.au/pico, e our estimation according to the illuminator/sensor geometry, f not found.
Table 2. Accuracies (in %) of four spectrophotometers and a smartphone in matching 183 RAL Design System Plus (RAL+) colors when (a) only studied colors (“Strict”), or (b) also adjacent colors (i.e., being gradually different in only one coordinate, i.e., hue, lightness, or chroma) were considered true (“Loose”).
Table 2. Accuracies (in %) of four spectrophotometers and a smartphone in matching 183 RAL Design System Plus (RAL+) colors when (a) only studied colors (“Strict”), or (b) also adjacent colors (i.e., being gradually different in only one coordinate, i.e., hue, lightness, or chroma) were considered true (“Loose”).
Color-Matching Accuracy (%)Nix Spectro 2Spectro 1 ProColorReader aPico bSmartphone b
(a) Strict98.476.0 (86.3 c)78.524.047.5
(b) Loose99.586.386.253.676.5
a Two faulty measurements were excluded from the calculations (n = 181). b Matching was based on the minimal ΔE00 to the labeled RAL+ colors. c Matching accuracy when 19 missing RAL+ assessed colors were dismissed.
Table 3. Color differences (ΔE00 median and, below in the squared brackets, minimum, 25th, 75th percentile, maximum) for (a) measured–labeled, (b) measured–assessed, and (c) normalize–labeled RAL+ colors (labeled: RAL+ color label, assessed: evaluated by the device manufacturers, measured: estimated by the spectrometers, normalized: mapped to the labeled RAL+ colors).
Table 3. Color differences (ΔE00 median and, below in the squared brackets, minimum, 25th, 75th percentile, maximum) for (a) measured–labeled, (b) measured–assessed, and (c) normalize–labeled RAL+ colors (labeled: RAL+ color label, assessed: evaluated by the device manufacturers, measured: estimated by the spectrometers, normalized: mapped to the labeled RAL+ colors).
ComparisonNix Spectro 2Spectro 1 ProColorReaderPicoSmartphone
(a) Measured vs. labeled *1.87
[0.38 1.32
2.42 4.34]
1.79
[0.42 1.04
3.59 9.41]
1.27
[0.33 0.84
1.83 7.19]
3.95
[1.23 2.64
5.88 12.84]
/ b
(b) Measured vs. assessed0.52
[0.16 0.43
0.66 1.30]
1.07
[0.21 0.74
1.53 3.63]
1.39
[0.01 0.98
1.83 4.31]
/ a/ b
(c) Normalized vs. labeled1.01
[0.19 0.73
1.43 3.83]
1.19
[0.14 0.86
1.60 7.14]
1.11
[0.20 0.77
1.61 6.33]
1.88
[0.26 1.23
2.85 7.37]
1.84
[0.20 1.21
3.21 8.51]
* The difference between measured and labeled colors is a limited measure for colorimetric accuracy (see Section 2.4), a Pico does not provide assessed RAL+ color values. b Not applicable.
Table 4. Overall colorimetric performances (matching and evaluating RAL+ colors in the CIELAB color space) and listed prices of four spectrophotometers and a smartphone used in this study.
Table 4. Overall colorimetric performances (matching and evaluating RAL+ colors in the CIELAB color space) and listed prices of four spectrophotometers and a smartphone used in this study.
DeviceRAL+ Color MatchingΔE00  aPrice
(1) Nix Spectro 2almost perfect (~99%)0.52–1.05~USD 1200
(2) Spectro 1 Pro, ColorReadervery good (~85%)1.07–1.39USD 130–300
(3) Pico, smartphone Asus 8good (~54–76%)~1.85USD 120–400 b
a Estimated from matched, assessed, and normalized RAL+ colors (Section 3.1 and Section 3.2). b USD 400 is the price of dermatoscope DL1, needed for colorimetric calibration of a smartphone.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Samec, J.; Štruc, E.; Berzina, I.; Naglič, P.; Cugmas, B. Comparative Analysis of Low-Cost Portable Spectrophotometers for Colorimetric Accuracy on the RAL Design System Plus Color Calibration Target. Sensors 2024, 24, 8208. https://doi.org/10.3390/s24248208

AMA Style

Samec J, Štruc E, Berzina I, Naglič P, Cugmas B. Comparative Analysis of Low-Cost Portable Spectrophotometers for Colorimetric Accuracy on the RAL Design System Plus Color Calibration Target. Sensors. 2024; 24(24):8208. https://doi.org/10.3390/s24248208

Chicago/Turabian Style

Samec, Jaša, Eva Štruc, Inese Berzina, Peter Naglič, and Blaž Cugmas. 2024. "Comparative Analysis of Low-Cost Portable Spectrophotometers for Colorimetric Accuracy on the RAL Design System Plus Color Calibration Target" Sensors 24, no. 24: 8208. https://doi.org/10.3390/s24248208

APA Style

Samec, J., Štruc, E., Berzina, I., Naglič, P., & Cugmas, B. (2024). Comparative Analysis of Low-Cost Portable Spectrophotometers for Colorimetric Accuracy on the RAL Design System Plus Color Calibration Target. Sensors, 24(24), 8208. https://doi.org/10.3390/s24248208

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop