1. Introduction
The use of modern technologies has modified our daily habits [
1,
2], especially following the COVID-19 pandemic, with the wide introduction of digital tools in academic [
3] and work environments [
4,
5] and an exponential increase in their use. In the health context, many applications have been developed and released in digital stores (App Store and Google Play) for various purposes such as screening or diagnosis of distinct pathological conditions [
6]. However, these tools require rigorous scientific studies to support and ensure their correct use in a clinical setting [
6]. Among the applications/platforms that have been scientifically validated for clinical use, some evaluate visual acuity (VA) [
7], stereopsis [
8,
9,
10,
11], achromatic contrast sensitivity function (CSF) [
12], visual performance with a multifocal lens [
13], and color vision [
14].
As mentioned, several digital applications have been developed for the specific measurement of contrast sensitivity (CS), which is the ability of the visual system to distinguish objects against a set background. This type of clinical measurement is especially useful for characterizing visual performance in elderly patients, but it is not usually incorporated into routine optometric/ophthalmological examinations. Furthermore, the measurement of contrast sensitivity function over short distances is especially relevant when evaluating the outcomes of any procedure to compensate for presbyopia, such as multifocal contact lenses or intraocular lenses [
15,
16]. However, this parameter is not commonly used (only in very few studies), and researchers prefer to evaluate distance contrast sensitivity, which is expected to be affected less. One reason for that may be that this test can be considered time-consuming or difficult to perform, but this can be overcome by using the previously mentioned digital tests displayed on calibrated tablets.
Very few studies have tried to compare the results of a digital evaluation of CSF with those obtained with conventional tests [
12,
17,
18,
19,
20]. Furthermore, most studies are focused on the evaluation of distance CSF. Bühren et al. [
20] carried out a comparative study of achromatic CS under varying light conditions using three different instruments (FF-CATS at 4 m, FACT at optical infinity, and Pelli–Robson at 1 m) in three types of populations: healthy individuals under 50 years of age, healthy individuals over 50 years of age, and patients over 50 years of age with cataracts. In this study, the authors concluded that, under the different light conditions established, the results obtained with the evaluated instruments were not interchangeable. Rodriguez-Vallejo et al. [
12] compared a new application (ClinicCSF) to measure CSF (at 2 m) with the iPad Retina against the Functional Acuity Contrast Test (FACT), confirming that there were no significant differences between tests when the same contrast sensitivity steps were used. However, no comparative analyses have been performed between printed and digital tests for measuring contrast sensitivity over short distances.
The Optopad digital tool is one of these new technologies for evaluating visual performance, and it was developed in collaboration between the Universities of Alicante and Valencia (Spain) [
21]. This digital test has not yet been commercialized; thus, its use is restricted, but it has been validated for the detection of chromatic deficiencies (Optopad-Color) [
14,
22] and has been shown to be useful in characterizing achromatic and chromatic contrast sensitivity function (Optopad-CSF) over short distances [
22,
23]. This system was developed in an attempt to obtain a low-cost, portable digital tool for the evaluation of CSF and color vision in clinical settings, allowing a fast measurement procedure. Aside from the detection of chromatic anomalies, the intention was also to use advances in digital technology to create an easy-to-use test for measuring achromatic and chromatic CSF over short distances.
The evaluation of chromatic contrast sensitivity over short distances is a procedure that is not commonly performed in routine clinical practice, but its potential usefulness should be investigated further. To date, there have been a number of studies investigating the response of the visual system to chromatic contrast [
24,
25,
26,
27]. Our research group [
28] conducted a comparative pilot study with 10 young subjects in which the effects produced by seven filters (three gray filters, four chromatic filters, and two low-vision lenses) on CSF were compared. This study concluded that, compared to gray filters of the same luminance, yellow filters may be useful when low achromatic contrasts are to be improved, although overall decreases in brightness may occur. Kim et al. [
26] conducted a pilot study with 13 patients to record the differences obtained in the measurement of achromatic and chromatic CSF in near and far vision after varying luminance. They concluded that luminance causes a drop in the measure of contrast sensitivity, but it does not affect the shape of the CSF. After this, the same group conducted another study to establish normative values for achromatic and chromatic CSF measures [
25]. However, it should be considered that the measurements were obtained at an intermediate distance (58 cm). These authors found higher sensitivity to the contrast of the L/M cone compared to the S cone and the achromatic responses. Wuerger et al. [
24] evaluated the effect of the variation in luminance at two different distances, 91 cm (distance vision) vs. 45.5 cm (near vision), obtaining a luminance-dependent computational model predicted by the CSF for achromatic and chromatic stimuli of arbitrary size. Bodduluri et al. [
29] conducted a comparative study of sensitivity to chromatic contrast (30 cm) in near vision with an application that operated on an iPad versus the results obtained with the Cambridge Color Test (CCT). The sample size was 100 healthy individuals. The authors concluded that, except for a game used to evaluate the blue–yellow contrast sensitivity, the CCT and tablet computer-based games showed similar repeatability, with comparable 95% limits of agreement. Wong et al. [
27] performed color CS testing of each eye using Chromatest in a sample of 150 eyes of diabetic patients. This non-comparative study did not achieve results to justify use of Chromatest for screening, but it reinforced the changes seen in tritan color vision in diabetic retinopathy. The Optopad-CSF test also allows the evaluation of near chromatic CSF, but its clinical usefulness has not been investigated in detail. Only this test has been shown to be capable of detecting chromatic contrast sensitivity alterations in patients suffering from COVID-19 compared to age-matched healthy controls.
As previously mentioned, one critical aspect when a new digital test is developed is to confirm its clinical validity [
6]. The validity of the measurements of near chromatic and achromatic CSF measurements obtained with the Optopad-CSF test is yet to be analyzed, and its clinical performance has not been compared with the performance of other tests for measuring near CSF. The aim of the current study was to analyze the performance of the Optopad-CSF test in a healthy population and to compare the data obtained with those provided by a conventional printed test that is considered as the gold standard.
2. Materials and Methods
2.1. Patients
This was a prospective cross-sectional clinical study that enrolled a total of 51 patients who underwent a complete visual examination at the Optometric Clinic of the University of Alicante. The inclusion criteria for the study were patients 18 years old or older and patients with no active ocular or systemic pathology compromising their visual function. Exclusion criteria included children, previous amblyopia, strabismus, and patients with any type of previous ocular surgery. The study received the approval of the Ethics Committee of the University of Alicante (Date: 26 February 2021. Exp. UA-2021-02-17) and was conducted following the standards of Good Clinical Practice and the international ethical principles applicable to research on humans (Declaration of Helsinki in its latest revision). All patients were informed about the nature of the study before their inclusion and provided signed consent to participate in it.
2.2. Clinical Tests
All patients had a complete eye examination including measurement of uncorrected and corrected distance and near visual acuity, manifest refraction, evaluation of ocular alignment with cover test, slit lamp biomicroscopy, measurement of stereopsis, and evaluation of near contrast sensitivity function at 40 cm with two different tests: the Vistech VCTS (Stereo Optical Co., Inc., Chicago, IL, USA) and the Optopad-CSF tests. With both tests, patches showing sinusoidal gratings with different spatial frequencies are presented and the subject must detect the orientation of the light–dark gratings. All measurements were performed in the right or left eye; the eye was selected randomly. Measurements were performed once after a clear explanation of the task. It should be considered that most of the tests performed were psychophysical measurements that could be very tiring for the patient. All these clinical examinations were performed by the same experienced optometrist (K.J.M.G.). Contrast sensitivity measurements were performed with the most optimal spectacle refractive correction in a darkened examination room.
The measurement with the Vistech VCTS test was performed in an iso-illuminated cabinet (a period of adaptation to experimental light conditions of 3 min was required before measurement) to prevent non-controlled illumination of the test or the presence of light reflexes that could interfere with the measurement procedure. A total of 5 spatial frequencies are evaluated with this test (FA = 1.5 cpd, FB = 3 cpd, FC = 6 cpd, FD = 12 cpd, and FE = 18 cpd), each one corresponding to each horizontal line containing the text. Along the line, a total of 8 contrast levels (Michelson contrast formula) are presented to determine the threshold for the spatial frequency evaluated. In our study, subjects were asked about the orientation of the gratings (left, right, center), starting from the easiest task (low frequency, high contrast) to the most difficult (high frequency, low contrast). The last correctly seen contrast in each line (each spatial frequency) was considered as the threshold, and the contrast sensitivity value was obtained (inverse of the discrimination threshold value).
A similar procedure was followed with the Optopad-CSF digital test, with a constant (maximum) illumination of the screen. Subjects were also asked about the orientation of the gratings (left, right, up), starting from the easiest task to the most difficult. The threshold contrast value was considered to be the average value between the last correctly seen stimulus and the first unseen stimulus. It should be considered that Optopad-CSF explores spatial CSF in achromatic and chromatic mechanisms. The test contains plates for measuring achromatic (CSF-A) (F
1A = 1.5 cpd, F
2A = 3 cpd, F
3A = 6 cpd, F
4A = 12 cpd, and F
5A = 24 cpd), red–green (CSF-T), and blue–yellow (CSF-D) (F
1C = 1 cpd, F
2C = 2 cpd, F
3C = 4 cpd, F
4C = 8 cpd, and F
5C = 12 cpd) spatial contrast sensitivity along the cardinal directions of DKL space [
30]. Each CSF is measured by 5 plates, 1 for each spatial frequency evaluated. Each plate contains a series of sinusoidal gratings of achromatic or chromatic decreasing contrast (cone contrast formula) in 2-degree circular windows, arranged in a 4 × 4 grid on an achromatic background with the maximum generable luminance of the device. The orientation of the grid is randomly chosen from 3 possibilities (−15°, 0°, and 15°). The grille surround sound is, again, the achromatic stimulus of the device with 60 cd/m
2. To minimize intrusions of the achromatic mechanism, chromatic grids include random achromatic noise.
The Optopad-CSF 1.0 is a fast and non-invasive method to characterize CSF at near distance on a portable electronic display device emitting polarized light (Apple iPad 6th Gen A1893). The iPad Retina screen used had a display size of 2048 × 1536 pixels at 267 pixels per inch, with a screen size of 9.7 in and 8-bit per-channel color resolution. To correctly reproduce the spatial and colorimetric characteristics of the designed stimuli, the device was previously colorimetrically characterized using the 3DLUT method [
31].
2.3. Statistical Analysis
Statistical analysis was performed using the SPSS statistical software version 28.0.0 for Windows (IBM SPSS Inc., Chicago, IL, USA). Data distributions were not normally distributed according to the Kolmogorov–Smirnov test; as a result, non-parametric statistics were used. Differences between the CS measurements corresponding to the different spatial frequencies obtained with the digital and conventional procedures were assessed by using the Friedman test, with post hoc analysis with the Wilcoxon test and Bonferroni correction. The Bland–Altman method was used to analyze the level of clinical interchangeability between digital and conventional measures [
32]. Spearman’s Rho correlation coefficient was calculated to investigate the relationship between different variables.
Only in the case of the comparison of the Optopad achromatic CSF with the VCTS test, both contrasts were calculated using the Michelson contrast formula. The comparison between the results of the two devices used to measure the CSF must be approached with care due to the different design and measurement characteristics of each device. In the current study, this problem was addressed by calculating the value of the index of contrast sensitivity (ICS), based on the study by Koefoed [
17]. The normalized value of ICS is obtained by calculating the residuals, with respect to the median of the normal population, for each frequency. Differences were weighted according to the presumed clinical importance of each frequency. Thus, 6 cpd was assigned the highest power (factor 3), whereas the frequencies 3 and 12 cpd received factor 2, and the remaining test frequencies were not weighted.
4. Discussion
As previously mentioned, this study aimed to evaluate and compare two different methodologies for measuring near achromatic CSF: a printed conventional test (Vistech VCTS) (considered as the classic gold standard) and a digital test to be used in previously colorimetrically characterized tablets (Optopad-CSF). Thus, the interchangeability of a classic test and a new digital test for measuring near achromatic CSF in clinical practice is analyzed and can be confirmed. Furthermore, as the digital test permits the measurement of chromatic CSF, an analysis of red–green and blue–yellow CSF in the healthy population evaluated was performed to provide a characterization of these new aspects of the visual function for their use in future studies and clinical practice. To date, the Optopad-CSF test is the only currently available portable device for characterizing near chromatic CSF.
4.1. Comparison of Near Achromatic CSF Measured with Conventional and Digital Tests
Our comparative analysis revealed that there were significant differences between Vistech and Optopad tests in terms of near CSF only for higher spatial frequencies (12 cpd). However, differences between tests for the remainder of the spatial frequencies measured by both tests did not reach statistical significance. This is consistent with the results of Rodriguez-Vallejo et al. [
12], who compared a new digital application to measure CSF at 2 m with an iPad Retina against the Functional Acuity Contrast Test (FACT), confirming that differences between tests were not significant when the same contrast sensitivity steps were used. However, despite the absence of significant differences between the Vistech and Optopad tests in the CSF for most of the spatial frequencies evaluated, both tests cannot be used interchangeably. Bland–Altman analysis revealed a significant scatter of the differences between tests for all spatial frequencies evaluated, with ranges of agreement over the inherent variability of the measurement obtained with both systems [
22,
23,
33]. In addition, a slight trend of increased CS values with the Vistech VCTS test was observed, especially for the intermediate frequencies. These findings are coherent, as it should be considered that both tests were designed differently, presenting different contrast steps. Indeed, the higher number of contrast steps provided by the Optopad test may have allowed a more accurate determination of the contrast threshold in some cases.
In any case, both tests showed a correlation of the CS measures obtained with them and age, which confirms the capability of both tests for detecting age-related differences in CSF. It should be mentioned that not all correlations between CS measures obtained with the Vistech VCTS test and age reached statistical significance. Furthermore, in the comparison of CS values according to age, the digital application detected a decrease in the precise discrimination of CS with increasing age [
34]. Thus, for all the spatial frequencies, age groups over 40 years of age showed such CS decrease. However, this decrease was only observed for patients over the age of 50 when measuring CSF with the Vistech VCTS test.
To the best of our knowledge, no comparative analysis between near CSF tests (including digital tests) has been performed to this date. Therefore, there is no possibility, according to the scientific evidence, of providing information about which near CSF tests should be used and which differences can be expected to be found with them. This is surprising considering that the measurement of near CSF is crucial when evaluating the efficacy of different methods of compensation for presbyopia [
15,
16,
23,
35,
36]. However, very few studies used this variable to confirm how the optical correction method applied affects near visual quality. Possibly, an explanation for this could be the limited number of tests available for such purpose. However, more research should be performed on this to obtain information about how to better evaluate near visual performance with presbyopia correction options.
4.2. Measurement of Near Chromatic CSF
Although there are some studies investigating the response of the visual system to chromatic contrast [
24,
25,
26,
27,
28,
29], comparisons of our results with those from previous studies must be made very carefully, since, generally, the stimuli, lighting conditions, maximum luminance, reproduction devices, and color space can differ. In the case of sensitivity to achromatic contrast, this problem can be minimized by using the same definition of contrast (Michelson) and by comparing data using the ICS parameter [
17]. In the case of sensitivity to chromatic contrast, the procedure to follow is not obvious. The color space and the chromatic characteristics of the stimuli can present a very wide variability among studies; this variability can determine the results.
As expected, considering differences in design between tests used for measuring near chromatic CSF in previous studies, our chromatic CSF results, in numerical terms, are very different from those obtained by previous authors, but some trends are shared. Specifically, our results show that when evaluating CSF in the three mechanisms using the cone contrast formula, the RG mechanism presents greater sensitivity than the achromatic mechanism and, in both cases, greater sensitivity than the BY mechanism, as has been shown in other studies [
25,
34,
37]. Kim et al. [
25] used a different cone contrast space than that used in our study and obtained the three contrast sensitivity functions using the qCSF approach. They found higher sensitivity measured at 58 cm to the contrast of the L/M cone compared to the S cone and the achromatic responses. Likewise, these authors found correlations between the two chromatic CSFs, but they concluded that these could be attributed to the narrow age range of the patients evaluated. Xu et al. [
37] also proposed different conditions in their experiment compared to ours, with stimuli in the directions of cone contrast space but with white, red, yellow, and green backgrounds. Although the results of these two studies are not strictly comparable with ours, it was found that the shapes (band pass for A and low pass for RG and BY) and the relationships between the curves are similar. In our results, as previously mentioned, weak correlations were found between the red–green and blue–yellow CS values for each spatial frequency evaluated.
4.3. Correlation of Age and CS Measured with Optopad-CSF
Ashraf et al. [
34] found that the decrease in sensitivity with age was more noticeable in the achromatic CSF for high spatial frequencies and in the chromatic CSFs for low spatial frequencies. These results did not exactly agree with those found in the study. The behavior of the curves was similar for the same lighting level used in our study, but the dependence on age seemed to be more remarkable for medium spatial frequencies for the three channels. This behavior was more evident if sensitivity values were expressed in dB. This difference may be due to the fact that Ashraf and colleagues [
34] only evaluated two age groups, whereas five age groups were examined in our study.
Regarding the influence of age, Pearson et al. [
38] studied the variation of achromatic and chromatic CS for two stimulus sizes and found that they agreed with the loss of retinal ganglion cells. These authors worked with contrast-sensitivity-modulated stimuli along the luminance, equiluminant L-cone, and equiluminant S-cone axes. The authors indicated that their results showing a decrease in CS with age (0.4–0.7 dB per decade) were consistent with those from other similar studies. Although the characteristics of the stimuli used in the test evaluated here were different, the CSF variation with age (in dB) for each spatial frequency and for the three measured channels was also analyzed. In CSF-A, the greatest decrease in sensitivity occurred between the first two decades (20 to 39) and the rest (40 to 69), especially for low and medium spatial frequencies. For the highest spatial frequencies, the greatest decrease occurred in the last decade. The variations were in the range between 0.1 and 0.5 dB per decade. In the CSF-T and D, the decrease varied between 0.1 and 0.2 dB per decade, a much more stable behavior than in the case of achromatic measurement. In both cases, the variations were smaller than those reported by Pearson et al. [
38].
4.4. Limitations of the Study
This study has some limitations that should be acknowledged. First, the selection of a printed test as the gold standard for comparison can be considered as a potential limitation of the study, because this test only allows a very gross measurement of the CSF. It should be considered that our aim was to evaluate the clinical performance of a new low-cost, portable device to test near CSF, the Optopad test, that uses a Retina screen driven by an 8-bit graphic card. A graphic card with greater resolution would have been ideal for measuring the CSF more precisely but would have required a more expensive set-up not easily accessible for clinicians and may have only been useful for research purposes. The panel design of the Optopad test takes the limitations of the actual graphic card into account. In the first place, the low average luminance of the stimulus and the achromatic noise masking the chromatic stimuli and the high luminance of the surrounding area help to reduce the subject’s sensitivity: the lowest generable contrast is not visible by any of the subjects used in the design stage, and the lowest contrast in the panel is greater than this value. On the other hand, with the panel design, the subject’s threshold is not determined precisely, but it is determined by which fixed class or category this threshold belongs (the range between the last stimuli seen and the first stimuli not seen). In this line, it makes sense to compare our device with another with a similar measurement strategy, and for this reason, the VCTS test was chosen for comparison. The sample size can be considered as a second limitation of the study. The sample size could not be increased due to logistic problems. However, in the near future, we plan to enlarge it. Therefore, this study can be considered as the preliminary evidence of the potential usefulness of the Optopad test, which should be investigated further in future studies. Specifically, more analysis is required in studies with larger samples to better characterize the age-related changes in the measurements evaluated, as well as the influence of other factors such as sex or ethnicity.
Another aspect that may be considered as a potential limitation is that it is known that children and adults tend to have neural biases to gratings of different orientations [
39]. As the test consists of the discrimination of the orientation of gratings, this potential preference may constitute a source of bias. However, this is especially present where there is an uncorrected refractive error, and in our sample, all subjects were evaluated with spectacle correction. Furthermore, the orientations of the gratings in the Optopad-CSF test are similar to those used in the VCTS test in order to avoid the well-known oblique effect that occurs in the human visual system when presenting gratings at 45°. Therefore, the potential contribution of this factor seems to be residual. In addition, none of the patients tested in our sample provided a response demonstrating a clear preference over a specific orientation, and consequently, this phenomenon was not a limiting factor.