4.1. Measurement Precision and Accuracy
The Keyence Microscope was utilized as a baseline tool to compare measurements from OCT and the XRCT, as it produces direct images of tablets and film coat while OCT and XRCT generate reconstructed images. Although the Keyence method aims for precision and accuracy, a reasonable standard deviation is expected due to the inherent variability of the film coat. This variability is a normal factor resulting from the overall film coating process and can cause differences in thickness both across the surface of individual tablets and among tablets from the same batch [
17]. The uneven coating visualized through the Keyence supports the high relative standard deviation values. Additionally, across all methods, Tablets A and C consistently exhibited the highest RSD values while Tablet B showed the lowest. However, the mean and median values presented in
Table 4 are closely aligned, indicating a symmetric distribution and supporting the use of the Keyence Microscope as a reference method for film coat thickness measurements.
When comparing the OCT and Keyence values in
Figure 4B,C for Tablet D, there is no overlap in the interval pots and two outliers overlapping the boxplot within the 50% middle region. These plots combined with the results of the
T-test yielding a
p-value of 0.0 indicate that there is strong evidence differentiating the measurements between the Keyence and the OCT. However, when looking at the comparisons for Tablet B in
Figure 4E,F there is an overlap between the data for the Keyence and Wasatch Spark OCT. Additionally, the
T-test comparing the data for Tablet B measured by the OCT and Keyence yields a
p-value of 0.207, which is greater than α= 0.05, indicating that there is no statistical difference between the data sets. The results of the data analysis show that the OCT did not provide accurate film coat thickness measurements; however, the measurements were the most precise out of all three methods with the lowest average RSD of 11.5% for all four tablets.
This poses the question of the accuracy of the OCT as there is a statistically significant difference between the data for Tablet D measured by the OCT and Keyence, and no statically significant difference for the measurements of Tablet B. After investigating the data and looking at the results of Tablet A and C, it was hypothesized that an X-factor could be used to adjust the data as the values were precise, but not accurate. To attempt to calculate an X-factor, the following procedure was followed:
The generated X-factors for Tablets A–D were determined to be 1.39, 0.96, 1.41, and 1.58, respectively. These values are inconsistent and when looking at the nominal thickness of the tablets generated by the Keyence, there is a correlation between thickness and X-factor adjustment. The thicker the film coat, the less adjustment is needed, and the X-factor decreases as thickness increases as shown in
Figure 7, where thickness is presented as percent weight gain. These values were obtained from an additional experiment measuring Tablet A coated at increasing thickness and examined using the Wasatch Spark OCT. This is further supported by the accurate OCT measurements of Tablet B, which had the thickest film coat and showed the smallest difference from the reference value, with only a 2.4% difference. As a result, a set X-factor value could not be determined, and further testing is needed to generate a model that is representative of the necessary adjustment factor.
The exact reason for the inaccuracy of the thickness values generated from the Wasatch Spark OCT is unknown and needs to be further investigated. However, it is believed that the adjustment is isolated to the specific OCT and is not applicable to all OCT instruments.
Due to the inconsistencies present in the OCT data using the Wasatch Spark OCT, a second OCT study was conducted with an alternate OCT instrument, the OSeeT by Phyllon GmbH, using Tablet D. This data yielded a mean of 26.4 µm, which is a 54.1% difference from the mean of 46 µm that was gathered from the Wasatch OCT. The plots presented in
Figure 6B,C show a greater overlap of the Keyence and OSeeT OCT data than the Wasatch Spark OCT data, although the data still falls in different groupings. The
T-test comparing the Keyence to the OSeeT OCT data also yielded a
p-value of 0.035 which is less than α = 0.05, indicating a statistically significant difference. However, this is expected as the second OCT study utilized Tablet D samples from a different batch than the Keyence. The OSeeT OCT study provides closer data to the Keyence and provides more support for the OCT as an acceptable method of accurately measuring tablet film thickness. Additionally, the data obtained from the OSeeT was compared to SEM and NIR which are qualified methods utilized by the team that performed the second OCT study (
Figure 8). With the significant overlap of the data from the validated SEM method, there is further support for OCT as an accurate and reliable method. However, due to the variability between the data sets, further experiments should be conducted to definitively establish the accuracy of the OCT method for measuring tablet film coat thickness.
XRCT was also used to measure the film coat thickness of the four different tablets. When comparing the XRCT to the Keyence values as seen in
Figure 4B,C, for Tablet D there is overlap present in both the interval plot and boxplots. However, the boxplot does reveals both high and low outlier values, and the XRCT had the highest RSD average across the four tablets indicating issues with the precision of the measurements. These plots, combined with a
p-value of 0.135 generated from a two-sample
T-test indicate that there is no statistically significant difference between the measurements generated from the Keyence and XRCT for Tablet D. Similarly, when looking at the analysis of Tablet B in
Figure 4E,F, there is again overlap of the interval and boxplots, with fewer outliers than Tablet D. A
p-value of 0.525 was generated from a two-sample paired
T-test, which is greater than the indicated α = 0.05, also supporting that there is no statistically significant difference between the Keyence and XRCT for Tablet B. The data analysis reveals a strong indication of accurate measurements from the XRCT but combined with the large relative standard deviations, raises questions regarding the precision of the measurements.
An ANOVA test was performed comparing all three methods for Tablet B and D which yielded a p-value of 0.043 and 0.0, respectively, both of which are less than the designated alpha value of 0.05, indicating that there is evidence to reject the null hypothesis that all three instruments provide the same measurement. However, this rejection is expected considering the X-factor adjustments needed for the OCT. When looking at the OCT, used in the primary study, and XRCT individually compared to the Keyence measurement data, the OCT provides precise, but inaccurate data, whereas the XRCT provides accurate but imprecise data.
4.2. Pugh Matrix
While precision and accuracy are fundamental criteria for evaluating the efficacy of measurement methods, additional factors must be considered when selecting an instrument for film coat thickness measurement during the development stage. These factors include, but are not limited to, ease of use, safety, and adaptability. An Analytical Hierarchy Process was employed to determine the relative importance of the selected criteria. Each criterion was systematically compared to the others to establish weighting factors that were subsequently incorporated into a Pugh Matrix, which was used to evaluate and compare the performance of the three measurement methods. The Pugh Matrix utilized a scoring scale ranging from 1 to 3, where 1 indicates the lowest performance and 3 the highest, for each criterion. This structured approach enabled a comprehensive comparison of the OCT and XRCT methods relative to the Keyence Microscope. The complete Analytical Hierarchy Process and Pugh Matrix can be found in
Figure A1 and
Figure A2, respectively.
The selected criteria include instrument ease of use, software ease of use, safety, precision/accuracy, time to complete, and adaptability. Stakeholders in the oral solid dosage development space were consulted to help develop these criteria and associated weighting. GMP compliance is not listed as a criterion for the lab/development scale as development labs are commonly non-GMP facilities; however, methods used at manufacturing sites must adhere to GMP compliance. Additionally, cost was not factored into the criteria ranking as at the time of testing, all methods were available in the utilized lab-space. Acquiring a new instrument will necessitate vendor research and depend on the desired design and complexity, as there are a multitude of options available on the market.
Within the Analytical Hierarchy Process, safety was determined to be the most critical criterion. When comparing the methods, the only safety concern for the OCT is the use of the laser, but the instrument has an inherently safe design and should not pose any significant risks. Both the Keyence and the XRCT presented minor safety considerations. The Keyence method requires physical destruction of tablets and is therefore only recommended for OEB 1–3 products that can be safely handled and cut within a ventilated balance enclosure. In contrast, the XRCT method is non-destructive but involves possible radiation exposure, necessitated specialized training and dosimeter usage for operator safety. Therefore, the Keyence and the XRCT were given the same score, and the OCT received the highest score.
Precision and accuracy were valued criteria as the method must provide measurements that are representative of the true film coat thickness of the tablet. As previously described, the Keyence served as the trusted reference measurements, with the only variability resulting from the inherent nonuniform coating thickness on the surface of tablets, and non-automated measurements, but both factors are consistent across all three methods. The OCT yields precise data with the lowest relative standard deviations, although the accuracy of the specific instrument was significant due to possible miscalibration. This was resolved with the presentation of accurate data via the External OCT Study and therefore received the same score as the Keyence as the inaccuracies are expected to be isolated to the specific OCT instrument used in the primary tablet trials. The XRCT presented the lowest precision and accuracy due to the resolution limitations, especially with larger tablets. Tablet B was the largest tablet and therefore could only reach a resolution of 7 µm/voxel based on distance from the source, but the instrument has a maximum resolution of 4 µm/voxel. The XRCT could be sufficient for thicker film coats (>50 µm) but can present challenges for thinner film coats or large tablets (>4 mm), especially in the case of functional coatings where a set thickness needs to be validated.
Adaptability received the same priority ranking as precision and accuracy. When working in the drug product development stage, the spray process is being optimized, so it is necessary to check coating thickness to observe how the film is building for a set of process parameters. Additionally, multiple distinct types of tablets and film coats are commonly in the development pipeline and present in a laboratory space at a given time, so the method needs to be versatile and have the capacity to measure a variety of tablets. This is in comparison to the manufacturing scale where in-line film thickness measurement tools are typically calibrated to a specific product with confirmed process parameters.
All three methods have unique challenges with adaptability. The Keyence does not have any size limitations and can visualize all varieties of film coats, regardless of thickness, including both clear and opaque coats. However, Keyence measurement requires the physical cutting of a tablet that exposes the core and is therefore limited to non-potent products. It is a possibility that the Keyence can be integrated into an isolator to measure OEB 4/5 tablets, but this would increase challenges with ease of use and safety. The OCT also does not have any size or thickness limitations, although thicker coatings can be observed more distinctly. However, the OCT can also only be used for clear-coated tablets as the light cannot penetrate through opaque coatings. The OCT is also non-destructive and is therefore a safer option if needed for potent products. The XRCT has minor size and thickness limitations due to its resolution capabilities, but it is important to note that all four tablets used in the study, which varied in size and thickness, were successfully measured using XRCT, although the image quality was affected. Additionally, the XRCT can measure both clear and opaque film coats, and like the OCT, is a non-destructive method.
When ranking adaptability, product portfolio consideration is crucial; if there are no potent products, then the Keyence is the most adaptable, and if there are only opaque products, then the OCT cannot be used. An additional consideration for adaptability is the multipurpose use of the instrument. Versatility enhances the overall value of the instrument by allowing it to address multiple analytical needs within the development process, thereby improving efficiency and reducing cost by limiting the need for multiple specialized devices. For instance, the XRCT is traditionally used to evaluate internal defects, such as cracking and the Keyence also has a laser functionality which measures surface roughness. However, as OCT was not originally designed for pharmaceutical use it is therefore limited in its applications in a development lab. Without specific product portfolio considerations, the XRCT received the highest score as size and thickness primarily impact image quality and there are no hard limitations, but these scores can vary for individual use cases.
Instrument and software ease of use are also criteria to evaluate when considering implementing a new method. For this study, both software and instrument were evaluated separately, but hold the same scoring weight. The OCT and Keyence systems exhibit comparable ease of use featuring straightforward interfaces and simple adjustments for visualizing the film coat and capturing images. Both methods require positioning the tablet under the camera, focusing the image, and using the built-in caliper tool to manually measure coating thickness. The Keyence provides direct imaging but necessitates physical cutting of the tablets. Once a tablet is secured on the stand, it remains stationary and can be shifted using the microscope controls to bring a region into the field of view. However, at high magnification, focusing the camera can be challenging, requiring frequent adjustments and repositioning to obtain multiple measurements. Alternatively, the OCT requires manual rotation of the tablet to capture images of different quadrants and similar focus adjustments to achieve a clear reconstruction image. The OCT software v.2.1.8.0 allows the image to be frozen, enabling multiple measurements to be recorded simultaneously. A second camera view also facilitates precise adjustment of the laser and identification of the measurement point to help improve visualization of the tablet film coat. Additionally, the measurements generated on the OCT are not the true measurements and require a calculation using the refractive index of the coating solution, which may need to be found separately if not already known. Some OCTs, such as the OSeeT used in the follow-up OCT study, have a feature that automatically performs calculations to provide final measurement data, whereas, for the Wasatch OCT, the data had to be extracted and calculated separately.
In terms of ease of use, the XRCT requires minimal set-up beyond mounting the tablet within the scanner. However, the overall process is more complex compared to other methods. This study utilized three software programs associated with the XRCT system: SkyScan 1275 Scanning Software v.1.7, NRecon v.1.7.4.6, and DataViewer v.1.5.6.2. The most challenging aspect of the XRCT is optimizing the scanning parameters which vary depending on the tablet’s size and density. Parameters such as voltage, exposure time, scanning angle, and resolution must be carefully adjusted for tablet type to achieve optimal image quality. Following the scanning procedure, image reconstruction is required, involving additional parameter adjustment to enhance image clarity. The DataViewer software v.1.5.6.2 provides multiple viewing options to visualize the tablet from different orientations. The primary limitation of DataViewer is that the built-in caliper tool allows only measurement to be recorded at a time. However, it offers an attenuation graph that aids in distinguishing the interface between the core and the film coat with the delineation is unclear. Considering these factors, both the Keyence and OCT received equivalent scores for instrument and software ease of use, while the XRCT while assigned a lower score.
The final criterion to consider is the time to complete. At the development stage, the goal is to obtain a quick measurement to verify parameters and coating thickness as the measurements may need to be taken multiple times for multiple tablets. The Keyence and OCT only allow one tablet at a time to be measured and took approximately the same duration to complete. However, the OCT used in the second study had the capacity to measure multiple tablets at once, which based on the specific instrument can decrease the testing time. With normal XRCT use for internal defects, multiple tablets can be contained and measured in one scan, but due to the need to bring the tablet as close to the source as possible, only one tablet could be scanned at a time. With the set scanning parameters, each scan took approximately two hours to complete and an additional 15 min for reconstruction. Although time-consuming in comparison to the Keyence and OCT, especially for larger sample sizes, the same scans can also be used to evaluate internal defects as mentioned in the adaptability considerations. Despite this, compared to the brief time needed for OCT and Keyence measurements, the XRCT received the lowest score.
Based on the results of the Pugh Matrix, the Keyence received the highest score given the criteria weighting. The OCT is close in score but lower due to its limited adaptability, and the XRCT received the lowest score due to ease of use and time to complete. However, it does not directly signify that the Keyence is the ideal method, as it still has limitations regarding safety and requires consideration of tablet potency.
When comparing existing methods, such as SEM, which was not explicitly evaluated in this study, this technique commonly used for particle characterization yields high-resolution images that show the delineation between film coat and core tablet. However, SEM typically requires physical destruction of the tablet, similar to the Keyence method [
8]. A further study incorporating SEM may be beneficial to evaluate its efficacy relative to the Keyence, OCT, and XRCT. The current standard method of assessing film coat thickness by percent weight gain is a quick, simple macroscopic technique that requires only an analytical balance and basic calculations. However, it provides only an average thickness for a batch sample and does not offer information regarding coating uniformity or quality. Therefore, it is advisable to use one of the imaging methods evaluated in this study to validate weight gain results and obtain more detailed insights into the tablet and coating characteristics [
6].