Next Article in Journal
Detection, Quantification and Molecular Characterization of Fowl Adenoviruses Circulating in Ecuadorian Chicken Flocks during 2019–2021
Previous Article in Journal
Image Classification and Automated Machine Learning to Classify Lung Pathologies in Deceased Feedlot Cattle
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Analytical Performance Evaluation of the New GEM® Premier™ 5000 in Comparison to the Epoc® Blood Gas Analyzer in Horses

1
Department of Clinical Sciences, Faculty of Veterinary Medicine, University of Liege, 4000 Liege, Belgium
2
Department of Clinical Sciences, Faculty of Veterinary Medicine, University of Zagreb, 10000 Zagreb, Croatia
3
German Olympic Committee for Equestrian Sports, 48231 Warendorf, Germany
*
Author to whom correspondence should be addressed.
Vet. Sci. 2023, 10(2), 114; https://doi.org/10.3390/vetsci10020114
Submission received: 8 December 2022 / Revised: 25 January 2023 / Accepted: 31 January 2023 / Published: 3 February 2023
(This article belongs to the Section Veterinary Surgery)

Abstract

:

Simple Summary

Blood gas analyzers are stationary or hand-held machines used to measure blood gases and electrolytes in a blood sample taken from a patient. No machine has been specifically designed for use in horses, and therefore every machine needs to be validated before being used in equine practice. The aim of this study was to compare the newly marketed GEM5000 machine to the formerly validated epoc machine for blood gas analysis in horses. Blood samples taken from healthy and sick horses were run on both machines in alternate order, and various statistical tests were used to analyze if the two machines give similar results. Although the precision of the GEM5000 is good for most parameters, the agreement with the epoc machine is not always satisfactory. Therefore, data from different blood gas machines should not be used interchangeably.

Abstract

Different blood gas analyzers are used in equine practice. Every machine needs to be validated, as they have not been designed for use in horses. The aim of this study was to compare the newly marketed GEM5000 machine to the formerly validated epoc machine for blood gas analysis in horses. In this prospective, non-blinded, comparative laboratory analyzer study, 43 equine blood samples were analyzed on both analyzers and values were compared between the two machines via Lin’s concordance analysis, Passing–Bablok regression analysis and Bland–Altman plots. Duplicate measurements were conducted on the GEM5000 machine to evaluate precision. The GEM5000 failed to achieve the required precision for tHb, Hct and iCa2+, but achieved acceptable precision for all other parameters. Concordance correlation analysis revealed poor correlation for Na+, Cl, iCa2+, K+, Hct and tHb, while there was an at least moderate agreement for all other parameters. Passing–Bablok regression revealed significant constant bias for pCO2, pO2, Cl, and iCa2+ and significant proportional bias for pCO2, iCa2+ and SO2. Bland–Altman analysis revealed significant systematic bias for Na+, Cl, iCa2+, K+, Hct, tHb and SO2. This study shows that while precision of the GEM5000 is good, values should not be used interchangeably with data obtained from other blood gas analyzers.

1. Introduction

The blood gas and electrolyte analysis (BGEA) is an essential tool in equine medicine and research as it helps the veterinarian to establish a clinical diagnosis, a prognosis and to provide an appropriate therapeutic monitoring of patients. Most machines offer the possibility to measure pH, partial pressures of oxygen (pO2) and carbon dioxide (pCO2), as well as electrolytes such as sodium (Na+), potassium (K+), chloride (Cl) and ionized calcium (iCa2+).
BGEA is especially indicated in patients in whom acid–base or electrolyte imbalances are suspected [1,2,3], such as in critically ill patients, where BGEA helps in monitoring patients and guides fluid support according to their needs. Likewise, the use of BGEA has been recommended to monitor exercising horses, as high-intensity exercise is associated with alterations in acid–base and electrolyte balance [4,5,6,7,8,9,10,11,12]. In addition, arterial BGEA can be used to assess ventilation efficiency of the lungs [2], making it indicated for the monitoring of patients undergoing general anesthesia, patients suffering from cardiac or respiratory disease and critically ill foals [3].
Since BGEA has become common practice in equine medicine, in clinics as well as in field conditions, several analyzers, hand-held and stationary ones, have been used and validated for equine practice, although none of these analyzers have been specifically designed for use with equine blood. Therefore, each machine needs to be validated and results of different devices should not be used interchangeably without precaution [13]. Recent papers compared various machines [13,14,15], but no study has evaluated the GEM5000 analyzer in horses so far.
The GEM5000 (Instrumentation Laboratory, Bedford, MA, USA) has been developed for the quantitative measurement of pH, pCO2, pO2, Na+, K+, Cl, iCa2+, glucose, L-lactate, total hemoglobin (tHb), hematocrit (Hct), saturation of hemoglobin (SO2) and CO-oximetry parameters in human whole blood. This analyzer is equipped with a so-called iQM2 system that provides automated continuous quality assurance in real time. The iQM2 technology performs continuous checks, before, during and after each sample, while errors are automatically detected and corrected, claiming superior reliability of the machine.
For the purpose of this study, the GEM5000 was compared to the epoc analyzer which has recently been validated for use with equine blood [13,14]. Our hypothesis was that the results obtained with the GEM5000 will not differ significantly from those obtained with the epoc machine, rendering the GEM5000 reliable for use in clinical settings for BGEA in horses.

2. Materials and Methods

2.1. Animals

Whole blood samples were collected from horses during their stay at the Equine Hospital of the University of Liege. Blood samples were taken from horses because of their primary clinical condition and only when deemed necessary by the clinician in charge. No extra blood was taken solely for the purpose of this study. In these conditions, no approval from the Ethical Committee of the institution was necessary. Owners of the horses agreed for the data of their horses and the results of the BGEA to be used for scientific purposes in an anonymized format. Forty-three blood samples from twenty-six horses admitted to the Equine Hospital of the University of Liege in January 2019 with various pathologies were used in this study. Horses with different diseases were recruited to ensure a wide range of blood gas partial pressures and electrolyte concentrations.

2.2. Sample Collection

Blood samples were taken in prefilled heparinized syringes (Blood gas-Monovette®, Sarstedt AG & Co. KG, Nümbrecht, Germany) as a part of the clinical work-up of the patients or as a part of monitoring during general anesthesia. Blood samples were taken from the jugular vein or from the carotid artery in standing horses or from a catheter placed in the transverse facial artery in anaesthetized horses.

2.3. Sample Analysis

Analyses were immediately performed after blood sample collection and both machines were used in alternating sequence. Both instruments were maintained, calibrated and operated according to the manufacturers’ guidelines. The devices were installed side by side to minimize the time interval between measurements. The following parameters were evaluated for the comparison of the two machines: pH, pCO2, pO2, Na+, Cl, iCa2+, K+, Hct, tHb, BE, SO2 and HCO3.
To evaluate the precision of the GEM5000 Premier machine, 29 samples were analyzed twice, in rapid succession. The following measured variables and calculated parameters were assessed for precision analysis: pH, pCO2, pO2, Na+, Cl, iCa2+, K+, Hct, tHb, BE, SO2 and HCO3.

2.4. Instruments

In both machines, epoc (epoc Blood Analysis System, Siemens Healthcare SA, Groot-Bijgaarden, Belgium), and GEM5000 (Gem Premier 5000, Zaventem, Belgium), the pH, pCO2 and electrolytes are measured potentiometrically with ion-selective electrodes and basing calculations on the Nernst-equation. Oxygen is measured with an ion-selective electrode of the Clarke type. The HCO3 is calculated by using the Henderson–Hasselbalch equation in both instruments using the following equation (log [HCO3] = pH + log pCO2 − 7.608).

2.5. Statistical Analysis

Precision. To evaluate precision of the GEM5000 machine, samples were run in duplicate, and the mean, the standard deviation and the coefficient of variation (CV) in percent of each duplicate measurement were calculated for each parameter (Microsoft Excel). The means of all the CV were compared to preset clinical limits of acceptance with the assumption that they should be equal to or less than 25% of the defined allowable total error [16]. The allowable errors for blood gases and electrolyte concentrations were based on the Criteria for Acceptable Performance of the Clinical Laboratory Improvements Amendments [17].
Agreement. In order to determine the bias between the two analyzers, results obtained from the GEM5000 machine were compared to those obtained from the epoc machine using concordance correlation analysis, the Bland–Altman method, and the Passing–Bablok regression analysis (MedCalc, Ostende, Belgium). Lin’s concordance correlation coefficient (rccc) has a measure for accuracy (bias corrected factor, Cb) and for precision (Pearson’s ρ). It serves as an indicator of the strength of concordance between two measurements [18]. A value of the rccc of less than 0.90 was considered as poor agreement, 0.90 to 0.95 as moderate agreement, 0.95 to 0.99 as substantial agreement and above 0.99 as almost perfect agreement between the methods [19].
The slope, the intercept and the residual standard deviation (RSD) of the Passing–Bablok regression analysis reflects the proportional, the constant bias and the random bias, respectively. If the 95% confidence intervals for intercept contained the value 0, and for slope the value 1, no significant constant or proportional bias between measurements is noticed. If data are normally distributed, 95% of random differences are expected to lie in the interval of −1.96 RSD to +1.96 RSD. A large interval is considered as an indicator for a high imprecision [20]. The linearity between compared results was assessed by the CUSUM test, which warrants the validity of Passing–Bablok procedure.
Additionally to regression analysis, Bland–Altman analysis determined the agreement between the compared methods by plotting the difference of two paired measurements against the mean of the two measurements. The mean difference between results of compared methods reflects the systematic bias. If the value 0 is included in the 95% confidence interval of the bias, it is assumed that there is no significant systematic bias [19,21]. Assuming that differences between measured values are normally distributed, 95% of all data points should lie within 1.96 times the standard deviation of the mean difference. This assumption allows for calculation of 95% limits of agreement [20,22]. The limits of agreement serve as an estimate of the total bias, which is composed of systematic and random bias and is assessed by the comparison with the pre-specified clinically allowable errors. Bias was assumed to be clinically relevant, if the 95% limits of agreement were outside the limits for the allowable total errors. The CLIA guidelines served as a basis for the assignment of limits for clinical acceptance [17].

3. Results

3.1. Animals and Samples

A total of 43 blood samples including 23 arterial and 20 venous blood samples were collected and analyzed. These samples were taken from 26 horses of various breeds (19 Warmblood Horses, 2 Frisians, 2 Riding Ponies, 1 Draft horse, 1 Quarter Horse, 1 Standardbred) and ages. There were 3 stallions, 14 geldings and 9 mares, aged between 1 and 25 years. The mean body weight was 543 kg and ranged between 293 and 700 kg.

3.2. Precision (Repeatability)

Table 1 displays the mean coefficient of variation (CV) of each of the 29 duplicate measurements obtained from the GEM5000 analyzer, with comparison to clinical limits of acceptance, which are defined as equal to or less than 25% of the defined allowable total error.

3.3. Agreement

Table 2 shows the mean values, standard deviations and ranges for the measured parameters of the two machines. Table 3 shows the results of the concordance correlation analysis between the epoc and the GEM5000 analyzer. At least moderate agreement was obtained for pH, pCO2, pO2, HCO3, BE and SO2, while the analysis revealed poor agreement for all measured electrolytes and tHb.
Table 4 shows the results of the Passing–Bablok regression and the Bland–Altman analysis from the comparison between epoc and GEM5000 for all measured parameters. Figure 1 displays the Bland–Altman plots for the comparison between the two analyzers for pH (A), pCO2 (B) and pO2 (C), Na+ (D), Cl (E), iCa2+ (F), K+ (G) Hct (H), tHb (I), BE (J), SO2 (K) and HCO3 (L). The CUSUM analysis revealed no significant deviation from the linear relationship between the compared results for all determined parameters (p > 0.05).
pH: For the pH, the Bland–Altman plot revealed no significant systematic bias between results obtained from the epoc and the GEM5000 (p = 0.7682). The Passing–Bablok regression revealed no significant constant or proportional bias.
pCO2: For the pCO2, the Bland–Altman plot revealed no significant systematic bias between results obtained from the epoc and the GEM5000 (p = 0.7512). The Passing–Bablok regression revealed a significant constant and proportional bias.
pO2: For the pO2, the Bland–Altman plot revealed no significant systematic bias between results obtained from the epoc and the GEM5000 (p = 0.1356). The Passing–Bablok regression revealed a significant constant but no significant proportional bias.
Na+, K+, Cl, iCa2+: The Bland–Altman analysis indicated a significant systematic bias between results obtained from the epoc and the GEM5000 for Na+ (p < 0.000), K+ (p = 0.0056), Cl (p = 0.00364), and iCa2+ (p = 0.0006). The Passing–Bablok regression indicated no significant proportional bias for Na+, K+, Cl, and no constant bias for Na+ and K+; however, there was a significant constant bias for Cl. For iCa2+, the Passing–Bablok analysis revealed both significant constant and proportional bias.
Hct: For the Hct, the Bland–Altman plot revealed a significant systematic bias between results obtained from the epoc and the GEM5000 (p < 0.0001). The Passing–Bablok regression revealed no significant constant or proportional bias.
tHb: For the tHb, the Bland–Altman plot revealed a significant systematic bias between results obtained from the epoc and the GEM5000 (p < 0.0001). The Passing–Bablok regression revealed no significant constant or proportional bias.
BE: For the BE, the Bland–Altman plot revealed no significant systematic bias between results obtained from the epoc and the GEM5000 (p = 0.6059). The Passing–Bablok regression revealed no significant constant or proportional bias.
SO2: For the SO2, the Bland–Altman plot revealed a significant systematic bias between results obtained from the epoc and the GEM5000 (p = 0.0002). The Passing–Bablok regression revealed no significant constant but a significant proportional bias.
HCO3: For the HCO3, the Bland–Altman plot revealed no significant systematic bias between results obtained from the epoc and the GEM5000 (p = 0.8377). The Passing–Bablok regression revealed no significant proportional or constant bias.

4. Discussion

Blood gases and electrolytes play a vital role in a number of disorders affecting the homeostasis of the patient. The delay to obtain laboratory results for iCa2+, Na+, K+ and Cl concentrations is often too long to allow for timely decision making in critically ill patients. Therefore, reliable methods for on-site measurements are critical. In addition, determination of blood gases usually requires an analysis immediately after blood sample collection, since storage and transportation to the laboratory would affect the results. Several studies have investigated the effect of syringe type and storage temperature on blood gas analysis and underline the importance of standardized storage conditions and minimal delay from sampling to analysis [24,25]. Different analyzers are used for this purpose, but no machine has been designed for specific use in horses. Therefore, every machine needs to be validated before use in clinics. The epoc analyzer has recently been tested for equine blood, but cannot be considered as a gold standard technique [13,14]. Precision targets were met by the epoc machine for pH, PO2, Na+, K+, glucose, lactate, HCO3, BE (ecf) and SO2, but not for PCO2, iCa2+, HCT and Hb [14], while agreement was poor for Hct, Hb and BE when compared to the iSTAT or an ABL machine. Kirsch and co-workers [12] reported that the epoc was not meeting precision targets for pO2, pCO2 and K+ and that agreement was poor for pH, [HCO3] and [Na+] when compared with the Cobas analyzer. Despite these variable results for precision and agreement with other machines, the epoc was chosen as a comparison machine for the GEM5000 in the present study, as its precision was generally accepted as satisfactory. Actually, no blood gas analyzer can be considered as a gold standard, and when comparing two machines, it is not clear which one provides data that are closer to the real values. Apart from storage temperature and duration, the body temperature itself may affect the measurement. In the current paper, the alpha-stat method has been used and all measurements were run on the machines, assuming a body temperature of 37 °C. Although, the importance of body temperature and temperature correction for blood gas analyses has been previously highlighted in exercising horses [26], it is probably less relevant for a method comparison study. The alpha-stat hypothesis suggests that we always interpret our blood gases as corrected to the same temperature (normal body temperature), regardless of how high or low the body temperature actually is. The pH-stat hypothesis, on the other hand, suggests that temperature should always be corrected to the core body temperature. Each approach has its advantages and disadvantages and deciding to use either one is especially important when clinical decisions are based on the results [27]. Since the current study compares the analytical performance of two different blood gas machines, we assume that any temperature related error would be the same for the two analyzers.
Precision analysis of the GEM5000 revealed that results were acceptable for pH, pCO2 and for all electrolytes, while they were considered too high for Hct, tHb and iCa2+. When comparing to maximal CV% given by Westgaard [16], Hct and tHb were out of acceptable range. Hct and tHb are linked and a possible explanation is improper mixing. The importance of mixing the samples, especially for Hct, has been underlined by Mion and co-workers [28], who tested the GEM5000 machine at two different human hospitals. They measured the effect of different handling of the sample during the pre-analytical phase before analyzing the sample in a GEM500 machine. They compared the effect of (1) automatic mixing using a rotary shaker for 5 min only to (2) 5 min of automatic mixing followed by 30 s of gentle turning and inverting by hand and (3) 5 min of automatic mixing using a rotary shaker followed by quick inversions by hand for an additional 30 s prior to analysis. Their results showed that additional hand mixing is superior to machine only mixing and that the best result is obtained when flipping the tube rapidly for 30 s before analyzing. In the present study, all samples were handled by the same operator and no machine mixing was used. The tubes where gently inverted by hand for 30 s before analyzing. The time from sampling to analysis was kept short, but results of precision for Hct and tHb indicate that precision could have been improved by better mixing of the samples. Although efforts were made to standardize the conditions, such as minimizing the delay from sampling to analysis, mixing the sample, and working in controlled room temperature and pressure, some errors might have occurred in the pre-analysis period. Available evidence strongly suggests that the pre- and post- analytical steps are more error-prone than the intra-analytical phase [28].
As with most machines, the precision is good, while the agreement is poor. It can be suggested that data from a single machine are reliable, while comparing data from different machines should be done cautiously. This may be of relevance in clinical practice, where analyses are run on different machines.
One of the principal limitations of the present study is the low number of samples investigated. In general, it is recommended that 40 to 100 samples should be used for method comparison studies [29], but this also depends on the range of samples, which should be as wide as possible. More than half of the results, however, were outside the reference intervals for equine venous blood, indicating a wide range of data. This is recommended by the Clinical Laboratory Improvement Amendments (CLIA) guidelines for evaluating agreement between two analyzers [30]. The reference ranges used for comparison were not generated by the machines in question, and therefore the exact number of samples out of reference range cannot be determined. Future studies should focus on the establishment of reference values for healthy horses on the GEM5000 machine. The importance of species and equipment specific reference values has been underlined by a recent study, which established reference values for equine BGEA [31].

5. Conclusions

Considering the overall satisfactory analytical performance, the good practicability, the intuitive and easy to use software interface and the rapid measuring time (about 45 s from sample aspiration to results), GEM5000 seems suitable to be used in equine practice, but results obtained with this machine should not be used interchangeably with those from other blood gas analyzers.

Author Contributions

Conceptualization, C.S., C.C., D.S. and K.K.; methodology, H.G.; software, K.K.; validation, C.S. and K.K.; formal analysis, C.S.; investigation, C.S., C.C., J.D. and H.G.; resources, C.S. and C.C.; data curation, C.S., P.D., J.D. and H.G.; writing—original draft preparation, K.K. and C.S.; writing—review and editing, C.C., P.D., K.K., J.D., H.G. and D.S.; supervision, C.S., K.K. and D.S.; funding acquisition, C.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Only waste blood was used in this study and therefore no approval from the Institutional Committee for the Ethical Use of Animals was necessary (Commission Éthique Animale, University of Liege).

Informed Consent Statement

Owners of the horses agreed that the data of their horses and the results of the BGEA may be used for scientific purposes in anonymized format.

Data Availability Statement

On publication of the article, data will be made available on an open science framework.

Acknowledgments

We thank the owners of the horses who agreed to let their horses participate in this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bliskslager, A.T.; Jones, S.L. Obstructive disorders of the gastrointestinal tract. In Equine Internal Medicine, 3rd ed.; Reed, S.M., Bayly, W.M., Sellon, C.D., Eds.; Elsevier Saunders: St. Louis, MO, USA, 1998; pp. 922–936. [Google Scholar]
  2. Stämpfli, H.; Oliver-Espinosa, O. Clinical Chemistry Tests. In Large Animal Internal Medicine, 5th ed.; Smith, B.P., Ed.; Elsevier Saunders: St. Louis, MO, USA, 2014; p. 362. [Google Scholar]
  3. Magdesian, K.G.; Southwood, L.L. Monitoring. In Equine Emergency and Critical Care Medicine; Southwood, L.L., Wilkins, P.A., Eds.; CRC Press: Boca Raton, FL, USA, 2015; pp. 635–637. [Google Scholar]
  4. Aguilera-Tejero, J.C.; López, I.; Bas, S.; Bas, S.; Mayer-Valor, R.; Rodríguez, M. Quantitative analysis of acid-base balance in show jumpers before and after exercise. Res. Vet. Sci. 2000, 68, 103–108. [Google Scholar] [CrossRef]
  5. Andrews, F.M.; Geiser, D.R.; White, S.L.; Williamson, L.H.; Maykuth, P.L.; Green, E.M. Haematological and biochemical changes in horses competing in a 3 Star horse trial and 3-day-event. Equine Vet. J. Suppl. 1995, 20, 57–63. [Google Scholar] [CrossRef]
  6. Foreman, J.H.; Waldsmith, J.K.; Lalum, R.B. Physical, acid-base and electrolyte changes in horses competing in Training, Preliminary and Intermediate horse trials. Equine Comp. Exerc. Physiol. 2004, 1, 99–105. [Google Scholar] [CrossRef]
  7. Hinchcliff, K.W.; Kohn, C.W.; Geor, R.; McCutcheon, L.J.; Foreman, J.; Andrews, F.M.; Allen, A.K.; White, S.L.; Williamson, L.H.; Maykuth, P.L. Acid:base and serum biochemistry changes in horses competing at a modified 1Star 3-day event. Equine Vet. J. Suppl. 1995, 20, 105–110. [Google Scholar]
  8. Rose, R.J.; Ilkiw, J.E.; Martin, I.C.A. Blood-gas, Acid-base and Haematological values in Horses during an Endurance ride. Equine Vet. J. 1979, 11, 56–59. [Google Scholar] [CrossRef]
  9. Rose, R.J.; Ilkiw, J.E.; Arnold, K.S.; Backhouse, J.W.; Sampson, D. Plasma biochemistry in the horse during 3-day event competition. Equine Vet. J. 1980, 12, 132–136. [Google Scholar] [CrossRef]
  10. Viu, J.; Jose-Cunilleras, E.; Armengou, L.; Cesarini, C.; Tarancón, I.; Rios, J.; Monreal, L. Acid-base imbalances during a 120 km endurance race compared by traditional and simplified strong ion difference methods. Equine Vet. J. Suppl. 2010, 42, 76–82. [Google Scholar] [CrossRef]
  11. Williamson, L.H.; Andrews, F.M.; Maykuth, P.L.; White, S.L.; Green, E.M. Biochemical changes in Three-day-event horses at the beginning, middle and end of Phase C and after Phase D. Equine Vet. J. Suppl. 1996, 22, 92–98. [Google Scholar] [CrossRef]
  12. Kirsch, K.; Sandersen, C. Traditional and quantitative analysis of acid-base and electrolyte imbalances in horses competing in cross-country competitions at 2-star to 5-star level. J. Vet. Intern. Med. 2020, 34, 909–921. [Google Scholar] [CrossRef] [PubMed]
  13. Kirsch, K.; Detilleux, J.; Serteyn, D.; Sandersen, C. Comparison of two portable clinical analyzers to one stationary analyzer for the determination of blood gas partial pressures and blood electrolyte concentrations in horses. PLoS ONE 2019, 14, e0211104. [Google Scholar] [CrossRef]
  14. Bardell, D.; West, E.; Senior, M.J. Evaluation of a new handheld point-of-care blood gas analyser using 100 equine blood samples. Vet Anaesth. Analg. 2017, 44, 77–85. [Google Scholar] [CrossRef]
  15. Elmeshreghi, T.N.; Grubb, T.L.; Greene, S.A.; Ragle, C.A.; Wardrop, J.A. Comparison of Enterprise Point-of-Care and Nova Biomedical Critical Care Xpress analyzers for determination of arterial pH, blood gas, and electrolyte values in canine and equine blood. Vet. Clin. Pathol. 2018, 47, 415–424. [Google Scholar] [CrossRef]
  16. Westgard, J.O.; Carey, R.N.; Wold, S. Criteria for judging precision and accuracy in method development and evaluation. Clin. Chem. 1974, 20, 825–833. [Google Scholar] [CrossRef]
  17. Center for Disease Control and Prevention (CDC); Centers for Medicare and Medical Services (CMS); HHS. Medicare, Medicaid, and CLIA programs: Laboratory requirements relating to quality systems and certain personnel qualifications: Final rule. Fed. Regist. 2003, 68, 3640–3714. [Google Scholar]
  18. Lin, L.I. A concordance correlation coefficient to evaluate reproducibility. Biometrics 1989, 45, 255–268. [Google Scholar] [CrossRef] [PubMed]
  19. McBride, G.B. A Proposal for Strength-of-Agreement Criteria for Lin’s Concordance Correlation Coefficient; NIWA Client Report; HAM 2005-062; National Institute of Water & Atmospheric Research Ltd.: Hamilton, New Zealand, 2005. [Google Scholar]
  20. Bland, J.M.; Altman, D.G. Statistical method for assessing agreement between two methods of clinical measurement. Lancet 1986, 1, 307–310. [Google Scholar] [CrossRef]
  21. Bland, J.M.; Altman, D.G. Measuring agreement in method comparison studies. Stat. Methods Med. Res. 1999, 8, 135–160. [Google Scholar] [CrossRef]
  22. Passing, H.; Bablok, W. A new biometrical procedure for testing the equality of measurements from two different analytical methods. Application of linear regression procedures for method comparison studies in Clinical Chemistry, Part I. J. Clin. Chem. Clin. Biochem. 1983, 21, 709–720. [Google Scholar] [CrossRef]
  23. Matburger, A.C.; Henke, J.; Hirschberger, J.; Matburger, S.; Henke, W. Evaluation des tragbaren i-STAT®-Blutgasanalysegerätes im klinischen Einsatz beim Hund. Tierärztl Prax. 2000, 28, 132–137. [Google Scholar]
  24. Kennedy, S.A.; Constable, P.D.; Sen, I.; Couëtil, L. Effects of syringe type and storage conditions on results of equine blood gas and acid-base analysis. Am. J. Vet. Res. 2012, 73, 979–987. [Google Scholar] [CrossRef]
  25. Picandet, V.; Jeanneret, S.; Lavoie, J.P. Effects of syringe type and storage temperature on results of blood gas analysis in arterial blood of horses. J. Vet. Intern. Med. 2007, 21, 476–481. [Google Scholar] [CrossRef] [PubMed]
  26. Mion, M.M.; Bragato, G.; Zaninotto, M.; Alessandroni, J.; Bernardini, S.; Plebani, M. Analytical performance evaluation of the new GEM® Premier™ 5000 analyzer in comparison to the GEM® Premier™ 4000 and the RapidPoint® 405 systems. Clin. Chim. Acta 2018, 486, 313–319. [Google Scholar] [CrossRef] [PubMed]
  27. Krouwer, J.S.; Tholen, D.; Garber, C.; Goldschmidt, H.M.; Kroll, M.H.; Linnet, K.; Meier, K.; Robinowitz, M.; Kennedy, J.W. Method Comparison and Bias Estimation Using Patient Samples, Approved Guideline, 2nd ed.; Clinical and Laboratory Standards Institute: Malvern, PA, USA, 2010. [Google Scholar]
  28. Hughes, J.; Bardell, D. Determination of reference intervals for equine arterial blood-gas, acid-base and electrolyte analysis. Vet. Anaesth. Analg. 2019, 46, 765–771. [Google Scholar] [CrossRef]
  29. Taylor, L.E.; Kronfeld, D.S.; Ferrante, P.L.; Wilson, J.A.; Tiegs, W. Blood-gas measurements adjusted for temperature at three sites during incremental exercise in the horse. J. Appl. Physiol. 1998, 85, 1030–1036. [Google Scholar] [CrossRef]
  30. Bisson, J.; Younker, J. Correcting arterial blood gases for temperature: (When) is it clinically significant? Nurs. Crit. Care 2006, 11, 232–238. [Google Scholar] [CrossRef] [PubMed]
  31. Linnet, K. Necessary sample size for method comparison studies based on regression analysis. Clin. Chem. 1999, 45, 882–894. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Bland-Altman plots for comparison of GEM5000 and epoc analyzers for blood pH (A), pCO2 (B), pO2 (C), Na+ (D), Cl (E), Ca2+ (F), K+ (G), packed cell volume PCV (H), tHb (I), BE (J), SO2 (K), [HCO3] (L). The dashed lines are upper and lower limit of agreement, the solid line is the mean difference (bias).
Figure 1. Bland-Altman plots for comparison of GEM5000 and epoc analyzers for blood pH (A), pCO2 (B), pO2 (C), Na+ (D), Cl (E), Ca2+ (F), K+ (G), packed cell volume PCV (H), tHb (I), BE (J), SO2 (K), [HCO3] (L). The dashed lines are upper and lower limit of agreement, the solid line is the mean difference (bias).
Vetsci 10 00114 g001aVetsci 10 00114 g001bVetsci 10 00114 g001c
Table 1. Mean values and standard deviation, and coefficient of variation of the first sample as well as the mean CV for all 29 duplicate measurements of blood samples on the GEM5000 analyzer.
Table 1. Mean values and standard deviation, and coefficient of variation of the first sample as well as the mean CV for all 29 duplicate measurements of blood samples on the GEM5000 analyzer.
Measured
Variables
GEM5000
Mean ± SD of the 1st SampleCV (%) of the 1st SampleMean CV (%) of All DuplicatesPrecision Target (CV%)
pH7.53 ± 0.0250.330.07<0.1 [13,16]
pCO2 (mmHg)38 ± 25.260.87<2.4 [12,16]
pO2 (mmHg)79.5 ± 8.510.693.18<4.8 [12,16]
Na+ (mmol/L)132 ± 000.3<0.3 [12,16]
Cl (mmol/L)95.5 ± 0.50.520.42<0.6 [14,16]
iCa2+ (mmol/L)1.67 ± 0.010.591.1<0.9 [14,16]
K+ (mmol/L)4.65 ± 0.153.220.8<2.3 [14,16]
PCV (%)31.5 ± 1.54.763.84<1.35 [14,16]
tHb (g/dL)10.7 ± 0.54.474.84<1.43 [14,16]
BE (mmol/L)8.8 ± 0.66.8234.8<38.2 [16]
SO2 (%)96.75 ± 1.151.191.04<5 [23]
HCO3 (mmol/L)32.05 ± 1.150.471.74<5 [23]
pCO2, partial pressure of carbon dioxide; pO2, partial pressure of oxygen; Na+, sodium; Cl, chloride; iCa2+, calcium; K+, potassium; Hct, hematocrit; tHb, total hemoglobin; BE, base excess; SO2, oxygen saturation; HCO3, bicarbonate. Data over of precision target in bold.
Table 2. Mean, standard deviation (SD) and measured concentration range for parameters determined by the two compared analyzers epoc and GEM5000 (n = 43).
Table 2. Mean, standard deviation (SD) and measured concentration range for parameters determined by the two compared analyzers epoc and GEM5000 (n = 43).
Measured
Variables
epocGEM5000
Mean ± SDRangeMean ± SDRange
pH7.390 ± 0.0567.280–7.5457.390 ± 0.0527.270–7.510
pCO2 (mmHg)48.7 ± 7.724.1–64.948.9 ± 6.627.0–65.0
pO2 (mmHg)117.9 ± 111.321.0–366.2120.2 ± 109.722.0–372.0
Na+ (mmol/L)136 ± 3129–144134 ± 3128–139
Cl (mmol/L)100 ± 490–113101 ± 492–111
iCa2+ (mmol/L)1.53 ± 0.161.14–1.781.57 ± 0.121.25–1.79
K+ (mmol/L)3.6 ± 0.62.5–5.23.7 ± 0.52.5–4.8
Hct (%)34 ± 1116–5930 ± 915–56
tHb (g/dL)11.5 ± 3.75.5–20.210.2 ± 3.35.1–19.0
BE (mmol/L)3.8 ± 4.1−12.6–10.74.0 ± 4.1−10.8–12.0
SO2 (%)80.4 ± 22.029.3–100.082.7 ± 20.133.8–100.0
HCO3 (mmol/L)29.5 ± 3.913.1–35.829.5 ± 4.113.6–37.5
pCO2, partial pressure of carbon dioxide; pO2, partial pressure of oxygen; Na+, sodium; Cl, chloride; iCa2+, calcium; K+, potassium; Hct; hematocrit; tHb, total hemoglobin; BE, base excess; SO2, oxygen saturation; HCO3, bicarbonate.
Table 3. Concordance correlation analysis between the epoc and the GEM5000 analyzer, indicating the accuracy (bias correction factor, Cb) and the precision (Pearson ρ) as well as the Lin’s concordance correlation coefficients (rccc) with 95% confidence intervals (95% CI).
Table 3. Concordance correlation analysis between the epoc and the GEM5000 analyzer, indicating the accuracy (bias correction factor, Cb) and the precision (Pearson ρ) as well as the Lin’s concordance correlation coefficients (rccc) with 95% confidence intervals (95% CI).
Measured
Variables
Concordance Correlation Analysis
Lin’s rccc
(95% CI)
Precision
ρ
Accuracy
Cb
pH0.956
(0.923 to 0.976)
0.9600.997substantial agreement
pCO2
(mmHg)
0.935
(0.889 to 0.962)
0.9460.989moderate agreement
pO2
(mmHg)
0.996
(0.992 to 0.998)
0.9961.000almost perfect agreement
Na+
(mmol/L)
0.720
(0.569 to 0.824)
0.8330.865poor agreement
Cl
(mmol/L)
0.811
(0.685 to 0.890)
0.8390.967poor agreement
iCa2+
(mmol/L)
0.837
(0.739 to 0.901)
0.8970.933poor agreement
K+
(mmol/L)
0.875
(0.785 to 0.929)
0.8950.977poor agreement
Hct
(%)
0.865
(0.779 to 0.920)
0.9250.936poor agreement
tHb
(g/dL)
0.814
(0.699 to 0.888)
0.8850.921poor agreement
BE
(mmol/L)
0.922
(0.862 to 0.957)
0.9230.999moderate agreement
SO2
(%)
0.979
(0.965 to 0.988)
0.9890.990substantial agreement
HCO3
(mmol/L)
0.926
(0.869 to 0.959)
0.9270.999moderate agreement
pCO2, partial pressure of carbon dioxide; pO2, partial pressure of oxygen; Na+, sodium; Cl, chloride; iCa2+, calcium; K+, potassium; Hct; hematocrit; tHb, total hemoglobin; BE, base excess; SO2, oxygen saturation; HCO3, bicarbonate.
Table 4. Results of the Passing–Bablok regression and the Bland–Altman plots resulting from the comparison between the GEM5000 and the epoc analyzer.
Table 4. Results of the Passing–Bablok regression and the Bland–Altman plots resulting from the comparison between the GEM5000 and the epoc analyzer.
Measured
Variables
Passing–Bablok RegressionBland–Altman Plot
Intercept
(95% CI)
Slope
(95% CI)
Residual Standard Deviation
(95% CI)
Bias
(95% CI)
Lower Limit of Agreement
(95% CI)
Upper Limit of Agreement
(95% CI)
Passing BablokBland–Altman
pH0.67
(−0.07 to 1.31)
0.91
(0.82 to 1.01)
0.011
(−0.022 to 0.022)
−0.001
(−0.006 to 0.004)
−0.032
(−0.040 to −0.024)
0.031
(0.022 to 0.039)
no significant constant biasno significant proportional biasno significant systematic biasp = 0.7682
pCO2
(mmHg)
7.13
(2.38 to 11.30)
0.85
(0.76 to 0.95)
1.690
(−3.312 to 3.312)
−0.1
(−0.7 to 0.9)
−4.9
(−6.3 to −3.6)
5.2
(3.8 to 6.6)
significant constant biassignificant proportional biasno significant systematic biasp = 0.7512
pO2
(mmHg)
2.84
(0.24 to 5.00)
1.01
(0.98 to 1.04)
7.253
(−14.215 to 14.215)
2.3
(−0.7 to 5.3)
−17.0
(−22.2 to −11.8)
21.6
(16.4 to 26.8)
significant constant biasno significant proportional biasno significant systematic biasp = 0.1356
Na+
(mmol/L)
−2.0
(−2.00 to 15.50)
1.0
(0.88 to 1.00)
1.230
(−2.410 to 2.410)
−1.6
(−2.1 to −1.1)
−4.8
(−5.7 to −4.0)
1.7
(0.8 to 2.6)
no significant constant biasno significant proportional biassignificant systematic biasp < 0.0001
Cl
(mmol/L)
14.86
(1.00 to 27.82)
0.86
(0.73 to 1.00)
1.614
(−3.163 to 3.163)
0.8
(0.1 to 1.5)
−3.8
(−5.1 to −2.6)
5.4
(4.1 to 6.7)
significant constant biasno significant proportional biassignificant systematic biasp = 0.0364
Ca2+
(mmol/L)
0.34
(0.18 to 0.51)
0.81
(0.70 to 0.90)
0.045
(−0.088 to 0.088)
0.04
(0.02 to 0.06)
−0.10
(−0.14 to −0.06)
0.18
(0.14 to 0.22)
significant constant biassignificant proportional biassignificant systematic biasp = 0.0006
K+
(mmol/L)
0.10
(−0.26 to 0.10)
1.00
(1.00 to 1.11)
0.180
(−0.352 to 0.352)
0.11
(0.03 to 0.19)
−0.38
(−0.51 to −0.25)
0.60
(0.47 to 0.74)
no significant constant biasno significant proportional biassignificant systematic biasp = 0.0056
HTC
(%)
−0.47
(−3.00 to 2.90)
0.92
(0.81 to 1.00)
2.840
(−5.566 to 5.566)
−3.5
(−4.7 to −2.2)
−11.6
(−13.8 to −9.4)
4.7
(2.5 to 6.9)
no significant constant biasno significant proportional biassignificant systematic biasp < 0.0001
tHb
(g/dL)
−0.04
(−1.23 to 1.12)
0.91
(0.79 to 1.02)
1.212
(−2.376 to 2.376)
−1.4
(−1.9 to −0.8)
−4.7
(−5.7 to −3.8)
2.0
(1.1 to 2.9)
no significant constant biasno significant proportional biassignificant systematic biasp < 0.0001
BE
(mmol/L)
−0.10
(−1.45 to 0.34)
1.07
(0.91 to 1.33)
1.163
(−2.279 to 2.279)
0.1
(−0.4 to 0.6)
−3.0
(−3.9 to −2.2)
3.3
(2.4 to 4.1)
no significant constant biasno significant proportional biasno significant systematic biasp = 0.6059
SO2
(%)
12.97
(6.10 to 15.73)
0.87
(0.84 to 0.94)
2.372
(−4.649 to 4.649)
2.3
(1.1 to 3.4)
−4.9
(−6.9 to −3.0)
9.4
(7.5 to 11.4)
no significant constant biassignificant proportional biassignificant systematic biasp = 0.0002
HCO3
(mmol/L)
−3.46
(−11.04 to 1.27)
1.12
(0.96 to 1.38)
1.116
(−2.188 to 2.188)
0.0
(−0.4 to 0.5)
−3.0
(−3.8 to −2.2)
3.1
(2.3 to 3.9)
no significant constant biasno significant proportional biasno significant systematic biasp = 0.8377
pCO2, partial pressure of carbon dioxide; pO2, partial pressure of oxygen; Na+, sodium; Cl, chloride; Ca2+, calcium; K+, potassium; HTC; packed cell volume; tHb, total hemoglobin; BE, base excess; SO2, oxygen saturation; HCO3, bicarbonate.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sandersen, C.; Dmitrovic, P.; Dupont, J.; Cesarini, C.; Guyot, H.; Serteyn, D.; Kirsch, K. Analytical Performance Evaluation of the New GEM® Premier™ 5000 in Comparison to the Epoc® Blood Gas Analyzer in Horses. Vet. Sci. 2023, 10, 114. https://doi.org/10.3390/vetsci10020114

AMA Style

Sandersen C, Dmitrovic P, Dupont J, Cesarini C, Guyot H, Serteyn D, Kirsch K. Analytical Performance Evaluation of the New GEM® Premier™ 5000 in Comparison to the Epoc® Blood Gas Analyzer in Horses. Veterinary Sciences. 2023; 10(2):114. https://doi.org/10.3390/vetsci10020114

Chicago/Turabian Style

Sandersen, Charlotte, Petra Dmitrovic, Julien Dupont, Carla Cesarini, Hugues Guyot, Didier Serteyn, and Katharina Kirsch. 2023. "Analytical Performance Evaluation of the New GEM® Premier™ 5000 in Comparison to the Epoc® Blood Gas Analyzer in Horses" Veterinary Sciences 10, no. 2: 114. https://doi.org/10.3390/vetsci10020114

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop