Reference Intervals and Decision Limits
Kristen R. Friedrichs
Search for more papers by this authorAsger Lundorff Jensen
Search for more papers by this authorMads Kjelgaard-Hansen
Search for more papers by this authorKristen R. Friedrichs
Search for more papers by this authorAsger Lundorff Jensen
Search for more papers by this authorMads Kjelgaard-Hansen
Search for more papers by this authorMarjory B. Brooks DVM, DACVIM
Director, Comparative Coagulation Section
Animal Health Diagnostic Center, Cornell University, Ithaca, New York, USA
Search for more papers by this authorKendal E. Harr DVM, MS, DACVP
URIKA, LLC, Mukilteo, Washington, USA
Search for more papers by this authorDavis M. Seelig DVM, PhD, DACVP
Associate Professor, Clinical Pathology
Department of Veterinary Clinical Sciences, University of Minnesota, College of Veterinary Medicine, St. Paul, Minnesota, USA
Search for more papers by this authorK. Jane Wardrop DVM, MS, DACVP
Professor and Director, Clinical Pathology Laboratory
Department of Veterinary Clinical Sciences, College of Veterinary Medicine, Washington State University, Pullman, Washington, USA
Search for more papers by this authorDouglas J. Weiss DVM, PhD, DACVP
Emeritus Professor
College of Veterinary Medicine, University of Minnesota, St. Paul, Minnesota, USA
Search for more papers by this authorSummary
The diagnostic workup of veterinary patients is a decision-making process. For the decision-making processes to be consistent, established decision criteria are essential. These criteria may be in the form of decision limits or population-based and subject-based reference intervals (RIs). One solution to the frequent problem of small reference sample sizes is to harvest results from laboratory databases, a procedure called data mining. The suitability of a particular population for RI generation assumes homogeneity in that population. Unlike RIs that are descriptive of the distribution of blood values in healthy subjects, a decision limit is a predetermined test threshold that distinguishes between two subgroups of a target population. Reference intervals typically are printed on laboratory reports along with patient results. This only should be done when the provided RIs are applicable to the patient demographic.
REFERENCES
- Bartlett WA , Braga F , Carobene A , et al. A checklist for critical appraisal of studies of biological variation . Clin Chem Lab Med 2015 ; 53 : 879 ā 885 .
- Bhattacharya CG . A simple method of resolution of a distribution into Gaussian components . J Biometric Soc 1967 ; 23 : 115 ā 135 .
- Bienvenu J , Later R , Pontet F . Reference material (CRM 470) for serum proteins: preparation, characteristics and conditions of use . Ann Biol Clin 1995 ; 53 : 499 ā 505 .
- Boswood A , Dukes-McEwan J , Loureiro J , et al. The diagnostic accuracy of different natriuretic peptides in the investigation of canine cardiac disease . J Small Anim Pract 2008 ; 49 : 26 ā 32 .
- Braga F , Panteghini M . Generation of data on within-subject biological variation in laboratory medicine: an update . Crit Rev Clin Lab Sci 2016 ; 53 : 313 ā 325 .
- Braun JP , Concordet D , GeffrĆ© A , et al. Confidence intervals of reference limits in small reference sample groups . Vet Clin Pathol 2013 : 42 : 395 ā 398 .
- Campora C , Freeman KP , Baral R. Clinical application of biological variation data to facilitate interpretation of canine and feline laboratory results . J Small Anim Prac 2018 ; 59 : 3 ā 9 .
- CLSI . Assessment of the diagnostic accuracy of laboratory tests using receiving operating characteristic curves; approved guideline-second edition . CLSA document EP24-A2. Wayne, A : Clinical and Laboratory Standards Institute , 2011 (reaffirmed April 2016).
- CLSI . Defining, establishing, and verifying reference intervals in the clinical laboratory; approved guideline ā third edition. CLSI document EP28-A3c . Wayne, PA : Clinical and Laboratory Standards Institute , 2008 (corrected October 2010).
- Cohen JF , Korevaar DA , Altman DG , et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration . BMJ Open 2016 ; 6 : e012799 . (open access)
- Concordet D , GeffrĆ© A , Braun JP , et al. A new approach for the determination of RIs from hospital-based data . Clin Chim Acta 2009 ; 405 : 43 ā 48 .
- Daly CH , Higgins V , Adeli K , et al. Reference interval estimation: methodological comparison using extensive simulations and empirical data . Clin Biochem 2017 ; 50 : 1145 ā 1158 .
- Eckersall PD. Calibration of novel protein biomarkers for veterinary clinical pathology: a call for international action . Front Vet Sci 2019 ; 6 : 210 . (open access)
- Freeman KP , Baral RM , Dhand NK , et al. Recommendations for designing and conducting veterinary clinical pathology biologic variation studies . Vet Clin Pathol 2017 ; 46 : 211 ā 220 .
- Friedrichs KR , Harr KE , Freeman KP , et al. ASVCP reference interval guidelines: determination of de novo reference intervals in veterinary species and other related topics . Vet Clin Pathol 2012 ; 41 : 441 ā 453 .
- Gardner IA , Greiner M . Receiver-operating characteristic curves and likelihood ratios: improvements over traditional methods for the evaluation and application of veterinary clinical pathology tests . Vet Clin Pathol 2006 ; 35 : 8 ā 17 .
- GeffrĆ© A , Concordet D , Trumel C , et al. Validation of preexisting reference intervals: can the procedure be applied to canine hemostasis? J Vet Diag Invest 2011 ; 23 : 343 ā 347 .
- Gillard J . A generalised BoxāCox transformation for the parametric estimation of clinical reference intervals . J Appl Stat 2012 ; 39 : 2231 ā 2245 .
- Habibzadeh F , Habibzadeh P , Yadollahie M . On determining the most appropriate cut-off value: the case of tests with continuous results . Biochemia Medica 2016 ; 26 ( 3 ): 297 ā 307 .
- Harris EK , Boyd JC . On dividing reference data into subgroups to produce separate reference ranges . Clin Chem 1990 ; 36 : 265 ā 270 .
- Horn PS , Feng L , Li Y , Pesce AJ . Effect of outliers and nonhealthy individuals on reference interval estimation . Clin Chem 2001 ; 47 : 2137 ā 2145 .
- Horn PS , Pesce AJ , Copeland BE . A robust approach to reference interval estimation and evaluation . Clin Chem 1998 ; 44 : 622 ā 631 .
- Iris-kidney.com , (International Renal Interest Society). Accessed December 23, 2019 at 9:50 a.m. CST.
- Jensen AL , Kjelgaard-Hansen M . Method comparison in the clinical laboratory . Vet Clin Pathol 2006 ; 35 : 276 ā 286 .
- Johansen MB , Christensen PA . A simple transformation independent method for outlier detection . Clin Chem Lab Med 2018 ; 28 : 1524 ā 1532 .
- Jones GRD . Validating common reference intervals in routine laboratories . Clin Chim Acta 2014 ; 432 : 119 ā 121 .
- Jones GRD , Haeckel R , Loh TP , et al. Indirect methods for reference interval determination - review and recommendations . Clin Chem Lab Med 2018 ; 57 : 20 ā 29 .
- Katayev A , Fleming JK , Luo D , et al. Reference interval data mining: no longer a probability paper method . Am J Clin Pathol 2015 ; 143 : 134 ā 142 .
- Kiupel M , Webster JD , Bailey KL , et al. Proposal of a 2-tier histologic grading system for canine cutaneous mast cell tumors to more accurately predict biological behavior . Vet Path 2011 ; 48 : 147 ā 155 .
- Lahti A . Partitioning biochemical reference data into subgroups: comparison of existing methods . Clin Chem Lab Med 2004 ; 42 : 725 ā 733 .
- Le Boedec K . Sensitivity and specificity of normality tests and consequences on reference interval accuracy at small sample size: a computer-simulation study . Vet Clin Pathol 2016 ; 45 : 648 ā 656.2
- MacDonald V . Chemotherapy: Managing side effects and safe handling . Can Vet J 2009 ; 50 : 665 ā 668 .
- McArt JAA , Nydam DV , Oetzel GR , et al. Elevated non-esterified fatty acids and beta-hydroxybutyrate and their association with transition dairy cow performance . Vet J 2013 ; 198 : 560 ā 570 .
- Moore AR , Camus MS , Harr KE , et al. Systematic evaluation of 106 reference data articles from non-domestic species published between 2014ā2016 . J Zoo Wild Med 2020 ; 51 : 468 ā 477 .
- Ozarda Y , Higgins V , Adeli K . Verification of reference intervals in routine clinical laboratories: practical challenges and recommendations . Clin Chem Lab Med 2019 ; 57 : 30 ā 37 .
- Ozarda Y , Sikaris K , Streichert T , et al. Distinguishing reference intervals and clinical decision limits ā A review by the IFCC committee on reference intervals and decision limits . Crit Rev Clin Lab Sci 2018 ; 55 : 420 ā 431 .
- Razali NM , Wah YB. Power comparisons of Shapiro-Wilk, Kolomogorov-Smirnov, Lilliefors and Anderson-Darling tests . J Stat Model Anal 2011 ; 2 : 21 ā 33 .
- Roth L , Tyler RD. Evaluation of low sodium: potassium ratios in dogs . J Vet Diag Invest 1999 ; 11 : 60 ā 64 .
- Sample SH , Fox KM , Wunn D , et al. Hematologic and biochemical reference intervals for adult Friesian horses from North America . Vet Clin Pathol 2015 ; 44 : 194 ā 199 .
- VetBiologicalVariation.org . Accessed August 13, 2019 at 4:30 p.m. CST
- Wellek S , Lackner KJ , Jennen-Steinmetz C , et al. Determination of reference limits: statistical concepts and tools for sample size calculation . Clin Chem Lab Med 2014 52 : 1685 ā 1694 .
- Xenoulis PG , Steiner JM . Canine and feline pancreatic lipase immunoreactivity . Vet Clin Pathol 2012 ; 41 : 312 ā 324 .
- Youden WJ . Index for rating diagnostic tests . Cancer 1950 ; 1 : 32 ā 35 .1
- Zalidivar-Lopez S , Marin LM , Iazbik MC , et al. Clinical pathology of greyhounds and other sighthounds . Vet Clin Pathol 2011 ; 40 : 414 ā 425 .