A Perspective on Errors, Bias, and Interpretation in the Forensic Sciences and Direction for Continuing Advancement*
Bruce Budowle Ph.D.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorMaureen C. Bottrell M.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorStephen G. Bunch Ph.D.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorRobert Fram M.A.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorDiana Harrison B.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorStephen Meagher
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorCary T. Oien M.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorPeter E. Peterson Ph.D.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorDanielle P. Seiger M.F.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorMichael B. Smith B.A.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorMelissa A. Smrz M.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorGreg L. Soltis M.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorRobert B. Stacey M.A.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorBruce Budowle Ph.D.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorMaureen C. Bottrell M.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorStephen G. Bunch Ph.D.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorRobert Fram M.A.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorDiana Harrison B.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorStephen Meagher
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorCary T. Oien M.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorPeter E. Peterson Ph.D.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorDanielle P. Seiger M.F.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorMichael B. Smith B.A.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorMelissa A. Smrz M.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorGreg L. Soltis M.S.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorRobert B. Stacey M.A.
FBI Laboratory, 2501 Investigation Parkway, Quantico, VA 22135.
Search for more papers by this authorThis is publication number 08-13 of the Laboratory Division of the Federal Bureau of Investigation. Names of commercial manufacturers are provided for identification only, and inclusion does not imply endorsement by the Federal Bureau of Investigation.
Abstract
Abstract: The forensic sciences are under review more so than ever before. Such review is necessary and healthy and should be a continuous process. It identifies areas for improvement in quality practices and services. The issues surrounding error, i.e., measurement error, human error, contextual bias, and confirmatory bias, and interpretation are discussed. Infrastructure is already in place to support reliability. However, more definition and clarity of terms and interpretation would facilitate communication and understanding. Material improvement across the disciplines should be sought through national programs in education and training, focused on science, the scientific method, statistics, and ethics. To provide direction for advancing the forensic sciences a list of recommendations ranging from further documentation to new research and validation to education and to accreditation is provided for consideration. The list is a starting point for discussion that could foster further thought and input in developing an overarching strategic plan for enhancing the forensic sciences.
References
- 1 Stacey RB. A report on the erroneous fingerprint individualization in the Madrid train bombing case. J Forensic Identif 2004; 54(6): 706–18.
- 2 Sheck B, Neufeld P, Dwyer J. Actual innocence. New York, NY: New American Library, Penguin Putnam, Inc., 2000.
- 3 Saks MJ, Koehler JJ. The coming paradigm shift in forensic identification science. Science 2005; 309: 892–5.
- 4 Bottrell MC. Forensic glass comparison: background information used in data interpretation. Forensic Sci Commun 2009; 11(2), http://www.fbi.gov/hq/lab/fsc .
- 5 Bunch SG, Smith ED, Giroux BN, Murphy PD. Is a match really a match? A primer on the procedures and validity of firearm and toolmark identification. Forensic Sci Commun 2009; 11(3), http://www.fbi.gov/hq/lab/fsc .
- 6 Harrison D, Burkes TM, Seiger DP. Handwriting examination: meeting the challenges of science and the law. Forensic Sci Commun 2009; 11(4), http://www.fbi.gov/hq/lab/fsc .
- 7 Oien CT. Forensic hair comparison: background information for interpretation. Forensic Sci Commun 2009; 11(2), http://www.fbi.gov/hq/lab/fsc .
- 8 Peterson PE, Dreyfus CB, Gische MR, Hollars M, Roberts MA, Ruth RM, et al. Latent prints: the state of the science. Forensic Sci Commun 2009; 11(4), http://www.fbi.gov/hq/lab/fsc .
- 9 Smith MB. The forensic analysis of footwear impression evidence. Forensic Sci Commun 2009; 11(4), http://www.fbi.gov/hq/lab/fsc .
- 10 Budowle B, Allard MW, Wilson MR, Chakraborty R. Forensics and mitochondrial DNA: applications, debates, and foundations. Annu Rev Genomics Hum Genet 2003; 4: 119–41.
- 11 Bird SJ. Scientific certainty: research versus forensic perspectives. J Forensic Sci 2001; 46(4): 978–81.
- 12 ISO/IEC. ISO/IEC 17025:2005 General requirements for the competence of testing and calibration laboratories, 2nd ed. Geneva, Switzerland: ISO Copyright Office, Reference Number ISO/IEC 17025:2005(E), 2005.
- 13 Budowle B, SWGMGF Members. Quality assurance guidelines for laboratories performing microbial forensic work. Forensic Sci Commun 2003; 5(4): at http://www.fbi.gov/hq/lab/fsc/backissu/oct2003/index.htm.
- 14 Budowle B, Smith JA, Moretti T, DiZinno J. DNA typing protocols: molecular biology and forensic analysis. Natick, MA: BioTechniques Books, BioForensic Sciences Series, Eaton Publishing, 2000.
- 15 The International Association for Identification. Scientific Working Group Documents. http://www.theiai.org (accessed October 3, 2008).
- 16 American Society of Quality (ASQ), Plan-do-check-act cycle. http://www.asq.org (accessed October 3, 2008).
- 17 Six sigma, http://www.isixsigma.com/sixsigma/six_sigma.asp (accessed October 3, 2008).
- 18 ASCLD/LAB. Supplemental requirements for the accreditation of forensic science testing and calibration laboratories. ASCLD/LAB-International supplemental requirements, 2006, AL-PD-3003-Ver 2.1. Garner, NC: ASCLD/LAB, 2006.
- 19 ILAC. Guidelines for forensic science laboratories, ILAC-G19, 2002, http://www.ilac.org/documents/g19_2002.pdf .
- 20 FQS-I 17025 Accreditation, http://www.forquality.org (accessed October 3, 2008).
- 21 Texas Code Crim. P. Ann. Art. 38.35, 2005.
- 22 Oklahoma Stat Ann. Tit. Forensic Laboratory Accreditation Act §74-150.37, 2002.
- 23 N.Y. Crim. Proc. §995-b.
- 24 Koehler JJ, Chia A, Lindsey S. The random match probability (RMP) in DNA evidence: irrelevant and prejudicial? Jurimetrics J 1995; 35: 201–19.
- 25 National Research Council II Report. The evaluation of forensic evidence. Washington, DC: National Academy Press, 1996.
- 26 Thompson WC. Subjective interpretation, laboratory error and the value of forensic DNA evidence: three case studies. Genetica 1995; 96: 153–68.
- 27 Thompson WC, Taroni F, Aitken CG. How the probability of a false positive affects the value of DNA evidence. J Forensic Sci 2003; 48: 47–54.
- 28 Harmon R, Budowle B. Questions about forensic science. Science 2006; 311: 607.
- 29 Grieve DL. Possession of truth. J Forensic Identif 1996; 46: 521–8.
- 30 Peterson JL, Lin G, Ho M, Chen Y, Gaensslen RE. The feasibility of external blind DNA proficiency testing. I. Background and findings. J Forensic Sci 2003; 48(1): 21–31.
- 31 Houck MM, Budowle B. Correlation of microscopic and mitochondrial DNA hair comparisons. J Forensic Sci 2002; 47: 964–7.
- 32 Byrd JS. Confirmation bias, ethics, and mistakes in forensics. J Forensic Identif 2006; 56: 511–25.
- 33 Saviano J. The pursuit of objectivity in the examination of forensic evidence. J Forensic Identif 2006; 56(6): 877–84.
- 34 Moretti TR, Baumstark AL, Defenbaugh DA, Keys KM, Budowle B. Validation of short tandem repeats (STRs) for forensic usage: performance testing of fluorescent multiplex STR systems and analysis of authentic and simulated forensic samples. J Forensic Sci 2001; 46: 647–60.
- 35 Moretti TR, Baumstark AL, Defenbaugh DA, Keys KM, Budowle B. Validation of STR typing by capillary electrophoresis. J Forensic Sci 2001; 46: 661–76.
- 36 Nisbett RE, Ross L. Human inference: strategies and shortcomings of social judgment. Englewood Cliffs, NJ: Prentice-Hall, Inc., 1980.
- 37 Dror IE, Charlton D, Péron A. Contextual information renders experts vulnerable to making erroneous identifications. Forensic Sci Int 2006; 156: 74–8.
- 38 Dror IE, Charlton D. Why experts make errors. J Forensic Identif 2006; 56: 600–16.
- 39 Saks MJ, Risinger DM, Rosenthal R, Thompson WC. Context effects in forensic science: a review and application of the science of science to crime laboratory practice in the United States. Sci Justice 2003; 43: 77–90.
- 40 Krane DE, Ford S, Gilder JR, Inman K, Jamieson A, Koppl R, et al. Sequential unmasking: a means of minimizing observer effects in forensic DNA interpretation. J Forensic Sci 2008; 53: 1006–7.
- 41 Office of the Inspector General. The FBI Laboratory: an investigation into laboratory practices and alleged misconduct in explosives-related and other cases. Washington, DC: US Department of Justice, 1997.
- 42 Stafford Smith CA, Goodman PD. Forensic hair comparison analysis: nineteenth century science or twentieth century snake oil? Columbia Human Rights Law Rev 1996; 27: 227–91.
- 43
Robertson J.
Forensic and microscopic examination of human hair. In: J Robertson, editor. Forensic examination of hair. London: Taylor and Francis, 1999; 79–154.
10.1201/9780203483527.ch2 Google Scholar
- 44 Evett IW, Weir BS. Interpreting DNA evidence. Sunderland, MA: Sinauer Associates Inc., 1998.
- 45 SWGMAT. Expert reporting guideline. Forensic Sci Commun 2009; 11(1), http://www.fbi.gov/hq/lab/fsc/current/standards/2009_01_standards02.htm .
- 46 U.S. Department of Justice. Education and training in forensic science: a guide for forensic science laboratories, educational institutions, and students. Washington, DC: U.S. Department of Justice, Office of Justice Programs, 2004.
- 47 Siegel JA. The appropriate educational background for entry level forensic scientists: a survey of practitioners. J Forensic Sci 1988; 33: 1065–8.
- 48
Aitken CGG,
Taroni F.
Statistics and the evaluation of evidence for forensic scientists, 2nd ed. West Sussex: John Wiley & Sons, Inc., 2004.
10.1002/0470011238 Google Scholar
- 49 Lucy D. Introduction to statistics for forensic scientists. West Sussex: John Wiley & Sons, Inc., 2005.
- 50
Taroni F,
Aitken CGG,
Garbolino P,
Biedermann A.
Bayesian networks and probabilistic inference in forensic science. West Sussex: John Wiley & Sons, Inc., 2006.
10.1002/0470091754 Google Scholar
- 51 FEPAC. http://www.aafs.org/default.asp?section_id=aafs&page_id=committee&subpage_id=fepac (accessed July 31, 2008).
- 52 Almirall JR, Furton KG. Trends in forensic science education: expansion and increased accountability. Anal Bioanal Chem 2003; 376: 1156–9.
- 53 Scientific Working Group for Materials Analysis (SWGMAT). Forensic fiber examiner training program. Forensic Sci Commun 2005; 7(2), http://lab.fbinet.fbi/library/fsc/backissu/april2005/standards/SWGMAT_fiber_training_program.pdf .
- 54 Fleckstein MP, Martone M, Pitluck HM. Law, ethical codes, and the report of the CSSP survey on ethics policies. J Forensic Sci 2001; 46: 982–5.
- 55 Peterson JL. Teaching ethics in a forensic science curriculum. J Forensic Sci 1988; 33: 1081–5.
- 56 http://www.waduicenter.com/toolbox/documents/ASCLD-labmgtguide.pdf (accessed July 31, 2008).
- 57 National Research Council. Forensic analysis: weighing bullet lead evidence. Washington, DC: National Academy Press, 2004.
- 58 National Research Council. Committee to assess the feasibility, accuracy and technical capability of a national ballistics database. Washington, DC: National Academy Press, 2008.
- 59 Bodziak WJ. Footwear impression evidence: detection, recovery, and examination, 2nd ed. Boca Raton: CRC Press, 2000; 347.
- 60 Clinical Laboratory Standards Institute. User verification of performance for precision and trueness; approved guideline, 2nd ed. Wayne, PA: Clinical and Laboratory Standards Institute (CLSI Document EP15-A2), 2005.
- 61 Clinical and Laboratory Standards Institute. Genotyping for infectious diseases: identification and characterization; approved guideline. Wayne, PA: Clinical and Laboratory Standards Institute (CLSI Document MM10-A), 2006.
- 62 Budowle B, Chakraborty R, Carmody G, Monson KL. Source attribution of a forensic DNA profile. Forensic Sci Commun 2000; 2, http://www.fbi.gov/programs/lab/fsc/current/budowle.htm .
- 63 Evett IW, Williams RL. A review of the sixteen points fingerprint standard in England and Wales. J Forensic Identif 1996; 46: 49–73.
- 64 International Association for Identification. Standardization committee report. FBI Law Enforcement Bull 1973; 42: 7–8.
- 65 Vanderkolk JR. Forensic individualization of images using quality and quantity of information. J Forensic Identif 1999; 49(3): 246–56.
- 66 Budowle B, Buscaglia J, Schwartz Perlman R. Review of the scientific basis for friction ridge comparisons as a means of identification: committee findings and recommendations. Forensic Sci Commun 2006;8, http://www.fbi.gov/hq/lab/fsc .
Citing Literature
