Bill Thompson and Eryn Newman (both from UC Irvine’s Department of Criminology, Law and Society) have posted an interesting new study to SSRN. Here is the study’s abstract:
Forensic scientists have come under increasing pressure to quantify the strength of their evidence, but it is not clear which of several possible formats for presenting quantitative conclusions will be easiest for lay people, such as jurors, to understand. This experiment examined the way that people recruited from Amazon’s Mechanical Turk (n = 541) responded to 2 types of forensic evidence — a DNA comparison and a shoeprint comparison — when an expert explained the strength of this evidence 3 different ways: using random match probabilities (RMPs), likelihood ratios (LRs), or verbal equivalents of likelihood ratios (VEs). We found that verdicts were sensitive to the strength of DNA evidence regardless of how the expert explained it, but verdicts were sensitive to the strength of shoeprint evidence only when the expert used RMPs. The weight given to DNA evidence was consistent with the predictions of a Bayesian network model that incorporated the perceived risk of a false match from 3 causes (coincidence, a laboratory error, and a frame-up), but shoeprint evidence was undervalued relative to the same Bayesian model. Fallacious interpretations of the expert’s testimony (consistent with the source probability error and the defense attorney’s fallacy) were common and were associated with the weight given to the evidence and verdicts. The findings indicate that perceptions of forensic science evidence are shaped by prior beliefs and expectations as well as expert testimony and consequently that the best way to characterize and explain forensic evidence may vary across forensic disciplines.
Readers of this blog unfamiliar with Thompson’s work over the years should consider diving deeper in his back catalog. Among his many illuminating articles, “DNA evidence in the OJ Simpson Trial” is a personal favorite. It explains a lot and is vital reading!