Back to search

University of Alabama Birmingham

Applying Signal Detection Theory Using Evofinder To A 10-Consecutively Manufactured Barrel Study That Included Damaged Bullets

Abstract

dc:description.abstract

The science of firearm and tool mark identification is based on the premise that no two tools produce the same microscopic detail and the tool that made the marks can be distinguished from all others. Based on the AFTE Theory of Identification, firearms comparisons can be classified as Identification, Elimination, Inconclusive, or Unsuitable for examination, with inconclusive indicating insufficient individual characteristics to support identification or exclusion. Error rates in firearm examinations are typically calculated by counting how often examiners make false-positive and false-negative conclusions relative to known ground truth, but inconclusive decisions complicate these calculations because they neither support nor contradict a shared source. Different counting rules for inconclusive results have been used in various large-scale black-box studies, and signal detection theory (SDT) offers a framework for understanding how these rules relate to error rates. Traditionally, firearm and toolmark examination and comparisons have relied on the comparison microscope, but recent work has turned to 3D Virtual Comparison Microscopy (VCM) to generate quantitative similarity metrics from digital bullet and cartridge case models. A key question is how VCM and similarity scores influence examiner decisions and estimated error rates when distinguishing same-source from different-source comparisons. This study applies SDT to similarity scores generated by the Evofinder system (ScannBI technology, Leeds Forensic Systems) to a previous ten-consecutively manufactured barrel study that included damaged bullets. A total of 432 bullets from the Best and Gardner 2022 study, including 40 damaged bullets from ten consecutively manufactured Thompson/Center Arms G2 Contender barrels, were scanned into Evofinder, generating 3D topographic images and 93,096 pairwise similarity scores between 0.115 and 1 were generated. The study examines how score distributions for same-source (known match) and different-source (known non-match) pairs overlap and how the bounds of their distribution are affected by surface quality, bullet damage, and barrel manufacturing similarity. Scores were plotted by ground truth and evaluated to identify potential decision thresholds and outliers. This study aims to provide a more nuanced, SDT-based understanding of sensitivity, specificity, and potential error rates for score-based firearm identification using current 3D automated ballistic identification systems.

Degree

thesis:*
Name thesis:degree_name
Master of Science in Forensic Science (MSFS)
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Criminal Justice

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Charania, Ruheen Firoz
Contributors dc:contributor
  • <p>Elizabeth Gardner</p>
  • <p>Brandon Best<br>Shelly McGrath</p>

Subjects

dc:subject × 1

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
University of Alabama Birmingham
Base URL
digitalcommons.library.uab.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Charania, Ruheen Firoz. Applying Signal Detection Theory Using Evofinder To A 10-Consecutively Manufactured Barrel Study That Included Damaged Bullets. Thesis thesis, https://digitalcommons.library.uab.edu/etd-2020s/214