Open Access. Powered by Scholars. Published by Universities.®

Chemistry Commons

Open Access. Powered by Scholars. Published by Universities.®

Social and Behavioral Sciences

Theses/Dissertations

2024

Machine learning performance validation

Articles 1 - 1 of 1

Full-Text Articles in Chemistry

Validating Machine And Human Decision-Making In Forensic Fire Debris Analysis, Frances A. Whitehead Jan 2024

Validating Machine And Human Decision-Making In Forensic Fire Debris Analysis, Frances A. Whitehead

Graduate Thesis and Dissertation 2023-2024

This work presents a background on the chemical complexity of fire debris analysis, including an ever-present matrix of pyrolysis products as the catalyst that led to the creation of the National Center for Forensic Science's Fire Debris Database. A selection of these 1,000+ casework-relevant ground truth samples was used to create two newly proposed analyst workflows to connect the current method of categorical reporting with evaluative reporting practices reflective of the strength of the evidence. Both workflows use linear sequential unmasking to help mitigate bias, a discrete scoring system for quantification of the analysis, and receiver operating characteristic (ROC) curves …