Physical Sciences and Mathematics Commons^™

How To Gauge The Quality Of A Testing Method When Ground Truth Is Known With Uncertainty, Nicholas Gray, Scott Ferson, Vladik Kreinovich

Departmental Technical Reports (CS)

The quality of a testing method is usually measured by using sensitivity, specificity, and/or precision. To compute each of these three characteristics, we need to know the ground truth, i.e., we need to know which objects actually have the tested property. In many applications (e.g., in medical diagnostics), the information about the objects comes from experts, and this information comes with uncertainty. In this paper, we show how to take this uncertainty into account when gauging the quality of testing methods.