Life Sciences Commons^™

Designing A Computer-Vision Application: A Case Study For Hand-Hygiene Assessment In An Open-Room Environment, Chengzang Zhong, Amy R. Reibman, Hansel A. Mina, Amanda J. Deering

Department of Food Science Faculty Publications

Hand-hygiene is a critical component for safe food handling. In this paper, we apply an iterative engineering process to design a hand-hygiene action detection system to improve food- handling safety. We demonstrate the feasibility of a baseline RGB-only convolutional neural network (CNN) in the restricted case of a single scenario; however, since this baseline system performs poorly across scenarios, we also demonstrate the application of two methods to explore potential reasons for its poor performance. This leads to the development of our hierarchical system that incorporates a variety of modalities (RGB, optical flow, hand masks, and human skeleton joints) for …