Physical Sciences and Mathematics Commons^™

Understanding Model Reasoning In Automated Speech Systems: Implementing A Prototype Explanation System Using The Lime Method, Vadim Kudlay

Honors Theses

The field of voice processing has seen great advancements thanks in part to the rise of deep learning. However, the application of these deep learning techniques with an audio input space leads to an interesting result not commonly found when dealing with other input domains. Namely, common techniques for generating auditory adversarial samples using gradient-based optimization have been observed to have extremely low transferability among even the same model structure. This implies an inherent difference in the latent representations of audio samples that may be worth investigating in the pursuit of a more resilient and interpretable voice processing framework. Our …