Engineering Commons^™

From A Locally Competitive Algorithm To Sensory Relevance Models, Walter Woods

Electrical and Computer Engineering PhD Day

This poster addresses the development of a new Machine Learning (ML) mechanism, the Sensory Relevance Model (SRM), as a means of splitting information processing tasks into two sub-tasks with more intuitive properties. Specifically, SRMs are a front-end for other ML techniques, re-mapping the input data to a similar space with significantly more sparsity, achieved through the transformation and suppression of inputs irrelevant to the task. Prior work has attempted to reveal this information for Neural Networks (NNs) either as a post-processing step via saliency maps or through a simple masking of the input achieved with a dot product (so-called ``attention'' …