Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Engineering
From A Locally Competitive Algorithm To Sensory Relevance Models, Walter Woods
From A Locally Competitive Algorithm To Sensory Relevance Models, Walter Woods
Electrical and Computer Engineering PhD Day
This poster addresses the development of a new Machine Learning (ML) mechanism, the Sensory Relevance Model (SRM), as a means of splitting information processing tasks into two sub-tasks with more intuitive properties. Specifically, SRMs are a front-end for other ML techniques, re-mapping the input data to a similar space with significantly more sparsity, achieved through the transformation and suppression of inputs irrelevant to the task. Prior work has attempted to reveal this information for Neural Networks (NNs) either as a post-processing step via saliency maps or through a simple masking of the input achieved with a dot product (so-called ``attention'' …