Physical Sciences and Mathematics Commons^™

Amplification Of Hidden Periodic Motions In 3d Videos, Thomas Boccuto, Seraiah Kutai, Kristen Mosley, Samuel Kirk

Mathematics Summer Fellows

Ordinary videos capture a surprising amount of hidden, visually imperceptible information. For instance, videos of peoples' faces may capture color changes in the skin and artery motion from heartbeats, while videos of mechanical systems can capture subtle vibrations indicating imminent failure. Algorithms can extract and exaggerate these signals for visualization on top of the original videos. In particular, Eulerian magnification algorithms sidestep the need to track hidden motions directly and instead devise multiscale bandpass filters to amplify signals in local spatial regions. In this work, we extend these techniques beyond color videos to geometric video data captured by 3D depth …