Engineering Commons^™

Super-Resolution Enhancement Of Digital Video, Russell C. Hardie, Richard R. Schultz, Kenneth E. Barner

Russell C. Hardie

SR from digital video is a relatively new field, in only its third decade of existence. There is no doubt that as imaging sensor technologies, optical fabrication techniques, and computational algorithms mature, SR will find its way into digital video products such as cameras and digital cable set-top boxes. These papers on the fundamental SR topics of image registration, regularization, photometric diversity, detector nonuniformity, compression, optical design, and performance metrics serve as pioneers in the dynamic and evolving field of SR image reconstruction research and development. We are proud to present them to the image and video processing research community. …

A Collaborative Adaptive Wiener Filter For Image Restoration Using A Spatial-Domain Multi-Patch Correlation Model, Khaled M. Mohamed, Russell C. Hardie

Russell C. Hardie

We present a new patch-based image restoration algorithm using an adaptive Wiener filter (AWF) with a novel spatial-domain multi-patch correlation model. The new filter structure is referred to as a collaborative adaptive Wiener filter (CAWF). The CAWF employs a finite size moving window. At each position, the current observation window represents the reference patch. We identify the most similar patches in the image within a given search window about the reference patch. A single-stage weighted sum of all of the pixels in the similar patches is used to estimate the center pixel in the reference patch. The weights are based …

Scene-Based Nonuniformity Correction Technique For Focal-Plane Arrays Using Readout Architecture, Balaji Narayanan, Russell C. Hardie, Robert A. Muse

Russell C. Hardie

Spatial fixed pattern noise is a common and major problem in modern infrared imagers due to the nonuniform response of the photodiodes in the focal plane array of the imaging system. In addition, the nonuniform response of the readout and the digitization electronics, involved in multiplexing the signals from the photodiodes, causes further nonuniformity. In this paper, we describe a novel scene based nonuniformity correction algorithm that treats the aggregate nonuniformity in separate stages. Firstly, the nonuniformity from the readout amplifiers is corrected using knowledge of the readout architecture of the imaging system. In the second stage, the nonuniformity resulting …

High-Resolution Image Reconstruction From Digital Video By Exploitation Of Nonglobal Motion, Timothy Tuinstra, Russell Hardie

Russell C. Hardie

Many imaging systems utilize detector arrays that do not sample the scene according to the Nyquist criterion. As a result, the higher spatial frequencies admitted by the optics are aliased. This creates undesirable artifacts in the imagery. Furthermore, the blurring effects of the optics and the finite detector size also degrade the image quality. Several approaches for increasing the sampling rate of imaging systems have been suggested in the literature. We propose an algorithm for resolution enhancement that exploits object motion in digital video sequences. Unlike previously defined techniques, we use an automated segmentation method to isolate rigid moving objects. …

Anomaly Detection In Hyperspectral Imagery: Comparison Of Methods Using Diurnal And Seasonal Data, Patrick C. Hytla, Russell C. Hardie, Michael T. Eismann, Joseph Meola

Russell C. Hardie

The use of hyperspectral imaging is a fast growing field with many applications in the civilian, commercial and military sectors. Hyperspectral images are typically composed of many spectral bands in the visible and infrared regions of the electromagnetic spectrum and have the potential to deliver a great deal of information about a remotely sensed scene. One area of interest regarding hyperspectral images is anomaly detection, or the ability to find spectral outliers within a complex background in a scene with no a priori information about the scene or its specific contents. Anomaly detectors typically operate by creating a statistical background …

Image Restoration Of Dispersion-Degraded Images From A Liquid-Crystal Beam Steerer, Ronald J. Broessel, Vince Dominic, Russell C. Hardie

Russell C. Hardie

Liquid-crystal arrays represents one of the first practical technologies capable of steering light by electronic control only. We use such a device to steer the field of view of a broadband imaging sensor. Unfortunately, dispersion degrades the image quality by smearing out details in the image and by introducing multiple diffraction orders (echoes) at the detector plane. We present a method to compensate for these unwanted effects and thus restore the broadband images obtained with the beam steerer. We use the beam-propagation method to find the wavelength-dependent impulse response, from which we determine the appropriate Wiener filter. When training data …

High-Resolution Image Reconstruction From A Sequence Of Rotated And Translated Frames And Its Application To An Infrared Imaging System, Russell C. Hardie, Kenneth J. Barnard, John G. Bognar, Ernest E. Armstrong, Edward A. Watson

Russell C. Hardie

Some imaging systems employ detector arrays that are not sufficiently dense to meet the Nyquist criterion during image acquisition. This is particularly true for many staring infrared imagers. Thus, the full resolution afforded by the optics is not being realized in such a system. This paper presents a technique for estimating a high-resolution image, with reduced aliasing, from a sequence of undersampled rotated and translationally shifted frames. Such an image sequence can be obtained if an imager is mounted on a moving platform, such as an aircraft. Several approaches to this type of problem have been proposed in the literature. …

Joint Map Registration And High Resolution Image Estimation Using A Sequence Of Undersampled Images, Russell C. Hardie, Kenneth J. Barnard, Ernest E. Armstrong

Russell C. Hardie

n many imaging systems, the detector array is not sufficiently dense to adequately sample the scene with the desired field of view. This is particularly true for many infrared focal plane arrays. Thus, the resulting images may be severely aliased. This paper examines a technique for estimating a high-resolution image, with reduced aliasing, from a sequence of undersampled frames. Several approaches to this problem have been investigated previously. However, in this paper a maximum a posteriori (MAP) framework for jointly estimating image registration parameters and the high-resolution image is presented. Several previous approaches have relied on knowing the registration parameters …

Multiframe Adaptive Wiener Filter Super-Resolution With Jpeg2000-Compressed Images, Barath Narayanan Narayanan, Russell C. Hardie, Eric J. Balster

Russell C. Hardie

Historically, Joint Photographic Experts Group 2000 (JPEG2000) image compression and multiframe super-resolution (SR) image processing techniques have evolved separately. In this paper, we propose and compare novel processing architectures for applying multiframe SR with JPEG2000 compression. We propose a modified adaptive Wiener filter (AWF) SR method and study its performance as JPEG2000 is incorporated in different ways. In particular, we perform compression prior to SR and compare this to compression after SR. We also compare both independent-frame compression and difference-frame compression approaches. We find that some of the SR artifacts that result from compression can be reduced by decreasing the …

A Web-Based Job Management System For Three-Dimensional Printing And Scanning At The University Of North Dakota, Dalyn Limesand, Stephanie Hollman, Jeremy Straub, Scott Kerlin

Jeremy Straub

Three-dimensional (3D) printers have gained popularity for use for many different projects. The work presented herein aims to make this process simpler. This paper discusses a system that will allow individuals from across campus to submit object files for printing by a 3D printer, without having to schedule appointment and manually operate it.

Logistical requirements dictate some level of human involvement, despite a goal of creating a fully automated system. Involvement areas include converting /preparing submitted files, sending the job to the printer, print tray preparation, and completed object removal. From a user’s perspective, however a seamless experience is anticipated. …

A Low-Cost Radio For An Open Cubesat, Michael Wegerson, Jeremy Straub, Ronald Marsh

Jeremy Straub

The OpenOrbiter small spacecraft development program aims to develop a template that can be used by colleges and universities world-wide to ‘jumpstart’ their own CubeSat development program. It is doing this through the development of designs (and implementations to test the designs functionality) of all basic CubeSat subsystems. A CubeSat can prospectively perform elements of a mission that would otherwise have required the development and deployment of a multi-million dollar satellite, thus, interest in CubeSats in industry and government is strong as well. The Open Prototype for Educational Nanosats (OPEN) design being produced by the OpenOrbiter program may, thus, be …

Development Of A Low-Cost Portable 3d Scanner Using Visible Light Cameras, Brendan Ydstie, Tierra Novacek, Benjamin Kading, Jeremy Straub, Scott Kerlin

Jeremy Straub

The medical field is beginning to use advanced manufacturing technologies such as three-dimensional (3D) scanning (where a real-world object is turned into a digital model) and printing (where a digital model is turned into a real-world object) to create customized prosthetics and other medical devices to address the specific needs of patients. This technology provides an efficient way to customize prosthetics to fit a particular person and his or her unique shape, making the prosthetics easier for the patient to use and in some cases, meeting needs that cannot be met via pre-fabricated equipment. The use of 3D scanning facilitates …

Using A Constellation Of Cubesats For In-Space Optical 3d Scanning, Jeremy Straub

Jeremy Straub

The assessment of in-space objects is an area of ongoing research. Characterization of resident space objects (RSOs) can be useful for assessing the operating status of operator-affiliated or non-affiliated space assets, identifying unknown objects or gathering additional details for known objects. Under the proposed approach, a ring-like constellation of CubeSats passes around the target (at a distance) collecting imagery. This imagery is then utilized to create a 3D model of the target. This paper considers several key elements of a constellation to perform this type of imaging, including the constellation design and imaging capabilities required and the astrodynamics relevant to …

Gaze Controlled Human-Computer Interface, Steve Petkovsek, Kevin Huang, Binay Poudel

Kevin Huang

The goal of the Gaze Controlled Human Computer Interface project is to design and construct a non-invasive gaze-tracking system that will determine where a user is looking on a computer screen in real time. To accomplish this, a fixed illumination source consisting of Infrared (IR) Light Emitting Diodes (LEDs) is used to produce corneal reflections on the user’s eyes. These reflections are captured with a video camera and compared to the relative location of the user’s pupils. From this comparison, a correlation matrix can be created and the approximate location of the screen that the user is looking at can …

Computational Multimedia For Video Self Modeling, Ju Shen

Ju Shen

Video self modeling (VSM) is a behavioral intervention technique in which a learner models a target behavior by watching a video of oneself. This is the idea behind the psychological theory of self-efficacy - you can learn or model to perform certain tasks because you see yourself doing it, which provides the most ideal form of behavior modeling. The effectiveness of VSM has been demonstrated for many different types of disabilities and behavioral problems ranging from stuttering, inappropriate social behaviors, autism, selective mutism to sports training. However, there is an inherent difficulty associated with the production of VSM material. Prolonged …

Enhancing Access To Radio Spectrum In Cognitive Radio Networks, Fatima Salahdine, Hassan El Ghazi, Naima Kaabouch

fatima salahdine