Open Access. Powered by Scholars. Published by Universities.®

Physics Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 31 - 46 of 46

Full-Text Articles in Physics

A Collaborative Adaptive Wiener Filter For Multi-Frame Super-Resolution, Khaled Mohamed, Russell Hardie May 2015

A Collaborative Adaptive Wiener Filter For Multi-Frame Super-Resolution, Khaled Mohamed, Russell Hardie

Russell C. Hardie

Factors that can limit the effective resolution of an imaging system may include aliasing from under-sampling, blur from the optics and external factors, and sensor noise. Image restoration and super-resolution (SR) techniques can be used to improve image resolution. One SR method, developed recently, is the adaptive Wiener filter (AWF) SR algorithm. This is a multi-frame SR method that combines registered temporal frames through a joint nonuniform interpolation and restoration process to provide a high-resolution image estimate. Variations of this method have been demonstrated to be effective for multi-frame SR, as well demosaicing RGB and polarimetric imagery. While the AWF …


Impact Of Detector-Element Active-Area Shape And Fill Factor On Image Sampling, Restoration, And Super-Resolution, Russell C. Hardie, Douglas R. Droege, Alexander J. Dapore, Mark E. Greiner May 2015

Impact Of Detector-Element Active-Area Shape And Fill Factor On Image Sampling, Restoration, And Super-Resolution, Russell C. Hardie, Douglas R. Droege, Alexander J. Dapore, Mark E. Greiner

Russell C. Hardie

In many undersampled imaging systems, spatial integration from the individual detector elements is the dominant component of the system point spread function (PSF). Conventional focal plane arrays (FPAs) utilize square detector elements with a nearly 100% fill factor, where fill factor is defined as the fraction of the detector element area that is active in light detection. A large fill factor is generally considered to be desirable because more photons are collected for a given pitch, and this leads to a higher signal-to-noise-ratio (SNR). However, the large active area works against super-resolution (SR) image restoration by acting as an additional …


Computationally Efficient Video Restoration For Nyquist Sampled Imaging Sensors Combining An Affine-Motion-Based Temporal Kalman Filter And Adaptive Wiener Filter, Michael Rucci, Russell Hardie, Kenneth Barnard May 2015

Computationally Efficient Video Restoration For Nyquist Sampled Imaging Sensors Combining An Affine-Motion-Based Temporal Kalman Filter And Adaptive Wiener Filter, Michael Rucci, Russell Hardie, Kenneth Barnard

Russell C. Hardie

In this paper, we present a computationally efficient video restoration algorithm to address both blur and noise for a Nyquist sampled imaging system. The proposed method utilizes a temporal Kalman filter followed by a correlation-model based spatial adaptive Wiener filter (AWF). The Kalman filter employs an affine background motion model and novel process-noise variance estimate. We also propose and demonstrate a new multidelay temporal Kalman filter designed to more robustly treat local motion. The AWF is a spatial operation that performs deconvolution and adapts to the spatially varying residual noise left in the Kalman filter stage. In image areas where …


Rank Conditioned Rank Selection Filters For Signal Restoration, Russell C. Hardie, Kenneth E. Barner May 2015

Rank Conditioned Rank Selection Filters For Signal Restoration, Russell C. Hardie, Kenneth E. Barner

Russell C. Hardie

A class of nonlinear filters called rank conditioned rank selection (RCRS) filters is developed and analyzed in this paper. The RCRS filters are developed within the general framework of rank selection(RS) filters, which are filters constrained to output an order statistic from the observation set. Many previously proposed rank order based filters can be formulated as RS filters. The only difference between such filters is in the information used in deciding which order statistic to output. The information used by RCRS filters is the ranks of selected input samples, hence the name rank conditioned rank selection filters. The number of …


Partition-Based Weighted Sum Filters For Image Restoration, Kenneth Barner, Ahmad Sarhan, Russell Hardie May 2015

Partition-Based Weighted Sum Filters For Image Restoration, Kenneth Barner, Ahmad Sarhan, Russell Hardie

Russell C. Hardie

We develop the concept of partitioning the observation space to build a general class of filters referred to as partition-based weighted sum (PWS) filters. In the general framework, each observation vector is mapped to one of M partitions comprising the observation space, and each partition has an associatedfiltering function. We focus on partitioning the observation space utilizing vector quantization and restrict the filtering function within each partition to be linear. In this formulation, a weighted sum of the observation samples forms the estimate, where the weights are allowed to be unique within eachpartition. The partitions are selected and weights tuned …


Map Estimation For Hyperspectral Image Resolution Enhancement Using An Auxiliary Sensor, Russell C. Hardie, Michael T. Eismann, Gregory L. Wilson Mar 2015

Map Estimation For Hyperspectral Image Resolution Enhancement Using An Auxiliary Sensor, Russell C. Hardie, Michael T. Eismann, Gregory L. Wilson

Russell C. Hardie

This paper presents a novel maximum a posteriori (MAP) estimator for enhancing the spatial resolution of an image using co-registered high spatial-resolution imagery from an auxiliary sensor. Here we focus on the use of high-resolution panchomatic data to enhance hyperspectral imagery. However, the estimation framework developed allows for any number of spectral bands in the primary and auxiliary image. The proposed technique is suitable for applications where some correlation, either localized or global, exists between the auxiliary image and the image being enhanced. To exploit localized correlations, a spatially varying statistical model, based on vector quantization, is used. Another important …


Partition-Based Interpolation For Color Filter Array Demosaicking And Super-Resolution Reconstruction, Min Shao, Kenneth E. Barner, Russell C. Hardie Mar 2015

Partition-Based Interpolation For Color Filter Array Demosaicking And Super-Resolution Reconstruction, Min Shao, Kenneth E. Barner, Russell C. Hardie

Russell C. Hardie

A class of partition-based interpolators that addresses a variety of image interpolation applications are proposed. The proposed interpolators first partition an image into a finite set of partitions that capture local image structures. Missing high resolution pixels are then obtained through linear operations on neighboring pixels that exploit the captured image structure. By exploiting the local image structure, the proposed algorithm produces excellent performance on both edge and uniform regions. The presented results demonstrate that partition-based interpolation yields results superior to traditional and advanced algorithms in the applications of color filter array (CFA) demosaicking and super-resolution reconstruction.


Super-Resolution Enhancement Of Digital Video, Russell C. Hardie, Richard R. Schultz, Kenneth E. Barner Mar 2015

Super-Resolution Enhancement Of Digital Video, Russell C. Hardie, Richard R. Schultz, Kenneth E. Barner

Russell C. Hardie

SR from digital video is a relatively new field, in only its third decade of existence. There is no doubt that as imaging sensor technologies, optical fabrication techniques, and computational algorithms mature, SR will find its way into digital video products such as cameras and digital cable set-top boxes. These papers on the fundamental SR topics of image registration, regularization, photometric diversity, detector nonuniformity, compression, optical design, and performance metrics serve as pioneers in the dynamic and evolving field of SR image reconstruction research and development. We are proud to present them to the image and video processing research community. …


Scene-Based Nonuniformity Correction Technique For Focal-Plane Arrays Using Readout Architecture, Balaji Narayanan, Russell C. Hardie, Robert A. Muse Mar 2015

Scene-Based Nonuniformity Correction Technique For Focal-Plane Arrays Using Readout Architecture, Balaji Narayanan, Russell C. Hardie, Robert A. Muse

Russell C. Hardie

Spatial fixed pattern noise is a common and major problem in modern infrared imagers due to the nonuniform response of the photodiodes in the focal plane array of the imaging system. In addition, the nonuniform response of the readout and the digitization electronics, involved in multiplexing the signals from the photodiodes, causes further nonuniformity. In this paper, we describe a novel scene based nonuniformity correction algorithm that treats the aggregate nonuniformity in separate stages. Firstly, the nonuniformity from the readout amplifiers is corrected using knowledge of the readout architecture of the imaging system. In the second stage, the nonuniformity resulting …


High-Resolution Image Reconstruction From Digital Video By Exploitation Of Nonglobal Motion, Timothy Tuinstra, Russell Hardie Mar 2015

High-Resolution Image Reconstruction From Digital Video By Exploitation Of Nonglobal Motion, Timothy Tuinstra, Russell Hardie

Russell C. Hardie

Many imaging systems utilize detector arrays that do not sample the scene according to the Nyquist criterion. As a result, the higher spatial frequencies admitted by the optics are aliased. This creates undesirable artifacts in the imagery. Furthermore, the blurring effects of the optics and the finite detector size also degrade the image quality. Several approaches for increasing the sampling rate of imaging systems have been suggested in the literature. We propose an algorithm for resolution enhancement that exploits object motion in digital video sequences. Unlike previously defined techniques, we use an automated segmentation method to isolate rigid moving objects. …


Aliasing Reduction In Staring Infrared Imagers Utilizing Subpixel Techniques, Joseph C. Gillette, Thomas M. Stadtmiller, Russell C. Hardie Mar 2015

Aliasing Reduction In Staring Infrared Imagers Utilizing Subpixel Techniques, Joseph C. Gillette, Thomas M. Stadtmiller, Russell C. Hardie

Russell C. Hardie

We introduce and analyze techniques for the reduction of aliased signal energy in a staring infrared imaging system. A standard staring system uses a fixed two-dimensional detector array that corresponds to a fixed spatial sampling frequency determined by the detector pitch or spacing. Aliasing will occur when sampling a scene containing spatial frequencies exceeding half the sampling frequency. This aliasing can significantly degrade the image quality. The aliasing reduction schemes presented here, referred to as microscanning, exploit subpixel shifts between time frames of an image sequence. These multiple images are used to reconstruct a single frame with reduced aliasing. If …


Anomaly Detection In Hyperspectral Imagery: Comparison Of Methods Using Diurnal And Seasonal Data, Patrick C. Hytla, Russell C. Hardie, Michael T. Eismann, Joseph Meola Mar 2015

Anomaly Detection In Hyperspectral Imagery: Comparison Of Methods Using Diurnal And Seasonal Data, Patrick C. Hytla, Russell C. Hardie, Michael T. Eismann, Joseph Meola

Russell C. Hardie

The use of hyperspectral imaging is a fast growing field with many applications in the civilian, commercial and military sectors. Hyperspectral images are typically composed of many spectral bands in the visible and infrared regions of the electromagnetic spectrum and have the potential to deliver a great deal of information about a remotely sensed scene. One area of interest regarding hyperspectral images is anomaly detection, or the ability to find spectral outliers within a complex background in a scene with no a priori information about the scene or its specific contents. Anomaly detectors typically operate by creating a statistical background …


Image Restoration Of Dispersion-Degraded Images From A Liquid-Crystal Beam Steerer, Ronald J. Broessel, Vince Dominic, Russell C. Hardie Mar 2015

Image Restoration Of Dispersion-Degraded Images From A Liquid-Crystal Beam Steerer, Ronald J. Broessel, Vince Dominic, Russell C. Hardie

Russell C. Hardie

Liquid-crystal arrays represents one of the first practical technologies capable of steering light by electronic control only. We use such a device to steer the field of view of a broadband imaging sensor. Unfortunately, dispersion degrades the image quality by smearing out details in the image and by introducing multiple diffraction orders (echoes) at the detector plane. We present a method to compensate for these unwanted effects and thus restore the broadband images obtained with the beam steerer. We use the beam-propagation method to find the wavelength-dependent impulse response, from which we determine the appropriate Wiener filter. When training data …


High-Resolution Image Reconstruction From A Sequence Of Rotated And Translated Frames And Its Application To An Infrared Imaging System, Russell C. Hardie, Kenneth J. Barnard, John G. Bognar, Ernest E. Armstrong, Edward A. Watson Mar 2015

High-Resolution Image Reconstruction From A Sequence Of Rotated And Translated Frames And Its Application To An Infrared Imaging System, Russell C. Hardie, Kenneth J. Barnard, John G. Bognar, Ernest E. Armstrong, Edward A. Watson

Russell C. Hardie

Some imaging systems employ detector arrays that are not sufficiently dense to meet the Nyquist criterion during image acquisition. This is particularly true for many staring infrared imagers. Thus, the full resolution afforded by the optics is not being realized in such a system. This paper presents a technique for estimating a high-resolution image, with reduced aliasing, from a sequence of undersampled rotated and translationally shifted frames. Such an image sequence can be obtained if an imager is mounted on a moving platform, such as an aircraft. Several approaches to this type of problem have been proposed in the literature. …


Joint Map Registration And High Resolution Image Estimation Using A Sequence Of Undersampled Images, Russell C. Hardie, Kenneth J. Barnard, Ernest E. Armstrong Mar 2015

Joint Map Registration And High Resolution Image Estimation Using A Sequence Of Undersampled Images, Russell C. Hardie, Kenneth J. Barnard, Ernest E. Armstrong

Russell C. Hardie

n many imaging systems, the detector array is not sufficiently dense to adequately sample the scene with the desired field of view. This is particularly true for many infrared focal plane arrays. Thus, the resulting images may be severely aliased. This paper examines a technique for estimating a high-resolution image, with reduced aliasing, from a sequence of undersampled frames. Several approaches to this problem have been investigated previously. However, in this paper a maximum a posteriori (MAP) framework for jointly estimating image registration parameters and the high-resolution image is presented. Several previous approaches have relied on knowing the registration parameters …


Multiframe Adaptive Wiener Filter Super-Resolution With Jpeg2000-Compressed Images, Barath Narayanan Narayanan, Russell C. Hardie, Eric J. Balster Mar 2015

Multiframe Adaptive Wiener Filter Super-Resolution With Jpeg2000-Compressed Images, Barath Narayanan Narayanan, Russell C. Hardie, Eric J. Balster

Russell C. Hardie

Historically, Joint Photographic Experts Group 2000 (JPEG2000) image compression and multiframe super-resolution (SR) image processing techniques have evolved separately. In this paper, we propose and compare novel processing architectures for applying multiframe SR with JPEG2000 compression. We propose a modified adaptive Wiener filter (AWF) SR method and study its performance as JPEG2000 is incorporated in different ways. In particular, we perform compression prior to SR and compare this to compression after SR. We also compare both independent-frame compression and difference-frame compression approaches. We find that some of the SR artifacts that result from compression can be reduced by decreasing the …