Physics Commons^™

Comparing Multiple Turbulence Restoration Algorithms Performance On Noisy Anisoplanatic Imagery, Michael Armand Rucci, Russell C. Hardie, Alexander J. Dapore

Russell C. Hardie

In this paper, we compare the performance of multiple turbulence mitigation algorithms to restore imagery degraded by atmospheric turbulence and camera noise. In order to quantify and compare algorithm performance, imaging scenes were simulated by applying noise and varying levels of turbulence. For the simulation, a Monte-Carlo wave optics approach is used to simulate the spatially and temporally varying turbulence in an image sequence. A Poisson-Gaussian noise mixture model is then used to add noise to the observed turbulence image set. These degraded image sets are processed with three separate restoration algorithms: Lucky Look imaging, bispectral speckle imaging, and a …

Analysis Of Various Classification Techniques For Computer Aided Detection System Of Pulmonary Nodules In Ct, Barath Narayanan Narayanan, Russell C. Hardie, Temesguen Messay

Russell C. Hardie

Lung cancer is the leading cause of cancer death in the United States. It usually exhibits its presence with the formation of pulmonary nodules. Nodules are round or oval-shaped growth present in the lung. Computed Tomography (CT) scans are used by radiologists to detect such nodules. Computer Aided Detection (CAD) of such nodules would aid in providing a second opinion to the radiologists and would be of valuable help in lung cancer screening. In this research, we study various feature selection methods for the CAD system framework proposed in FlyerScan. Algorithmic steps of FlyerScan include (i) local contrast enhancement (ii) …

On The Simulation And Mitigation Of Anisoplanatic Optical Turbulence For Long Range Imaging, Russell C. Hardie, Daniel A. Lemaster

Russell C. Hardie

We describe a numerical wave propagation method for simulating long range imaging of an extended scene under anisoplanatic conditions. Our approach computes an array of point spread functions (PSFs) for a 2D grid on the object plane. The PSFs are then used in a spatially varying weighted sum operation, with an ideal image, to produce a simulated image with realistic optical turbulence degradation. To validate the simulation we compare simulated outputs with the theoretical anisoplanatic tilt correlation and differential tilt variance. This is in addition to comparing the long- and short-exposure PSFs, and isoplanatic angle. Our validation analysis shows an …

Recursive Non-Local Means Filter For Video Denoising, Redha A. Ali, Russell C. Hardie

Russell C. Hardie

In this paper, we propose a computationally efficient algorithm for video denoising that exploits temporal and spatial redundancy. The proposed method is based on non-local means (NLM). NLM methods have been applied successfully in various image denoising applications. In the single-frame NLM method, each output pixel is formed as a weighted sum of the center pixels of neighboring patches, within a given search window. The weights are based on the patch intensity vector distances. The process requires computing vector distances for all of the patches in the search window. Direct extension of this method from 2D to 3D, for video …

Block Matching And Wiener Filtering Approach To Optical Turbulence Mitigation And Its Application To Simulated And Real Imagery With Quantitative Error Analysis, Russell C. Hardie, Michael Armand Rucci, Barry K. Karch, Alexander J. Dapore

Russell C. Hardie

We present a block-matching and Wiener filtering approach to atmospheric turbulence mitigation for long-range imaging of extended scenes. We evaluate the proposed method, along with some benchmark methods, using simulated and real-image sequences. The simulated data are generated with a simulation tool developed by one of the authors. These data provide objective truth and allow for quantitative error analysis. The proposed turbulence mitigation method takes a sequence of short-exposure frames of a static scene and outputs a single restored image. A block-matching registration algorithm is used to provide geometric correction for each of the individual input frames. The registered frames …

Simulation Of Anisoplanatic Imaging Through Optical Turbulence Using Numerical Wave Propagation With New Validation Analysis, Russell C. Hardie, Jonathan D. Power, Daniel A. Lemaster, Douglas R. Droege, Szymon Gladysz, Santasri Bose-Pillai

Russell C. Hardie

We present a numerical wave propagation method for simulating imaging of an extended scene under anisoplanatic conditions. While isoplanatic simulation is relatively common, few tools are specifically designed for simulating the imaging of extended scenes under anisoplanatic conditions. We provide a complete description of the proposed simulation tool, including the wave propagation method used. Our approach computes an array of point spread functions (PSFs) for a two-dimensional grid on the object plane. The PSFs are then used in a spatially varying weighted sum operation, with an ideal image, to produce a simulated image with realistic optical turbulence degradation. The degradation …

Differential Tilt Variance Effects Of Turbulence In Imagery: Comparing Simulation With Theory, Daniel A. Lemaster, Russell C. Hardie, Szymon Gladysz, Matthew D. Howard, Michael Armand Rucci, Matthew E. Trippel, Jonathan D. Power, Barry K. Karch

Russell C. Hardie

Differential tilt variance is a useful metric for interpreting the distorting effects of turbulence in incoherent imaging systems. In this paper, we compare the theoretical model of differential tilt variance to simulations. Simulation is based on a Monte Carlo wave optics approach with split step propagation. Results show that the simulation closely matches theory. The results also show that care must be taken when selecting a method to estimate tilts.

Digital Image Processing, Russell C. Hardie, Majeed M. Hayat

Russell C. Hardie

In recent years, digital images and digital image processing have become part of everyday life. This growth has been primarily fueled by advances in digital computers and the advent and growth of the Internet. Furthermore, commercially available digital cameras, scanners, and other equipment for acquiring, storing, and displaying digital imagery have become very inexpensive and increasingly powerful. An excellent treatment of digital images and digital image processing can be found in Ref. [1]. A digital image is simply a two-dimensional array of finite-precision numerical values called picture elements (or pixels). Thus a digital image is a spatially discrete (or discrete-space) …

Segmentation Of Pulmonary Nodules In Computed Tomography Using A Regression Neural Network Approach And Its Application To The Lung Image Database Consortium And Image Database Resource Initiative Dataset, Temesguen Messay, Russell C. Hardie, Timothy R. Tuinstra

Russell C. Hardie

We present new pulmonary nodule segmentation algorithms for computed tomography (CT). These include a fully-automated (FA) system, a semi-automated (SA) system, and a hybrid system. Like most traditional systems, the new FA system requires only a single user-supplied cue point. On the other hand, the SA system represents a new algorithm class requiring 8 user-supplied control points. This does increase the burden on the user, but we show that the resulting system is highly robust and can handle a variety of challenging cases. The proposed hybrid system starts with the FA system.

If improved segmentation results are needed, the SA …

Super-Resolution Using Adaptive Wiener Filters, Russell C. Hardie

Russell C. Hardie

The spatial sampling rate of an imaging system is determined by the spacing of the detectors in the focal plane array (FPA). The spatial frequencies present in the image on the focal plane are band-limited by the optics. This is due to diffraction through a finite aperture. To guarantee that there will be no aliasing during image acquisiton, the Nyquist criterion dictates that the sampling rate must be greater than twice the cut-off frequency of the optics. However, optical designs involve a number of trade-offs and typical imaging systems are designed with some level of aliasing. We will refer to …

Techniques For The Regeneration Of Wideband Speech From Narrowband Speech, Jason A. Fuemmeler, Russell C. Hardie, William R. Gardner

Russell C. Hardie

This paper addresses the problem of reconstructing wideband speech signals from observed narrowband speech signals. The goal of this work is to improve the perceived quality of speech signals which have been transmitted through narrowband channels or degraded during acquisition. We describe a system, based on linear predictive coding, for estimating wideband speech from narrowband. This system employs both previously identified and novel techniques. Experimental results are provided in order to illustrate the system’s ability to improve speech quality. Both objective and subjective criteria are used to evaluate the quality of the processed speech signals.

A Fast Image Super-Resolution Algorithm Using An Adaptive Wiener Filter, Russell C. Hardie

Russell C. Hardie

A computationally simple super-resolution algorithm using a type of adaptive Wiener filter is proposed. The algorithm produces an improved resolution image from a sequence of low-resolution (LR) video frames with overlapping field of view. The algorithm uses subpixel registration to position each LR pixel value on a common spatial grid that is referenced to the average position of the input frames. The positions of the LR pixels are not quantized to a finite grid as with some previous techniques. The output high-resolution (HR) pixels are obtained using a weighted sum of LR pixels in a local moving window. Using a …

Scene-Based Nonuniformity Correction With Reduced Ghosting Using A Gated Lms Algorithm, Russell C. Hardie, Frank Orion Baxley, Brandon J. Brys, Patrick C. Hytla

Russell C. Hardie

In this paper, we present a scene-based nouniformity correction (NUC) method using a modified adaptive least mean square (LMS) algorithm with a novel gating operation on the updates. The gating is designed to significantly reduce ghosting artifacts produced by many scene-based NUC algorithms by halting updates when temporal variation is lacking. We define the algorithm and present a number of experimental results to demonstrate the efficacy of the proposed method in comparison to several previously published methods including other LMS and constant statistics based methods. The experimental results include simulated imagery and a real infrared image sequence. We show that …

Fast Super-Resolution With Affine Motion Using An Adaptive Wiener Filter And Its Application To Airborne Imaging, Russell C. Hardie, Kenneth J. Barnard, Raúl Ordóñez

Russell C. Hardie

Fast nonuniform interpolation based super-resolution (SR) has traditionally been limited to applications with translational interframe motion. This is in part because such methods are based on an underlying assumption that the warping and blurring components in the observation model commute. For translational motion this is the case, but it is not true in general. This presents a problem for applications such as airborne imaging where translation may be insufficient. Here we present a new Fourier domain analysis to show that, for many image systems, an affine warping model with limited zoom and shear approximately commutes with the point spread function …

Super-Resolution For Imagery From Integrated Microgrid Polarimeters, Russell C. Hardie, Daniel A. Lemaster, Bradley Michael Ratliff

Russell C. Hardie

Imagery from microgrid polarimeters is obtained by using a mosaic of pixel-wise micropolarizers on a focal plane array (FPA). Each distinct polarization image is obtained by subsampling the full FPA image. Thus, the effective pixel pitch for each polarization channel is increased and the sampling frequency is decreased. As a result, aliasing artifacts from such undersampling can corrupt the true polarization content of the scene. Here we present the first multi-channel multi-frame super-resolution (SR) algorithms designed specifically for the problem of image restoration in microgrid polarization imagers. These SR algorithms can be used to address aliasing and other degradations, without …

Adaptive Wiener Filter Super-Resolution Of Color Filter Array Images, Barry K. Karch, Russell C. Hardie

Russell C. Hardie

Digital color cameras using a single detector array with a Bayer color filter array (CFA) require interpolation or demosaicing to estimate missing color information and provide full-color images. However, demosaicing does not specifically address fundamental undersampling and aliasing inherent in typical camera designs. Fast non-uniform interpolation based super-resolution (SR) is an attractive approach to reduce or eliminate aliasing and its relatively low computational load is amenable to real-time applications. The adaptive Wiener filter (AWF) SR algorithm was initially developed for grayscale imaging and has not previously been applied to color SR demosaicing. Here, we develop a novel fast SR method …

Fast Super-Resolution Using An Adaptive Wiener Filter With Robustness To Local Motion, Russell C. Hardie, Kenneth J. Barnard

Russell C. Hardie

We present a new adaptive Wiener filter (AWF) super-resolution (SR) algorithm that employs a global background motion model but is also robust to limited local motion. The AWF relies on registration to populate a common high resolution (HR) grid with samples from several frames. A weighted sum of local samples is then used to perform nonuniform interpolation and image restoration simultaneously. To achieve accurate subpixel registration, we employ a global background motion model with relatively few parameters that can be estimated accurately. However, local motion may be present that includes moving objects, motion parallax, or other deviations from the background …

Joint Wavelet Transform Correlation With Separated Target And Reference Planes, Boon Yi Soon, Mohammad A. Karim, Russell C. Hardie, Mohammad S. Alam

Russell C. Hardie

In recent years, we realize the usefulness of feature extraction for optical correlator and hereby, we investigate the capability of Laplace operator in feature extraction of multiple targets. The first-order terms and the false alarm terms in the correlation output would be removed using electronic power spectrum subtraction technique. Most importantly, the entire magneto-optic SLM is completely utilized for displaying only targets in the input scene. A new cost efficient hardware implementation is proposed and aforementioned result of the proposed system is evaluated through computer simulation.

Robust Super-Resolution By Fusion Of Interpolated Frames For Color And Grayscale Images, Barry K. Karch, Russell C. Hardie

Russell C. Hardie

Multi-frame super-resolution (SR) processing seeks to overcome undersampling issues that can lead to undesirable aliasing artifacts in imaging systems. A key factor in effective multi-frame SR is accurate subpixel inter-frame registration. Accurate registration is more difficult when frame-to-frame motion does not contain simple global translation and includes locally moving scene objects. SR processing is further complicated when the camera captures full color by using a Bayer color filter array (CFA). Various aspects of these SR challenges have been previously investigated. Fast SR algorithms tend to have difficulty accommodating complex motion and CFA sensors. Furthermore, methods that can tolerate these complexities …

Impact Of Detector-Element Active-Area Shape And Fill Factor On Image Sampling, Restoration, And Super-Resolution, Russell C. Hardie, Douglas R. Droege, Alexander J. Dapore, Mark E. Greiner

Russell C. Hardie

In many undersampled imaging systems, spatial integration from the individual detector elements is the dominant component of the system point spread function (PSF). Conventional focal plane arrays (FPAs) utilize square detector elements with a nearly 100% fill factor, where fill factor is defined as the fraction of the detector element area that is active in light detection. A large fill factor is generally considered to be desirable because more photons are collected for a given pitch, and this leads to a higher signal-to-noise-ratio (SNR). However, the large active area works against super-resolution (SR) image restoration by acting as an additional …

Rank Conditioned Rank Selection Filters For Signal Restoration, Russell C. Hardie, Kenneth E. Barner

Russell C. Hardie

A class of nonlinear filters called rank conditioned rank selection (RCRS) filters is developed and analyzed in this paper. The RCRS filters are developed within the general framework of rank selection(RS) filters, which are filters constrained to output an order statistic from the observation set. Many previously proposed rank order based filters can be formulated as RS filters. The only difference between such filters is in the information used in deciding which order statistic to output. The information used by RCRS filters is the ranks of selected input samples, hence the name rank conditioned rank selection filters. The number of …

Map Estimation For Hyperspectral Image Resolution Enhancement Using An Auxiliary Sensor, Russell C. Hardie, Michael T. Eismann, Gregory L. Wilson

Russell C. Hardie

This paper presents a novel maximum a posteriori (MAP) estimator for enhancing the spatial resolution of an image using co-registered high spatial-resolution imagery from an auxiliary sensor. Here we focus on the use of high-resolution panchomatic data to enhance hyperspectral imagery. However, the estimation framework developed allows for any number of spectral bands in the primary and auxiliary image. The proposed technique is suitable for applications where some correlation, either localized or global, exists between the auxiliary image and the image being enhanced. To exploit localized correlations, a spatially varying statistical model, based on vector quantization, is used. Another important …

Partition-Based Interpolation For Color Filter Array Demosaicking And Super-Resolution Reconstruction, Min Shao, Kenneth E. Barner, Russell C. Hardie

Russell C. Hardie

A class of partition-based interpolators that addresses a variety of image interpolation applications are proposed. The proposed interpolators first partition an image into a finite set of partitions that capture local image structures. Missing high resolution pixels are then obtained through linear operations on neighboring pixels that exploit the captured image structure. By exploiting the local image structure, the proposed algorithm produces excellent performance on both edge and uniform regions. The presented results demonstrate that partition-based interpolation yields results superior to traditional and advanced algorithms in the applications of color filter array (CFA) demosaicking and super-resolution reconstruction.

Super-Resolution Enhancement Of Digital Video, Russell C. Hardie, Richard R. Schultz, Kenneth E. Barner

Russell C. Hardie

SR from digital video is a relatively new field, in only its third decade of existence. There is no doubt that as imaging sensor technologies, optical fabrication techniques, and computational algorithms mature, SR will find its way into digital video products such as cameras and digital cable set-top boxes. These papers on the fundamental SR topics of image registration, regularization, photometric diversity, detector nonuniformity, compression, optical design, and performance metrics serve as pioneers in the dynamic and evolving field of SR image reconstruction research and development. We are proud to present them to the image and video processing research community. …

Scene-Based Nonuniformity Correction Technique For Focal-Plane Arrays Using Readout Architecture, Balaji Narayanan, Russell C. Hardie, Robert A. Muse

Russell C. Hardie

Spatial fixed pattern noise is a common and major problem in modern infrared imagers due to the nonuniform response of the photodiodes in the focal plane array of the imaging system. In addition, the nonuniform response of the readout and the digitization electronics, involved in multiplexing the signals from the photodiodes, causes further nonuniformity. In this paper, we describe a novel scene based nonuniformity correction algorithm that treats the aggregate nonuniformity in separate stages. Firstly, the nonuniformity from the readout amplifiers is corrected using knowledge of the readout architecture of the imaging system. In the second stage, the nonuniformity resulting …

Aliasing Reduction In Staring Infrared Imagers Utilizing Subpixel Techniques, Joseph C. Gillette, Thomas M. Stadtmiller, Russell C. Hardie

Russell C. Hardie

We introduce and analyze techniques for the reduction of aliased signal energy in a staring infrared imaging system. A standard staring system uses a fixed two-dimensional detector array that corresponds to a fixed spatial sampling frequency determined by the detector pitch or spacing. Aliasing will occur when sampling a scene containing spatial frequencies exceeding half the sampling frequency. This aliasing can significantly degrade the image quality. The aliasing reduction schemes presented here, referred to as microscanning, exploit subpixel shifts between time frames of an image sequence. These multiple images are used to reconstruct a single frame with reduced aliasing. If …

Anomaly Detection In Hyperspectral Imagery: Comparison Of Methods Using Diurnal And Seasonal Data, Patrick C. Hytla, Russell C. Hardie, Michael T. Eismann, Joseph Meola

Russell C. Hardie

The use of hyperspectral imaging is a fast growing field with many applications in the civilian, commercial and military sectors. Hyperspectral images are typically composed of many spectral bands in the visible and infrared regions of the electromagnetic spectrum and have the potential to deliver a great deal of information about a remotely sensed scene. One area of interest regarding hyperspectral images is anomaly detection, or the ability to find spectral outliers within a complex background in a scene with no a priori information about the scene or its specific contents. Anomaly detectors typically operate by creating a statistical background …

Image Restoration Of Dispersion-Degraded Images From A Liquid-Crystal Beam Steerer, Ronald J. Broessel, Vince Dominic, Russell C. Hardie

Russell C. Hardie

Liquid-crystal arrays represents one of the first practical technologies capable of steering light by electronic control only. We use such a device to steer the field of view of a broadband imaging sensor. Unfortunately, dispersion degrades the image quality by smearing out details in the image and by introducing multiple diffraction orders (echoes) at the detector plane. We present a method to compensate for these unwanted effects and thus restore the broadband images obtained with the beam steerer. We use the beam-propagation method to find the wavelength-dependent impulse response, from which we determine the appropriate Wiener filter. When training data …

High-Resolution Image Reconstruction From A Sequence Of Rotated And Translated Frames And Its Application To An Infrared Imaging System, Russell C. Hardie, Kenneth J. Barnard, John G. Bognar, Ernest E. Armstrong, Edward A. Watson

Russell C. Hardie

Some imaging systems employ detector arrays that are not sufficiently dense to meet the Nyquist criterion during image acquisition. This is particularly true for many staring infrared imagers. Thus, the full resolution afforded by the optics is not being realized in such a system. This paper presents a technique for estimating a high-resolution image, with reduced aliasing, from a sequence of undersampled rotated and translationally shifted frames. Such an image sequence can be obtained if an imager is mounted on a moving platform, such as an aircraft. Several approaches to this type of problem have been proposed in the literature. …

Joint Map Registration And High Resolution Image Estimation Using A Sequence Of Undersampled Images, Russell C. Hardie, Kenneth J. Barnard, Ernest E. Armstrong

Russell C. Hardie

n many imaging systems, the detector array is not sufficiently dense to adequately sample the scene with the desired field of view. This is particularly true for many infrared focal plane arrays. Thus, the resulting images may be severely aliased. This paper examines a technique for estimating a high-resolution image, with reduced aliasing, from a sequence of undersampled frames. Several approaches to this problem have been investigated previously. However, in this paper a maximum a posteriori (MAP) framework for jointly estimating image registration parameters and the high-resolution image is presented. Several previous approaches have relied on knowing the registration parameters …