Other Electrical and Computer Engineering Commons^™

Fast Super-Resolution With Affine Motion Using An Adaptive Wiener Filter And Its Application To Airborne Imaging, Russell C. Hardie, Kenneth J. Barnard, Raúl Ordóñez

Raúl Ordóñez

Fast nonuniform interpolation based super-resolution (SR) has traditionally been limited to applications with translational interframe motion. This is in part because such methods are based on an underlying assumption that the warping and blurring components in the observation model commute. For translational motion this is the case, but it is not true in general. This presents a problem for applications such as airborne imaging where translation may be insufficient. Here we present a new Fourier domain analysis to show that, for many image systems, an affine warping model with limited zoom and shear approximately commutes with the point spread function …

Robust Super-Resolution By Fusion Of Interpolated Frames For Color And Grayscale Images, Barry K. Karch, Russell C. Hardie

Russell C. Hardie

Multi-frame super-resolution (SR) processing seeks to overcome undersampling issues that can lead to undesirable aliasing artifacts in imaging systems. A key factor in effective multi-frame SR is accurate subpixel inter-frame registration. Accurate registration is more difficult when frame-to-frame motion does not contain simple global translation and includes locally moving scene objects. SR processing is further complicated when the camera captures full color by using a Bayer color filter array (CFA). Various aspects of these SR challenges have been previously investigated. Fast SR algorithms tend to have difficulty accommodating complex motion and CFA sensors. Furthermore, methods that can tolerate these complexities …

Computationally Efficient Video Restoration For Nyquist Sampled Imaging Sensors Combining An Affine-Motion-Based Temporal Kalman Filter And Adaptive Wiener Filter, Michael Rucci, Russell Hardie, Kenneth Barnard

Russell C. Hardie

In this paper, we present a computationally efficient video restoration algorithm to address both blur and noise for a Nyquist sampled imaging system. The proposed method utilizes a temporal Kalman filter followed by a correlation-model based spatial adaptive Wiener filter (AWF). The Kalman filter employs an affine background motion model and novel process-noise variance estimate. We also propose and demonstrate a new multidelay temporal Kalman filter designed to more robustly treat local motion. The AWF is a spatial operation that performs deconvolution and adapts to the spatially varying residual noise left in the Kalman filter stage. In image areas where …

Segmentation Of Pulmonary Nodules In Computed Tomography Using A Regression Neural Network Approach And Its Application To The Lung Image Database Consortium And Image Database Resource Initiative Dataset, Temesguen Messay, Russell C. Hardie, Timothy R. Tuinstra

Electrical and Computer Engineering Faculty Publications

We present new pulmonary nodule segmentation algorithms for computed tomography (CT). These include a fully-automated (FA) system, a semi-automated (SA) system, and a hybrid system. Like most traditional systems, the new FA system requires only a single user-supplied cue point. On the other hand, the SA system represents a new algorithm class requiring 8 user-supplied control points. This does increase the burden on the user, but we show that the resulting system is highly robust and can handle a variety of challenging cases. The proposed hybrid system starts with the FA system. If improved segmentation results are needed, the SA …

Segmentation Of Pulmonary Nodules In Computed Tomography Using A Regression Neural Network Approach And Its Application To The Lung Image Database Consortium And Image Database Resource Initiative Dataset, Temesguen Messay, Russell C. Hardie, Timothy R. Tuinstra

Electrical and Computer Engineering Faculty Publications

We present new pulmonary nodule segmentation algorithms for computed tomography (CT). These include a fully-automated (FA) system, a semi-automated (SA) system, and a hybrid system. Like most traditional systems, the new FA system requires only a single user-supplied cue point. On the other hand, the SA system represents a new algorithm class requiring 8 user-supplied control points. This does increase the burden on the user, but we show that the resulting system is highly robust and can handle a variety of challenging cases. The proposed hybrid system starts with the FA system.

If improved segmentation results are needed, the SA …

Map Estimation For Hyperspectral Image Resolution Enhancement Using An Auxiliary Sensor, Russell C. Hardie, Michael T. Eismann, Gregory L. Wilson

Russell C. Hardie

This paper presents a novel maximum a posteriori (MAP) estimator for enhancing the spatial resolution of an image using co-registered high spatial-resolution imagery from an auxiliary sensor. Here we focus on the use of high-resolution panchomatic data to enhance hyperspectral imagery. However, the estimation framework developed allows for any number of spectral bands in the primary and auxiliary image. The proposed technique is suitable for applications where some correlation, either localized or global, exists between the auxiliary image and the image being enhanced. To exploit localized correlations, a spatially varying statistical model, based on vector quantization, is used. Another important …

Scene-Based Nonuniformity Correction Technique For Focal-Plane Arrays Using Readout Architecture, Balaji Narayanan, Russell C. Hardie, Robert A. Muse

Russell C. Hardie

Spatial fixed pattern noise is a common and major problem in modern infrared imagers due to the nonuniform response of the photodiodes in the focal plane array of the imaging system. In addition, the nonuniform response of the readout and the digitization electronics, involved in multiplexing the signals from the photodiodes, causes further nonuniformity. In this paper, we describe a novel scene based nonuniformity correction algorithm that treats the aggregate nonuniformity in separate stages. Firstly, the nonuniformity from the readout amplifiers is corrected using knowledge of the readout architecture of the imaging system. In the second stage, the nonuniformity resulting …

High-Resolution Image Reconstruction From A Sequence Of Rotated And Translated Frames And Its Application To An Infrared Imaging System, Russell C. Hardie, Kenneth J. Barnard, John G. Bognar, Ernest E. Armstrong, Edward A. Watson

Russell C. Hardie

Some imaging systems employ detector arrays that are not sufficiently dense to meet the Nyquist criterion during image acquisition. This is particularly true for many staring infrared imagers. Thus, the full resolution afforded by the optics is not being realized in such a system. This paper presents a technique for estimating a high-resolution image, with reduced aliasing, from a sequence of undersampled rotated and translationally shifted frames. Such an image sequence can be obtained if an imager is mounted on a moving platform, such as an aircraft. Several approaches to this type of problem have been proposed in the literature. …

Multiframe Adaptive Wiener Filter Super-Resolution With Jpeg2000-Compressed Images, Barath Narayanan Narayanan, Russell C. Hardie, Eric J. Balster

Russell C. Hardie

Historically, Joint Photographic Experts Group 2000 (JPEG2000) image compression and multiframe super-resolution (SR) image processing techniques have evolved separately. In this paper, we propose and compare novel processing architectures for applying multiframe SR with JPEG2000 compression. We propose a modified adaptive Wiener filter (AWF) SR method and study its performance as JPEG2000 is incorporated in different ways. In particular, we perform compression prior to SR and compare this to compression after SR. We also compare both independent-frame compression and difference-frame compression approaches. We find that some of the SR artifacts that result from compression can be reduced by decreasing the …

Investigation Of Electromagnetic Velocities And Negative Refraction In A Chiral Metamaterial With Second-Order Material Dispersion Using Spectral Analyses And Dispersive Models, Monish Ranjan Chatterjee, Tarig A. Algadey

Electrical and Computer Engineering Faculty Publications

In recent years, considerable research has been carried out relative to the electromagnetic (EM) propagation and refraction characteristics in metamaterials with emphasis on the origins of negative refractive index.

Negative refractive index may be introduced in metamaterials via different methods; one such is the condition whereby the Poynting vector of the EM wave is in opposition to the group velocity in the material. Alternatively, negative refractive index also occurs when the group and phase velocities in the medium are in opposition. The latter phenomenon has been extensively investigated in the literature, including recent work involving chiral metamaterials with material dispersion …

Secure Transmission Of Static And Dynamic Images Via Chaotic Encryption In Acousto-Optic Hybrid Feedback With Profiled Light Beams, Monish Ranjan Chatterjee, Fares S. Almehmadi

Electrical and Computer Engineering Faculty Publications

Secure information encryption via acousto-optic (AO) chaos with profiled optical beams indicates substantially better performance in terms of system robustness. This paper examines encryption of static and time-varying (video) images onto AO chaotic carriers using Gaussian-profile beams with diffracted data numerically generated using transfer functions. The use of profiled beams leads to considerable improvement in the encrypted signal.

While static image encryption exhibits parameter tolerances within about ±10% for uniform optical beams, profiled beams reduce the tolerance to less than 1%, thereby vastly improving both the overall security of the transmitted information as well as the quality of the image …

Robust Super-Resolution By Fusion Of Interpolated Frames For Color And Grayscale Images, Barry K. Karch, Russell C. Hardie

Electrical and Computer Engineering Faculty Publications

Multi-frame super-resolution (SR) processing seeks to overcome undersampling issues that can lead to undesirable aliasing artifacts in imaging systems. A key factor in effective multi-frame SR is accurate subpixel inter-frame registration. Accurate registration is more difficult when frame-to-frame motion does not contain simple global translation and includes locally moving scene objects. SR processing is further complicated when the camera captures full color by using a Bayer color filter array (CFA). Various aspects of these SR challenges have been previously investigated. Fast SR algorithms tend to have difficulty accommodating complex motion and CFA sensors. Furthermore, methods that can tolerate these complexities …