Electrical and Computer Engineering Commons^™

Resampling And Super-Resolution Of Hexagonally Sampled Images Using Deep Learning, Dylan Flaute, Russell C. Hardie, Hamed Elwarfalli

Electrical and Computer Engineering Faculty Publications

Super-resolution (SR) aims to increase the resolution of imagery. Applications include security, medical imaging, and object recognition. We propose a deep learning-based SR system that takes a hexagonally sampled low-resolution image as an input and generates a rectangularly sampled SR image as an output. For training and testing, we use a realistic observation model that includes optical degradation from diffraction and sensor degradation from detector integration. Our SR approach first uses non-uniform interpolation to partially upsample the observed hexagonal imagery and convert it to a rectangular grid. We then leverage a state-of-the-art convolutional neural network (CNN) architecture designed for SR …

Method Of Making Temperature-Immune Self-Referencing Fabry–Pérot Cavity Sensors, Hengky Chandrahalim, Jonathan W. Smith

AFIT Patents

A method of making passive microscopic Fabry-Pérot Interferometer (FPI) sensor includes forming a three-dimensional microscopic optical structure on a cleaved tip of an optical fiber that reflects a light signal back through the optical fiber. The reflected light is altered by refractive index changes in the three-dimensional structure that is subject to at least one of: (i) thermal radiation; and (ii) volatile organic compounds.

A Unified Framework Of Deep Learning-Based Facial Expression Recognition System For Diversified Applications, Sanoar Hossain, Saiyed Umer, Vijayan K. Asari, Ranjeet Kumar Rout

Electrical and Computer Engineering Faculty Publications

This work proposes a facial expression recognition system for a diversified field of appli- cations. The purpose of the proposed system is to predict the type of expressions in a human face region. The implementation of the proposed method is fragmented into three components. In the first component, from the given input image, a tree-structured part model has been applied that predicts some landmark points on the input image to detect facial regions. The detected face region was normalized to its fixed size and then down-sampled to its varying sizes such that the advantages, due to the effect of multi-resolution …

Wavelength And Power Dependence On Multilevel Behavior Of Phase Change Materials, Gary A. Sevison, Joshua A. Burrow, Haiyun Guo, Andrew M. Sarangan, Joshua R. Hendrickson, Imad Agha

Electro-Optics and Photonics Faculty Publications

We experimentally probe the multilevel response of GeTe, Ge2Sb2Te5 (GST), and 4% tungsten-doped GST (W-GST) phase change materials (PCMs) using two wavelengths of light: 1550 nm, which is useful for telecom-applications, and near-infrared 780 nm, which is a standard wavelength for many experiments in atomic and molecular physics. We find that the materials behave differently with the excitation at the different wavelengths and identify useful applications for each material and wavelength. We discuss thickness variation in the thin films used as well and comment on the interaction of the interface between the material and the substrate with regard to the …

Optical Switching Performance Of Thermally Oxidized Vanadium Dioxide With An Integrated Thin Film Heater, Andrew M. Sarangan, Gamini Ariyawansa, Ilya Vitebskiy, Igor Anisimov

Electro-Optics and Photonics Faculty Publications

Optical switching performance of vanadium dioxide produced by thermal oxidation of vanadium is presented in this paper. A 100nm thick vanadium was oxidized under controlled conditions in a quartz tube furnace to produce approximately 200nm thick VO2. The substrate was appropriately coated on the front and back side to reduce reflection in the cold state, and an integrated thin film heater was fabricated to allow in-situ thermal cycling. Electrical measurements show a greater than three orders of magnitude change in resistivity during the phase transition. Optical measurements exhibit 70% transparency at 1500nm and about 15dB extinction across a wide spectral …

Guest Editorial: Edge Intelligence For Beyond 5g Networks, Yan Zhang, Zhiyong Feng, Hassnaa Moustafa, Feng Ye, Usman Javaid, Chunfen Cui

Electrical and Computer Engineering Faculty Publications

Beyond fifth-generation (B5G) networks, or so-called "6G", is the next-generation wireless communications systems that will radically change how Society evolves. Edge intelligence is emerging as a new concept and has extremely high potential in addressing the new challenges in B5G networks by providing mobile edge computing and edge caching capabilities together with Artificial Intelligence (AI) to the proximity of end users. In edge intelligence empowered B5G networks, edge resources are managed by AI systems for offering powerful computational processing and massive data acquisition locally at edge networks. AI helps to obtain efficient resource scheduling strategies in a complex environment with …

Twisted Spatiotemporal Optical Vortex Random Fields, Milo W. Hyde Iv

Faculty Publications

We present twisted spatiotemporal optical vortex (STOV) beams, which are partially coherent light sources that possess a coherent optical vortex and a random twist coupling their space and time dimensions. These beams have controllable partial coherence and transverse orbital angular momentum (OAM), which distinguishes them from the more common spatial vortex and twisted beams (known to carry longitudinal OAM) in the literature and should ultimately make them useful in applications such as optical communications and optical tweezing. We present the mathematical analysis of twisted STOV beams, deriving the mutual coherence function and linear and angular momentum densities. We simulate the …

Temperature-Immune Self-Referencing Fabry–Pérot Cavity Sensors, Hengky Chandrahalim, Jonathan W. Smith

AFIT Patents

A passive microscopic Fabry-Pérot Interferometer (FPI) sensor an optical fiber a three-dimensional microscopic optical structure formed on a cleaved tip of an optical fighter that reflects a light signal back through the optical fiber. The reflected light is altered by refractive index changes in the three-dimensional structure that is subject to at least one of: (i) thermal radiation; and (ii) volatile organic compounds.

Color-Compressive Bilateral Filter And Nonlocal Means For High-Dimensional Images, Christina Karam, Kenjiro Sugimoto, Keigo Hirakawa

Electrical and Computer Engineering Faculty Publications

We propose accelerated implementations of bilateral filter (BF) and nonlocal means (NLM) called color-compressive bilateral filter (CCBF) and color-compressive nonlocal means (CCNLM). CCBF and CCNLM are random filters, whose Monte-Carlo averaged output images are identical to the output images of conventional BF and NLM, respectively. However, CCBF and CCNLM are considerably faster because the spatial processing of multiple color channels are combined into a single random filtering process. This implies that the complexity of CCBF and CCNLM is less sensitive to color dimension (e.g., hyperspectral images) relatively to other BF and NLM methods. We experimentally verified that the execution time …

Deep Learning For Anisoplanatic Optical Turbulence Mitigation In Long-Range Imaging, Matthew A. Hoffmire, Russell C. Hardie, Michael A. Rucci, Richard Van Hook, Barry K. Karch

Electrical and Computer Engineering Faculty Publications

We present a deep learning approach for restoring images degraded by atmospheric optical turbulence. We consider the case of terrestrial imaging over long ranges with a wide field-of-view. This produces an anisoplanatic imaging scenario where turbulence warping and blurring vary spatially across the image. The proposed turbulence mitigation (TM) method assumes that a sequence of short-exposure images is acquired. A block matching (BM) registration algorithm is applied to the observed frames for dewarping, and the resulting images are averaged. A convolutional neural network (CNN) is then employed to perform spatially adaptive restoration. We refer to the proposed TM algorithm as …

Plasmonic Waveguides To Enhance Quantum Electrodynamic Phenomena At The Nanoscale, Ying Li, Christos Argyropoulos

Department of Electrical and Computer Engineering: Faculty Publications

The emerging field of plasmonics can lead to enhanced light-matter interactions at extremely nanoscale regions. Plasmonic (metallic) devices promise to efficiently control both classical and quantum properties of light. Plasmonic waveguides are usually used to excite confined electromagnetic modes at the nanoscale that can strongly interact with matter. The analysis of these nanowaveguides exhibits similarities with their low frequency microwave counterparts. In this article, we review ways to study plasmonic nanostructures coupled to quantum optical emitters from a classical electromagnetic perspective. These quantum emitters are mainly used to generate single-photon quantum light that can be employed as a quantum bit …

Computational Modelling Enables Robust Multidimensional Nanoscopy, Matthew D. Lew

Electrical & Systems Engineering Publications and Presentations

The following sections are included:

• Present State of Computational Modelling in Fluorescence Nanoscopy

• Recent Contributions to Computational Modelling in Fluorescence Nanoscopy

• Outlook on Computational Modelling in Fluorescence Nanoscopy

• Acknowledgments

• References

Plasmon-Driven Nanowire Actuators For On-Chip Manipulation, Shuangyi Linghu, Zhaoqi Gu, Jinsheng Lu, Wei Fang, Zongyin Yang, Huakang Yu, Zhiyuan Li, Runlin Zhu, Jian Peng, Qiwen Zhan, Songlin Zhuang1, Min Gu, Fuxing Gu

Electro-Optics and Photonics Faculty Publications

Chemically synthesized metal nanowires are promising building blocks for next-generation photonic integrated circuits, but technological implementation in monolithic integration will be severely hampered by the lack of controllable and precise manipulation approaches, due to the strong adhesion of nanowires to substrates in non-liquid environments. Here, we demonstrate this obstacle can be removed by our proposed earthworm-like peristaltic crawling motion mechanism, based on the synergistic expansion, friction, and contraction in plasmon-driven metal nanowires in non-liquid environments. The evanescently excited sur- face plasmon greatly enhances the heating effect in metal nanowires, thereby generating surface acoustic waves to drive the nanowires crawling along …

On-Chip Silicon Photonic Controllable 2 × 2 Four-Mode Waveguide Switch, Cao Dung Truong, Duy Nguyen Thi Hang, Hengky Chandrahalim, Minh Tuan Trinh

Faculty Publications

Multimode optical switch is a key component of mode division multiplexing in modern high-speed optical signal processing. In this paper, we introduce for the first time a novel 2 × 2 multimode switch design and demonstrate in the proof-of-concept. The device composes of four Y-multijunctions and 2 × 2 multimode interference coupler using silicon-on-insulator material with four controllable phase shifters. The shifters operate using thermo-optic effects utilizing Ti heaters enabling simultaneous switching of the optical signal between the output ports on four quasi-transverse electric modes with the electric power consumption is in order of 22.5 mW and the switching time …

Tunable Optical Filter Using Phase Change Materials For Smart Ir Night Vision Applications, Remona Heenkenda, Keigo Hirakawa, Andrew Sarangan

Electro-Optics and Photonics Faculty Publications

In this paper we present a tunable filter using Ge2Sb2Se4Te1 (GSST) phase change material. The design principle of the filter is based on a metal-insulator-metal (MIM) cavity operating in the reflection mode. This is intended for night vision applications that utilize 850nm as the illumination source. The filter allows us to selectively reject the 850nm band in one state. This is illustrated through several daytime and nighttime imaging applications.

Ieee Access Special Section Editorial: Trends And Advances In Bio-Inspired Image-Based Deep Learning Methodologies And Applications, Peter Peer, Carlos M. Travieso-Gonzalez, Vijayan K. Asari, Malay Kishore Dutta

Electrical and Computer Engineering Faculty Publications

Many of the technological advances we enjoy today have been inspired by biological systems due to their ease of operation and outstanding efficiency. Designing technological solutions based on biological inspiration has become a cornerstone of research in a variety of areas ranging from control theory and optimization to computer vision, machine learning, and artificial intelligence. Especially in the latter few areas, biologically relevant solutions are becoming increasingly important as we look for new ways to make artificial systems more efficient, intelligent, and overall effective.

Dales Objects: A Large Scale Benchmark Dataset For Instance Segmentation In Aerial Lidar, Nina M. Singer, Vijayan K. Asari

Electrical and Computer Engineering Faculty Publications

We present DALES Objects, a large-scale instance segmentation benchmark dataset for aerial lidar. DALES Objects contains close to half a billion hand-labeled points, including semantic and instance segmentation labels. DALES Objects is an extension of the DALES (Varney et al., 2020) dataset, adding additional intensity and instance segmentation annotation. This paper provides an overview of the data collection, preprocessing, hand-labeling strategy, and final data format. We propose relevant evaluation metrics and provide insights into potential challenges when evaluating this benchmark dataset. Finally, we provide information about how researchers can access the dataset for their use at go.udayton.edu/dales3d.

Rapid Quantification Of Biofouling With An Inexpensive, Underwater Camera And Image Analysis, Matthew R. First, Scott C. Riley, Kazi Aminul Islam, Victoria Hill, Jiang Li, Richard C. Zimmerman, Lisa A. Drake

Electrical & Computer Engineering Faculty Publications

To reduce the transport of potentially invasive species on ships' submerged surfaces, rapid-and accurate-estimates of biofouling are needed so shipowners and regulators can effectively assess and manage biofouling. This pilot study developed a model approach for that task. First, photographic images were collected in situ with a submersible, inexpensive pocket camera. These images were used to develop image processing algorithms and train machine learning models to classify images containing natural assemblages of fouling organisms. All of the algorithms and models were implemented in a widely available software package (MATLAB^©). Initially, an unsupervised clustering model was used, and three …

Conditional Generative Adversarial Network Demosaicing Strategy For Division Of Focal Plane Polarimeters, Garrett Sargent, Bradley M. Ratliff, Vijayan K. Asari

Electrical and Computer Engineering Faculty Publications

Division of focal plane (DoFP), or integrated microgrid polarimeters, typically consist of a 2 × 2 mosaic of linear polarization filters overlaid upon a focal plane array sensor and obtain temporally synchronized polarized intensity measurements across a scene, similar in concept to a Bayer color filter array camera. However, the resulting estimated polarimetric images suffer a loss in resolution and can be plagued by aliasing due to the spatially-modulated microgrid measurement strategy. Demosaicing strategies have been proposed that attempt to minimize these effects, but result in some level of residual artifacts. In this work we propose a conditional generative adversarial …

3-D Fabry–Pérot Cavities Sculpted On Fiber Tips Using A Multiphoton Polymerization Process, Jonathan W. Smith, Jeremiah C. Williams, Joseph S. Suelzer, Nicholas G. Usechak, Hengky Chandrahalim

Faculty Publications

This paper presents 3-D Fabry–Pérot (FP) cavities fabricated directly onto cleaved ends of low-loss optical fibers by a two-photon polymerization (2PP) process. This fabrication technique is quick, simple, and inexpensive compared to planar microfabrication processes, which enables rapid prototyping and the ability to adapt to new requirements. These devices also utilize true 3-D design freedom, facilitating the realization of microscale optical elements with challenging geometries. Three different device types were fabricated and evaluated: an unreleased single-cavity device, a released dual-cavity device, and a released hemispherical mirror dual-cavity device. Each iteration improved the quality of the FP cavity's reflection spectrum. The …

Polarization-Selective Modulation Of Supercavity Resonances Originating From Bound States In The Continuum, Chan Kyaw, Riad Yahiaoui, Joshua A. Burrow, Viet Tran, Kyron Keelen, Wesley Sims, Eddie C. Red, Willie S. Rockward, Mikkel A. Thomas, Andrew M. Sarangan, Imad Agha, Thomas A. Searles

Electro-Optics and Photonics Faculty Publications

Bound states in the continuum (BICs) are widely studied for their ability to confine light, produce sharp resonances for sensing applications and serve as avenues for lasing action with topological characteristics. Primarily, the formation of BICs in periodic photonic band gap structures are driven by symmetry incompatibility; structural manipulation or variation of incidence angle from incoming light. In this work, we report two modalities for driving the formation of BICs in terahertz metasurfaces. At normal incidence, we experimentally confirm polarization driven symmetry-protected BICs by the variation of the linear polarization state of light. In addition, we demonstrate through strong coupling …

Transfer-To-Transfer Learning Approach For Computer Aided Detection Of Covid-19 In Chest Radiographs, Barath Narayanan Narayanan, Russell C. Hardie, Vignesh Krishnaraja, Christina Karam, Venkata Salini Priyamvada Davuluru

Electrical and Computer Engineering Faculty Publications

The coronavirus disease 2019 (COVID-19) global pandemic has severely impacted lives across the globe. Respiratory disorders in COVID-19 patients are caused by lung opacities similar to viral pneumonia. A Computer-Aided Detection (CAD) system for the detection of COVID-19 using chest radiographs would provide a second opinion for radiologists. For this research, we utilize publicly available datasets that have been marked by radiologists into two-classes (COVID-19 and non-COVID-19). We address the class imbalance problem associated with the training dataset by proposing a novel transfer-to-transfer learning approach, where we break a highly imbalanced training dataset into a group of balanced mini-sets and …

Atmospheric Turbulence Study With Deep Machine Learning Of Intensity Scintillation Patterns, Artem V. Vorontsov, Mikhail A. Vorontsov, Grigorii A. Fillimonov, Ernst Polnau

Electro-Optics and Photonics Faculty Publications

A new paradigm for machine learning-inspired atmospheric turbulence sensing is developed and applied to predict the atmospheric turbulence refractive index structure parameter using deep neural network (DNN)-based processing of short-exposure laser beam intensity scintillation patterns obtained with both: experimental measurement trials conducted over a 7 km propagation path, and imitation of these trials using wave-optics numerical simulations. The developed DNN model was optimized and evaluated in a set of machine learning experiments. The results obtained demonstrate both good accuracy and high temporal resolution in sensing. The machine learning approach was also employed to challenge the validity of several eminent atmospheric …

Enhancing The Visibility Of Vernier Effect In A Tri-Microfiber Coupler Fiber Loop Interferometer For Ultrasensitive Refractive Index And Temperature Sensing, Fangfang Wei, Dejun Liu, Zhe Wang, Zhuochen Wang, Gerald Farrell, Qiang Wu, Gang-Ding Peng, Yuliya Semenova

Articles

In this paper a Vernier effect based sensor is analyzed and demonstrated experimentally in a tri-microfiber coupler (Tri-MFC) and polarization-maintaining fiber (PMF) loop interferometer (Tri-MFC-PMF) to provide ultrasensitive refractive index and temperature sensing. The main novelty of this work is an analysis of parameters of the proposed Tri-MFC-PMF with the objective of determining the conditions leading to a strong Vernier effect. It has been identified by simulation that the Vernier effect is a primary factor in the design of Tri-MFC-PMF loop sensing structure for sensitivity enhancement. It is furthermore demonstrated experimentally that enhancing the visibility of the Vernier spectrum in …

Single‐Molecule 3d Orientation Imaging Reveals Nanoscale Compositional Heterogeneity In Lipid Membranes, Jin Lu, Hesam Mazidi, Tianben Ding, Oumeng Zhang, Matthew D. Lew

Electrical & Systems Engineering Publications and Presentations

In soft matter, thermal energy causes molecules to continuously translate and rotate, even in crowded environments, thereby impacting the spatial organization and function of most molecular assemblies, such as lipid membranes. Directly measuring the orientation and spatial organization of large collections (>3000 molecules μm⁻²) of single molecules with nanoscale resolution remains elusive. In this paper, we utilize SMOLM, single‐molecule orientation localization microscopy, to directly measure the orientation spectra (3D orientation plus “wobble”) of lipophilic probes transiently bound to lipid membranes, revealing that Nile red's (NR) orientation spectra are extremely sensitive to membrane chemical composition. SMOLM images resolve …

Artificial Neural Network Discovery Of A Switchable Metasurface Reflector, J. R. Thompson, J. A. Burrow, P. J. Shah, J. Slagle, E. S. Harper, A. Van Rynbach, I. Agha, M. S. Mills

Electro-Optics and Photonics Faculty Publications

Optical materials engineered to dynamically and selectively manipulate electromag- netic waves are essential to the future of modern optical systems. In this paper, we simulate various metasurface configurations consisting of periodic 1D bars or 2D pillars made of the ternary phase change material Ge2Sb2Te5 (GST). Dynamic switching behavior in reflectance is exploited due to a drastic refractive index change between the crystalline and amorphous states of GST. Selectivity in the reflection and transmission spectra is manipulated by tailoring the geometrical parameters of the metasurface. Due to the immense number of possible metasurface configurations, we train deep neural networks capable of …

A Hybrid Achromatic Metalens, Fatih Balli, Mansoor A. Sultan, Sarah K. Lami, J. Todd Hastings

Electrical and Computer Engineering Faculty Publications

Metalenses, ultra-thin optical elements that focus light using subwavelength structures, have been the subject of a number of recent investigations. Compared to their refractive counterparts, metalenses offer reduced size and weight, and new functionality such as polarization control. However, metalenses that correct chromatic aberration also suffer from markedly reduced focusing efficiency. Here we introduce a Hybrid Achromatic Metalens (HAML) that overcomes this trade-off and offers improved focusing efficiency over a broad wavelength range from 1000-1800 nm. HAMLs can be designed by combining recursive ray-tracing and simulated phase libraries rather than computationally intensive global search algorithms. Moreover, HAMLs can be fabricated …

Free Charge Carrier Properties In Two-Dimensional Materials And Monoclinic Oxides Studied By Optical Hall Effect, Sean Knight

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

In this dissertation, optical Hall effect (OHE) measurements are used to determine the free charge carrier properties of important two-dimensional materials and monoclinic oxides. Two-dimensional material systems have proven useful in high-frequency electronic devices due to their unique properties, such as high mobility, which arise from their two-dimensional nature. Monoclinic oxides exhibit many desirable characteristics, for example low-crystal symmetry which could lead to anisotropic carrier properties. Here, single-crystal monoclinic gallium oxide, an AlInN/GaN-based high-electron-mobility transistor (HEMT) structure, and epitaxial graphene are studied as examples. To characterize these material systems, the OHE measurement technique is employed. The OHE is a physical …

Statistical Photo-Calibration Of Photo-Detectors For Radiometry Without Calibrated Light Sources Comprising An Arithmetic Unit To Determine A Gain And A Bias From Mean Values And Variance Values, Adrian M. Catarius, Nicholas Yielding, Stephen C. Cain, Michael D. Seal

AFIT Patents

Calibration of a radiometry system uses a readout circuit of a photo-detector to provide first and second measurements collected over first and second integration times, respectively, where the first and second measurements are related to a photonic input to the photo-detector by a gain and a bias. First mean and variance values are computed for a plurality of first measurements. Second mean and variance values are computed for a plurality of second measurements. The gain and bias are determined from the first and second mean values and the first and second variance values without the use of a calibrated source. …

Integrated Photonic Device, Brittney Kuhn

Student Scholar Symposium Abstracts and Posters

In computer mediated communication networks, information is typically encoded optically to transmit signals over long distances. At a network node, the optical signal is transformed into the electrical domain, processed electronically, and transformed back to an optical state to reach its destination. Transitioning between optical and electrical encoding of the signal is a potential security weak point, especially for quantum communication links. If information can remain in one state as it travels through the network, then security breaches can be detected and dealt with more easily. Furthermore, keeping the information in one state can reduce power consumption in the network. …