Open Access. Powered by Scholars. Published by Universities.®

Digital Commons Network™

Open Access. Powered by Scholars. Published by Universities.®

Electrical and Computer Engineering

Institution
Keyword
Publication Year
Publication
Publication Type

Articles 1 - 30 of 127

Full-Text Articles in Entire DC Network

Reducing Complexity In Versatile Video Coding Intra-Coding Through Machine Learning-Based Optimization Of Partitioning And Prediction, Amina Kessentini, Amna Maraoui, Imen Werda, Fatma Ezahra Sayadi Mar 2026

Reducing Complexity In Versatile Video Coding Intra-Coding Through Machine Learning-Based Optimization Of Partitioning And Prediction, Amina Kessentini, Amna Maraoui, Imen Werda, Fatma Ezahra Sayadi

Turkish Journal of Electrical Engineering and Computer Sciences

The escalating demand for high-resolution multimedia content has necessitated more efficient video compression solutions. The Versatile Video Coding (VVC) standard, despite achieving remarkable compression gains, introduces significant computational complexity, primarily due to its exhaustive Rate-Distortion Optimization (RDO) process. To address this, we propose an intelligent approach leveraging supervised machine learning techniques to streamline the VVC encoding process. Specifically, we introduce a Lightweight Neural Network (LNN) for efficient coding unit partitioning decisions and a Decision Tree (DT) classifier for optimizing the intra prediction process. This dual-method framework, tailored for All Intra coding configuration, significantly reduces encoder complexity while maintaining compression performance …


Architecting A Complex Adaptive System Model For Selecting Policies To Reduce Kidney Discard, Lirim Ashiku Jan 2026

Architecting A Complex Adaptive System Model For Selecting Policies To Reduce Kidney Discard, Lirim Ashiku

Doctoral Dissertations

"The kidney allocation system is a complex, evolving system involving multiple heterogeneous agents. Each agent exhibits emergent behavior that may not fully align with the complex system goals. Therefore, there is a need for a transdisciplinary systems approach to visualize the interdependency among agents and understand the dominant patterns that shape the kidney allocation system.

First, this research presented an incremental hierarchical system engineering approach in identifying the agents’ needs and behaviors toward the complex systems’ goal of maximizing deceased donor kidney utilization and reducing kidney discard. The hierarchical systems approach linked with model-based system engineering aided in eliciting agents’ …


Reinforcement Learning In A Virtual World: A Study Of Ppo And Sac Within Unity Ml Agents, Rufat Mammadzada Nov 2025

Reinforcement Learning In A Virtual World: A Study Of Ppo And Sac Within Unity Ml Agents, Rufat Mammadzada

Chemical Technology, Control and Management

This study explores the use of Unity3D as a versatile platform for developing, training, and evaluating intelligent agents through reinforcement learning. Leveraging the Unity ML-Agents Toolkit, a dynamic 3D environment was created to examine agent learning behavior using two advanced algorithms: Proximal Policy Optimization (PPO) and Soft Actor-Critic (SAC). The simulation environment consisted of navigable terrain bounded by red borders, with collectible blue balls serving as rewards and a purple cube representing the agent. A carefully designed reward system was implemented to encourage goal-directed behavior and penalize inefficiency, while time constraints introduced an additional challenge requiring both precision and speed. …


Multimedia Forensics: Identification And Verification Of Source Camera, Vehicle Speed Estimation, And Deepfakes Detection, Jiajun Jiang Aug 2025

Multimedia Forensics: Identification And Verification Of Source Camera, Vehicle Speed Estimation, And Deepfakes Detection, Jiajun Jiang

Electrical & Computer Engineering Theses & Dissertations

This dissertation advances multimedia forensics by addressing three critical research areas that enhance the authenticity verification and analysis of digital media. Multimedia forensics, which encompasses techniques for examining images, videos, audio, and text, faces increasing challenges due to sophisticated editing tools and massive data volumes. In the first study, a fast source camera identification and verification method based on PRNU analysis is proposed for video forensic investigations. By integrating camera rolling and I-frame analysis, this approach achieves a processing speed improvement of at least 15 times over conventional frame-by-frame methods while reducing false positives. The second study focuses on vehicular …


Tellings Of The Pacific Ocean: A Landscape-Based Approach For Multispecies Design And Hci, Maliheh Ghajargar Jun 2025

Tellings Of The Pacific Ocean: A Landscape-Based Approach For Multispecies Design And Hci, Maliheh Ghajargar

Engineering Faculty Articles and Research

Environmental disturbances induced by climate change have caused significant changes in our ecosystems and are threatening the health of our environments. As a response to this issue, a growing body of work has emerged in HCI and design, which seeks to foreground more-than-human stories in support of making more sustainable and just futures. This research contributes to this broad agenda by probing graphic novels as a multispecies storytelling method for design and HCI. Combining ideas from Anna Tsing’s adventures of landscape and from HCI and design’s use of sequential art (e.g., storyboards), we use landscape as the main protagonist of …


Energy-Aware Sensor Fusion Architecture For Autonomous Channel Robot Navigation In Constrained Environments, Mohamed Shili, Hicham Chaoui, Khaled Nouri Jan 2025

Energy-Aware Sensor Fusion Architecture For Autonomous Channel Robot Navigation In Constrained Environments, Mohamed Shili, Hicham Chaoui, Khaled Nouri

Electrical & Computer Engineering Faculty Publications

Navigating autonomous robots in confined channels is inherently challenging due to limited space, dynamic obstacles, and energy constraints. Existing sensor fusion strategies often consume excessive power because all sensors remain active regardless of environmental conditions. This paper presents an energy-aware adaptive sensor fusion framework for channel robots that deploys RGB cameras, laser range finders, and IMU sensors according to environmental complexity. Sensor data are fused using an adaptive Extended Kalman Filter (EKF), which selectively integrates multi-sensor information to maintain high navigation accuracy while minimizing energy consumption. An energy management module dynamically adjusts sensor activation and computational load, enabling significant reductions …


Co-Emulation Of Robotics And Software-Defined Radio Based 5g Wireless Communications., Bhaskara Venkata Raju Garuda Dec 2024

Co-Emulation Of Robotics And Software-Defined Radio Based 5g Wireless Communications., Bhaskara Venkata Raju Garuda

Electronic Theses and Dissertations

The convergence of robotics and 5G wireless communication technologies has opened new avenues for real-time, dynamic robotic applications. This dissertation introduces a novel framework that integrates the Robot Operating System (ROS), Software-Defined Radios (SDRs), and 5G wireless networks to achieve seamless coemulation of robotic systems. The research emphasizes the unique features of 5G, such as ultra-low latency and high throughput, which enable critical applications like remote surgery, industrial automation, and autonomous vehicles. The methodology combines ROS for robotic control, SDRs for programmable communication channels, and 5G testbeds for high-speed, reliable data transmission. The experimental evaluation focuses on both position-based and …


Performance Evaluation And Integration Of Distortion Mitigation Methods For Fisheye Video Object Detection, John Benedict Du, Gian Paolo Mayuga, Maria Leonora Guico Sep 2024

Performance Evaluation And Integration Of Distortion Mitigation Methods For Fisheye Video Object Detection, John Benedict Du, Gian Paolo Mayuga, Maria Leonora Guico

Electronics, Computer, and Communications Engineering Faculty Publications

The distortion observed in fisheye cameras has proven to be a persistent challenge for numerous state-of-the-art object detection algorithms, instigating the development of various techniques aimed at mitigating this issue. This study aims to evaluate various methods for mitigating distortion in fisheye camera footage and their impact on video object detection accuracy and speed. Using Python, OpenCV, and third-party libraries, the researchers modified and optimized said methods for video input and created a framework for running and testing different distortion correction methods and object detection algorithm configurations. Through experimentation with different datasets, the study found that undistorting the image using …


Intelligent Millimeter-Wave System For Human Activity Monitoring For Telemedicine, Abdullah K. Alhazmi, Mubarak A. Alanazi, Awwad H. Alshehry, Saleh M. Alshahry, Jennifer Jaszek, Cameron Djukic, Anna Brown, Kurt Jackson, Vamsy P. Chodavarapu Jan 2024

Intelligent Millimeter-Wave System For Human Activity Monitoring For Telemedicine, Abdullah K. Alhazmi, Mubarak A. Alanazi, Awwad H. Alshehry, Saleh M. Alshahry, Jennifer Jaszek, Cameron Djukic, Anna Brown, Kurt Jackson, Vamsy P. Chodavarapu

Electrical and Computer Engineering Faculty Publications

Telemedicine has the potential to improve access and delivery of healthcare to diverse and aging populations. Recent advances in technology allow for remote monitoring of physiological measures such as heart rate, oxygen saturation, blood glucose, and blood pressure. However, the ability to accurately detect falls and monitor physical activity remotely without invading privacy or remembering to wear a costly device remains an ongoing concern. Our proposed system utilizes a millimeter-wave (mmwave) radar sensor (IWR6843ISK-ODS) connected to an NVIDIA Jetson Nano board for continuous monitoring of human activity. We developed a PointNet neural network for real-time human activity monitoring that can …


Small Object Detection Techniques In Remote Sensing Images Using Aam And Raspp, Farhan Iqbal Jan 2024

Small Object Detection Techniques In Remote Sensing Images Using Aam And Raspp, Farhan Iqbal

Chulalongkorn University Theses and Dissertations (Chula ETD)

Remote sensing technology has advanced substantially, with significant research focused on identifying and recognizing small, distant objects within large-scale scenes. Despite these strides, the task remains difficult due to limitations in image resolution, varied object scales, dense object distribution, and diverse orientations. Current object detection methods often struggle to maintain the fine detail essential for small object detection, resulting in the loss of critical information. To address this, we introduce an Advanced Attention Mechanism (AAM) that combines a novel Combined Channel and Spatial Attention (CCSA) approach with Residual Atrous Spatial Pyramid Pooling (RASSP). This integration enhances detection accuracy by preserving …


Focal Modulation Network For Lung Segmentation In Chest X-Ray Images, Şaban Öztürk, Tolga Çukur Oct 2023

Focal Modulation Network For Lung Segmentation In Chest X-Ray Images, Şaban Öztürk, Tolga Çukur

Turkish Journal of Electrical Engineering and Computer Sciences

Segmentation of lung regions is of key importance for the automatic analysis of Chest X-Ray (CXR) images, which have a vital role in the detection of various pulmonary diseases. Precise identification of lung regions is the basic prerequisite for disease diagnosis and treatment planning. However, achieving precise lung segmentation poses significant challenges due to factors such as variations in anatomical shape and size, the presence of strong edges at the rib cage and clavicle, and overlapping anatomical structures resulting from diverse diseases. Although commonly considered as the de-facto standard in medical image segmentation, the convolutional UNet architecture and its variants …


Dynamic Deep Neural Network Inference Via Adaptive Channel Skipping, Meixia Zou, Xiuwen Li, Jinzheng Fang, Hong Wen, Weiwei Fang Sep 2023

Dynamic Deep Neural Network Inference Via Adaptive Channel Skipping, Meixia Zou, Xiuwen Li, Jinzheng Fang, Hong Wen, Weiwei Fang

Turkish Journal of Electrical Engineering and Computer Sciences

Deep neural networks have recently made remarkable achievements in computer vision applications. However, the high computational requirements needed to achieve accurate inference results can be a significant barrier to deploying DNNs on resource-constrained computing devices, such as those found in the Internet-of-things. In this work, we propose a fresh approach called adaptive channel skipping (ACS) that prioritizes the identification of the most suitable channels for skipping and implements an efficient skipping mechanism during inference. We begin with the development of a new gating network model, ACS-GN, which employs fine-grained channel-wise skipping to enable input-dependent inference and achieve a desirable balance …


Pymaivar: An Open-Source Python Suit For Audio-Image Representation In Human Action Recognition, Muhammad B. Shaikh, Douglas Chai, Syed M. S. Islam, Naveed Akhtar Sep 2023

Pymaivar: An Open-Source Python Suit For Audio-Image Representation In Human Action Recognition, Muhammad B. Shaikh, Douglas Chai, Syed M. S. Islam, Naveed Akhtar

Research outputs 2022 to 2026

We present PyMAiVAR, a versatile toolbox that encompasses the generation of image representations for audio data including Wave plots, Spectral Centroids, Spectral Roll Offs, Mel Frequency Cepstral Coefficients (MFCC), MFCC Feature Scaling, and Chromagrams. This wide-ranging toolkit generates rich audio-image representations, playing a pivotal role in reshaping human action recognition. By fully exploiting audio data's latent potential, PyMAiVAR stands as a significant advancement in the field. The package is implemented in Python and can be used across different operating systems.


Inter-Frame Video Compression Based On Adaptive Fuzzy Inference System Compression Of Multiple Frame Characteristics, Arief Bramanto Wicaksono Putra, Rheo Malani, Bedi Suprapty, Achmad Fanany Onnilita Gaffar, Roman Voliansky Jul 2023

Inter-Frame Video Compression Based On Adaptive Fuzzy Inference System Compression Of Multiple Frame Characteristics, Arief Bramanto Wicaksono Putra, Rheo Malani, Bedi Suprapty, Achmad Fanany Onnilita Gaffar, Roman Voliansky

Knowledge Engineering and Data Science

Video compression is used for storage or bandwidth efficiency in clip video information. Video compression involves encoders and decoders. Video compression uses intra-frame, inter-frame, and block-based methods. Video compression compresses nearby frame pairs into one compressed frame using inter-frame compression. This study defines odd and even neighboring frame pairings. Motion estimation, compensation, and frame difference underpin video compression methods. In this study, adaptive FIS (Fuzzy Inference System) compresses and decompresses each odd-even frame pair. First, adaptive FIS trained on all feature pairings of each odd-even frame pair. Video compression-decompression uses the taught adaptive FIS as a codec. The features utilized …


An Adaptive Image Restoration Algorithm Based On Hybrid Total Variation Regularization, Cong Thang Pham, Thi Thu Thao Tran, Hung Vi Dang, Hoai Phuong Dang Jan 2023

An Adaptive Image Restoration Algorithm Based On Hybrid Total Variation Regularization, Cong Thang Pham, Thi Thu Thao Tran, Hung Vi Dang, Hoai Phuong Dang

Turkish Journal of Electrical Engineering and Computer Sciences

In imaging systems, the mixed Poisson-Gaussian noise (MPGN) model can accurately describe the noise present. Total variation (TV) regularization-based methods have been widely utilized for Poisson-Gaussian removal with edge-preserving. However, TV regularization sometimes causes staircase artifacts with piecewise constants. To overcome this issue, we propose a new model in which the regularization term is represented by a combination of total variation and high-order total variation. We study the existence and uniqueness of the minimizer for the considered model. Numerically, the minimization problem can be efficiently solved by the alternating minimization method. Furthermore, we give rigorous convergence analyses of our algorithm. …


Utilizing Motion And Spatial Features For Sign Language Gesture Recognition Using Cascaded Cnn And Lstm Models, Hamzah Luqman, Elsayed Elalfy Nov 2022

Utilizing Motion And Spatial Features For Sign Language Gesture Recognition Using Cascaded Cnn And Lstm Models, Hamzah Luqman, Elsayed Elalfy

Turkish Journal of Electrical Engineering and Computer Sciences

Sign language is a language produced by body parts gestures and facial expressions. The aim of an automatic sign language recognition system is to assign meaning to each sign gesture. Recently, several computer vision systems have been proposed for sign language recognition using a variety of recognition techniques, sign languages, and gesture modalities. However, one of the challenging problems involves image preprocessing, segmentation, extraction and tracking of relevant static and dynamic features related to manual and nonmanual gestures from different images in sequence. In this paper, we studied the efficiency, scalability, and computation time of three cascaded architectures of convolutional …


Segmentation Of Diatoms Using Edge Detection And Deep Learning, Hüseyi̇n Gündüz, Cüneyd Nadi̇r Solak, Serkan Günal Sep 2022

Segmentation Of Diatoms Using Edge Detection And Deep Learning, Hüseyi̇n Gündüz, Cüneyd Nadi̇r Solak, Serkan Günal

Turkish Journal of Electrical Engineering and Computer Sciences

Diatoms are photosynthesizing algae found in almost every aquatic environment. Detecting the number and diversity of diatoms is very important to analyze water quality appropriately. Accurate segmentation of diatoms is therefore crucial for this detection process. In this study, a new and effective model for the automatic segmentation of diatoms based on image processing and deep learning algorithms is proposed. In the proposed model, edge segments of a given image containing diatoms and nondiatom particles are first obtained. These edge segments are then combined, resulting in closed contours representing diatom candidates. In the final step, the diatom candidates are classified …


Analyzing The Influence Of Smart-Device Visual Features, Viewing Distance And Content Factors On Video Streaming Qoe, Alex Frank Mongi Jun 2022

Analyzing The Influence Of Smart-Device Visual Features, Viewing Distance And Content Factors On Video Streaming Qoe, Alex Frank Mongi

Tanzania Journal of Engineering and Technology (TJET)

Quality of experience (QoE) over wireless networks has attracted attention from industry and academia due to an increase in video streaming applications. Several researchers have attempted to understand the factors affecting QoE and design appropriate quality control strategies. Normally, video streaming is initiated by a user who accesses video content over a network using a smart device that may be held at various viewing distances. Each aforementioned factor has the potential to affect QoE. However, several studies explore the behavior of wireless networks on video streaming QoE. To understand the effects of other factors on QoE, this paper investigates the …


A New Effective Denoising Filter For High Density Impulse Noise Reduction, Iman Elawady, Caner Özcan May 2022

A New Effective Denoising Filter For High Density Impulse Noise Reduction, Iman Elawady, Caner Özcan

Turkish Journal of Electrical Engineering and Computer Sciences

Today, thanks to the rapid development of technology, the importance of digital images is increasing. However, sensor errors that may occur during the acquisition, interruptions in the transmission of images and errors in storage cause noise that degrades data quality. Salt and pepper noise, a common impulse noise, is one of the most well-known types of noise in digital images. This noise negatively affects the detailed analysis of the image. It is very important that pixels affected by noise are restored without loss of image fine details, especially at high level of noise density. Although many filtering algorithms have been …


Two Person Interaction Recognition Based On A Dual-Coded Modified Metacognitive (Dcmmc) Extreme Learning Machine, Saman Nikzad, Afshin Ebrahimi May 2022

Two Person Interaction Recognition Based On A Dual-Coded Modified Metacognitive (Dcmmc) Extreme Learning Machine, Saman Nikzad, Afshin Ebrahimi

Turkish Journal of Electrical Engineering and Computer Sciences

Human action recognition has been an active research area for over three decades. However, state-of-the-art proposed algorithms are still far from developing error-free and fully-generalized systems to perform accurate interaction recognition. This work proposes a new method for two-person interaction recognition from videos, based on well-known cognitive theories. The main idea is to perform classification based on a theory of cognition known as dual coding theory. The theory states that human brain processes and represents two types of information to learn/classify data named analogue and symbolic codes, i.e. (verbal as analogue and visual as symbolic). To implement such a theory …


Augmented Communications : A Solution For Overcoming High Spatial Correlation Of The Massive-Miso Vlc Channel, Monette Khadr Dec 2021

Augmented Communications : A Solution For Overcoming High Spatial Correlation Of The Massive-Miso Vlc Channel, Monette Khadr

Legacy Theses & Dissertations (2009 - 2024)

A key challenge for future wireless networks is to come upon a riveting compromise between spectral efficiency, complexity, and energy efficiency. The challenge is also intensified due to the pace at which the Internet-of-Things (IoT) technology is arriving, causing an upheaval to pre-existing network infrastructures in terms of elevating spectrum scarcity. To keep pace with the exploding data demand forecasts, a circumvention is required. One realization is by utilizing the high-band spectrum and the rich body of knowledge on multiple-input multiple-output (MIMO) technologies. One of the prominent high frequency technologies is visible light communications (VLC). VLC provide a large unregulated …


Issue 17: Contributors, Don Flournoy Oct 2021

Issue 17: Contributors, Don Flournoy

Online Journal of Space Communication

List of Issue 17 Contributors


Usdla: An Instructional Media Selection Guide For Distance Learning, Jolly T. Holden, Philip Westfall Sep 2021

Usdla: An Instructional Media Selection Guide For Distance Learning, Jolly T. Holden, Philip Westfall

Online Journal of Space Communication

Purpose and Use of the Media Selection Guide


Increasingly, educators and trainers are challenged within their respective
organizations to provide for the efficient distribution of instructional con-
tent using instructional media. The appropriate selection of instructional
media to support distance learning is not intuitive and does not occur as a
matter of personal preference. On the contrary, instructional media selec-
tion is a systematic sequence of qualitative processes based on sound in-
structional design principles. Although media selection is often mentioned
when studying the discipline of instructional technology or Instructional
Systems Design (ISD), it is sometimes overlooked when applying the …


Model Curricula: Ohio University Apr 2021

Model Curricula: Ohio University

Online Journal of Space Communication

Programs of Education Relating to Satellite and Space Communication in:

Telecommunication Communications Systems Management

Electrical Engineering and Computer Science


Bibliometric Survey On Multipurpose Face Recognition System Using Deep Learning, Priyanka Tupe-Waghmare, Rahul Raghvendra Joshi Prof. Feb 2021

Bibliometric Survey On Multipurpose Face Recognition System Using Deep Learning, Priyanka Tupe-Waghmare, Rahul Raghvendra Joshi Prof.

Library Philosophy and Practice (e-journal)

Face recognition is a new concept coming up lately and flourishing in the field of network access and multimedia information systems. Since humans are at the focus of attention in variety of applications containing videos, the concept of face recognition is rising in popularity. Several areas involving network security, retrieval and indexing of the content, and compression of videos gain a lot of benefit from the face recognition systems and related technology. Controlling the access of the networks with the help of facial recognition not only makes it difficult for the hackers to steal the information but also makes the …


A Novel Hybrid Decision-Based Filter And Universal Edge-Based Logical Smoothingadd-On To Remove Impulsive Noise, Rajanbir Singh Ghumaan, Prateek Jeet Singh Sohi, Nikhil Sharma, Bharat Garg Jan 2021

A Novel Hybrid Decision-Based Filter And Universal Edge-Based Logical Smoothingadd-On To Remove Impulsive Noise, Rajanbir Singh Ghumaan, Prateek Jeet Singh Sohi, Nikhil Sharma, Bharat Garg

Turkish Journal of Electrical Engineering and Computer Sciences

This paper presents a novel hybrid filter along with a universal extension to remove salt and pepper noise even at a very high noise density. The proposed filter initially specifies a threshold and then denoises the image using a combination of linear, nonlinear, and probabilistic techniques. Furthermore, to improve the quality, a universal add-on is presented which uses edge detection and smoothening techniques to brush out fine details from the restored image. To evaluate the efficacy, the proposed and existing filtering techniques are implemented in MATLAB and simulated with benchmark images. The simulation results show that the proposed filter is …


Efficient Hybrid Passive Method For The Detection And Localization Of Copy-Moveand Spliced Images, Navneet Kaur, Neeru Jindal, Kulbir Singh Jan 2021

Efficient Hybrid Passive Method For The Detection And Localization Of Copy-Moveand Spliced Images, Navneet Kaur, Neeru Jindal, Kulbir Singh

Turkish Journal of Electrical Engineering and Computer Sciences

Digital passive image forgery methods are extensively used to verify the authenticity and integrity of images.Splicing and copy-move are the most common types of passive digital image forgeries. Several approaches have beenproposed to detect these forgeries separately, but very few approaches are available that can detect them simultaneously.However, a more e?icient method is still in demand to meet the day-to-day challenges to detect these forgeries at thesame time. So, a passive hybrid approach based on discrete fractional cosine transform (DFrCT) and local binarypattern (LBP) is proposed to detect copy-move and splicing forgeries simultaneously. The extra parameter i.e. fractionalparameter of DFrCT …


An Evolutionary-Based Image Classification Approach Through Facial Attributes, Seli̇m Yilmaz, Cemi̇l Zalluhoğlu Jan 2021

An Evolutionary-Based Image Classification Approach Through Facial Attributes, Seli̇m Yilmaz, Cemi̇l Zalluhoğlu

Turkish Journal of Electrical Engineering and Computer Sciences

With the recent developments in technology, there has been a significant increase in the studies on analysisof human faces. Through automatic analysis of faces, it is possible to know the gender, emotional state, and even theidentity of people from an image. Of them, identity or face recognition has became the most important task whichhas been studied for a long time now as it is crucial to take measurements for public security, credit card verification,criminal identification, and the like. In this study, we have proposed an evolutionary-based framework that relies ongenetic programming algorithm to evolve a binary- and multilabel image classifier …


Learning Multiview Deep Features From Skeletal Sign Language Videos Forrecognition, Ashraf Ali Shaik, Venkata Durga Prasad Mareedu, Venkata Vijaya Kishore Polurie Jan 2021

Learning Multiview Deep Features From Skeletal Sign Language Videos Forrecognition, Ashraf Ali Shaik, Venkata Durga Prasad Mareedu, Venkata Vijaya Kishore Polurie

Turkish Journal of Electrical Engineering and Computer Sciences

The most challenging objective in machine translation of sign language has been the machine?s inability tolearn interoccluding finger movements during an action process. This work addresses the problem of teaching a deeplearning model to recognize differently oriented skeletal data. The multi-view 2D skeletal sign language video data isobtained using 3D motion-captured system. A total of 9 signer views were used for training the proposed network andthe 6 for testing and validation. In order to obtain multi-view deep features for recognition, we proposed an end-to-endtrainable multistream convolutional neural network (CNN) with late feature fusion. The fused multiview features arethen inputted to …


Turkish Sign Language Recognition Based On Multistream Data Fusion, Cemi̇l Gündüz, Hüseyi̇n Polat Jan 2021

Turkish Sign Language Recognition Based On Multistream Data Fusion, Cemi̇l Gündüz, Hüseyi̇n Polat

Turkish Journal of Electrical Engineering and Computer Sciences

Sign languages are nonverbal, visual languages that hearing- or speech-impaired people use for communication.Aside from hands, other communication channels such as body posture and facial expressions are also valuable insign languages. As a result of the fact that the gestures in sign languages vary across countries, the significance ofcommunication channels in each sign language also differs. In this study, representing the communication channels usedin Turkish sign language, a total of 8 different data streams-4 RGB, 3 pose, 1 optical flow-were analyzed. Inception3D was used for RGB and optical flow; and LSTM-RNN was used for pose data streams. Experiments were conductedby …