Computer Engineering Commons^™

Synthetically Expressive: Evaluating Gesture And Voice For Emotion And Empathy In Vr And 2d Scenarios, Haoyang Du, Kiran Chhatre, Christopher Peters, Brian Keegan, Rachel Mcdonnell, Cathy Ennis

Conference papers

The creation of virtual humans increasingly leverages automated synthesis of speech and gestures, enabling expressive, adaptable agents that effectively engage users. However, the independent development of voice and gesture generation technologies, alongside the growing popularity of virtual reality (VR), presents significant questions about the integration of these signals and their ability to convey emotional detail in immersive environments. In this paper, we evaluate the influence of real and synthetic gestures and speech, alongside varying levels of immersion (VR vs. 2D displays) and emotional contexts (positive, neutral, negative) on user perceptions. We investigate how immersion affects the perceived match between gestures …

Face Off: Evaluating Virtual Human Expressions And Non-Tracking Control Methods In Vr, J K Sangeeth Chandran, Marisa Llorens Salvador, Cathy Ennis

Conference papers

Social virtual reality (VR) applications have become more ubiquitous in recent years; central to this is the communication pipeline, how users perceive virtual human facial expressions, and how they control them in real time, especially when using VR devices without face-tracking. We investigated both aspects in a set of experiments. Firstly, we compared the perception of virtual human emotions on a traditional 2D screen and in VR. In a second experiment, we used a validated set of stimuli to compare three different control methods for manipulating an avatar’s facial expressions in VR. These control methods utilize non-tracking control techniques, which …

Explaining Time Series Classifiers Through Post-Hoc Xai Methods Capturing Temporal Dependencies, Ephrem Tibebe Mekonnen

Conference papers

Time series classification is essential in domains such as healthcare and finance, where accurate predictions can have significant real-world consequences. However, in many high-stakes applications, understanding why a model makes a certain decision is just as important as the prediction itself. While deep learning models excel at capturing complex temporal patterns, their black-box nature limits transparency, making it difficult to trust and interpret their decisions. Although eXplainable AI (XAI) methods have advanced considerably for image and tabular data, applying them to time series remains challenging due to the intricate temporal dependencies and high dimensionality of the data. Post-hoc model-agnostic XAI …

Genwriter: Reducing Gender Cues In Biographies Through Text Rewriting, Shweta Soundararajan, Sarah Jane Delany

Conference papers

Gendered language is the use of words that indicate an individual’s gender. Though useful in certain context, it can reinforce gender stereotypes and introduce bias, particularly in machine learning models used for tasks like occupation classification. When textual content such as biographies contains gender cues, it can influence model predictions, leading to unfair outcomes such as reduced hiring opportunities for women. To address this issue, we propose GenWriter, an approach that integrates Case-Based Reasoning (CBR) with Large Language Models (LLMs) to rewrite biographies in a way that obfuscates gender while preserving semantic content. We evaluate GenWriter by measuring gender bias …

Power Saving In Open Ran By Using Advanced Cpu Scheduling Algorithm, Saish Urumkar, Sachin Sharma

Conference papers

Open RAN is an emerging wireless technology that is gaining significant attention for its potential to enable flexi- ble, cost-efficient, and interoperable networks. Reducing power utilization in Open RAN, particularly for 5G base stations (gNodeBs) deployed in remote areas, remains a critical challenge due to limited power availability. In our previous work, we developed a CPU scheduling algorithm that optimized core allocation based on load conditions, reducing power utilization for gNodeB in a virtualized Open RAN environment. Extending our previous work, this paper introduces an advanced CPU scheduling for Open RAN designed to reduce power utilization in real hardware Open …

Demonstrating The Impact Of Cpu Scheduling On Power Consumption In Virtualized Open Ran, Saish Urumkar, Sachin Sharma

Conference papers

Open RAN (Open Radio Access Network) is a next- generation wireless network gaining significant research interest globally due to its potential to provide a cost-efficient and scalable solution for growing network demands. Energy efficiency is an important area of focus in Open RAN deployments, as reducing power consumption while maintaining network performance is essential for sustainable wireless communication. This paper demonstrates the impact of CPU (Central Processing Unit) scheduling process priorities on power consumption and network performance in an Open RAN NodeB deployed on a testbed in the USA. The experimental results are demonstrated using two scenarios: (1) CPU Priority-Based …

Multi-Objective Deep Reinforcement Learning For Dynamic Algorithm Selection In Open Ran, Saish Urumkar, Byrav Ramamurthy, Sachin Sharma

Conference papers

Open Radio Access Networks (Open RAN) provide flexible, modular multi-vendor interoperability. Growing mobile data demand requires balancing network performance with power efficiency. Mobile operators need intelligent resource management to achieve Key Performance Indicator (KPI) targets while maintaining operational efficiency. This paper proposes a solution using a multi-objective deep reinforcement learning (MODRL) model deployed on the Open RAN Intelligent Controller (RIC). Three customizable operator profiles (Power Saving, Balanced, and Performance) are used which define specific priority ratios between performance and power saving objectives.

To evaluate, individual algorithms (CPU scheduling and UE connection state switching) are implemented in Open RAN, achieving 5–20%CPU …

The Digital Loophole: Evaluating The Effectiveness Of Child Age Verification Methods On Social Media, Fatmaelzahraa Eltaher, Rahul Gajula, Luis Miralles-Pechuán, Christina Thorpe, Susan Mckeever

Conference papers

Social media platforms are an integral part of daily life for nearly five billion people worldwide. However, the growing presence of underage users on these platforms raises significant concerns regarding children's exposure to harmful content and its impact on their mental health. This paper examines the effectiveness of age verification measures implemented on leading platforms Facebook, YouTube, Instagram, TikTok, Snapchat, and X. We evaluate the age verification processes required for account creation by simulating the registration steps for minors on these platforms. We also compare these methods to best practices in online age assurance in finance, betting and public transportation …

An Evaluation Of Features Extracted From Facial Images In The Context Of Accurate Age Estimation⋆, Malik Awais Khan, Aurelia Power, Peter Corcoran, Christina Thorpe

Conference papers

Age estimation by face image recognition can be used in numerous ways with regression models to manage access control, improve security, and guarantee the protection of children online. The approaches used for predicting age—including data selection, cleaning techniques, feature extraction, algorithm choice, and hyperparameter tuning—often struggles with generalization. Furthermore, a lot of methods neglect to specifically address how extracted face features might be used for prediction. To address the lack of racial diversity we acquired a dataset consisting of different races from literature. We also examined the ability of local, global and hybrid facial features to predict ages. Two variants …

Interpreting Black-Box Time Series Classifiers Using Parameterised Event Primitives, Ephrem Tibebe Mekonnen, Luca Longo, Pierpaolo Dondio

Conference papers

Amidst the remarkable performance of deep learning models in time series classification, there is a pressing demand for methods that unveil their prediction rationale. Existing feature importance techniques often neglect the temporal nature of time series data, focusing solely on segment importance. Addressing this gap, this paper introduces a local model-agnostic method akin to LIME, which generates neighbouring samples by randomly perturbing segments of the original instance. Subsequently, weights are computed for each neighbouring instance based on its distance from the original, elucidating its influence. Parameterised event primitives (PEPs) are then extracted from these perturbed samples, encompassing increasing and decreasing …

Design Considerations For Self-Management Technologies For People Living With Dementia And Informal Carers - Perspectives Of Healthcare Professionals And Charity Workers, Dympna O'Sullivan, Julie Doyle, Orla Moran, Michael Wilson, Siobhan Oneill, Jonathan Turner, Suzanne Smith

Conference papers

Dementia is a neurodegenerative disorder that leads to decline in memory, language, reasoning, and the ability to perform daily activities. It is linked to poorer quality of life for the person with dementia and their informal (unpaid) carers. While early intervention and access to adequate care are critical in slowing dementia's progression and better managing associated symptoms, dementia is frequently only diagnosed at an advanced stage and care is often fragmented. To better understand how to meet the complex needs of persons living with dementia and their informal carers, 10 healthcare professionals and 10 charity workers from relevant community and …

Design Considerations For Self-Management Technologies For People Living With Dementia And Informal Carers – Perspectives Of Healthcare Professionals And Charity Workers, Dympna O'Sullivan

Conference papers

Dementia is a neurodegenerative disorder that leads to decline in memory, language, reasoning, and the ability to perform daily activities. It is linked to poorer quality of life for the person with dementia and their informal (unpaid) carers. While early intervention and access to adequate care are critical in slowing dementia's progression and better managing associated symptoms, dementia is frequently only diagnosed at an advanced stage and care is often fragmented. To better understand how to meet the complex needs of persons living with dementia and their informal carers, 10 healthcare professionals and 10 charity workers from relevant community and …

Poster: Optimising Electric Vehicle Charging Infrastructure In Dublin Using Geecharge, Alexander Mutiso Mutua, Ruairí De Fréin, Ali Malik, Kibanza Eliel, Sahbane Marco, Pantel Maxime

Conference papers

Range anxiety is a significant challenge affecting electric vehicles use as drivers fear running out of charge without finding a charging point on time. We develop methods to optimise the distribution of charging points. EV portacharge and GEECharge solutions distribute charging points in a city by considering the population density and Points Of Interest (POI) or road traffic. This paper focuses on (1) developing and evaluating methods to distribute Charging Points (CPs) in Dublin city; (2) optimising CP allocation; (3) visualising paths in the graph network to show the most used roads and points of interest; (4) describing a way …

Round Trip Time Measurement Over Microgrid Power Network, Yasin Emir Kutlu, Ruairí De Fréin, Malabika Basu, Ali Malik

Conference papers

A focus of the Power Systems and Networking communities is the design and deployment of Microgrid (MG) integration systems that ensure that quality of service targets are met for load sharing systems at different endpoints. This paper presents an integrated Microgrid testbed that allows Microgrids endpoints to share their current, voltage and power values using a Network Published Shared Variable (NPSV) approach. We present Round Trip Time (RTT) measurements for time sensitive Microgrid control traffic in the presence of varying background traffic as an example quality of service measurement. Numerical results are presented using a range of different background traffic …

Author Gender Identification Considering Gender Bias, Manuela N. Jeyaraj, Sarah Jane Delany

Conference papers

Writing style and choice of words used in textual content can vary between men and women both in terms of who the text is talking about and who is writing the text. The focus of this paper is on author gender prediction, identifying the gender of who is writing the text. We compare closed and open vocabulary approaches on different types of textual content including more traditional writing styles such as in books, and more recent writing styles used in user generated content on digital platforms such as blogs and social media messaging. As supervised machine learning approaches can reflect …

Understanding And Quantifying Human Factors In Programming From Demonstration: A User Study Proposal, Shakra Mehak, Aayush Jain, John D. Kelleher, Philip Long, Michael Guilfoyle, Maria Chiara Leva

Conference papers

Programming by demonstration (PbD) is a promising method for robots to learn from direct, non-expert human interaction. This approach enables the interactive transfer of human skills to the robot. As the non-expert user is at the center of PbD, the efficacy of the learned skill is largely dependent on the demonstrations provided. Although PbD methods have been extensively developed and validated in the field of robotics, there has been inadequate confirmation of their effectiveness from the perspective of human teachability. To address this gap, we propose to experimentally investigate the impact of communicating robot learning process on the efficacy of …

Exploring The Impact Of Competition And Incentives On Game Jam Participation And Behaviour, John Healy, Niamh Germaine

Conference papers

Competitive elements are a common feature of many game jams. However, there has been little research to date on the impact of competition on participants and their behaviours. To better understand how incentives and competition may affect the motivations and behaviour of game jam participants, we surveyed 47 game jam participants and analysed data from 4,564 online game jams. We found that incentives and competition were neither strong deterrents nor significant motivators for game jam participation. However, a significant percentage of the participants surveyed indicated that incentives and competition would affect their behaviour during a game jam. Our findings suggest …

Medical Concept Mention Identification In Social Media Posts Using A Small Number Of Sample References, Vasudevan Nedumpozhimana, Sneha Rautmare, Meegan Gower, Maja Popovic, Nishtha Jain, Patricia Buffini, John Kelleher

Conference papers

Identification of mentions of medical concepts in social media text can provide useful information for caseload prediction of diseases like Covid-19 and Measles. We propose a simple model for the automatic identification of the medical concept mentions in the social media text. We validate the effectiveness of the proposed model on Twitter, Reddit, and News/Media datasets.

Does Self-View Mode Generate Video Conferencing Fatigue? An Experiment Using Eeg Signals, Jin Xu, Eoin Whelan, Ann O'Brien, Denis O’Hora

Conference papers

The ability to see or hide one’s own image is a typical feature of video conferencing platforms. This study will conduct an EEG-based neurobiological experiment to determine if the self-view mode generates video conference fatigue and if this differs between males and females. 40 volunteers will participate in a simulated video conference meeting with the self-view mode on and off at different times. In addition, an EEG-based fatigue monitor will be proposed to demonstrate the level of human mental fatigue. The experimental insights will provide direct biological evidence of the impact of video conferencing features on the user experience and …

Energy-Aware Ai-Driven Framework For Edge-Computing-Based Iot Applications, Muhammad Zawish, Nouman Ashraf, Rafay Iqbal Ansari, Steven Davy

Conference papers

The significant growth in the number of Internet of Things (IoT) devices has given impetus to the idea of edge computing for several applications. In addition, energy harvestable or wireless-powered wearable devices are envisioned to empower the edge intelligence in IoT applications. However, the intermittent energy supply and network connectivity of such devices in scenarios including remote areas and hard-to-reach regions such as in-body applications can limit the performance of edge computing-based IoT applications. Hence, deploying state-of-the-art convolutional neural networks (CNNs) on such energy-constrained devices is not feasible due to their computational cost. Existing model compression methods, such as network …

Optimising Electric Vehicle Charging Infrastructure In Dublin Using Geecharge, Alexander Mutua Mutiso, Ruairí De Fréin, Ali Malik, Eliel Kibanza, Marco Sahbane, Maxime Pantel

Conference papers

Range anxiety poses a hurdle to the adoption of Electric Vehicles (EVs), as drivers worry about running out of charge without timely access to a Charging Point (CP). We present novel methods for optimising the distribution of CPs, namely, EV portacharge and GEECharge. These solutions distribute CPs in Dublin, in this paper, by considering the population density and Points Of Interest (POIs) or road traffic. The object of this paper is to (1) develop and evaluate methods to distribute CPs in Dublin city; (2) optimise CP allocation; (3) visualise paths in the graph network to show the most used roads …

Impact Of Character N-Grams Attention Scores For English And Russian News Articles Authorship Attribution, Liliya Mukhmutova, Robert J. Ross, Giancarlo Salton

Conference papers

Language embeddings are often used as black-box word-level tools that provide powerful language analysis across many tasks, but yet for many tasks such as Authorship Attribution access to feature level information on character n-grams can provide insights to help with model refinement and development. In this paper we investigate and evaluate the importance of character n-grams within an embeddings context in authorship attribution through the use of attention scores. We perform this investigation both for English (Reuters_50_50) and Russian (Taiga) news authorship datasets. Our analysis show that character n-grams attention score is higher for n-grams that are considered to be …

Using Machine Learning To Identify Patterns In Learner-Submitted Code For The Purpose Of Assessment, Botond Tarcsay, Fernando Perez-Tellez, Jelena Vasic

Conference papers

Programming has become an important skill in today’s world and is taught widely both in traditional and online settings. Instructors need to grade increasing amounts of student work. Unit testing can contribute to the automation of the grading process but it cannot assess the structure or partial correctness of code, which is needed for finely differentiated grading. This paper builds on previous research that investigated machine learning models for determining the correctness of programs from token-based features of source code and found that some such models can be successful in classifying source code with respect to whether it passes unit …

Analysis Of Attention Mechanisms In Box-Embedding Systems, Jeffrey Sardina Jeffrey Sardina, Callie Sardina, John Kelleher, Declan O’Sullivan

Conference papers

Large-scale Knowledge Graphs (KGs) have recently gained considerable research attention for their ability to model the inter- and intra- relationships of data. However, the huge scale of KGs has necessitated the use of querying methods to facilitate human use. Question Answering (QA) systems have shown much promise in breaking down this human-machine barrier. A recent QA model that achieved state-of-the-art performance, Query2box, modelled queries on a KG using box embeddings with an attention mechanism backend to compute the intersections of boxes for query resolution. In this paper, we introduce a new model, Query2Geom, which replaces the Query2box attention mechanism with …

Action Classification In Human Robot Interaction Cells In Manufacturing, Shakra S.M. Mehak, Maria Chiara Leva, John Kelleher, Michael Guilfoyle

Conference papers

Action recognition has become a prerequisite approach to fluent Human-Robot Interaction (HRI) due to a high degree of movement flexibility. With the improvements in machine learning algorithms, robots are gradually transitioning into more human-populated areas. However, HRI systems demand the need for robots to possess enough cognition. The action recognition algorithms require massive training datasets, structural information of objects in the environment, and less expensive models in terms of computational complexity. In addition, many such algorithms are trained on datasets derived from daily activities. The algorithms trained on non-industrial datasets may have an unfavorable impact on implementing models and validating …

Detecting Road Intersections From Satellite Images Using Convolutional Neural Networks, Fatmaelzahraa Eltaher, Luis Miralles-Pechuán, Jane Courtney, Susan Mckeever

Conference papers

Automatic detection of road intersections is an important task in various domains such as navigation, route planning, traffic prediction, and road network extraction. Road intersections range from simple three-way T-junctions to complex large-scale junctions with many branches. The location of intersections is an important consideration for vulnerable road users such as People with Blindness or Visually Impairment (PBVI) or children. Route planning applications, however, do not give information about the location of intersections as this information is not available at scale. As a first step to solving this problem, a mechanism for automatically mapping road intersection locations is required, ideally …

Dynamic Influence Diagram-Based Deep Reinforcement Learning Framework And Application For Decision Support For Operators In Control Rooms, Joseph Mietkiewicz, Ammar N. Abbas, Chidera Winifred Amazu, Anders L. Madsen, Gabriele Baldissone

Conference papers

In today’s complex industrial environment, operators are often faced with challenging situations that require quick and accurate decision-making. The human-machine interface (HMI) can display too much information, leading to information overload and potentially compromising the operator’s ability to respond effectively. To address this challenge, decision support models are needed to assist operators in identifying and responding to potential safety incidents. In this paper, we present an experiment to evaluate the effectiveness of a recommendation system in addressing the challenge of information overload. The case study focuses on a formaldehyde production simulator and examines the performance of an improved Human-Machine Interface …

Interpretable Input-Output Hidden Markov Model-Based Deep Reinforcement Learning For The Predictive Maintenance Of Turbofan Engines, Ammar N. Abbas, Georgios C. Chasparis, John Kelleher

Conference papers

An open research question in deep reinforcement learning is how to focus the policy learning of key decisions within a sparse domain. This paper emphasizes on combining the advantages of input-output hidden Markov models and reinforcement learning. We propose a novel hierarchical modeling methodology that, at a high level, detects and interprets the root cause of a failure as well as the health degradation of the turbofan engine, while at a low level, provides the optimal replacement policy. This approach outperforms baseline deep reinforcement learning (DRL) models and has performance comparable to that of a state-of-the-art reinforcement learning system while …

Show, Prefer And Tell: Incorporating User Preferences Into Image Captioning, Annika Lindh, Robert J. Ross, John Kelleher

Conference papers

Image Captioning (IC) is the task of generating natural language descriptions for images. Models encode the image using a convolutional neural network (CNN) and generate the caption via a recurrent model or a multi-modal transformer. Success is measured by the similarity between generated captions and human-written “ground-truth” captions, using the CIDEr [14], SPICE [1] and METEOR [2] metrics. While incremental gains have been made on these metrics, there is a lack of focus on end-user opinions on the amount of content in captions. Studies with blind and low-vision participants have found that lack of detail is a problem [6, 13, …

Meme Sentiment Analysis Enhanced With Multimodal Spatial Encoding And Face Embedding, Muzhaffar Hazman, Susan Mckeever, Josephine Griffith

Conference papers

Internet memes are characterised by the interspersing of text amongst visual elements. State-of-the-art multimodal meme classifiers do not account for the relative positions of these elements across the two modalities, despite the latent meaning associated with where text and visual elements are placed. Against two meme sentiment classification datasets, we systematically show performance gains from incorporating the spatial position of visual objects, faces, and text clusters extracted from memes. In addition, we also present facial embedding as an impactful enhancement to image representation in a multimodal meme classifier. Finally, we show that incorporating this spatial information allows our fully automated …