Automation, Ai, And Future Skills Needs: An Irish Perspective,
2023
Technological University Dublin, Ireland
Automation, Ai, And Future Skills Needs: An Irish Perspective, Raimunda Bukartaite, Daire Hooper
Articles
This study explores insights from key stakeholders into the skills they believe will be necessary for the future of work as we become more reliant on artificial intelligence (AI) and technology. The study also seeks to understand what human resource policies and educational interventions are needed to support and take advantage of these changes.
Detection Of Truthful, Semi-Truthful, False And Other News With Arbitrary Topics Using Bert-Based Models,
2023
Technological University Dublin, Ireland
Detection Of Truthful, Semi-Truthful, False And Other News With Arbitrary Topics Using Bert-Based Models, Elena Shushkevich, John Cardiff, Anna Boldyreva
Conference Papers
Easy and uncontrolled access to the Internet provokes the wide propagation of false information, which freely circulates in the Internet. Researchers usually solve the problem of fake news detection (FND) in the framework of a known topic and binary classification. In this paper we study possibilities of BERT-based models to detect fake news in news flow with unknown topics and four categories: true, semi-true, false and other. The object of consideration is the dataset CheckThat! Lab proposed for the conference CLEF-2022. The subjects of consideration are the models SBERT, RoBERTa, and mBERT. To improve the quality of classification we use …
Enhancing Zero‑Shot Action Recognition In Videos By Combining Gans With Text And Images,
2023
Technological University Dublin, Ireland
Enhancing Zero‑Shot Action Recognition In Videos By Combining Gans With Text And Images, Kaiqiang Huang, Luis Miralles-Pechuán, Susan Mckeever
Articles
Zero-shot action recognition (ZSAR) tackles the problem of recognising actions that have not been seen by the model during the training phase. Various techniques have been used to achieve ZSAR in the field of human action recognition (HAR) in videos. Techniques based on generative adversarial networks (GANs) are the most promising in terms of performance. GANs are trained to generate representations of unseen videos conditioned on information related to the unseen classes, such as class label embeddings. In this paper, we present an approach based on combining information from two different GANs, both of which generate a visual representation of …
A Real-Time Machine Learning Framework For Smart Home-Based Yoga Teaching System,
2023
National College of Ireland, Ireland
A Real-Time Machine Learning Framework For Smart Home-Based Yoga Teaching System, Jothika Sunney, Musfira Jilani, Pramod Pathak, Paul Stynes
Conference papers
Practicing yoga poses in a home-based environment has increased due to Covid19. Yoga poses without a trainer can be challenging, and incorrect yoga poses can cause muscle damage. Smart home-based yoga teaching systems may aid in performing accurate yoga poses. However, the challenge with such systems is the computational time required to detect yoga poses. This research proposes a real-time machine learning framework for teaching accurate yoga poses. It combines a pose estimation model, a pose classification model, and a real-time feedback mechanism. The dataset consists of five popular yoga poses namely the downdog pose, the tree pose, the goddess …
Show, Prefer And Tell: Incorporating User Preferences Into Image Captioning,
2023
Technological University Dublin
Show, Prefer And Tell: Incorporating User Preferences Into Image Captioning, Annika Lindh, Robert J. Ross, John Kelleher
Conference papers
Image Captioning (IC) is the task of generating natural language descriptions for images. Models encode the image using a convolutional neural network (CNN) and generate the caption via a recurrent model or a multi-modal transformer. Success is measured by the similarity between generated captions and human-written “ground-truth” captions, using the CIDEr [14], SPICE [1] and METEOR [2] metrics. While incremental gains have been made on these metrics, there is a lack of focus on end-user opinions on the amount of content in captions. Studies with blind and low-vision participants have found that lack of detail is a problem [6, 13, …
Dynamic Influence Diagram-Based Deep Reinforcement Learning Framework And Application For Decision Support For Operators In Control Rooms,
2023
Technological University Dublin, Ireland
Dynamic Influence Diagram-Based Deep Reinforcement Learning Framework And Application For Decision Support For Operators In Control Rooms, Joseph Mietkiewicz, Ammar N. Abbas, Chidera Winifred Amazu, Anders L. Madsen, Gabriele Baldissone
Conference papers
In today’s complex industrial environment, operators are often faced with challenging situations that require quick and accurate decision-making. The human-machine interface (HMI) can display too much information, leading to information overload and potentially compromising the operator’s ability to respond effectively. To address this challenge, decision support models are needed to assist operators in identifying and responding to potential safety incidents. In this paper, we present an experiment to evaluate the effectiveness of a recommendation system in addressing the challenge of information overload. The case study focuses on a formaldehyde production simulator and examines the performance of an improved Human-Machine Interface …
Exploring The Impact Of Competition And Incentives On Game Jam Participation And Behaviour,
2023
Galway Mayo Institute of Technology, Ireland
Exploring The Impact Of Competition And Incentives On Game Jam Participation And Behaviour, John Healy, Niamh Germaine
Conference papers
Competitive elements are a common feature of many game jams. However, there has been little research to date on the impact of competition on participants and their behaviours. To better understand how incentives and competition may affect the motivations and behaviour of game jam participants, we surveyed 47 game jam participants and analysed data from 4,564 online game jams. We found that incentives and competition were neither strong deterrents nor significant motivators for game jam participation. However, a significant percentage of the participants surveyed indicated that incentives and competition would affect their behaviour during a game jam. Our findings suggest …
Actor-Centric Spatio-Temporal Feature Extraction For Action Recognition,
2023
Technological University Dublin
Actor-Centric Spatio-Temporal Feature Extraction For Action Recognition, Anil Kunchala, Bianca Schoen-Phelan, Mélanie Bouroche
Conference papers
Action understanding involves the recognition and detection of specific actions within videos. This crucial task in computer vision gained significant attention due to its multitude of applications across various domains. The current action detection models, inspired by 2D object detection methods, employ two-stage architectures. The first stage is to extract actor-centric video sub-clips, i.e. tubelets of individuals, and the second stage is to classify these tubelets using action recognition networks. The majority of these recognition models utilize a frame-level pre-trained 3D Convolutional Neural Networks (3D CNN) to extract spatio-temporal features of a given tubelet. This, however, results in suboptimal spatio-temporal …
How Online Discourse Networks Fields Of Practice: The Discursive Negotiation Of Autonomy On Art Organisation About Pages,
2023
Technological University Dublin, Ireland
How Online Discourse Networks Fields Of Practice: The Discursive Negotiation Of Autonomy On Art Organisation About Pages, Tommie Soro
Articles
This article examines how the online discourse of art organisations forges relationships between the artworld and the fields of politics and economy. Combining elements of Pierre Bourdieu’s field analysis and Norman Fairclough’s critical discourse analysis, the article analyses an elite art magazine, e-flux, and an elite art museum, IMMA, and the activities of discourses, genres, and utterances on their about pages. Its results suggest that the about pages of these organisations forge links between the artworld and the fields of politics and economy by mobilising discourse in these fields and by incorporating discourse practices from these fields. The ideological tension …
Music For Visual Media Of The 21st Century What Role Does Music Have In Visual Media,
2023
Technological University Dublin
Music For Visual Media Of The 21st Century What Role Does Music Have In Visual Media, Sigrid Heugen
Doctoral
This research consists of a composition portfolio which examines new perspectives on musical experiences in virtual environments, through the exploration and development of immersive adaptive music for a visual medium. The research addresses the usage, adaptation, and creation of music in visual media such as Virtual Reality (VR) and other Extended Realities (XR).
Setransformer: A Transformer-Based Code Semantic Parser For Code Comment Generation,
2023
Beijing University of Chemical Technology, Beijing, China
Setransformer: A Transformer-Based Code Semantic Parser For Code Comment Generation, Zheng Li, Yonghao Wu, Bin Peng, Xiang Chen, Zeyu Sun, Yong Liu, Paul Doyle
Conference Papers
Automated code comment generation technologies can help developers understand code intent, which can significantly reduce the cost of software maintenance and revision. The latest studies in this field mainly depend on deep neural networks, such as convolutional neural networks and recurrent neural network. However, these methods may not generate high-quality and readable code comments due to the long-term dependence problem, which means that the code blocks used to summarize information are far from each other. Owing to the long-term dependence problem, these methods forget the previous input data’s feature information during the training process. In this article, to solve the …
Meme Sentiment Analysis Enhanced With Multimodal Spatial Encoding And Face Embedding,
2023
University of Galway, Galway, Ireland
Meme Sentiment Analysis Enhanced With Multimodal Spatial Encoding And Face Embedding, Muzhaffar Hazman, Susan Mckeever, Josephine Griffith
Conference papers
Internet memes are characterised by the interspersing of text amongst visual elements. State-of-the-art multimodal meme classifiers do not account for the relative positions of these elements across the two modalities, despite the latent meaning associated with where text and visual elements are placed. Against two meme sentiment classification datasets, we systematically show performance gains from incorporating the spatial position of visual objects, faces, and text clusters extracted from memes. In addition, we also present facial embedding as an impactful enhancement to image representation in a multimodal meme classifier. Finally, we show that incorporating this spatial information allows our fully automated …
Using Machine Learning To Identify Patterns In Learner-Submitted Code For The Purpose Of Assessment,
2023
Technological University Dublin, Dublin, Ireland
Using Machine Learning To Identify Patterns In Learner-Submitted Code For The Purpose Of Assessment, Botond Tarcsay, Fernando Perez-Tellez, Jelena Vasic
Conference papers
Programming has become an important skill in today’s world and is taught widely both in traditional and online settings. Instructors need to grade increasing amounts of student work. Unit testing can contribute to the automation of the grading process but it cannot assess the structure or partial correctness of code, which is needed for finely differentiated grading. This paper builds on previous research that investigated machine learning models for determining the correctness of programs from token-based features of source code and found that some such models can be successful in classifying source code with respect to whether it passes unit …
A Tutoring Framework To Support Computer Science Programmes In Higher Education,
2023
National College of Ireland, Ireland
A Tutoring Framework To Support Computer Science Programmes In Higher Education, Emer Thornbury, Frances Sheridan, Pramod Pathak, Cristina Hava Muntean, Paul Stynes
Conference papers
Computing Support is the provision of academic supports such as individual tutoring and support classes to students studying computing at third level. Students can struggle with computing as it requires practice involving trial and error. This work proposes a research informed tutoring framework to support computer science students at third level. The tutoring framework combines three pillars; staff and training, pedagogies and activities. Support is put in place to help students develop technical and programming skills. Essential tutoring is provided for those who might otherwise drop out of college. The framework was applied to first and second-year undergraduate programmes and …
Work In Progress: A Virtual Educational Robotics Coding Club Framework To Improve K-6 Students Emotional Engagement In Stem,
2023
National College of Ireland, Ireland
Work In Progress: A Virtual Educational Robotics Coding Club Framework To Improve K-6 Students Emotional Engagement In Stem, Kate Carmody, Julie Booth, Jospehine Bleach, Pramod Pathak, Paul Styles
Conference papers
The growing popularity and deployment of Internet of Things (IoT) devices has led to serious security concerns. The integration of a security operations center (SOC) becomes increasingly important in this situation to ensure the security of IoT devices. In this article, we will present a summary of IoT device security issues, their vulnerabilities, a review of current challenges to keep these devices secure, and discuss the role that SOC can bring in protecting IoT devices while considering the challenges encountered and the directions to consider when implementing a reliable SOC for IoT monitoring.
Detecting Road Intersections From Satellite Images Using Convolutional Neural Networks,
2023
Technological University Dublin
Detecting Road Intersections From Satellite Images Using Convolutional Neural Networks, Fatmaelzahraa Eltaher Ph.D, Luis Miralles-Pechuán, Jane Courtney, Susan Mckeever
Conference papers
Automatic detection of road intersections is an important task in various domains such as navigation, route planning, traffic prediction, and road network extraction. Road intersections range from simple three-way T-junctions to complex large-scale junctions with many branches. The location of intersections is an important consideration for vulnerable road users such as People with Blindness or Visually Impairment (PBVI) or children. Route planning applications, however, do not give information about the location of intersections as this information is not available at scale. As a first step to solving this problem, a mechanism for automatically mapping road intersection locations is required, ideally …
Queer In Ai: A Case Study In Community-Led Participatory Ai,
2023
University of California, USA
Queer In Ai: A Case Study In Community-Led Participatory Ai, Anaelia Ovalle, Arjun Subramonian, Ashwiin Singh, Claas Voelcker, Danica Sutherland, Davide Locatelli, Eva Breznik, Felip Klubicka, Hang Yuan, Hetvi J, Huan Zhang, Jaidev Shriram, Kruno Lehman, Luca Soldaini, Maarten Sap, Marc Peter Deisenroth, Maria Leonor Pacheco, Maria Ryskina, Martin Mundt, Melind Agarwal, Nyx Mclean, Pan Xu, A. Pranav, Raj Korpan, Ruchira Ray, Sarah Mathew, Sarthak Arora, S.T. John, Tanvi Anand, Vishakha Agrawal, William Agnew, Yanan Long, Zijie J. Wang, Zeerak Talat, Avijit Ghosh, Nathaniel Dennler, Michael Noseworthy, Sharvani Jha, Emi Baylor, Aditya Joshi, Natalia Y. Bilenko, Andrew Mcnamara, Raphael Gontijo-Lopes, Alex Markham, Evyn Dong, Jackie Kay, Manu Saraswat, Nikhil Vytla, Luke Stark
Conference papers
Queerness and queer people face an uncertain future in the face of ever more widely deployed and invasive artificial intelligence (AI). These technologies have caused numerous harms to queer people, including privacy violations, censoring and downranking queer content, exposing queer people and spaces to harassment by making them hypervisible, deadnaming and outing queer people. More broadly, they have violated core tenets of queerness by classifying and controlling queer identities. In response to this, the queer community in AI has organized Queer in AI, a global, decentralized, volunteer-run grassroots organization that employs intersectional and community-led participatory design to build an inclusive …
Robustness Of Image-Based Malware Classification Models Trained With Generative Adversarial Networks,
2023
Technological University Dublin
Robustness Of Image-Based Malware Classification Models Trained With Generative Adversarial Networks, Ciaran Reilly, Stephen O Shaughnessy, Christina Thorpe
Conference papers
As malware continues to evolve, deep learning models are increasingly used for malware detection and classification, including image based classification. However, adversarial attacks can be used to perturb images so as to evade detection by these models. This study investigates the effectiveness of training deep learning models with Generative Adversarial Network-generated data to improve their robustness against such attacks. Two image conversion methods, byte plot and space-filling curves, were used to represent the malware samples, and a ResNet-50 architecture was used to train models on the image datasets. The models were then tested against a projected gradient descent attack. It …
Interpretable Input-Output Hidden Markov Model-Based Deep Reinforcement Learning For The Predictive Maintenance Of Turbofan Engines,
2023
Technological University Dublin, Ireland
Interpretable Input-Output Hidden Markov Model-Based Deep Reinforcement Learning For The Predictive Maintenance Of Turbofan Engines, Ammar N. Abbas, Georgios C. Chasparis, John Kelleher
Conference papers
An open research question in deep reinforcement learning is how to focus the policy learning of key decisions within a sparse domain. This paper emphasizes on combining the advantages of input-output hidden Markov models and reinforcement learning. We propose a novel hierarchical modeling methodology that, at a high level, detects and interprets the root cause of a failure as well as the health degradation of the turbofan engine, while at a low level, provides the optimal replacement policy. This approach outperforms baseline deep reinforcement learning (DRL) models and has performance comparable to that of a state-of-the-art reinforcement learning system while …
Graph-Based Mutations For Music Generation,
2023
University of Galway, Ireland
Graph-Based Mutations For Music Generation, Maziar Kanani, Sean O'Leary, James Mcdermott
Conference papers
Our study aims to compare the effects of direct mutation and graphbased mutation on representations of music domain. We focus on short tunes from the Irish folk tradition, represented as integer sequences, and use a graph-based representation based on Pathway Assembly (a directed acyclic graph) and the Sequitur algorithm. We define multiple mutation operators to work directly on the sequences or on the graphs, hypothesizing that graph-based mutations will tend to preserve the pattern used per tune, while direct mutation of sequences will tend to destroy patterns, resulting in new generated tunes that are more complex. We perform experiments on …
