Other Computer Engineering Commons^™

Human-Machine Communication: Complete Volume. Volume 2

Human-Machine Communication

This is the complete volume of HMC Volume 2.

Annual Report 2020-2021, Depaul University College Of Computing And Digital Media

CDM Annual Reports

LETTER FROM THE DEAN

As I write this letter during the beginning of the 2021–22 academic year, we have started to welcome the majority of our students to campus— many for the very first time, and some for the first time in a year and a half. It has been wonderful to be together, in-person, again. Four quarters of learning and working remotely was challenging, to be sure, but I have been consistently amazed by the resilience, innovation, and hard work of our students, faculty, and staff, even in the most difficult of circumstances. This annual report, covering the 2020–21 …

Touching Light: A Framework For The Facilitation Of Music-Making In Mixed Reality, Ian Thomas Riley

Graduate Theses, Dissertations, and Problem Reports (ETD)

Drawing upon the historical development of analog and digital technologies alongside the proliferation of computer-assisted performance practices, this research seeks to develop a framework for integrating Mixed Reality applications to live musical performance, specifically through the creation of a Microsoft HoloLens 2 Mixed Reality application in order to facilitate a live performance of an original musical composition for percussion and real-time Mixed Reality environment. Mixed Reality enables a performer to interact with virtual (holograms, VSTs, etc.) and physical (vibraphone, tuned drums, microphones, etc.) objects simultaneously. Tandem to the development of the conceptual framework was the composition of an original score …

Supporting Coordination Of Children With Asd Using Neurological Music Therapy: A Pilot Randomized Control Trial Comparing An Elastic Touch-Display With Tambourines, Franceli L. Cibrian, Melisa Madrigal, Marina Avelais, Monica Tentori

Engineering Faculty Articles and Research

Aim

To evaluate the efficacy of Neurologic Music Therapy (NMT) using a traditional and a technological intervention (elastic touch-display) in improving the coordination of children with Autism Spectrum Disorder (ASD), as a primary outcome, and the timing and strength control of their movements as secondary outcomes.

Methods

Twenty-two children with ASD completed 8 NMT sessions, as a part of a 2-month intervention. Participants were randomly assigned to either use an elastic touch-display (experimental group) or tambourines (control group). We conducted pre- and post- assessment evaluations, including the Developmental Coordination Disorder Questionnaire (DCDQ) and motor assessments related to the control of …

Back To The Future With Higher Ed: A Sample Of Drupal Sites At Uga, Rachel S. Evans, Deborah Stanley, Delmaries I. Gray, Lauren Blais

Presentations

Consisting of a show and tell of a selection of large and small site installations from various departments, schools and colleges at the University of Georgia, panelists including back end and front end developers, public relations experts, librarians, and web coordinators will share their ship's timeline with Drupal versions and examples from the past, present and future. A moderator will then ask questions of panelists including: the biggest challenges they have faced with migrations and upgrades, the issues or blessings of more cohesive branding initiatives over the last few years, and their visions, concerns, and hopes for the future. In …

Creation Of Mobile Applications For The Shrines Of Al-Hakim Al-Termizi, Mavlyuda Xodjayeva, Turdali Jumayev, Alimjon Dadamuhamedov, Barno Saydakhmedova

The Light of Islam

We recognize that the sustainable development of tourism has great potential for the development of cultural and humanitarian ties around the world. We emphasize the importance of information technology in tourism, especially in the areas of advertising, marketing, differentiation and specialization of tourism products. In addition, we reaffirm our commitment to pilgrimage tourism for the individual growth of people and the strengthening of basic social norms and national values. The program uses modern programming languages such as Php, Java, C ++. Al-Hakim at-Termizi is one of the most famous places of worship in Uzbekistan, which is also known for its …

Dynamic Procedural Music Generation From Npc Attributes, Megan E. Washburn

Master's Theses

Procedural content generation for video games (PCGG) has seen a steep increase in the past decade, aiming to foster emergent gameplay as well as to address the challenge of producing large amounts of engaging content quickly. Most work in PCGG has been focused on generating art and assets such as levels, textures, and models, or on narrative design to generate storylines and progression paths. Given the difficulty of generating harmonically pleasing and interesting music, procedural music generation for games (PMGG) has not seen as much attention during this time.

Music in video games is essential for establishing developers' intended mood …

Annual Report 2019-2020, Depaul University College Of Computing And Digital Media

CDM Annual Reports

LETTER FROM THE DEAN

As I write this letter wrapping up the 2019-20 academic year, we remain in a global pandemic that has profoundly altered our lives. While many things have changed, some stayed the same: our CDM community worked hard, showed up for one another, and continued to advance their respective fields. A year that began like many others changed swiftly on March 11th when the University announced that spring classes would run remotely. By March 28th, the first day of spring quarter, we had moved 500 CDM courses online thanks to the diligent work of our faculty, staff, …

Computer Vision Machine Learning And Future-Oriented Ethics, Abagayle Lee Blank

Honors Projects

Computer Vision Machine Learning (CVML) in the application of facial recognition is currently being researched, developed, and deployed across the world. It is of interest to governments, technology companies, and consumers. However, fundamental issues remain related to human rights, error rates, and bias. These issues have the potential to create societal backlash towards the technology which could limit its benefits as well as harm people in the process. To develop facial recognition technology that will be beneficial to society in and beyond the next decade, society must put ethics at the forefront. Drawing on AI4People’s adaption of bioethics for AI, …

Adapt At Semeval-2018 Task 9: Skip-Gram Word Embeddings For Unsupervised Hypernym Discovery In Specialised Corpora, Alfredo Maldonado, Filip Klubicka

Other resources

This paper describes a simple but competitive unsupervised system for hypernym discovery. The system uses skip-gram word embeddings with negative sampling, trained on specialised corpora. Candidate hypernyms for an input word are predicted based on cosine similar- ity scores. Two sets of word embedding mod- els were trained separately on two specialised corpora: a medical corpus and a music indus- try corpus. Our system scored highest in the medical domain among the competing unsu- pervised systems but performed poorly on the music industry domain. Our approach does not depend on any external data other than raw specialised corpora.

Using Virtual Reality And Photogrammetry To Enrich 3d Object Identity, Cole Juckette, Heather Richards-Rissetto, Hector Eluid Guerra Aldana, Norman Martinez

Department of Anthropology: Faculty Publications

The creation of digital 3D models for cultural heritage is commonplace. With the advent of efficient and cost effective technologies archaeologists are making a plethora of digital assets. This paper evaluates the identity of 3D digital assets and explores how to enhance or expand that identity by integrating photogrammetric models into VR. We propose that when a digital object acquires spatial context from its virtual surroundings, it gains an identity in relation to that virtual space, the same way that embedding the object with metadata gives it a specific identity through its relationship to other information. We explore this concept …

Examining A Hate Speech Corpus For Hate Speech Detection And Popularity Prediction, Filip Klubicka, Raquel Fernandez

Other resources

As research on hate speech becomes more and more relevant every day, most of it is still focused on hate speech detection. By attempting to replicate a hate speech detection experiment performed on an existing Twitter corpus annotated for hate speech, we highlight some issues that arise from doing research in the field of hate speech, which is essentially still in its infancy. We take a critical look at the training corpus in order to understand its biases, while also using it to venture beyond hate speech detection and investigate whether it can be used to shed light on other …

Quantitative Fine-Grained Human Evaluation Of Machine Translation Systems: A Case Study On English To Croatian, Filip Klubicka, Antonio Toral, Victor Manuel Sanchez-Cartagena

Articles

This paper presents a quantitative fine-grained manual evaluation approach to comparing the performance of different machine translation (MT) systems. We build upon the well-established Multidimensional Quality Metrics (MQM) error taxonomy and implement a novel method that assesses whether the differences in performance for MQM error types between different MT systems are statistically significant. We conduct a case study for English-to- Croatian, a language direction that involves translating into a morphologically rich language, for which we compare three MT systems belonging to different paradigms: pure phrase-based, factored phrase-based and neural. First, we design an MQM-compliant error taxonomy tailored to the relevant …

Is It Worth It? Budget-Related Evaluation Metrics For Model Selection, Filip Klubicka, Giancarlo Salton, John D. Kelleher

Conference papers

Projects that set out to create a linguistic resource often do so by using a machine learning model that pre-annotates or filters the content that goes through to a human annotator, before going into the final version of the resource. However, available budgets are often limited, and the amount of data that is available exceeds the amount of annotation that can be done. Thus, in order to optimize the benefit from the invested human work, we argue that the decision on which predictive model one should employ depends not only on generalized evaluation metrics, such as accuracy and F-score, but …

Applied Deep Learning: Automated Segmentation Of White Matter Hyperintensities (Wmh) On Brain Mr Images, Matt Berseth

DHI Digital Projects Showcase

Small vessel disease plays a crucial role in stroke, dementia, and ageing. White matter hyperintensities (WMH) of vascular origin are one of the main consequences of small vessel disease and well visible on brain MR images. Quantification of WMH volume, location, and shape is of key importance in clinical research studies and likely to find its way into clinical practice; supporting diagnosis, prognosis, and monitoring of treatment for dementia and other neurodegenerative diseases. It has been noted that visual rating of WMH has important limitations and hence a more detailed segmentation of WMH is preferred. Various automated WMH segmentation techniques …

Harmonic Scale Transformations, John H. Chalmers

The Transdisciplinary STEAM+ Journal

My artwork derives from a project to delineate the transformations certain types of harmonic musical scales undergo as the sizes of their generating intervals vary over the space of the octave.

Modeling And Python Scripting In Maya For The Animation Short Style, Gilenn Emille G. Collado

Computer Engineering

The computer animation and graphics industry has dramatically improved over the years alongside the growth of technology. This paper discusses how that came about through a specific tool called Maya. It talks about its features and what it can create for you and the world. It also describes how scripting can simplify a job and make more of it. It highlights the effectiveness of the ability to manipulate code to create something amazing.

Project Llama: Making A Cappella Arranging Easier, Jason Lu

Liberal Arts and Engineering Studies

This project was intended to improve the current state of a cappella arranging. It explains the problems with current tools and explores other options.

Visualizing Population Density Based On Wifi Router Location And Network Usage, Tyler Deitz

Liberal Arts and Engineering Studies

This research paper introduces a prototype of a feature for Robert E. Kennedy’s maps web application. The feature visualizes population density based off wifi router location and network usage within the building. The significance of the feature is noted by documenting the library’s transition into a hub for student life and campus culture, which increases the space’s occupancy and visitor retention for a longer time. The feature is based off a Voronoi diagram map distribution which strongly affects its technical and visual implementation. The end product is user tested by Cal Poly students and received a 93.5% satisfaction rate.

Experimental Boss Design And Testing, Joseph P. Mistretta

Undergraduate Honors Theses

Over the years, gaming has developed rapidly from simple pixel-based experiences to fully blown three-dimensional worlds. As developing technologies improve, so does the complexity and flexibility of what can be created. Encounters, along with all aspects of any gaming experience, have evolved along with the technologies that create them. These intense combat instances, often times referred to as “bosses”, represent a chance for the developer to challenge player skill, cooperation, and coordination. In addition to being major challenges, encounters also allow players to feel a sense of progression as they learn and adapt to mechanics incorporated within an encounter’s design. …

Story Guided Virtual Cultural Heritage Applications, Selma Rizvic

Journal of Interactive Humanities

Virtual cultural heritage applications, particularly virtual museums, nowadays include various forms of storytelling. Every object, site or artifact is better perceived and understood through the adjoining story. Interactive applications naturally request the storytelling to become interactive as well. This paper describes the concepts of interactive digital storytelling in our virtual museums and cultural heritage presentations and discusses their advantages and drawbacks recognized through user evaluation. We used digital stories not only to introduce visitors with the context and information on the objects, but also to enhance their navigation through virtual environments with purpose of learning and perceiving maximum amount of …

Measuring The Counter/Assumption Model's Effect On Argumentation Quality, Evan D G Ovadia

Master's Theses

This thesis presents a new platform called See the Reason, built upon a tree- structured argumentation model called the Counter/Assumption model. In the Counter/Assumption model, a topic is posted first, then under that topic, reasons for and against, and for each reason, counterarguments, and for any counterargu- ment, more counterarguments. The model enables us to systematically determine whether a claim is “tentatively true” or “tentatively false,” in an effort to motivate people to make their side’s claims tentatively true and the opposing side’s claims tentatively false, thus encouraging conflict. Research suggests that debates with more conflict are better, so this …

Judging Emotion From Low-Pass Filtered Naturalistic Emotional Speech, John Snel, Charlie Cullen

Conference papers

In speech, low frequency regions play a significant role in paralinguistic communication such as the conveyance of emotion or mood. The extent to which lower frequencies signify or contribute to affective speech is still an area for investigation. To investigate paralinguistic cues, and remove interference from linguistic cues, researchers can low-pass filter the speech signal on the assumption that certain acoustic cues characterizing affect are still discernible. Low-pass filtering is a practical technique to investigate paralinguistic phenomena, and is used here to investigate the inference of naturalistic emotional speech. This paper investigates how listeners perceive the level of Activation, and …

The Mayaarch3d Project: A 3d Webgis For Analyzing Ancient Architecture And Landscapes, Jennifer Von Schwerin, Heather Richards-Rissetto, Fabio Remondino, Giorgio Agugario, Gabrio Girardi

Department of Anthropology: Faculty Publications

There is a need in the humanities for a 3D WebGIS with analytical tools that allow researchers to analyze 3D models linked to spatially referenced data. Geographic Information Systems (GIS) allow for complex spatial analysis of 2.5D data. For example, they offer bird’s eye views of landscapes with extruded building footprints, but one cannot ‘get on the ground’ and interact with true 3D models from a pedestrian perspective. Meanwhile, 3D models and virtual environments visualize data in 3D space, but analytical tools are simple rotation or lighting effects. The MayaArch3D Project is developing a 3D WebGIS—called QueryArch3D—to allow these two …

Real Time Visibility Culling With Hardware Occlusion Queries And Uniform Grids, Ilya Iseletsk Seletsky

Master's Theses

Culling out non-visible portions of 3D scenes is important for rendering large complex worlds at an interactive frame rate. Past 3D engines used static prebaked visibility data which was generated using complex algorithms. Hardware Occlusion Queries are a modern feature that allows engines to determine if objects are invisible on the fly. This allows for fully dynamic destructible and editable environments as opposed to static prebaked environments of the past. This paper presents an algorithm that uses Hardware Occlusion Queries to cull fully dynamic scenes in real-time. This algorithm is relatively simple in comparison to other real-time occlusion culling techniques, …

Geospatial Virtual Heritage: A Gesture-Based 3d Gis To Engage The Public With Ancient Maya Archaeology, Heather Richards-Rissetto, Jim Robertsson, Jennifer Von Schwerin, Giorgio Agugario, Fabio Remondino, Gabrio Girardi

Department of Anthropology: Faculty Publications

This paper presents our research to develop a gesture-based 3D GIS system to engage the public in cultural heritage. It compares two types of interaction—device-based vs. natural interaction— and summarizes the beta-testing results of a 3D GIS tool for archaeology, called QueryArch3D, in which participants used device-based interaction (i.e. mouse and keyboard). It follows with a description of the gesture-based system—that we developed in response to these beta-tests. The system uses QueryArch3D and Microsoft’s Kinect to enable people use body movements (in lieu of keyboard or mouse) to navigate a virtual reality landscape, query 3D objects, and call up photos, …

The Quickiecomposer Android Application, Brigit Elizabeth Hawley

Liberal Arts and Engineering Studies

The QuickieComposer application is a program intended for use on Android Devices. Designed for the composer on the go, the QuickieComposer app is perfect for those “in the moment” compositions. In the following document, the functionality and development of the first version of the QuickieComposer application is explained.

Kinect And 3d Gis In Archaeology, Heather Richards-Rissetto, Fabio Remondino, Jim Robersson, Jennifer Von Schwerin, Giorgio Agugiaro, Gabrio Girardi

Department of Anthropology: Faculty Publications

This paper explores the potential of using Microsoft's Kinect to create a low-cost and portable system to virtually navigate, through a prototype 3D GIS, the digitally reconstructed ancient Maya city and UNESCO World Heritage Site of Copan in Honduras. The 3D GIS, named QueryArch3D, was developed as part of the MayaArch3D project (http://mayaarch3d.unm.edu), which explores the possibilities of integrating databases and 3D digital tools for research and teaching on ancient architectures and landscapes. The developed system, based on the Flexible Action and Articulated Skeleton Toolkit (FAAST), controls in a remote and touchless mode the movements in the 3D environment in …

Obtaining Speech Assets For Judgement Analysis On Low-Pass Filtered Emotional Speech, John Snel, Charlie Cullen

Conference papers

Investigating the emotional content in speech from acoustic characteristics requires separating the semantic con- tent from the acoustic channel. For natural emotional speech, a widely used method to separate the two channels is the use of cue masking. Our objective is to investigate the use of cue masking in non-acted emotional speech by analyzing the extent to which filtering impacts the perception of emotional content of the modified speech material. However, obtaining a corpus of emotional speech can be quite difficult whereby verifying the emotional content is an issue thoroughly discussed. Currently, speech research is showing a tendency toward constructing …

Forty Years Of Movie Hacking: Considering The Potential Implications Of The Popular Media Representation Of Computer Hackers From 1968 To 2008, Damian Gordon

Articles

Increasingly movies are being produced which feature plots that incorporate elements of computer security and hacking, and cumulatively these movies are creating a public perception as to the nature of computer security. This research examines movies that feature hackers (and hacking) to identify if any common themes emerge from these movies in their representation of these issues. To achieve this, first a corpus of hacking movies is created, and then using a qualitative data analysis technique, guidelines are developed which distinguish those movies that actually have the potential to create a perception with the general public. The resultant dataset is …