Engineering Commons^™

American Sign Language Recognition Using Machine Learning And Computer Vision, Kshitij Bantupalli, Ying Xie

Master of Science in Computer Science Theses

Speech impairment is a disability which affects an individual’s ability to communicate using speech and hearing. People who are affected by this use other media of communication such as sign language. Although sign language is ubiquitous in recent times, there remains a challenge for non-sign language speakers to communicate with sign language speakers or signers. With recent advances in deep learning and computer vision there has been promising progress in the fields of motion and gesture recognition using deep learning and computer vision-based techniques. The focus of this work is to create a vision-based application which offers sign language translation …

Unsupervised Feature Learning For Point Cloud By Contrasting And Clustering With Graph Convolutional Neural Network, Ling Zhang

Dissertations and Theses

Recently, deep graph neural networks (GNNs) have attracted significant attention for point cloud understanding tasks, including classification, segmentation, and detection. However, the training of such deep networks still requires a large amount of annotated data, which is both expensive and time-consuming. To alleviate the cost of collecting and annotating large-scale point cloud datasets, we propose an unsupervised learning approach to learn features from unlabeled point cloud ”3D object” dataset by using part contrasting and object clustering with GNNs. In the contrast learning step, all the samples in the 3D object dataset are cut into two parts and put into a …

The Social Presence Of Jibo, Parisa Farhadi

Graduate Research Theses & Dissertations

This research is an attempt to investigate how a social robot is perceived by users at the first encounter. And to find out whether a social robot like Jibo is understood merely as a kind of a technological object or a social entity. Previous studies in Human-Robot Interaction have considered social presence as a mediator in users’ social responses toward robots; however, the focus of this study is the social presence itself and investigates whether Jibo produces a sense of presence during initial encounters. To this end, the current study examines individuals’ perceptions of and responses to Jibo. Participants (N=8) …

Analysis And Control Of Fiber-Reinforced Elastomeric Enclosures (Frees), Soheil Habibian

Master’s Theses

While rigid robots are extensively used in various applications, they are limited in the tasks they can perform and can be unsafe in close human-robot interactions. Soft robots on the other hand surpass the capabilities of rigid robots in several ways, such as compatibility with the work environments, degrees of freedom, manufacturing costs, and safe interactions with the environment. This thesis studies the behavior of Fiber-Reinforced Elastomeric Enclosures (FREEs) as a particular type of soft pneumatic actuator that can be used in soft manipulators. A dynamic lumped-parameter model is created to simulate the motion of a single FREE under various …

3d Formation Control In Multi-Robot Teams Using Artificial Potential Fields, Sanjana Reddy Mohan

Electronic Theses and Dissertations

Multi-robot teams find applications in emergency response, search and rescue operations, convoy support and many more. Teams of autonomous aerial vehicles can also be used to protect a cargo of airplanes by surrounding them in some geometric shape. This research develops a control algorithm to attract UAVs to one or a set of bounded geometric shapes while avoiding collisions, re-configuring in the event of departure or addition of UAVs and maneuvering in mission space while retaining the configuration. Using potential field theory, weighted vector fields are described to attract UAVs to a desired formation. In order to achieve this, three …

Estimation Of Multi-Directional Ankle Impedance As A Function Of Lower Extremity Muscle Activation, Lauren Knop

Dissertations, Master's Theses and Master's Reports

The purpose of this research is to investigate the relationship between the mechanical impedance of the human ankle and the corresponding lower extremity muscle activity. Three experimental studies were performed to measure the ankle impedance about multiple degrees of freedom (DOF), while the ankle was subjected to different loading conditions and different levels of muscle activity. The first study determined the non-loaded ankle impedance in the sagittal, frontal, and transverse anatomical planes while the ankle was suspended above the ground. The subjects actively co-contracted their agonist and antagonistic muscles to various levels, measured using electromyography (EMG). An Artificial Neural Network …

Estimation And Prediction Of The Human Gait Dynamics For The Control Of An Ankle-Foot Prosthesis, Guilherme Aramizo Ribeiro

Dissertations, Master's Theses and Master's Reports

With the growing population of amputees, powered prostheses can be a solution to improve the quality of life for many people. Powered ankle-foot prostheses can be made to behave similar to the lost limb via controllers that emulate the mechanical impedance of the human ankle. Therefore, the understanding of human ankle dynamics is of major significance. First, this work reports the modulation of the mechanical impedance via two mechanisms: the co-contraction of the calf muscles and a change of mean ankle torque and angle. Then, the mechanical impedance of the ankle was determined, for the first time, as a multivariable …

Robotic Automation Of A Cnc Machine, Jace Hovey

Honors Undergraduate Theses

Robotic automation of CNC machines is becoming more popular as robot technology advances and becomes more readily available. While some CNC machines can run autonomously with part catchers, vertical milling centers require an external entity to keep the machine running. Collaborative and Industrial robots are the two main selections for automating a vertical CNC milling machine. We investigate specifically which robot type is most effective for machine tending a Haas VF2 vertical milling center. To do this a cell floor plan, risk assessment, overall equipment effectiveness evaluation, and a total cost analysis are performed to compare robots. With this results …

Immunity-Based Framework For Autonomous Flight In Gps-Challenged Environment, Mohanad Al Nuaimi

Graduate Theses, Dissertations, and Problem Reports

In this research, the artificial immune system (AIS) paradigm is used for the development of a conceptual framework for autonomous flight when vehicle position and velocity are not available from direct sources such as the global navigation satellite systems or external landmarks and systems. The AIS is expected to provide corrections of velocity and position estimations that are only based on the outputs of onboard inertial measurement units (IMU). The AIS comprises sets of artificial memory cells that simulate the function of memory T- and B-cells in the biological immune system of vertebrates. The innate immune system uses information about …

Exploring Cyber-Physical Systems, Misbah Uddin Mohammed

Graduate Research Theses & Dissertations

The advances in IOT, Computer Vision, AI and Machine Learning have made these technologies ubiquitous to our daily lives. From Smart Phones to Connected Vehicles, Cyber Physical systems have been interspersed into everything we interact in today’s world. The aim or this thesis was to explore these advances in Cyber Physical Systems and analyze the different sectors they were affecting. We then hand-picked certain domains and explored further by carrying out practical projects using some of the latest software and hardware resources available. Technologies like Amazon Alexa services, NVIDIA Jetson boards, TensorFlow, OpenCV, NodeJS were heavily employed in our various …

Multirobot Confidence And Behavior Modeling: An Evaluation Of Telerobotic Performance And Efficiency, Nathan Lucas

Wayne State University Dissertations

There is considerable interest in multirobot systems capable of performing spatially distributed, hazardous, and complex tasks as a team. There is also growing interest in manned-unmanned teams leveraging the unique abilities of humans and automated machines working alongside each other. The limitations of human perception and cognition affect the ability of operators to integrate information from multiple mobile robots, switch between their spatial frames of reference, and divide attention among many sensory inputs and command outputs. Automation is necessary to help the operator manage increasing demands as the number of robots scales up. However, more automation does not necessarily equate …

Routing Algorithm For The Ground Team In Transmission Line Inspection Using Unmanned Aerial Vehicle, Yu Li

Masters Theses

"With the rapid development of robotics technology, robots are increasingly used to conduct various tasks by utility companies. An unmanned aerial vehicle (UAV) is an efficient robot that can be used to inspect high-voltage transmission lines. UAVs need to stay within a data transmission range from the ground station and periodically land to replace the battery in order to ensure that the power system can support its operation. A routing algorithm must be used in order to guide the motion and deployment of the ground station while using UAV in transmission line inspection. Most existing routing algorithms are dedicated to …

Volumetric Error Compensation For Industrial Robots And Machine Tools, Le Ma

Doctoral Dissertations

“A more efficient and increasingly popular volumetric error compensation method for machine tools is to compute compensation tables in axis space with tool tip volumetric measurements. However, machine tools have high-order geometric errors and some workspace is not reachable by measurement devices, the compensation method suffers a curve-fitting challenge, overfitting measurements in measured space and losing accuracy around and out of the measured space. Paper I presents a novel method that aims to uniformly interpolate and extrapolate the compensation tables throughout the entire workspace. By using a uniform constraint to bound the tool tip error slopes, an optimal model with …

Light Touch Based Virtual Cane For Balance Assistance During Standing, Sindhu Reddy Alluri

Masters Theses

"Can additional information about one's body kinematics provided through hands improve human balance? Light-Touch (LT) through hands helps improve balance in a wide range of populations, both healthy and impaired. The force is too small to provide any meaningful mechanical assistance -- rather, it is suggested that the additional sensory information through hands helps the body improve balance.

To investigate the potential for improving human balance through biofeedback through hands, we developed a Virtual Cane (VC) for balance assistance during standing. The VC mimics the physical cane's function of providing information about one's body in space. Balance experiments on 10 …

Controlled Switching In Kalman Filtering And Iterative Learning Controls, He Li

Masters Theses

“Switching is not an uncommon phenomenon in practical systems and processes, for examples, power switches opening and closing, transmissions lifting from low gear to high gear, and air planes crossing different layers in air. Switching can be a disaster to a system since frequent switching between two asymptotically stable subsystems may result in unstable dynamics. On the contrary, switching can be a benefit to a system since controlled switching is sometimes imposed by the designers to achieve desired performance. This encourages the study of system dynamics and performance when undesired switching occurs or controlled switching is imposed. In this research, …

Virtual Morphology As A Method Of Robotic Control, Conner Todd Castle

Graduate Theses, Dissertations, and Problem Reports

This thesis presents Virtual Morphology (VM), a method that explores a different perspective on the design of robot autonomy using inspiration from morphological computing and programmed computation. Morphological computation offers physical solutions that solve complex tasks, like robotic grasping of unknown objects, with relative ease. Unfortunately, these physical solutions are difficult to adjust post-development, and are usually designed to complete only one or a few specific tasks. Programmed computational approaches are more flexible because they can be implemented and adjusted through software, but unfortunately, these approaches can become rather complex as tasks become more difficult. This thesis explores the potential …

Autonomous Combat Robot, Andrew J. Szabo Ii, Chris Heldman, Tristin Weber, Tanya Tebcherani, Holden Leblanc, Fabian Ardeljan

Williams Honors College, Honors Research Projects

This honors project will also serve as an engineering senior design project.

The objective is to design and build the software and electrical systems for a 60 lb weight class combat robot that will function autonomously and outperform manually driven robots during competition.

While running autonomously, the robot will use LiDAR sensors to detect and attack opponent robots. This robot will also be able to be remote controlled in manual mode. This will mitigate the risk in case the autonomy or sensors fail. LED lights on the robot will indicate whether it is in autonomous or manual mode. The system …

Hydrogen Fuel Cell Gasket Handling And Sorting With Machine Vision Integrated Dual Arm Robot, Devin C. Fowler

Electronic Theses and Dissertations

Recently demonstrated robotic assembling technologies for fuel cell stacks used fuel cell components manually pre-arranged in stacks (presenters), all oriented in the same position. Identifying the original orientation of fuel cell components and loading them in stacks for a subsequent automated assembly process is a difficult, repetitive work cycle which if done manually, deceives the advantages offered by automated fabrication technologies of fuel cell components and by robotic assembly processes. We present an innovative robotic technology which enables the integration of automated fabrication processes of fuel cell components with robotic assembly of fuel cell stacks into a fully automated fuel …