Robotics Commons^™

The Self-Aware Room: A Framework For Operational Self-Awareness In Evolvable Blended Environments, David B. Smith

Publications and Research

The Self-Aware Room (SAR) is a room-scale research environment developed within the larger Balanced Blended Space and Blended Reality Performance System research trajectory. Rather than treating the room as a conventional “smart” environment composed of fixed automation technologies, SAR approaches it as an evolvable blended environment made from physical, virtual, conceptual, sensory, computational, and performative relationships. Its defining feature is not any particular sensor, model, or output device, but the set of transformations through which physical activity becomes structured observation, bounded representation, interpreted state, governed decision, and mediated response.

This paper develops the conceptual and methodological foundations of SAR as …

3d Printed Portable Automatic Pill Dispenser​, Amber M. Ocasio

Publications and Research

Medication adherence is a major public health concern, particularly among patients with chronic illnesses. Reports from the National Institutes of Health indicate that adherence rates are significantly lower for chronic conditions, with patients taking only ~50% of medications prescribed. Unintentional non-adherence—such as forgetting doses—is more prevalent (62.9%, 47.1%, 46.9%) than intentional non-adherence, and the consequences include medication waste, disease progression, reduced functional abilities, lower quality of life, and increased reliance on medical resources. Because existing automatic pill dispensers cost over $100 on average, they remain inaccessible for many lower-income patients who could benefit from such technology. This project addresses this …

Csc36000 - Modern Distributed Computing Assignment, Saptarashmi Bandyopadhyay

Open Educational Resources

This assignment covers standard performance metrics for Distributed Systems and the basics of Multiprocessing for CSC36000 - Modern Distributed Computing at the City College of New York CUNY. It is an interactive coding assignment intended to be executed in a Python notebook.

Virtual Environment Creation And Camera Calibration For Soft Target Identification And Assistance In Crowded Spaces With A Sensor Network And A Robotic Dog, Eltan Samoylov

Dissertations and Theses

Crowded places are increasingly targets of violence due to the increased accessibility and covertness of weapons, explosives, and other technology like drones. Addressing the challenges of protecting crowded places and assisting vulnerable individuals requires a multidisciplinary approach, taking inspiration from many different perspectives. Video surveillance of these crowded public facilities, such as train and bus stations, airports, shopping malls, and sports arenas, is very important to public safety, both for identifying threats/terrorist attacks and implementing evacuation plans.

The work of this thesis is part of a larger project aiming to explore the potential of using real-time computer vision and deep …

Robotics Lab With The Lego Spike Prime Robot, Susan Imberman, Tatiana Anderson, Chang Guo, Vladimir Frants, Daniel Agman, Orit D. Gruber

Open Educational Resources

This lab introduces the field of Robotics. Robotics is a field that combines Artificial Intelligence with Engineering. In this lab, the student will be experimenting with the LEGO® Spike Prime Robot. The student's final report should include a copy of all the completed answers, program code, and observations.

After completing this lab experiment, the student will proceed to answer the following questions in the Observations section at the end of the lab report:

• List some applications of robotics in daily living and industry ?

• How does a robot sense and react to its environment?

• What new ideas were observed during …

Experimentation With Speech Recognition And Word Error Rates, Sarah Zelikovitz, Orit D. Gruber

Open Educational Resources

In this lab you will be using the speech recognition program in Windows. After the initial training session, you will proceed to conduct experiments to evaluate the accuracy of the speech program.

At the end of this lab, you will be able to answer the following questions:

What is the purpose of speech recognition programs ?

• What are some applications of speech recognition programs ?

• What is the metric to evaluate speech recognition programs?

• What parameters are used to test speech recognition programs?

Communication Challenges In Underwater Wireless Networks: Mac Protocols And Software Solutions, Dmitrii Dugaev

Dissertations, Theses, and Capstone Projects

Underwater wireless networks (UWNs) represent a diverse and intriguing research domain, encompassing a wide array of scientific and industrial applications. This dissertation delves into the communication challenges at the Medium Access Control (MAC) layer within UWNs, stemming from the distinctive signal propagation conditions and the harshness of the deployment environment. The manuscript provides comprehensive coverage of key aspects of UWNs, including potential applications, communication protocols, methodologies employed in such networks, and existing software solutions that facilitate simulation, emulation, and real testbed scenarios for underwater research endeavors. Furthermore, this research introduces innovative software and communication solutions designed to facilitate the seamless …

The Potential Of The Implementation Of Offline Robotic Programming Into Automation-Related Pedagogy, Max Rios Carballo, Xavier Brown

Publications and Research

In this study, the offline programming tool RoboDK is used to program industrial robots for the automation sector. The study explores the feasibility of using this non-disruptive robot programming software for classroom use; assesses how well RoboDK can be used to program various robots used in the industry; creates and tests various applications; and pinpoints technical obstacles that prevent a smooth link between offline programming and actual robots. Initial results indicate that RoboDK is an effective tool for deploying its offline programming code to a Universal Robot, UR3e. There are many potential for advanced applications. The goal of the project …

Introducing Ros-Projects To Undergraduate Robotic Curriculum, Lili Ma, Yu Wang, Chen Xu, Xiaohai Li

Publications and Research

This paper describes three MATLAB-ROS-based simulation projects developed for an undergraduate robotics course. The Robot Operating System (ROS) is an open-source framework that helps researchers and developers build and reuse code between robotics applications. Adoption of ROS in the undergraduate curricula is still rare due to its demanding requirements of C++/Python/Java programming skills and familiarity with Linux. Recently, MathWorks released its ROS Toolbox, making it easier to interact with simulators like the Gazebo and ROS-supported physical robots. The MATLAB-ROS-Gazebo simulation platform allows students to utilize other MATLAB Toolboxes, such as Image Processing, Computer Vision, Visualization, and Navigation Toolboxes, for fast …

Development Of A Raspberry Pi-Controlled Vex Robot For A Robotics Technology Course, Lili Ma, Justin Bartholomew, Yu Wang, Xiaohai Li

Publications and Research

This paper describes the development of a Raspberry PI-controlled VEX robot for an undergraduate robotic course. The Raspberry PI controls the mobile base built using the VEX robotics kit without using the Cortex micro-controller that comes with the kit. The aim is to create a physical robot that is manageable, easily replicable, and capable of performing advanced robotic control tasks such as vision-based control.

The constructed robot adopts the great features of the PI and the VEX hardware. Firstly, the VEX hardware consists of various sensors and actuators for students to practice the construction and assembly of an autonomous robot. …

Robotic Inspection And Data Analytics To Localize And Visualize The Structural Defects Of Civil Infrastructure, Jinglun Feng

Dissertations and Theses

Ground Penetrating Radar (GPR) serves as a significant nondestructive evaluation (NDE) technique to inspect and survey underground objects (e.g., rebars, utility pipes) in complex urban environments. In addition to GPR, visual-based surface defect detection plays a crucial role in assessing and maintaining civil infrastructure. To facilitate deployment on a robotic platform and enhance inspection capabilities, the integration of GPR and visual-based sensors, such as RGB-D cameras, is crucial to obtain accurate subsurface and surface information. This thesis presents a novel robotic-based inspection system for the efficient collection of NDE data and accurate 3D reconstruction of both subsurface and surface infrastructure …

Automated Robotic Light Bulb Testing Platform, Agha I. Akram, Muhammad Ali Ummy

Publications and Research

The main purpose of this project is to create a functional prototype of a multilayered system that incorporates aspects of electrical, mechanical, and computer engineering technology. The main objective of the system is to be able to determine whether a light bulb is working or not. The building blocks of this system are a robotic arm that is able to slide along a rail (for added mobility), a conveyor belt, and an electromechanical device that holds and tests light bulbs. Initially, the robot arm picks up a light bulb and places it into the holder which then tests it. A …

Design And Control Of Quasi-Direct Drive Actuation For Lightweight And Versatile Wearable Robots, Shuangyue Yu

Dissertations and Theses

Wearable robots have shown great potential for augmenting the physical capabilities of humans in lab settings. However, wearable robots for augmenting the physical capabilities of humans under community-based conditions are the new frontier of robotics. Furthermore, the design and control are still considered to be grand challenges for providing physical augmentation for humans. In terms of design, the state-of-the-art exoskeletons are typically rigid, bulky, and limited to lab settings. In terms of control, most of the rhythmic controllers are not versatile and are focused only on steady-state walking assistance.

The motivation behind my research is to improve both the design …

High Energy And Power Density Peptidoglycan Musclesthrough Super-Viscous Nanoconfined Water, Haozhen Wang, Zhi-Lun Liu, Jianpei Lao, Sheng Zhang, Rinat Abzalimov, Tong Wang, Xi Chen

Advanced Science Research Center

Water-responsive (WR) materials that reversibly deform in response to humidity changes show great potential for developing muscle-like actuators for miniature and biomimetic robotics. Here, it is presented that Bacillus (B.) subtilis’ peptidoglycan (PG) exhibits WR actuation energy and power densities reaching 72.6 MJ m−3 and 9.1 MW m−3, respectively, orders of magnitude higher than those of frequently used actuators, such as piezoelectric actuators and dielectric elastomers. PG can deform as much as 27.2% within 110 ms, and its actuation pressure reaches ≈354.6 MPa. Surprisingly, PG exhibits an energy conversion efficiency of ≈66.8%, which can be attributed to its super-viscous nanoconfined …

3d Bionic Arm, Anny Baez Silfa

Publications and Research

Previous work had been done on what was an adaptation of a robotic arm for Roboqueen, which is a persistent research project of the Department of Computer Engineering Technology. This robotic arm consisted of removing the cardboard hands from the Roboqueen and being replaced by 3D printed fingers and wrists to add functionality that did not exist before. Servo motors connected to Arduinos hidden in the forearm will be used to move the fingers and pick up and hold objects in the hand. Currently, the Finger Myoware is an update of the robotic arm in order to understand how prosthetic …

Child Detection System For Preventing Hot-Car Death, Touheda Khanom, Fahmeda Khanom

Publications and Research

According to the Safety Organization Kids and Cars, an average of 38 children die each year from hot cars due to lack of attention from parents. Existing alert system uses sensors that detect child presence and care less about detecting temperature inside the car. In order to save children from heatstroke, our research focuses on providing information about the temperature inside the car using very effective sensors with high precision. In our research, we have tested different sensors and figured out three sensors that can provide precise information about the presence of a child without an adult. Our child detection …

Inverse Kinematics Of The 6dof C12xl, Carl Liu, Lili Ma

Publications and Research

Industrial robotic manipulators are widely used in applications such as pick & place, welding, and assembly to perform repeated tasks in replace of human labor. Such tasks typically require fully autonomous mechanical arms that are capable of identifying the parts to operate, path planning, and trajectory generation & tracking. A robotic arm consists of a sequence of rigid links connected by movable components (the joints). Proper control of the arm’s motion requires the knowledge of inverse kinematics, which computes/outputs the joint variables, i.e., angles for revolute joints and displacement for prismatic joints, causing the robotic arm’s end effector (e.g., gripper, …

Cooperative Target Tracking In Concentric Formations, Lili Ma

Publications and Research

This paper considers the problem of coordinating multiple unmanned aerial vehicles (UAVs) in a circular formation around a moving target. The main contribution is allowing for versatile formation patterns on the basis of the following components. Firstly, new uniform spacing control laws are proposed that spread the agents not necessarily over a full circle, but over a circular arc. Uniform spacing formation controllers are proposed, regulating either the separation distances or the separation angles between agents. Secondly, the use of virtual agents is proposed to allow for different radii in agents’ orbits. Thirdly, a hierarchical combination of formation patterns is …

The Law Of Black Mirror - Syllabus, Yafit Lev-Aretz, Nizan Packin

Open Educational Resources

Using episodes from the show Black Mirror as a study tool - a show that features tales that explore techno-paranoia - the course analyzes legal and policy considerations of futuristic or hypothetical case studies. The case studies tap into the collective unease about the modern world and bring up a variety of fascinating key philosophical, legal, and economic-based questions.

Tech Policy And Legal Theory Syllabus, Yafit Lev-Aretz, Nizan Packin

Open Educational Resources

Technology has changed dramatically over the last couple of decades. Currently, virtually all business industries are powered by large quantities of data. The potential as well as actual uses of business data, which oftentimes includes personal user data, raise complex issues of informed consent and data protection. This course will explore many of these complex issues, with the goal of guiding students into thinking about tech policy from a broad ethical perspective as well as preparing students to responsibly conduct themselves in different areas and industries in a world growingly dominated by technology.

Cooperative Target Tracking In Balanced Circular And Elliptical Formations, Lili Ma, Naira Hovakimyan

Publications and Research

This paper extends our earlier results on cooperative target tracking in cyclic pursuit using a group of mobile robots by further prescribing the formation radius and achieving an elliptical formation pattern. Prescribing the formation radius of a balanced circular formation is achieved by adjusting a parameter in the existing control input to each robot. The new elliptical formation pattern is obtained via a transformation matrix. Both single-integrator and double-integrator robot models are considered. The effectiveness of the proposed schemes is demonstrated by simulation examples.

Artificial Intelligence And Game Theory Controlled Autonomous Uav Swarms, Janusz Kusyk, M. Umit Uyar, Kelvin Ma, Eltan Samoylov, Ricardo Valdez, Joseph Plishka, Sagor E. Hoque, Giorgio Bertoli, Jefrey Boksiner

Publications and Research

Autonomous unmanned aerial vehicles (UAVs) operating as a swarm can be deployed in austere environments, where cyber electromagnetic activities often require speedy and dynamic adjustments to swarm operations. Use of central controllers, UAV synchronization mechanisms or pre-planned set of actions to control a swarm in such deployments would hinder its ability to deliver expected services. We introduce artificial intelligence and game theory based flight control algorithms to be run by each autonomous UAV to determine its actions in near real-time, while relying only on local spatial, temporal and electromagnetic (EM) information. Each UAV using our flight control algorithms positions itself …

V-Slam And Sensor Fusion For Ground Robots, Ejup Hoxha

Dissertations and Theses

In underground, underwater and indoor environments, a robot has to rely solely on its on-board sensors to sense and understand its surroundings. This is the main reason why SLAM gained the popularity it has today. In recent years, we have seen excellent improvement on accuracy of localization using cameras and combinations of different sensors, especially camera-IMU (VIO) fusion. Incorporating more sensors leads to improvement of accuracy,but also robustness of SLAM. However, while testing SLAM in our ground robots, we have seen a decrease in performance quality when using the same algorithms on flying vehicles.We have an additional sensor for ground …

Hardware Implementation Of Assistive Technology Robot, Joycephine Li

Publications and Research

SuperHERO is an on-going research project in Computer Engineering Technology department which involves upgrading Heathkit Education Robot (HERO) hardware circuits and features by using modern hardware devices and sensors. The current phase of the project will focus on upgrading the motor drive system hardware as well as implementation and testing of features such as mobile robot obstacle detection and other assistive technologies to help people with disabilities. This involves the reattachment of the robot arm after repairing and updating with 3D printing and using modern hardware and software technology. We observed that the robotic arm has rotary and translation movements …

Self-Driving Toy Car Using Deep Learning, Fahim Ahmed, Suleyman Turac, Mubtasem Ali

Publications and Research

Our research focuses on building a student affordable platform for scale model self-driving cars. The goal of this project is to explore current developments of Open Source hardware and software to build a low-cost platform consisting of the car chassis/framework, sensors, and software for the autopilot. Our research will allow other students with low budget to enter into the world of Deep Learning, self-driving cars, and autonomous cars racing competitions.

3d Printed Smart Mobile, Bingfang Chen

Publications and Research

The goal of this research project is to design and build a prototype of a smart mobile robot to participate and compete in IEEE Micro-mouse and similar competitions. The robot has to find its way out of a maze as quickly as possible, by exploring and learning the paths in the maze. 3D printing technology will be used to build a lightweight robot frame so that it can move at a fast speed.

Unsupervised Feature Learning For Point Cloud By Contrasting And Clustering With Graph Convolutional Neural Network, Ling Zhang

Dissertations and Theses

Recently, deep graph neural networks (GNNs) have attracted significant attention for point cloud understanding tasks, including classification, segmentation, and detection. However, the training of such deep networks still requires a large amount of annotated data, which is both expensive and time-consuming. To alleviate the cost of collecting and annotating large-scale point cloud datasets, we propose an unsupervised learning approach to learn features from unlabeled point cloud ”3D object” dataset by using part contrasting and object clustering with GNNs. In the contrast learning step, all the samples in the 3D object dataset are cut into two parts and put into a …

A Dexterous, Glove-Based Teleoperable Low-Power Soft Robotic Arm For Delicate Deep-Sea Biological Exploration, Brennan T. Phillips, Kaitlyn P. Becker, Shunichi Kurumaya, Kevin C. Galloway, Griffin Whittredge, Daniel M. Vogt, Clark B. Teeple, Michelle H. Rosen, Vincent A. Pieribone, David F. Gruber, Robert J. Wood

Publications and Research

Modern marine biologists seeking to study or interact with deep-sea organisms are confronted with few options beyond industrial robotic arms, claws, and suction samplers. This limits biological interactions to a subset of “rugged” and mostly immotile fauna. As the deep sea is one of the most biologically diverse and least studied ecosystems on the planet, there is much room for innovation in facilitating delicate interactions with a multitude of organisms. The biodiversity and physiology of shallow marine systems, such as coral reefs, are common study targets due to the easier nature of access; SCUBA diving allows for in situ delicate …

Enhancing 3d Visual Odometry With Single-Camera Stereo Omnidirectional Systems, Carlos A. Jaramillo

Dissertations, Theses, and Capstone Projects

We explore low-cost solutions for efficiently improving the 3D pose estimation problem of a single camera moving in an unfamiliar environment. The visual odometry (VO) task -- as it is called when using computer vision to estimate egomotion -- is of particular interest to mobile robots as well as humans with visual impairments. The payload capacity of small robots like micro-aerial vehicles (drones) requires the use of portable perception equipment, which is constrained by size, weight, energy consumption, and processing power. Using a single camera as the passive sensor for the VO task satisfies these requirements, and it motivates the …

A Hands-On Robotics Concentration Curricula In Engineering Technology Programs, Andy S. Zhang, Angran Xiao, Yu Wang, Farrukh Zia, Muhammad Ummy

Publications and Research

This paper discusses the creation of a robotic concentration with four courses to meet the industry demands for qualified graduates in product design and services. Advances in computer technology and electronics have created a new field called mechatronics. Nowadays almost all high tech products are mechatronics in nature. Products such as automotive subsystems (such as anti-lock braking systems and automatic steering systems), medical devices, environmental monitoring systems, service and surgical robots are all mechatronic products. The robotic concentration focus on one of the most popular and visible area of mechatronics: robotics. The creation of the four courses: Embedded Systems Fundamentals, …