Open Access. Powered by Scholars. Published by Universities.®

Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 9 of 9

Full-Text Articles in Engineering

Autopath: Harnessing Parallel Execution Paths For Efficient Resource Allocation In Multi-Stage Big Data Frameworks, Han Gao, Zhengyu Yang, Janki Bhimani, Teng Wang, Jiayin Wang, Ningfang Mi, Bo Sheng Dec 2016

Autopath: Harnessing Parallel Execution Paths For Efficient Resource Allocation In Multi-Stage Big Data Frameworks, Han Gao, Zhengyu Yang, Janki Bhimani, Teng Wang, Jiayin Wang, Ningfang Mi, Bo Sheng

Zhengyu Yang

Due to the flexibility of data operations and scalability of in-memory cache, Spark has revealed the potential to become the standard distributed framework to replace Hadoop for data-intensive processing in both industry and academia. However, we observe that the built-in scheduling algorithms in Spark (i.e., FIFO and FAIR) are not optimized for the applications with multiple parallel and independent branches in stages. Specifically, the child stage needs to wait and collect data from all its parent branches, but this wait has no guaranteed upper bound since it is tightly coupled with each branch’s workload characteristic, stage order, and their corresponding …


Robust Distributed Scheduling Via Time Period Aggregation, Shih-Fen Cheng, John Tajan, Hoong Chuin Lau Dec 2015

Robust Distributed Scheduling Via Time Period Aggregation, Shih-Fen Cheng, John Tajan, Hoong Chuin Lau

Shih-Fen Cheng

In this paper, we evaluate whether the robustness of a market mechanism that allocates complementary resources could be improved through the aggregation of time periods in which resources are consumed. In particular, we study a multi-round combinatorial auction that is built on a general equilibrium framework. We adopt the general equilibrium framework and the particular combinatorial auction design from the literature, and we investigate the benefits and the limitation of time-period aggregation when demand-side uncertainties are introduced. By using simulation experiments on a real-life resource allocation problem from a container port, we show that, under stochastic conditions, the performance variation …


Robust Distributed Scheduling Via Time Period Aggregation, Shih-Fen Cheng, John Tajan, Hoong Chuin Lau Dec 2015

Robust Distributed Scheduling Via Time Period Aggregation, Shih-Fen Cheng, John Tajan, Hoong Chuin Lau

Shih-Fen Cheng

In this paper, we evaluate whether the robustness of a market mechanism that allocates complementary resources could be improved through the aggregation of time periods in which resources are consumed. In particular, we study a multi-round combinatorial auction that is built on a general equilibrium framework. We adopt the general equilibrium framework and the particular combinatorial auction design from the literature, and we investigate the benefits and the limitation of time-period aggregation when demand-side uncertainties are introduced. By using simulation experiments on a real-life resource allocation problem from a container port, we show that, under stochastic conditions, the performance variation …


Robust Distributed Scheduling Via Time Period Aggregation, Shih-Fen Cheng, John Tajan, Hoong Chuin Lau Dec 2015

Robust Distributed Scheduling Via Time Period Aggregation, Shih-Fen Cheng, John Tajan, Hoong Chuin Lau

Shih-Fen CHENG

In this paper, we evaluate whether the robustness of a market mechanism that allocates complementary resources could be improved through the aggregation of time periods in which resources are consumed. In particular, we study a multi-round combinatorial auction that is built on a general equilibrium framework. We adopt the general equilibrium framework and the particular combinatorial auction design from the literature, and we investigate the benefits and the limitation of time-period aggregation when demand-side uncertainties are introduced. By using simulation experiments on a real-life resource allocation problem from a container port, we show that, under stochastic conditions, the performance variation …


Patient-Centered Appointment Scheduling Using Agent-Based Simulation, Tammy Toscos, Ayten Turkcan, Brad Doebbeling Dec 2015

Patient-Centered Appointment Scheduling Using Agent-Based Simulation, Tammy Toscos, Ayten Turkcan, Brad Doebbeling

Tammy R Toscos

Enhanced access and continuity are key components of patient-centered care. Existing studies show that several interventions such as providing same day appointments, walk-in services, after-hours care, and group appointments, have been used to redesign the healthcare systems for improved access to primary care. However, an intervention focusing on a single component of care delivery (i.e. improving access to acute care) might have a negative impact other components of the system (i.e. reduced continuity of care for chronic patients). Therefore, primary care clinics should consider implementing multiple interventions tailored for their patient population needs. We collected rapid ethnography and observations to …


Green Scheduling For Radiant Systems In Buildings, Truong X. Nghiem, Madhur Behl, George J. Pappas, Rahul Mangharam Jan 2013

Green Scheduling For Radiant Systems In Buildings, Truong X. Nghiem, Madhur Behl, George J. Pappas, Rahul Mangharam

Truong X Nghiem

In this report we look at the problem of peak power reduction for buildings with electric radiant floor heating systems. Uncoordinated operation of a multi-zone radiant floor heating system can result in temporally correlated electricity demand surges or peaks in the building’s electricity consumption. As peak power prices are 200-400 times that of the nominal rate, this uncoordinated activity can result in high electricity costs and expensive system operation. We have previously presented green scheduling as an approach for reducing the aggregate peak power consumption in buildings while ensuring that indoor thermal comfort is always maintained. This report extends the …


Green Scheduling For Radiant Systems In Buildings, Truong X. Nghiem, Madhur Behl, George J. Pappas, Rahul Mangharam Oct 2012

Green Scheduling For Radiant Systems In Buildings, Truong X. Nghiem, Madhur Behl, George J. Pappas, Rahul Mangharam

Madhur Behl

In this report we look at the problem of peak power reduction for buildings with electric radiant floor heating systems. Uncoordinated operation of a multi-zone radiant floor heating system can result in temporally correlated electricity demand surges or peaks in the building’s electricity consumption. As peak power prices are 200-400 times that of the nominal rate, this uncoordinated activity can result in high electricity costs and expensive system operation. We have previously presented green scheduling as an approach for reducing the aggregate peak power consumption in buildings while ensuring that indoor thermal comfort is always maintained. This report extends the …


Green Scheduling For Radiant Systems In Buildings, Truong Nghiem, Madhur Behl, George Pappas, Rahul Mangharam Oct 2012

Green Scheduling For Radiant Systems In Buildings, Truong Nghiem, Madhur Behl, George Pappas, Rahul Mangharam

Rahul Mangharam

In this report we look at the problem of peak power reduction for buildings with electric radiant floor heating systems. Uncoordinated operation of a multi-zone radiant floor heating system can result in temporally correlated electricity demand surges or peaks in the building’s electricity consumption. As peak power prices are 200-400 times that of the nominal rate, this uncoordinated activity can result in high electricity costs and expensive system operation. We have previously presented green scheduling as an approach for reducing the aggregate peak power consumption in buildings while ensuring that indoor thermal comfort is always maintained. This report extends the …


Two-Step Optimal Thermal Generation Scheduling, B Fardanesh, F. Eugenio Villaseca Jul 2012

Two-Step Optimal Thermal Generation Scheduling, B Fardanesh, F. Eugenio Villaseca

F. Eugenio Villaseca

A new approach to the solution of the optimal thermal generation scheduling problem is presented. The problem is solved in two steps. As a first step, the optimal production schedule for the next day is obtained based on a daily load forecast, reserve capacity requirements, and present status of generating units. The second-step algorithm uses the results of the first step and adjusts the previous schedule to meet new constraints developed during the course of the day. Variable truncation dynamic programming is proposed as a new method to reduce computation effort. To eliminate the need for solving the entire problem …