Systems Engineering Commons^™

Machine Learning In Requirements Elicitation: A Literature Review, Cheligeer Cheligeer, Jingwei Huang, Guosong Wu, Nadia Bhuiyan, Yuan Xu, Yong Zeng

Engineering Management & Systems Engineering Faculty Publications

A growing trend in requirements elicitation is the use of machine learning (ML) techniques to automate the cumbersome requirement handling process. This literature review summarizes and analyzes studies that incorporate ML and natural language processing (NLP) into demand elicitation. We answer the following research questions: (1) What requirement elicitation activities are supported by ML? (2) What data sources are used to build ML-based requirement solutions? (3) What technologies, algorithms, and tools are used to build ML-based requirement elicitation? (4) How to construct an ML-based requirements elicitation method? (5) What are the available tools to support ML-based requirements elicitation methodology? Keywords …

Presenting To Senior Decision Makers: Clear, Concise & Complete, Kirk Michealson

Operations Management Presentations

Your manager just assigned you to lead a new project for your Vice President. You have many questions! What are the details of the project? What does the VP want to see in briefings? Does the VP have an advocate for pre-briefs? What information is important to include in the presentation? How detailed should the information be? How should the information be presented? Are there any best practices in developing presentations? In this webinar, you will learn strategies for sharing important information with key stakeholders in your career – and how to actually get them to listen!

On Valuing Biopharmaceutical Product Pipelines: An Effectuation Model And Evidence, Mark J. Ahn, Anne S. York, Wei Wu, Yulianto Suharto, Tugrul Unsal Daim

Engineering and Technology Management Faculty Publications and Presentations

New creative approaches are needed to manage emerging biotechnology innovations, regulations, and payor environments to enhance product pipeline productivity, valuation, and risk management. Biopharmaceutical firms must make dynamic resource allocation decisions on their relative levels of internal R&D and external strategic alliances in furthering their pipelines. As the predominant method of using discounted cash flow (DCF) methodologies may lead to chronic underinvestment and performance, we evaluated the integration of traditional DCF with an effectuation model of analysis. Unlike traditional financial models that begin with the end goal of assumed known cash flows and recursively solve for portfolio optimization, the effectuation …

A Decision Analysis Framework For Evaluation Of Helmet Mounted Display Alternatives For Fighter Aircraft, Matthew R. Dansereau

Theses and Dissertations

The promise of providing an intuitive and efficient information interface, while allowing the warfighter to perform other critical tasks such as targeting or aircraft control, has led to the growing popularity of Helmet Mounted Displays (HMDs) across the military landscape, especially combat aircraft. Though design and selection of competing systems is critical to optimized performance and safety, structured methods for the evaluation of HMDs are not often used in the acquisition community, leaving selection among alternative designs to the judgment of subject matter experts. However, technical decision-making has been shown to be flawed without the use of a structured decision …

Epistemic Uncertainty Analysis: An Approach Using Expert Judgment And Evidential Credibility, Patrick Hester

Engineering Management & Systems Engineering Faculty Publications

When dealing with complex systems, all decision making occurs under some level of uncertainty. This is due to the physical attributes of the system being analyzed, the environment in which the system operates, and the individuals which operate the system. Techniques for decision making that rely on traditional probability theory have been extensively pursued to incorporate these inherent aleatory uncertainties. However, complex problems also typically include epistemic uncertainties that result from lack of knowledge. These problems are fundamentally different and cannot be addressed in the same fashion. In these instances, decision makers typically use subject matter expert judgment to assist …

The Optimization Of The Threshold For The Preventive Maintenance Actions In A Condition-Based Maintenance Program Via Dynamic Programming Approach, Kamran Shahanaghi, Mehdi Jafarian, Majid Beikverdi, Zeinab Nezhadbiglari

Mehdi Jafarian

The last step of a condition based maintenance (CBM) program is maintenance decision-making. This step is the most important and the most critical stage of maintenance for executive personnel and management whom work on taking maintenance actions. This decision making would be done according to certain criteria such as risk, cost, reliability and availability. This paper considered a dynamic programming model to optimization of the threshold for the preventive maintenance actions in a condition-based maintenance program. The basis of this modeling is the average cost of maintenance actions, failures and exchanges. In this paper, we improved the memory of the …

Extending The Strategy Based Risk Model Using The Delphi Method: An Application To The Validation Process For Research And Developmental (R&D) Satellites, Amanda J. Langenbrunner, Mary R. Trautwein

Theses and Dissertations

The validation between a research and developmental satellite and its ground system is critical to ensuring the success on-orbit. However, the exact process for completing validation is not documented, frequently underfunded, and accomplished ad hoc. This leads to debate regarding maintenance of budget and schedule, while ensuring on-orbit success. This thesis examines readiness and on-orbit activities within the U.S. Air Force Space Development and Test Wing's Research Development Test and Evaluation Support Complex. Combining historical data with the consultation of subject matter experts, a validation process was defined. Risks associated with this process were then analyzed using the Strategy Based …

Value-Driven Enterprise Architecture Score: Evaluation Applied To Joint Force Protection Future State Design, Larry D. Cotton, Gary A. Haase

Theses and Dissertations

This research presents a methodology to evaluate the quality of a system's architecture using principles drawn from Value-Focused Thinking (VFT) and resulting in a Value-Driven Enterprise Architecture Score (VDEA-Score). This is an overall numerical architecture quality score useful to a system's management team to identify the advantages and disadvantages of a system design and associated architecture documentation or to track its quality across discrete evaluation epochs. This effort determined which aspects of the architecture are most valuable to the stakeholder in the areas of (1) the system effectiveness values (quality of the instantiated system being represented and its ability to …

Developing A Decision Model For Joint Improvised Explosive Device Defeat Organization (Jieddo) Proposal Selection, Lyle M. Dawley, Lenore A. Marentee, Alice Marie Long

Theses and Dissertations

This research uses decision analysis to develop a structured, repeatable and most importantly defensible decision model for the evaluation of proposed IED defeat solutions submitted to the Joint IED Defeat Organization (JIEDDO). Additive value models using Value-Focused Thinking (VFT) and the Analytic Hierarchy Process (AHP) are examined as possible methodologies. VFT is determined to be the "best fit" for JIEDDO's decision situation in which proposals are submitted continuously and must be scored independently of previous proposals. VFT is first used to determine desirable qualities in IED defeat options, and then to generate a hierarchal value model to evaluate these qualities …

A Decision Tool To Evaluate Budgeting Methodologies For Estimating Facility Recapitalization Requirements, Krista M. Hickman

Theses and Dissertations

The purpose of this research was to develop a decision tool to assist in the evaluation of facility recapitalization budget estimation models to determine which model was best suited for a particular organization. Specifically, this thesis sought to answer an overarching research question addressing the importance of recapitalization and the best method to estimate the facility recapitalization budget using the Department of Defense (DoD) as the subject of the research. A comprehensive literature review revealed ten existing recapitalization model alternatives to consider for implementation. The methodology used to develop a decision tool was based on the Value Focused Thinking (VFT) …

Selecting Electricity Generation Sources In Remote Locations, Kelly E. Kwan

Theses and Dissertations

The purpose of this research was to investigate the impact of using a decision analysis technique for the selection of an electrical generation system for remote locations. Specifically, this thesis sought to answer five research questions addressing the types of energy sources used in remote locations, the decision-making processes used to identify these sources, the types of constraints incorporated in such a process, other valued factors, and their level of importance in relation to each other. The research questions were answered through a comprehensive literature review and the 10-Step Value-Focused Thinking Process on a specific case study in the National …

The Optimization Of The Threshold For The Preventive Maintenance Actions In A Condition-Based Maintenance Program Via Dynamic Programming Approach, Mehdi Jafarian, Majid Beikverdi, Kamran Shahanaghi, Zeinab Nezhadbiglari

Mehdi Jafarian

The last step of a condition based maintenance (CBM) program is maintenance decision-making. This step is the most important and the most critical stage of maintenance for executive personnel and management whom work on taking maintenance actions. This decision making would be done according to certain criteria such as risk, cost, reliability and availability. This paper considered a dynamic programming model to optimization of the threshold for the preventive maintenance actions in a condition-based maintenance program. The basis of this modeling is the average cost of maintenance actions, failures and exchanges. In this paper, we improved the memory of the …

Reverse Decision Making And Goal Attainment A Proof Of Concept As A New Approach To The Decision Making Process Under Uncertainty, Shitalkumar S. Sabne

Engineering Management & Systems Engineering Theses & Dissertations

Decision making occurs when one must choose among alternatives. However, in uncertain environments where problems are complex and decision makers lack complete knowledge of the situation as well as decision alternatives, it's not possible for them to select an optimal decision outcome by 'Traditional Decision Approaches'. At present Reverse Decision Making is the central, although new and unproved, approach of Old Dominion University's Engineering Management and Systems Engineering research on decision making process for uncertain and complex situations. Even though research in decision making spans over one hundred years, there are still important problems which remain to be addressed.

There …

Neuro-Physiologically-Driven Adaptive Automation To Improve Decision Making Under Stress, Michael C. Dorneich, Patricia May Ververs, Stephen D. Whitlow, Santosh Mathan, James Carciofini, Trent Reusser

Michael C. Dorneich

The advent of netted communications and a wide array of battlefield sensors is enabling real-time information streaming and asset management. However, the burden of information management is placed solely on the receiver of the information. Honeywell Laboratories developed a Communications Scheduler (CoS), an adaptive information management system for the dismounted Soldier, driven by an assessment of the individual's current cognitive capacity to process incoming information, in order to improve decision making under high task load conditions. An evaluation was conducted to demonstrate whether cognitive capacity to perform under differing task loads could be detected using neuro-physiological sensors and then if …

Assessing The Usefulness Of The Decision Framework For Identifying And Selecting Knowledge Management Projects, Kevin G. Budai

Theses and Dissertations

Knowledge management (KM) is becoming recognized as a valuable tool for the Department of Defense (DoD) in its effort to maintain a competitive, strategic advantage against its enemies in a new threat environment. Decision superiority is the ultimate end result and is only possible through the effective and efficient use of its chief key resource--knowledge. As the Air Force seeks to transform the way it does business the concept of knowledge management has made its way to the forefront of both the Air Force's Information Strategy and Information Resource Flight Plan. This research assesses the usefulness of a knowledge management …

Using Value-Focused Thinking To Evaluate The Effectiveness Of Air Force Utility Privatization, Carlos Braziel

Theses and Dissertations

The majority of the Air Force s stateside utility systems are old, obsolete, and unreliable. The cost to upgrade and repair these systems is currently estimated at over $4 billion. In response, the Air Force began efforts to convey ownership of these utility systems to the private sector through privatization efforts. However, privatization critics believe that newly privatized entities of government will cost the public more money and provide a lower level of service. Therefore, independent audits are a necessity to ensure government initiatives, meet their intended goals. However, the Air Force currently lacks an effective auditing tool to ensure …

The Application Of Value Focused Thinking To Utilities Privatization Source Selection, J. Heath Duncan

Theses and Dissertations

The Department of Defense's utility systems have suffered from under-funding and lack of technology investment, thereby creating a service gap between these DoD systems and systems operated by commercial providers. In order to overcome this gap and refurbish their systems, the DoD has focused its efforts on privatization of these systems. The utilities privatization decision is extremely vital and permanent and thus warrants backup source selection methodologies. Since awarding contracts in the utilities privatization arena requires a decision considering tradeoffs between multiple competing objectives, a value-focused thinking approach was used to create a structured, standardized value model taking into account …

Influence Of Feedback And Comment Labels On Information Sharing In A Computer Mediated Collaborative Environment, Gary D. Denney

Theses and Dissertations

A group support system (GSS) uses a combination of networked personal computers, software, and human facilitation to improve the group decision-making process. Group support Systems are being used in the Air Force today in a variety of capacities and in particular by the Warner-Robins Air Logistics Center (WR-ALC) to assess acquisition risks. Prior GSS research has found that certain structural and social dimensions of GSS designs might influence whether optimal process improvements take place. However, the dimensions that positively influence group performance have continued to be a matter of debate. This thesis looked at several structural and social contingencies to …

The Effects Of Extraneous Presentation Graphics On Decision Making, Thomas S. Tingley

Theses and Dissertations

Almost every professional presentation includes some form of graphics. Many previous researchers have analyzed the relative effectiveness of graphical decision aids, such as pie charts or bar graphs. Very little research, however, has been conducted to determine the effects of extraneous graphics, such as pictures and logos, on decision making. This study employed an experiment to determine whether extraneous graphics hinder or enhance a decision maker's ability to obtain the pertinent information from a professional presentation. Other factors such as gender and graphics training were also analyzed for any influence on the results obtained. The results of the study indicated …

A Nonlinear Dynamic Method For Supporting Large-Scale Decision-Making In Uncertain Environments, Wayne Woodhams

Engineering Management & Systems Engineering Theses & Dissertations

This research developed a methodology for supporting decision making by reducing uncertainty in decision environments which are too large, dynamic and complex to be treated by traditional quantitative and simulation techniques. These environments are complex because of the free choice associated with human involvement, and the existence of a large number of interrelated factors which influence the outcomes of the decision process. They are dynamic because the ground rules affecting those interrelationships are constantly changing. Uncertainty cannot be treated probabilistically, since identification of a full set of outcomes and factors of influence is not possible.

The venue for the investigation …

A Study Of Similarity And Analogical Decision-Making In Collaborative Design, Christopher Edward Weeks

Engineering Management & Systems Engineering Theses & Dissertations

The purpose of this study is to investigate the role of similarity and analogy in design communication and propose a descriptive representation of the analogical decision-making process in the context of engineering design. It is proposed that social, cultural, and contextual knowledge are brought to bear on statements of need in the form of analogy as a means to elicit and evince potential design solutions. A goal of this study is to identify communicative behaviors, representing process variables of analogical decision-making, that can be used to describe how design information is represented, manipulated, and conveyed in a collaborative design effort. …