Education Commons^™

An Instrumental Case Study Of Confirmative Evaluation In The Continuous Improvement Of Online Remote Leaders’ Work, Chad Lawrence Mclane

STEMPS Theses & Dissertations

Confirmative evaluation is often noted as an important element of models of Human Performance Technology and Performance Improvement, but there exists confusion around what is and what is not confirmative evaluation. A significant issue limiting the use of confirmative evaluation is the Performance Improvement field’s inability to clearly classify confirmative evaluation in terms of its purpose and scope. Additionally, the performance improvement field lacks sufficient examples of confirmative evaluation in the literature necessary to adequately define confirmative evaluation and demonstrate its use. Without sufficient examples of confirmative evaluation, practitioners of performance improvement are left without a clear path of how …

Factors Promoting And Inhibiting The Practice Of Needs Assessment By Human Performance Practitioners, Christopher D. Adams

STEMPS Theses & Dissertations

Needs assessment is an essential activity for human performance improvement practitioners. This qualitative study employed the critical incident technique to determine factors, encountered by practitioners during needs assessment, which promote or inhibit successful needs assessment by exploring practitioners work across 50 incidents. Using extreme cases representing practitioners’ most and least successful needs assessment experiences allowed participants to recall rich detail of their process and the context in which they were working. Participants were also asked to reflect on what criteria they used to select most and least successful examples. From that basis, the study explored three research questions and associated …

An Exploration Of Professional Preparedness Of Instructional Designers To Evaluate, Philena V. Devaughn

STEMPS Theses & Dissertations

Formative, summative, and confirmative evaluation of instructional products determine whether learner objectives have been attained and substantiate the value of the instruction. The ability to implement an evaluation plan is classified as an essential skill for instructional designers by the International Board of Standards for Training and Performance Improvement (IBSTPI). Previous research has ascertained that entry-level instructional designers have failed to master the skills required to create evaluation plans.

The purpose of this qualitative study was to examine the professional preparation received by instructional designers, for instruction evaluation, through graduate level programs. The data collected for this study was the …

The Correlation Between The National Survey Of Student Engagement Indicators And First Year Student Achievement, Satisfaction, And Retention, Larry Peck

STEMPS Theses & Dissertations

The purpose of this study was to determine if the National Survey of Student Engagement indicators (NSSE), High-Impact Practices, demographic variables and non-involvement factors can significantly predict student achievement, satisfaction, and retention. The sample included data from 493 freshmen from a large public university in the Southeastern United States who participated in the National Survey of Student Engagement in 2015 and 2016. This study seeks to benefit instructional designers, educators, and educational institutions to maximize their resources and efforts to achieve maximum achievement, retention, and satisfaction.

The study concluded that achievement is highly correlated with higher-order learning, learning strategies, effective …

The Influence Of Multimedia Production Knowledge On The Design Decisions Of The Instructional Designer, Stephen Brent Hoard

STEMPS Theses & Dissertations

This study explored the interaction of multimedia production competencies of expert and novice instructional designers on the design decisions made during the instructional design process / workflow. This multiple measures study used qualitative survey instruments to access and measure the production competencies of participants, then a design aloud protocol to capture and measure the instructional design decision-making process for those same participants. A follow-on interview after the initial design aloud session was conducted in order to triangulate and confirm any trends or findings uncovered during the earlier design aloud session. Ultimately, the objective of this study was to provide some …

Factors Influencing The Selection Of Academic Help Sources, Joan Giblin

STEMPS Theses & Dissertations

This study extends the literature on academic help-seeking by identifying factors influencing undergraduate students’ selection of a source of help. Learners engage in intentional decisions to seek help from human and non-human sources to resolve gaps in knowledge. Decision making heuristics provide a theoretical lens to understand these intentional decisions. Previous research in academic help-seeking assumed learners sought only human sources of assistance, resulting in a narrow understanding of how learners resolve knowledge gaps. Methodological trends in help-seeking research consistently favor quantitative, survey based tools with pre-defined options. As a result, the factors that influence the selection of a source …

Elaboration And Question Strategy Effect On Learning Outcomes And Cognitive Load, Julie Ann Bridges

STEMPS Theses & Dissertations

The purpose of this study was to investigate the effects of instructor-created elaborations, learner-created elaborations and adjunct questions on learning outcomes in an asynchronous learning environment, using pre-recorded video. The study also investigated the effects of instructor-created elaborations, learner-created elaborations, or adjunct questions on perceived cognitive load. The effect of learning strategy on quality of elaboration was also investigated. Results showed no significant difference in learning outcomes or cognitive load or quality of elaboration, but a post-hoc analysis revealed a significant difference in intrinsic cognitive load for students who used generative strategies while having no gain in learning outcomes.

Defining The Competencies, Programming Languages, And Assessments For An Introductory Computer Science Course, Simon Sultana

STEMPS Theses & Dissertations

The purpose of this study was to define the competencies, programming languages, and assessments for an introductory computer science course at a small private liberal arts university. Three research questions were addressed that involved identifying the competencies, programming languages, and assessments that academic and industry experts in California’s Central Valley felt most important and appropriate for an introduction to computer science course.

The Delphi methodology was used to collect data from the two groups of experts with various backgrounds related to computing. The goal was to find consensus among the individual groups to best define aspects that would best comprise …

Effects Of Learner-To-Learner Interactions On Social Presence, Achievement And Satisfaction, Susan Elizabeth Allred Oyarzun

STEMPS Theses & Dissertations

The relationships between learner-to-learner interactions, achievement, social presence, and satisfaction in online learning have varying degrees of strength according to the research. More evidence is needed to identify clarify relationships among these variables and to identify best practices for designing learner-to-learner interactions to increase achievement, level of social presence, and learner satisfaction. This non-experimental, comparative study investigated the strategies used for learner-to-learner interactions effects on achievement, social presence, and satisfaction. Surveys measuring social presence and interaction quality were administered to instructors and students enrolled in 17 undergraduate asynchronous online courses. The surveys for instructors and students were the same, except …

Program Standards For Establishing High Quality Postsecondary Trade And Industrial Education Programs, Beno Rubin

STEMPS Theses & Dissertations

The problem of this study was to develop standards that can be used as a basis for establishing high quality postsecondary trade and industrial education programs. There were two research objectives. These included: developing a set of program standards to be used to establish high quality postsecondary trade and industrial education programs and developing descriptors that can be used to assess achievement of high quality postsecondary trade and industrial education programs.

The Delphi technique was chosen for this study to generate consensus regarding the program standards. The panel of experts, comprised of postsecondary administrators of trade and industrial programs, was …

Priming Middle School Females’ Engagement In Engineering And Technology, Mary Bonk Isaac

STEMPS Theses & Dissertations

The purpose of this study was to validate data collected between 2009-2013 via an instrument used to assess middle school girls’ identification with and interest in engineering and technology following the Society of Women Engineers’ WOW events. Recognizing the importance of measuring the impact of such mentored E & T activities on young females’ attitudes about and interest in STEM, and more specifically, engineering and technology, SWE outreach experts developed a participant survey based on event objectives and domain knowledge, but never rigorously examined whether it produced statistically valid data that could be used to draw inferences about girls’ propensity …

The Effects Of Student Engagement On Retention: Comparing Male Undergraduate Stem Majors To Non-Stem Majors, Tourgee D. Simpson Jr.

STEMPS Theses & Dissertations

Researchers suggest certain benchmarks of student engagement (i.e., student-faculty interaction, level of academic challenge, enriching educational experiences, active and collaborative learning, and supportive campus environment) positively influence student success. This study investigated the relationship between student engagement and the retention of male, full-time undergraduate students in STEM majors by comparing male, full-time undergraduate students in select science, technology, engineering, and math (STEM) majors to male, full-time undergraduate students in non-STEM majors to identify best practices to improve retention and increase degree completion among men in STEM fields.

Students were invited to participate in the National Survey of Student Engagement (NSSE). …

Prompting Self-Monitoring Of Learning In Self-Paced Computer Based Training: The Effect On Self-Regulation And Learning, Christopher J. Coburn

STEMPS Theses & Dissertations

The purpose of this dissertation was to investigate the effects of prompting students to monitor their use of learning strategies and comprehension while completing self-paced, work-related training in a computer-based learning environment. Study participants included 94 enlisted military volunteers, randomly assigned to one of three groups in the spring of 2012. Changes in strategy use and comprehension were evaluated within and between groups receiving either immediate, delayed or no prompts using multiple methods of measurement, both during and after training. Prompts asked participants to rate their level of agreement to statements regarding their strategy use and comprehension of lesson content. …

Community Of Inquiry Framework And Learning Outcomes, Jennifer Ann Maddrell

STEMPS Theses & Dissertations

First described by Garrison, Anderson, and Archer (2000), the Community of Inquiry (CoI) framework suggests social presence, teaching presence, and cognitive presence are essential elements to foster successful educational experiences in computer-mediated higher education distance learning environments. While hundreds of CoI-based articles have been published since 2000, those critical of the framework and related research suggested a lack of empirical evidence to support the framework's central claim that a CoI leads to deep and meaningful learning outcomes (Rourke & Kanuka, 2009). The current study, conducted with 51 graduate students in five distance education courses at the same university, compared the …

Effectiveness Of The Combat Operational Stress Control Training Program: Expectations Of The U.S. Marine Corps, Marek M. Sipko

STEMPS Theses & Dissertations

This study evaluated the effectiveness of the U.S. Marine Corps combat operational stress preventive training program to determine whether the program meets the training effectiveness criteria of the Marine Corps. This evaluation entailed both qualitative and quantitative inquiries to answer the subject matter research questions.

The participants consisted of active duty and reserve Marines on active duty. For the purposes of the quantitative analysis, the researcher obtained a random sample of 480 Marines. Additionally, the researcher obtained a purposefully stratified qualitative sample of 12 active duty Marines consisting of four junior non-commissioned Marines, four staff non-commissioned officers, and four commissioned …

The Effect Of Technology Education On Student's State Standardized Test Scores, Maurice Torrez Frazier

STEMPS Theses & Dissertations

The intent of this dissertation was to determine if technology education program completers score higher on academic standards assessments than do students who do not enroll in technology education courses. Many states have developed academic standards for public school students to measure the quality of the educational system. States and local school systems adopted these standards and their accompanying tests to establish a level of academic competency for all of their students. One of the goals of technology education courses was to provide practical applications to reinforce the content of the core subject areas. The purpose of this study was …