Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research

Wayne State University

Keyword
Publication Year
Publication
Publication Type

Articles 31 - 60 of 64

Full-Text Articles in Education

Influence Of Target Population Misspecification On Employee Perceptions At A, Joe Lee Smith Jan 2014

Influence Of Target Population Misspecification On Employee Perceptions At A, Joe Lee Smith

Wayne State University Dissertations

Numerous researchers have conducted qualitative and quantitative studies examining employee perceptions related to changes in their work environment based upon management/top-down (deductive) communication of vision, mission, and envisioned organization goals Hofstede, Neuijen, Daval, Ohayv, & Sanders (1990), but research on the influence of subgroup/identity types on workforce perception is sparse Dutton, Dukerich, & Harquail (1994). Data on subgroup identification with the mission and strategic goals envisioned by management/administration is limited. Also limited is knowledge of the influence they have over their members, which places management at a disadvantage in planning strategic organization objectives Albert & Whetten, (1985). These subgroups have …


The Reliability And Validity Of The Thin Slice Technique: Observational Research On Video Recorded Medical Interactions, Tanina Suzanne Foster Jan 2014

The Reliability And Validity Of The Thin Slice Technique: Observational Research On Video Recorded Medical Interactions, Tanina Suzanne Foster

Wayne State University Dissertations

The Reliability and Validity of the Thin Slice Technique: Observational Research on Video Recorded Medical Interactions

Introduction: Observational research using the thin slice technique has been routinely incorporated in observational research methods, however there is limited evidence supporting use of this technique compared to full interaction coding. The purpose of this study was to determine if this technique could be reliability coded, if ratings are consistent between the first, second and third slice, and if they are indeed representative of full interactions.

Methods: Three 30-second thin slices were sampled from the beginning, middle and end of a full-length video-recorded …


A Case Study Of The Impact Of A Sytematic Evaluation Process In A Graduate Medical Education Residency Program, Heidi T. Kromrei Jan 2014

A Case Study Of The Impact Of A Sytematic Evaluation Process In A Graduate Medical Education Residency Program, Heidi T. Kromrei

Wayne State University Dissertations

The Accreditation Council for Graduate Medical Education has charged institutions that sponsor accredited Graduate Medical Education programs (residency and fellowship specialty programs) with overseeing implementation of mandatory annual program evaluation efforts to ensure compliance with regulatory requirements. Physicians receive scant, if any, training in program evaluation methodology. Human Performance Technology (HPT) offers models suitable for residency program evaluation as well as trained evaluators who are experts in evaluation. Leaders in the field of HPT have called for empirical studies to examine the impact of HPT models in a variety of contexts.

This single case study examined the impact of using …


Validity Of The Educator Evaluation Instrument In The State Of West Virginia, Carla Howe Jan 2014

Validity Of The Educator Evaluation Instrument In The State Of West Virginia, Carla Howe

Wayne State University Dissertations

In the state of West Virginia, the educator evaluation system was implemented in 2010 as part of a comprehensive system of support to increase teacher effectiveness and student learning. As part of the system, the Educator Evaluation Instrument was developed to measure teachers' effectiveness. This study was conducted to determine whether the Educator Evaluation Instrument was valid for use in measuring effectiveness.

A hierarchical confirmatory factor analysis (HCFA) was conducted on the scores from the demonstration year. The data were not normal, nor was good model fit established based on the current model. Because good model fit could not be …


Building Local Skills: The Multitrait-Multimethod Matrix In Practice, Anna Clara Gersh Jan 2014

Building Local Skills: The Multitrait-Multimethod Matrix In Practice, Anna Clara Gersh

Wayne State University Dissertations

The potential of expanding the evaluative skills of site-based practitioners is examined in a variety of educational enterprises by introducing a procedure to determine evidence for construct validity of measurement tools. The expectations of administrators of educational enterprises, including school day principals, administrators of after school and extended day programs, camps and other instructional settings to effectively collect and manage data is growing. Research skills are an important part of both accountability and improvement efforts which are frequently tied to funding. The multitrait-multimethod matrix (MTMM) (Campbell & Fiske, 1959) combined with the Sawilowsky I test (Sawilowsky, 2002) may provide a …


Assessment Practices Of Students With Learning Disabilities In Lebanese Private Schools: A National Survey, Rasha Elhage Jan 2014

Assessment Practices Of Students With Learning Disabilities In Lebanese Private Schools: A National Survey, Rasha Elhage

Wayne State University Dissertations

Education is intended to provide diverse students with the skills and competencies needed to enhance their lives (Salvia, Ysseldyke & Bolt, 2011). This includes assessment practices that enable teachers to identify students' current level of skills, their strength and weaknesses, target instruction at student's personal level, monitor student learning and progress and plan and conduct adjustments in instruction, and evaluate the extent to which students have met instructional goals. This study intended to discover, describe, and evaluate the assessment practices of teachers and administrators working with students with learning disabilities in Lebanese private schools via the Context, Input, Process and …


The Development Of A Survey To Analyze If The Hpv Vaccine Is Appropriate For School Aged Girls, Tiffany Faith Davis Jan 2014

The Development Of A Survey To Analyze If The Hpv Vaccine Is Appropriate For School Aged Girls, Tiffany Faith Davis

Wayne State University Theses

The Human Papilloma Virus also known as HPV is a sexually transmitted disease. This particular STD consists of genital warts and can lead to cervical cancer in women. A HPV vaccine, Gardisil has been developed to help prevent the transmission of this particular STD. The topic of this paper is to discuss whether the HPV vaccine should be required to administer among female girls and adolescents. Despite the fact that the HPV vaccine is a preventative method for contracting HPV, many parents are not eager to accept this as a required vaccine to be administered to their daughter. One of …


The Impact Of Nested Testing On Experiment-Wise Type I Error Rate, Jack Sawilowsky Jan 2014

The Impact Of Nested Testing On Experiment-Wise Type I Error Rate, Jack Sawilowsky

Wayne State University Dissertations

When conducting a statistical test the initial risk that must be considered is a Type I error, also known as a false positive. The Type I error rate is set by nominal alpha, assuming all underlying conditions of the statistic are met. Experiment-wise Type I error inflation occurs when multiple tests are conducted overall for a single experiment. There is a growing trend in the social and behavioral sciences utilizing nested designs. A Monte Carlo study was conducted using a two layer design. Five theoretical distributions and four real datasets taken from Micceri (1989) were used, each with five different …


Factors That Are Associated With Workkeys® Assessment Scores Of Inmates In Michigan Department Of Correction's Community And Employment Readiness Training Program And Michigan State Industries Program, Pamela S. Jackson Jan 2013

Factors That Are Associated With Workkeys® Assessment Scores Of Inmates In Michigan Department Of Correction's Community And Employment Readiness Training Program And Michigan State Industries Program, Pamela S. Jackson

Wayne State University Dissertations

Inmates face challenges in obtaining employment once they leave prison because many are undereducated and lack work skills. This study examined demographic and criminogenic variables of inmates in Michigan Department of Correction's (MDOC) Community and Employment Readiness Training (CERT) and Michigan State Industries (MSI) programs that were associated with their scores obtained on the WorkKeys® assessment test. MDOC uses the WorkKeys® to assess the gaps between inmates' current job readiness skill level and skills needed for various types of jobs upon release. There is no published literature comparing MDOC's Community and Employment Readiness Training (CERT) and Michigan State Industries (MSI) …


Content Learning And Identity Construction (Clic): A Framework To Strengthen African American Students’ Mathematics And Science Learning In Urban Elementary Schools, Maria Varelas, Danny B. Martin, Justine M. Kane Jan 2013

Content Learning And Identity Construction (Clic): A Framework To Strengthen African American Students’ Mathematics And Science Learning In Urban Elementary Schools, Maria Varelas, Danny B. Martin, Justine M. Kane

Teacher Education Faculty Publications

We present a theoretical framework that views learning as a process involving content learning (CL) and identity construction (IC). We view identities as lenses through which people make sense of, and position themselves, through stories and actions, and as lenses for understanding how they are positioned by others. As people become more (or less) central members of a disciplinary community (e.g., a science or mathematics classroom) and engage (or not) in various cultural practices, changes in identity and knowledge accompany changes in position and status. Identity construction (IC) and content learning (CL) share an important characteristic: they both involve meaning …


An Empirical Examination And Metaevaluation Of The Impact Evaluation Process, Anne Maechling Blake Jan 2013

An Empirical Examination And Metaevaluation Of The Impact Evaluation Process, Anne Maechling Blake

Wayne State University Dissertations

This dissertation empirically examines the Guerra-Lopez (2007a) Impact Evaluation Process (IEP), which is a prescriptive program evaluation model. Since there is no generally accepted process for arriving at final judgments about the usefulness, appropriateness, effectiveness, reliability, and validity of evaluation models, this study used a combination of approaches to begin to build a body of evidence about the effectiveness of the IEP. Primarily, the study used Stufflebeam's (2011) recently revised Program Evaluations Metaevaluation Checklist to examine the model. The Checklist is based on the Joint Committee on Standards for Educational Evaluation's (2010) Program Evaluation Standards. Fitzpatrick, Sanders, & Worthen (2011) …


Supporting The Growth Of Principals As Instructional Leaders: An Interpretive Study About The New Work Of School Leaders, Jeffrey Thomas Hillman Jan 2013

Supporting The Growth Of Principals As Instructional Leaders: An Interpretive Study About The New Work Of School Leaders, Jeffrey Thomas Hillman

Wayne State University Dissertations

This study explored the emerging context of elementary school principals as they engaged in the work of Instructional Leadership. Naturalistic Inquiry was adopted as a methodological framework to explore the unique perspectives and understandings of participants. Focus Group activities, surveys, small group interviews, and recursive ethnographic interviews were used to capture rich and descriptive representations of principal understandings. Research questions explored the experiences and conditions that participants identified as essential for their growth as Instructional Leaders. The concept of paradigm and the implications of system structures and hierarchies was investigated as it relates to the supporting conditions necessary for principal …


Descriptive Statistical Attributes Of Special Education Datasets, Valerie Felder Jan 2013

Descriptive Statistical Attributes Of Special Education Datasets, Valerie Felder

Wayne State University Dissertations

ABSTRACT

Descriptive Statistical Attributes of Special Education Data Sets

by

VALERIE FELDER

December 2013

Advisor: Dr. Shlomo Sawilowsky

Major: Educational Evaluation and Research

Degree: Doctor of Philosophy

Micceri (1989) examined the distributional characteristics of 440 large-sample achievement and psychometric measures. All the distributions were found to be nonnormal at alpha = .01. Micceri indicated three factors that might contribute to a non-Gaussian error distribution in the population. The first factor is subpopulations within a target population. The second factor is ceiling effects and the third factor is treatment effects that may change the location parameter, variability, or shape of the …


How To Produce Articulate Artists, Peter J. Barr Phd, Christine Reising Oct 2012

How To Produce Articulate Artists, Peter J. Barr Phd, Christine Reising

Mid-America College Art Association Conference 2012 Digital Publications

This twenty-minute Powerpoint presentation will describe the team-taught, year-long Foundations Core Concepts Program at Siena Heights University in Adrian, Michigan. It has been in place since 2006 and has successfully integrated a course previously called "Language of Art" (taught by an art historian) with hands-on studio assignments previously taught in a stand-alone design course (taught by a studio professor). We have found that this hybrid approach is extremely effective in developing sensitive and articulate art majors who are prepared to integrate design concepts into all of their artworks and to analyze and describe eloquently both personal and historical works of …


Estimating The Efficiency Of Michigan's Rural And Urban Public School Districts, Rita Ann Maranowski Jan 2012

Estimating The Efficiency Of Michigan's Rural And Urban Public School Districts, Rita Ann Maranowski

Wayne State University Dissertations

This study examined student achievement in Michigan public school districts to determine if rural school districts are demonstrating greater financial efficiency by producing higher levels of student achievement than school districts in other geographic locations with similar socioeconomics. Three models were developed using multiple regression analysis of student achievement for high school graduation rates and student proficiency rates for eleventh grade students in mathematics and English language arts as reported from the Michigan Merit Examination results. These models compared student achievement by geographic location which included a selection of 10 independent variables and a sample size of 496 Michigan public …


Robustness Of The Achievable Benchmark Of Care Method, Jeff Arthur Capobianco Jan 2012

Robustness Of The Achievable Benchmark Of Care Method, Jeff Arthur Capobianco

Wayne State University Dissertations

The Achievable Benchmark of Care Method is a process of care performance improvement measurement approach for identifying top performing healthcare providers. The purpose of this study was to investigate the robustness of the method. This was achieved by comparing the robustness of the standard ABC method, which uses the mean to calculate the benchmark, to versions of the ABC method where the mean was replaced with either a 5%, 10%, or 20% trimmed mean, a 15% Winsorized mean or the one-step Huber ø1.28 calculation. Monte Carlo simulations where conducted using publically available, Medicare process of care data. The mean was …


Miblsi Program Evaluuation Of Participatory Elementary Schools From 2003-20009, Marvin Gibbs Jan 2012

Miblsi Program Evaluuation Of Participatory Elementary Schools From 2003-20009, Marvin Gibbs

Wayne State University Dissertations

This dissertation details the use of the Program Evaluations Metaevaluation Checklist (PEMC), Stufflebeam, 1999, which is for performing final, summative metaevaluations. It is organized according to the Joint Committee Program Evaluation Standards. For each of the 30 standards the checklist includes 6 checkpoints drawn from the substance of the standard. It reports the use of the PEMC in evaluating the use of So, How Are We Doing? A MiBLSi Evaluation Study. The study shows that the PEMC could be a functional tool for a metaevaluation if modified for a specific evaluation. The results of the Kruskal- Wallis one way analysis …


The Dependent Samples T And Wilcoxon Sign Rank Maximum Test, Saverpierre Maggio Jan 2012

The Dependent Samples T And Wilcoxon Sign Rank Maximum Test, Saverpierre Maggio

Wayne State University Dissertations

A maximum test using the parametric dependent samples t-test and the non-parametric Wilcoxon sign rank test was created using a FORTRAN program and various subroutines of the International Mathematical and Statistical Libraries (IMSL, 1980). Two tailed critical values were derived from a mixed normal distribution. Critical values obtained were at the 0.05, 0.025, 0.01 and 0.005 alpha levels via sample sizes (n) 8 through 30, 45, 60, 90 and 120. Critical values were compared to values obtained through the application of the Bonferroni correction method. It was concluded that the Bonferroni is an unnecessary method. Findings of the study are …


The Effect Of Nonrandom Selection Of Clusters In A Two Stage Cluster Design, Jason Christopher Parrott Jan 2012

The Effect Of Nonrandom Selection Of Clusters In A Two Stage Cluster Design, Jason Christopher Parrott

Wayne State University Dissertations

Although not as efficient as simple random sampling, cluster sampling has been regarded as a valid sampling technique when the researcher is attempting to save cost. However in order to do so, it is necessary that random selection occurs in all stages of sampling. This simulation study examines purposeful selection of cluster sampling in the second stage of a two stage cluster design. Using Monte Carlo methods a simulation was conducted comparing the random selection of both stages of a two stage cluster sample to purposeful selection of the second stage of a two stage cluster sample. The study compares …


Planned Missingness Study Design: Two Methods To Developing The Study Survey Versions, E. Whitney G. Moore Jan 2012

Planned Missingness Study Design: Two Methods To Developing The Study Survey Versions, E. Whitney G. Moore

Kinesiology, Health and Sport Studies

A planned missingness data study design takes advantage of modern techniques for handling data missingness that is MCAR (Missing Completely at Random) and MAR (Missing at Random) (Brown, 2006; Enders, 2010). As modern data imputation techniques have improved, this study design option has become a powerful, cost-effective option for collecting the most data across the largest sample possible, while keeping the fatigue effect and expense of the study minimized (Little, 2010a, 2010b, 2012). The purpose of this guide is to provide an applied example for designing the surveys necessary when conducting a planned missingness research study design.


Tell Me More About It: A Query Into Intelligence Scores And Their Relations With Achievement And Problem Behavior, Alicia Mariana January Jan 2012

Tell Me More About It: A Query Into Intelligence Scores And Their Relations With Achievement And Problem Behavior, Alicia Mariana January

Wayne State University Dissertations

Research has demonstrated negative outcomes associated with significant childhood cognitive, behavioral, emotional, or academic problems. These associations may reflect the importance of cognitive skills for mediating social and emotional functioning, however the directions of these relations remain a point of contention. Additionally, most of the child research is based on early editions of the Wechsler Intelligence Scale for Children. Little attention has been given to examining the relations between behavioral adjustment, achievement, and IQ utilizing the Wechsler Intelligence Scale for Children (WISC-IV). The WISC-IV uses different subtests, index scores, and norms than its predecessors and has been described as being …


A Comparison Of The Effects Of Non-Normal Distributions On Tests Of Equivalence, Linda Ellington Jan 2011

A Comparison Of The Effects Of Non-Normal Distributions On Tests Of Equivalence, Linda Ellington

Wayne State University Dissertations

Statistical theory and its application provide the foundation to modern systematic inquiry in the behavioral, physical and social sciences disciplines (Fisher, 1958; Wilcox, 1996). It provides the tools for scholars and researchers to operationalize constructs, describe populations, and measure and interpret the relations between populations and variables (Weinbach & Grinnell, 1997; Wilcox, 1996). Given that the majority of real data analysis in the behavioral and social sciences is comprised of non-normally distributed data, it is important that researchers be aware of the effects of non-normal distributions on the probability of detecting equivalence between populations.

The present study examined the effects …


Reliability Generalization: Lapsus Linguae, Julie Marilyn Smith Jan 2011

Reliability Generalization: Lapsus Linguae, Julie Marilyn Smith

Wayne State University Dissertations

This study examines the proposed Reliability Generalization (RG) method for studying reliability. RG employs the application of meta-analytic techniques similar to those used in validity generalization studies to examine reliability coefficients. This study explains why RG does not provide a proper research method for the study of reliability, including describing how reliability is not a singular metric but a family of coefficients that are not interchangeable, along with other issues, such as sample and test administration. This research used Monte Carlo simulations designed to illustrate how the same instrument, administered repeatedly, can result in different reliability coefficients and to show …


Cultural Enrichment: Connecting African American Elementary Children To Academic Achievement, Deborah L. Winston Jan 2011

Cultural Enrichment: Connecting African American Elementary Children To Academic Achievement, Deborah L. Winston

Wayne State University Dissertations

A large, growing number of mis-educated American citizens are being produced by America's public schools. Many of these students are being funneled into the penal system shortly after dropping out of high school. This phenomenon is especially prevalent among African American male students, many of whom have withdrawn academically years prior to permanently dropping out of school. Additionally, to further underscore the importance of successfully educating African American students are the debilitating effects brought about after incarceration. About 4 million people in the United States, including 1.4 million Black men (13 percent of the adult male Black population) have currently …


Approximate Vs. Monte Carlo Critical Values For The Winsorized T-Test, Michael Lance Jan 2011

Approximate Vs. Monte Carlo Critical Values For The Winsorized T-Test, Michael Lance

Wayne State University Dissertations

Historically, it has been accepted practice for critical values for the Winsorized t test for independent samples to be based on adjusted degrees of freedom depending on the number of total non-Winsorized (approximate) values. Recently, a new such table of Winsorized critical values has been developed via approximate randomization by Monte Carlo simulation.

Based on eight common data distributions estimated from Psychology and Education along with the normal and five Mathematical distributions, these two tables of values were compared with respect to robustness to types I and II errors through Monte Carlo simulations for one and 10% Winsorized values per …


Validation Of The Organizational Culture Assessment Instrument: An Application Of The Korean Version, Yun Seok Choi, Minhee Seo, David Scott, Jeffrey J. Martin Mar 2010

Validation Of The Organizational Culture Assessment Instrument: An Application Of The Korean Version, Yun Seok Choi, Minhee Seo, David Scott, Jeffrey J. Martin

Kinesiology, Health and Sport Studies

The purpose of this study was to examine the psychometric properties of the Korean version of the Organizational Culture Assessment Instrument (OCAI) based on the Competing Values Framework (CVF). More specially, cultural equivalence between the Korean version and the original English version of the OCAI was evaluated using 39 bilingual Koreans. Next, a field test was conducted to examine scale reliability and construct validity of the Korean version of the OCAI using 133 organizational members from the Korean Professional Baseball League (KPBL). The findings indicate that the Korean version was successfully translated, items maintained the same meaning of the original …


Development And Validation Of A Measurement Scale To Analyze The Environment For Evidence-Based Medicine Learning And Practice By Medical Residents, Fangqiong Mi Jan 2010

Development And Validation Of A Measurement Scale To Analyze The Environment For Evidence-Based Medicine Learning And Practice By Medical Residents, Fangqiong Mi

Wayne State University Dissertations

A growing number of residency programs are instituting curricula to include the component of evidence-based medicine (EBM) principles and process. However, these curricula may not be able to achieve the optimal learning outcomes, perhaps because various contextual factors are often overlooked when EBM training is being designed, developed, and implemented. The purpose of the study was to develop and validate an instrument, the EBM Environment Scale, to analyze the environment for EBM learning and practice as perceived by medical residents.

The development of the EBM Environment Scale underwent the process of content domain identification, item generation, review by content experts …


An Analysis Of Linking Formative And Summative Evaluations For Program Advancement, Angela E. Carey Jan 2009

An Analysis Of Linking Formative And Summative Evaluations For Program Advancement, Angela E. Carey

Wayne State University Theses

The purpose of this study was to determine if there is a relationship between the functions of Formative Evaluations and the functions of Summative Evaluations in successful programs. The success of the individual programs was measured according to their own expectations as listed in their objective; that is if said objectives were met or exceeded. The study focused on the functions of each evaluation process which included Formative (Implementation) and Summative (Outcome; Impact and Cost Benefit) Evaluations. Data was collected from previous education based research studies provided by Wayne State University's Online Journal Library system. A correlation analysis was utilized …


Demystifying Survey Research: Practical Suggestions For Effective Question Design, Deborah H. Charbonneau Jan 2007

Demystifying Survey Research: Practical Suggestions For Effective Question Design, Deborah H. Charbonneau

Library Scholarly Publications

Objective ‐Recent research has yielded several studies helpful for understanding the use of the survey technique in various library environments. Despite this, there has been limited discussion to guide library practitioners preparing survey questions. The aim of this article is to provide practical suggestions for effective questions when designing written surveys.

Methods ‐Advice and important considerations to help guide the process of developing survey questions are drawn from a review of the literature and personal experience.

Results ‐Basic techniques can be incorporated to improve survey questions, such as choosing appropriate question forms and incorporating the use of scales. Attention should …


Gaining Options: A Mathematics Program For Potentially Talented At-Risk Adolescent Girls, Pamela Trotman Reid, Sally K. Roberts Apr 2006

Gaining Options: A Mathematics Program For Potentially Talented At-Risk Adolescent Girls, Pamela Trotman Reid, Sally K. Roberts

Teacher Education Faculty Publications

In response to indicators that a decline in interest in mathematics occurs among girls—particularly those from low-income and minority groups—during middle school, the GO-GIRL (Gaining Options: Girls Investigate Real Life) program was designed to help potentially talented at-risk girls. The program aimed to build mathematical confidence, skills, and conceptual understanding by integrating mathematics and social science research in a single-sex, technology-rich environment supported by university student mentors. The program targeted seventh-grade urban girls from public and private schools. Participants met over the course of ten Saturdays to learn research methods, computer skills, mathematics, and descriptive statistics. Quantitative data from the …