Education Commons^™

Assessment Of Method Effects Of Keying And Wording In Instruments: A Mixed-Methods Explanatory Sequential Study, Lin Ma

Electronic Theses and Dissertations

This dissertation presents an innovative approach to examining the keying method, wording method, and construct validity on psychometric instruments. By employing a mixed methods explanatory sequential design, the effects of keying and wording in two psychometric assessments were examined and validated. Those two self-report psychometric assessments were the Effortful Control assessment (Ellis & Rothbart, 2001) and the Grit assessment (Duckworth & Quinn, 2009). Moreover, the quantitative phase utilized structural equation modeling to analyze 2,104 students’ responses and assess the construct of keying and wording. Various hypothetical models were investigated and evaluated. The reliability of each construct in each method was …

Mis-Specification Of Functional Forms In Growth Mixture Modeling: A Monte Carlo Simulation, Richa Ghevarghese

Electronic Theses and Dissertations

Growth mixture modeling (GMM) is a methodological tool used to represent heterogeneity in longitudinal datasets through the identification of unobserved subgroups following qualitatively and quantitatively distinct trajectories in a population. These growth trajectories or functional forms are informed by the underlying developmental theory, are distinct to each subgroup, and form the core assumptions of the model. Therefore, the accuracy of the assumed functional forms of growth strongly influences substantive research and theories of growth. While there is evidence of mis-specified functional forms of growth in GMM literature, the weight of this violation has been largely overlooked. Current solutions to circumvent …

Digital Searching: A Grounded Theory Study On The Modern Search Experience, Nicolas Armando Parés

Electronic Theses and Dissertations

This Grounded theory study explores US adults' modern information search process as they pursue information through digital search user interfaces and tools. To study the current search process, a systematic grounded theory methodology and two data collection methods, a think-aloud protocol and semi-structured interviews, are used to develop the theory. The emerging theory addressed two tightly connected research questions that asked, “What is the process by which humans search and discover information?” and “What is the process by which search and discovery interfaces and tools support the modern search process?”

The study collects participant data from US adults who have …

Estimation Of Treatment Effects With Multilevel Observational Data Using Deep Neural Networks, Logistic Regression, And Multilevel Modeling: A Propensity Score Approach, Neba Nfonsang

Electronic Theses and Dissertations

This study used a propensity score approach to estimate treatment effects in a multilevel setting. The propensity score approach involves the estimation of propensity scores for covariate balancing and the estimation of treatment effects. This study aimed at understanding how propensity scores estimated through a simple logistic regression compare with propensity scores estimated through an optimized deep neural networks model. The study also examined how treatment effects estimated with propensity score weights from logistic regression compare with treatment effects estimated with propensity score weights from deep neural networks.

Few causal studies have been conducted in a multi-level setting with observational …

Engagement And Development Of Professional Skills Among Low-Income, High-Achieving Students: A Structural Equation Model, Nasser Alresaini

Electronic Theses and Dissertations

This dissertation tested the effect of academic engagement and social engagement on developing soft professional skills for low-income, high-achieving students in higher education. Using the publicly available data of GMS scholarship, the analysis was consisted of EFA and SEM. The general effect model gave a general idea about the tested population, whereas the conditional model highlighted the groups' specific significance. Low-income, high-achieving students continued their academic and social engagement growth during their school years. Academic engagement positively enhanced students' soft professional skills for students who did not receive the GMS scholarship, students from educated and uneducated parents, Asian and Hispanic …

Moving Past ‘One Size Fits All’: Developing A Trajectory Deviance Index For Dynamic Measurement Modeling, Yixiao Dong

Electronic Theses and Dissertations

Dynamic Measurement Modeling (DMM) is a recently developed measurement framework for gauging developing constructs (e.g., learning capacity) that conventional single-timepoint tests cannot assess. Like most measurement models, overall model fit indices of DMM do not indicate the measurement appropriateness for each included student. For this reason, other measurement modeling paradigms (e.g., Item-Response Theory; IRT) utilize person-fit or model appropriateness statistics to indicate whether a measurement model appropriately describes the data from each individual student. However, within the extant DMM framework, no statistical index has yet been developed for this purpose. Thus, the current project advanced a person-specific DMM Trajectory Deviance …

Statistical Modeling Of Positive Peer Support On Longitudinal Adolescent Substance Use, Kady Rost

Electronic Theses and Dissertations

To evaluate this study’s research question of ”Does the latent construct of Positive Peer Support (PPS) relate to the construct of Adolescent Substance Use (ASU) over time, controlling for neighborhood safety, race, and sex?”, Structural Equation (SEM) and Latent Growth Curve Modeling (LGCM) were used to investigate trajectories. Secondary longitudinal data from Zimmerman (2014) of 604 students enrolled for four consecutive years in public schools located in Flint, Michigan. In the secondary data resource, students who participated were declared “at risk” by GPA. Significant relationships were found in SEM: Positive Peer Support to Adolescent Substance Use, All Control Variables to …

A Grounded Theory Inquiry Into The Pedagogical Socialization Of Graduate Students Within Graduate Quantitative Methods Courses, Amanda Kay Thomas

Electronic Theses and Dissertations

Quantitative methods are one of the most highly technical fields of study within social sciences graduate programs. Although classroom pedagogy is an important factor connected to student success within graduate quantitative methods courses little is known on the pedagogical socialization experiences of masters and doctoral students. The purpose of this grounded theory inquiry was to discover graduate students perspectives on their pedagogical socialization experiences and the norms, values and role expectations transmitted during the teaching and learning of quantitative methods. Narrative data was collected from in-depth interviews among a theoretical sample of 31 masters and doctoral students enrolled in introductory, …

Social Support Among Undergraduate Students: Measure Development And Validation, Heather M. Blizzard

Electronic Theses and Dissertations

Being born into circumstances of low-income, having a racial minority status, and/or non-college educated families dwindle the opportunities for many students to obtain a college degree (Cox, 2016; Engle & Tinto, 2008; Jenkins et al., 2013). While many institutions of higher education have diligently worked to develop programs geared towards attending the educational inequalities among diverse student populations, there is still a great need for programs centered on the inequalities surrounding social support (Cox, 2016; Ward et al., 2012; Soria & Stebleton, 2012).

The purpose of this study was to develop and assess a measure to examine perceived social support …

Assessing Robustness Of The Rasch Mixture Model To Detect Differential Item Functioning - A Monte Carlo Simulation Study, Jinjin Huang

Electronic Theses and Dissertations

Measurement invariance is crucial for an effective and valid measure of a construct. Invariance holds when the latent trait varies consistently across subgroups; in other words, the mean differences among subgroups are only due to true latent ability differences. Differential item functioning (DIF) occurs when measurement invariance is violated. There are two kinds of traditional tools for DIF detection: non-parametric methods and parametric methods. Mantel Haenszel (MH), SIBTEST, and standardization are examples of non-parametric DIF detection methods. The majority of parametric DIF detection methods are item response theory (IRT) based. Both non-parametric methods and parametric methods compare differences among subgroups …

How 6-12th Grade Staff Support Students With Depression: A Pilot Study To Develop Measures Of Implicit Associations, Explicit Attitudes And Helping Behavior, Paul M. Thompson

Electronic Theses and Dissertations

Students with emotional disabilities are disproportionately suspended and expelled in K-12 schools. Attribution theory suggests individuals are less likely to provide assistance to others if they believe the individuals are responsible for their own difficulties. To test attribution theory, this study created new measures of explicit attitudes and implicit associations of licensed 6-12th grade staff regarding students with depression as well as a helping behavior measure of staff toward students with depression. The survey was distributed within a single school district in the western United States. A majority of the sample (N = 52) held a mental health license (60%), …

Is A Picture Worth A Thousand Numbers? An Exploration Of Understanding And Recall Of Data Presentations, Holly L. Roof

Electronic Theses and Dissertations

This dissertation reports results of a study with a quasi-randomized experimental component and a protocol analysis, or think aloud, component. The experimental component was designed to determine if people with no statistical training and people with some statistical training differed in their understanding and recollection of statistical information with varying degrees of complexity. Information was presented using data visualization techniques based on cognitive theory and compared to presentations using APA-style numerical tables of statistical output. The focus was on using empirically-supported graphical displays in PowerPoint presentations such as one might see at a research conference. Classroom groups of beginning and …

A Comparison Of Bayesian Estimation Techniques In A Multidimensional Two-Parameter Partial Credit Item Response Model, Peiyan Liu

Electronic Theses and Dissertations

Bayesian estimation methods have shown better performance than the traditional Marginal Maximum Likelihood (MML) estimation method for parameter estimation in relatively simple item response models. However, extant literature is lacking on the investigation of Bayesian parameter estimation approaches for a multidimensional two parameter partial credit (M2PPC) model, therefore this simulation study investigated the performance of two Bayesian Markov Chain Monte Carlo (MCMC) algorithms: Gibbs Sampler and Hamiltonian Monte Carlo-No-U-Turn-Sampler (HMC-NUTS) for M2PPC models' parameter estimation. It compared the estimation accuracy and computing speed in different combinations of situations, including prior choices, test lengths, and the relationships between dimensions.

The datasets …

Latent Growth Curve And Latent Change Score Modeling Of Developmental Relationships Between Executive Functioning And Math Achievement In Early Elementary School, Kerry-Ann Lewis Pearcy

Electronic Theses and Dissertations

The current study compared latent growth curve (LGC) models and latent change score (LCS) models capabilities in modeling complex data in a development framework. Using the nationally representative ECLS-K:2011 dataset, LGC and LCS models explored the dynamic relationship between executive function and math achievement. The relationship between the two constructs has been extensively examined but little is understood about their dynamic relationship. The findings of this study indicated LCS to be more robust than LGC in modeling complex data and in examining dynamic relationship. The findings also suggested that one of the two executive functioning tasks, Dimensional Change Card Sort …

Assessment Of Multiple-Form Structure Designs Of Multistage Testing Using Irt, Hanan M. Alghamdi

Electronic Theses and Dissertations

The current study investigated multistage testing (MST) as an alternative to classical linear testing (CLT) for the General Aptitude Test (GAT). The aim was to assess the effects of two assembly methods (narrow vs. wide range—NR vs. WR), two routing methods (Defined Population Intervals—DPI— and the Approximate Maximum Information method—AMI), and two panel structures (two-stage and three-stage) on precision of ability estimates and accuracy of classification for both sections of the GAT (Verbal and Mathematics). Thus, eight conditions were examined and compared: 2 (assembly conditions) * 2 (panel structures) * 2 (routing methods).

The dataset that included a sample of …

Access To And Success Within High Ability Tracks In Title I Schools: The International Baccalaureate, Melissa Gordon

Electronic Theses and Dissertations

With a growing number of low-income students in the United States, it is critical to address persistent gaps in educational attainment. This study examined the postsecondary enrollment rates of students in Title I schools offering high academic ability tracks such as the International Baccalaureate Diploma Programme (IBDP) and explored access to these high ability tracks. Results indicate that the IBDP is available to low-income and minority students in Title I schools, although their participation rates were much lower than the participation rates of the average Title I student body. Nevertheless, once students participate in the IBDP, race/ethnicity and income appear …

Factor Invariance Of The Standard Achievement Admission Test By Gender And School Types, Mohammed Alqabbaa

Electronic Theses and Dissertations

This study examined the factorial structure of the SAAT with exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Specifically, a CFA of a four-factor model (the hypothesized model) was tested to see if the model had good fit as well as a model generated from an EFA. The EFA showed that the SAAT test only measured two factors (biology and chemistry), not the four posited by the test developers. The CFA provided good fit to a two-factor model; however, a CFA showed that the hypothesized four-factor model also fit the data well and so the hypothesized model was selected …

A Comparison Of Latent Class Analysis And The Mixture Rasch Model: A Cross-Cultural Comparison Of 8th Grade Mathematics Achievement In The Fourth International Mathematics And Science Study (Timss-2011), Turker Toker

Electronic Theses and Dissertations

This study provides a comparison of the results of latent class analysis (LCA) and mixture Rasch model (MRM) analysis using data from the Trends in International Mathematics and Science Study - 2011 (TIMSS-2011) with a focus on the 8th-grade mathematics section. The research study focuses on the comparison of LCA with Mplus version 7.31 and MRM with WinMira 2011 to determine if results obtained differ when the assumed psychometric model differs. Also, a log-linear analysis was conducted to understand the interactions between latent classes identified by LCA and MRM. The data set used in the study was from four diverse …

A Reliability Generalization Study Of The Brief Symptom Inventory-18, Dareen Taha Alzahrani

Electronic Theses and Dissertations

Reliability generalization (RG) is a meta-analytic method that aims to assess the variability of test score reliability across studies and identify the sources of this variability. In this study, a reliability generalization analysis was performed on studies of the Brief Symptom Inventory-18 (BSI-18) to examine the variability in Cronbach's alpha reliability estimates reported in the literature. This inventory was chosen because of its extensive use in counseling and medical settings and documented reliability and validity. The database that was consulted to collect articles was PsycInfo. The reported Cronbach's alphas were obtained to assess whether defined moderator variables affected reliability estimates. …

A Comparison Between Propensity Score Matching, Weighting, And Stratification In Multiple Treatment Groups: A Simulation Study, Priyalatha Govindasamy

Electronic Theses and Dissertations

The application of propensity score techniques (matching, stratification, and weighting) with multiple treatment levels are similar to those used in binary groups. However, given that the application of propensity scores in multiple treatment groups is new, factors affecting the performance of matching, stratification, and weighting in multiple treatment groups are less explored. Therefore, this study was conducted to determine the performance of different propensity score techniques with multiple treatment groups under various circumstances. Specifically, the study focused on examining how the three propensity score corrective techniques perform in estimating treatment effects under (1) overt and (2) hidden types of selection …

Measuring Teachers' Knowledge And Use Of Data And Assessments: Creating A Measure As A First Step Toward Effective Professional Development, Courtney Vidacovich

Electronic Theses and Dissertations

Current teaching standards and practices are dictated, at least in part, by state- and district-mandated standardized tests. Yet, despite being surrounded by data, teachers receive only basic trainings on how to use assessments. In reality, teachers use data and assessments daily--even minute by minute--through the assessment process, which uses multiple data sources to make informed decisions on student learning and teaching practices. A measure was needed to understand how the policies and expectations from schools, districts, and states compare with actual classroom practices. The teachers Knowledge and Use of Data and Assessment (tKUDA) measure was designed to do just that. …

Development Of The Readiness To Teach Online Scale, Angel Chi

Electronic Theses and Dissertations

Despite the growing importance of online education, faculty acceptance has remained unchanged. Training programs developed for faculty to teach online have often focused on assessing their cognitive rather than affective and behavioral outcomes. The Readiness To Teach Online scale was developed as part of a multiphase mixed method research project to measure faculty perceptions and motivations toward teaching online. Items in the subcategory Teaching and Learning measured perceptions of technology and online teaching, and motivations regarding resources and other external factors. Items in the subcategories Social and Student Engagement, Faculty and Technology Support, Course Development and Instructional Design, and Evaluation …

Student Perceptions Of School Climate: A Validity And Data Use Study Of A District-Developed Survey, Mya L. Martin-Glenn

Electronic Theses and Dissertations

Over the past 25 years, researchers have consistently reported that students' perceptions of their school's climate can have a measurable impact on their level of engagement in school, motivation to learn, social development, and, ultimately, their academic achievement. In light of the continued emphasis on education reform and school accountability, the ability to accurately measure the learning environment, interpret the results from that measure, and then determine the appropriate course of action in addressing areas of concern has become increasingly important for school leaders. This dissertation used an embedded mixed methods design to examine one district's self-developed measure of their …

Through The Eyes Of Visitors: Understanding The Contexts Of The Visitor Photo Study At The Denver Museum Of Nature & Science, Kathryn Irene Schroeder

Electronic Theses and Dissertations

This case study describes the analysis of the Visitor Photo Study, a study in which visitors to the Denver Museum of Nature & Science documented their visit through pictures. The origins, implementation, and findings of the Visitor Photo Study are considered within the contexts of the fields of Community-Based Research (Strand, Marullo, Cutforth, Stoecker, & Donohue, 2003b), Visual Studies (Marshall & Rossman, 2011; Pink, 2007), and Visitor Studies (Visitor Studies Association, 2012). This study considers the extent to which the principles and elements of each of these fields were present in the Visitor Photo Study, which elements were not fully …

Development And Validation Of The Children's Social Competence Scale, Annette Irene Nuñez

Electronic Theses and Dissertations

Few scales exist that assess social competence in children with Asperger's and high functioning autism (AS/HFA). Due to the nature of the disorder, the current social competence measures that do exist are not designed to assess the social difficulties that many children with AS/HFA encounter. To meet this challenge a scale was developed to better understand social competence in children with AS/HFA, the Children's Social Competence Scale (CSCS). Two studies that report the development and initial validation of the scale were conducted with children between the ages of 3 and 8 with and without a diagnosis of AS/HFA. First, an …

Comprehensive Validation Of A Measure Of Student School Engagement: A Pilot Study Of Middle School Students, Emma Vazirabadi

Electronic Theses and Dissertations

Although it may sound reasonable that American education continues to be more effective at sending high school students to college, in a study conducted in 2009, The Council of the Great City Schools states that "slightly more than half of entering ninth grade students arrive performing below grade level in reading and math, while one in five entering ninth grade students is more than two years behind grade level...[and] 25% received support in the form of remedial literacy instruction or interventions" (Council of the Great City Schools, 2009). Students are distracted with technology (Lei & Zhao, 2005), family (Xu & …