Education Commons^™

The Performance Of The Linear Logistic Test Model When The Q-Matrix Is Misspecified: A Simulation Study, George T. Macdonald

USF Tampa Graduate Theses and Dissertations

A simulation study was conducted to explore the performance of the linear logistic test model (LLTM) when the relationships between items and cognitive components were misspecified. Factors manipulated included percent of misspecification (0%, 1%, 5%, 10%, and 15%), form of misspecification (under-specification, balanced misspecification, and over-specification), sample size (20, 40, 80, 160, 320, 640, and 1280), Q-matrix density (60% and 46%), number of items (20, 40, and 60 items), and skewness of person ability distribution (-0.5, 0, and 0.5). Statistical bias, root mean squared error, confidence interval coverage, confidence interval width, and pairwise cognitive components correlations were computed. The impact …

Making College Count: An Examination Of Quantitative Reasoning Activities In Higher Education, Louis M. Rocconi, Amber D. Lambert, Alexander C. Mccormick, Shimon A. Sarraf

Numeracy

Findings from national studies along with more frequent calls from those who employ college graduates suggest an urgent need for colleges and universities to increase opportunities for students to develop quantitative reasoning (QR) skills. To address this issue, the current study examines the relationship between the frequency of QR activities during college and student and institutional characteristics, as well as whether students at institutions with an emphasis on QR (at least one QR course requirement for all students) report more QR activity. Results show that gender, race-ethnicity, major, full-time status, first-generation status, age, institutional enrollment size, and institutional control are …

The Relationship Between Rating Scales Used To Evaluate Tasks From Task Inventories For Licensure And Certification Examinations, Adrienne W. Cadle

USF Tampa Graduate Theses and Dissertations

The first step in developing or updating a licensure or certification examination is to conduct a job or task analysis. Following completion of the job analysis, a survey validation study is performed to validate the results of the job analysis and to obtain task ratings so that an examination blueprint may be created. Psychometricians and job analysts have spent years arguing over the choice of scales that should be used to evaluate job tasks, as well as how those scales should be combined to create an examination blueprint. The purpose of this study was to determine the relationship between individual …

The Problem Of Too Many Statistical Tests: Subgroup Analyses In A Study Comparing The Effectiveness Of Online And Live Lectures, David M. Lane

Numeracy

The more statistical analyses performed in the analysis of research data, the more likely it is that one or more of the conclusions will be in error. Multiple statistical analyses can occur when the sample contains several subgroups and the researchers perform separate analyses for each subgroup. For example, separate analyses may be done for different ethnic groups, different levels of education, and/or for both genders. Media reports of research frequently omit information on the number of subgroup analyses performed thus leaving the reader with insufficient information to assess the validity of the conclusions. This article discusses the problems with …

Quantitative Reasoning Learning Progressions For Environmental Science: Developing A Framework, Robert L. Mayes, Franziska Peterson, Rachel Bonilla

Numeracy

Quantitative reasoning is a complex concept with many definitions and a diverse account in the literature. The purpose of this article is to establish a working definition of quantitative reasoning within the context of science, construct a quantitative reasoning framework, and summarize research on key components in that framework. Context underlies all quantitative reasoning; for this review, environmental science serves as the context.In the framework, we identify four components of quantitative reasoning: the quantification act, quantitative literacy, quantitative interpretation of a model, and quantitative modeling. Within each of these components, the framework provides elements that comprise the four components. The …

An Analysis Of Factor Extraction Strategies: A Comparison Of The Relative Strengths Of Principal Axis, Ordinary Least Squares, And Maximum Likelihood In Research Contexts That Include Both Categorical And Continuous Variables, Kevin Barry Coughlin

USF Tampa Graduate Theses and Dissertations

This study is intended to provide researchers with empirically derived guidelines for conducting factor analytic studies in research contexts that include dichotomous and continuous levels of measurement. This study is based on the hypotheses that ordinary least squares (OLS) factor analysis will yield more accurate parameter estimates than maximum likelihood (ML) and principal axis factor anlaysis (PAF); the level of improvement in estimates will be related to the proportion of observed variables that are dichotomized and the strength of communalities within the data sets.

To achieve this study's objective, maximum likelihood, ordinary least squares, and principal axis factor extraction models …

Translation, Adaptation And Invariance Testing Of The Teaching Perspectives Inventory: Comparing Faculty Of Malaysia And The United States, Jecky Misieng

USF Tampa Graduate Theses and Dissertations

As a result of growing attention in cross-cultural research, existing measurement instruments developed in one language are being translated and adapted for use in other languages and cultural contexts. The benefits of having the same instrument across cultures can only be realized if the process of translation and adaptation of the measurement instruments produces measurement operations that function similarly across national and cultural boundaries. Producing invariant measurement instruments that assess educational and psychological constructs provide a way of testing the cross-cultural generality of theories that include these constructs.

The major purposes of the study were to translate and adapt the …

Effectiveness Of Propensity Score Methods In A Multilevel Framework: A Monte Carlo Study, Aarti P. Bellara

USF Tampa Graduate Theses and Dissertations

Propensity score analysis has been used to minimize the selection bias in observational studies to identify causal relationships. A propensity score is an estimate of an individual's probability of being placed in a treatment group given a set of covariates. Propensity score analysis aims to use the estimate to create balanced groups, akin to a randomized experiment. This study used Monte Carlo methods to examine the appropriateness of using propensity score methods to achieve balance between groups on observed covariates and reproduce treatment effect estimates in multilevel studies. Specifically, this study examined the extent to which four different propensity score …

Reading Assessment Practices Of Elementary General Education Teachers: A Descriptive Study, Sarah Mirlenbrink Bombly

USF Tampa Graduate Theses and Dissertations

In this descriptive study, I researched five elementary general education teachers' reading assessment practices as they worked within the context of IDEA (2004), NCLB (2002) and Response to Intervention (RTI). My own connection to the classroom and reading assessment practices brought me to this research. I presented my personal and professional connection through vignettes about my own classroom assessment practices. Relevant literature on both the context and culture of assessment were pertinent to this research.

I used a qualitative design, specifically, Colaizzi's (1978) method of phenomenological analysis. Data were three in-depth phenomenological interviews, relevant documents and artifacts, and use of …

Value-Added And Observational Measures Used In The Teacher Evaluation Process: A Validation Study, Claudia Güerere

USF Tampa Graduate Theses and Dissertations

Scores from value-added models (VAMs), as used for educational accountability, represent the educational effect teachers have on their students. The use of these scores in teacher evaluations for high-stakes decision making is new for the State of Florida. Validity evidence that supports or questions the use of these scores is critically needed. This research, using data from 2385 teachers from 104 schools in one school district in Florida, examined the validity of the value-added scores by correlating these scores with scores from an observational rubric used in the teacher evaluation process. The VAM scores also were examined in relation to …

Perceptions Of Workplace Mentoring Behaviors For Lifelong Career Development, Lynne A. Key

USF Tampa Graduate Theses and Dissertations

This study's purpose was to investigate the importance of mentoring functions and behaviors for lifelong career development as perceived by protégés. The population included individuals in middle to late adulthood (age 40 years and older) who reported they had been a protégé in at least one mentoring association perceived as beneficial to their lifelong career development; and were either employed or had been employed as a middle manager, senior manager, C-level executive, business owner, or member of a profession. The sample was obtained using a chain-sample method; 67 Ambassadors completed an online survey and each invited 10 contacts to complete …