Education Commons^™

Cross-Cultural Adaptation Of The Inventory Of Reading Occupations-Adult Into Filipino And Its Content Validation, Peñafrancia E. Ching, Treisha Naedine H. Santos, Lenin Grajo, Maria Concepcion Cabatan, Anna Liza Y. Tan Pascual

The Open Journal of Occupational Therapy

Background: Adult functional literacy ensures adequate and safe engagement in daily activities. It is assessed through the Inventory of Reading Occupations-Adult (IRO-A). The instrument underwent translation with cultural adaptation and content validation to ensure relevance to the Filipino context.

Method: The translation and cultural adaptation of the IRO-A to Filipino (Fil IRO-A) was guided by the process proposed by two international guidelines for cross-cultural adaptations that involves (a) forward translation and synthesis, (b) back translation, and (c) pre-panel review of the adaptation to the Filipino context. The Fil IRO-A also underwent content validation by seven experts. Item and …

The Examination Of Nonparametric Person-Fit Statistics As Appropriate Measures Of Response Bias In Ordered Polytomous Items, Mark F. Beck

College of Education and Human Sciences: Dissertations, Theses, and Student Research

Survey research is ubiquitous within the social sciences; however, surveys are vulnerable to response biases. Response biases introduce construct-irrelevant variance into survey responses, which degrades the accuracy of conclusions drawn through the use of surveys. Nonparametric person-fit statistics have been shown to accurately identify response biases in dichotomous response data but are not well studied in polytomous response data. This study examines the accuracy of nonparametric person-fit statistics in polytomous response data. A 6 x 4 x 4 x 2 simulation study was conducted, with type of aberrancy (6), number of response options (4), dimensionality (4), and test length (2) …

Development And Validation Of An Instrument To Measure Teacher Self-Efficacy For Meeting The Needs Of Military-Connected Children, Amy M. O'Neill

Theses and Dissertations--Education Sciences

The average military child changes schools six to nine times before graduating high school. With those moves come significant educational challenges, but there is currently no known instrument designed to measure whether teachers believe they are capable of meeting the needs of this population. The purpose of this study was to develop, pilot, and provide initial psychometric evidence for a scale, the Teacher Self-Efficacy Scale for Military Kids (TSES for MilKids), that measures teacher self-efficacy for meeting the needs of military-connected children. A 19-item instrument was created and distributed to regular education teachers in Grades 1-5 in civilian school districts …

Assessing Differential Item Functioning And Differential Test Functioning In An Academic Motivation Scale Using Item Response Theory Methods, Gerald J. Bean

International Journal of School Social Work

Social work researchers and practitioners who use measurement instruments to make data-informed decisions need to ensure those decisions are based on items and scales that are free from possible bias or undesirable differential functioning. In this study, we provide an example of how a set of Item Response Theory (IRT) statistical methods and tools can be used by social work measurement researchers to assess differential item (DIF) and scale (DTF) functioning. For the example, we explored the possible race, gender, and family composition differential functioning of a scale—the Academic Motivation Scale (AMS)—developed for use by school social workers. The data …

Psychometric Properties Of The 26-Item Eating Attitudes Test (Eat-26): An Application Of Rasch Analysis, Natalie M. Papini, Myungjin Jung, Amanda Cook, Nanette V. Lopez, Lauren T. Ptomey, Stephen D. Herrmann, Minsoo Kang

Faculty and Student Publications

Background: The 26-item Eating Attitudes Test (EAT-26) is a commonly used tool to assess eating disorder risk. The purpose of this study was to examine the psychometric properties of the EAT-26 with a combined sample: (1) of adults with overweight and obesity enrolled in a behavioral weight loss program and (2) general adult sample (n = 469; age = 36.17 ± 17.83 years; female = 72.5%; white = 66.3%; obese BMI category = 58%). Methods: Rasch modeling was used to assess model-data fit, create an item-person map to evaluate relative distribution items and persons, item difficulty, and person’s eating disorder …

Evidence Of Emotional Intelligence In College Presidents’ Public Writing: Does Their Emotional Intelligence Change Over Time?, Karen Powers Liebhaber

Graduate Theses and Dissertations

Higher education (HIED) presidents face a wide variety of competing demands and pressures. High emotional intelligence (EI) has been found to be effective in good leadership, but few studies exist which examine HIED presidents’ EI. This quantitative growth model study attempted to expand the understanding of EI and its source of change among HIED presidents. Several conceptualizations link together in this study to better understand HIED presidents’ EI. First, higher EI has been linked to strong leadership and strong communication. Studies show EI can change over time and EI is associated with certain demographic factors. Further, language, particularly written language, …

Validation Of The Child And Adult Social Support Scale (Casss) Which Measures Social Support In The Indonesian Version, Endah Mastuti, Fajrianthi, Fitri Andriani

International Conference on Assessment and Learning (ICAL)

Social support has an important role, so that students in online learning can reduce the various problems they face. Social support here comes from parents, teachers, classmates, close friends, and the school itself as an institution. Based on this, it is necessary to do research related to social support to get an overview of the support from whom students need in online learning. Furthermore, this can be used as input to intervene in the problems faced by students. To conduct this research, it is necessary to have a measuring tool to conduct social support research. One of the comprehensive measuring …

An Investigation Into The Relationship Between Teacher Grit, Technology Self-Efficacy, And Technology Integration, Joshua Jeremiah Shiloh Marsh

Theses and Dissertations--Education Sciences

The use of educational technology applications has grown tremendously in the last decade. Instructors are now equipped with hardware and software applications previously unavailable, such as mobile and interactive technologies. These tools can have tremendous impact on students’ learning and teacher practices. Teachers can improve their assessment capabilities through technology integration, provide better learning opportunities for students with learning disabilities, and promote deeper learning practices. Due to these benefits, budgets at the federal, state, and local levels of the United States now have specific allocations regarding technology-related purchases. Nevertheless, barriers remain regarding the effective integration of technologies in public schools. …

Measurement Invariance Across Immigrant And Non-Immigrant Populations On Pisa Cognitive And Non-Cognitive Scales, Maritza Casas

Doctoral Dissertations

International large-scale educational assessments (ILSAs) have played a relevant role in educational policies targeting immigrant students across countries as their results are used by governments as input for decision-making purposes. Given the potential impact that ILSAs can have, the psychometric features of these assessments must be carefully assessed and empirical evidence about the extent to which the inferences made based on test results are valid must be collected. To do so, the first step is to determine if the test results have the same meaning across countries and groups of examinees that is, if the measures are invariant so that …

Multiracial Individuals And Educational Testing, Karen Alexander

The Nebraska Educator: A Student-Led Journal

A literature review focused on quantitative measures and methods regarding multiracial individuals and educational testing revealed that multiracial individuals are uniquely different than monoracial individuals in terms of their racial identity and these unique identities interact with test scores. Until recently, this uniqueness has been ignored by institutions and within the field of educational testing. The uniqueness of multiracial identity should be taken into consideration when using test measures to make decisions for selection and when comparing group outcomes. The review provides a brief picture regarding the history of categorization of multiracial individuals and current research which connects the multiracial …

Dataset For Study: Reliability Of The Kiersma-Chen Empathy Scale In Health Sciences Students, David B. Gillette, Todd E. Davenport, J. Mark Vanness, Rupa Balachandran, Edward L. Rogan, Deepti Vyas, Suzanne M. Galal, Tracey Delnero, Paul Subar, Elisa Chavez

Physical Therapy Faculty & Staff Datasets

Background: Empathy is the ability to understand and identify with another person’s feelings and is important in student development.

Purpose: The purpose of this study was to assess reliability of the Kiersma-Chen Empathy Scale (KCES)[1] and its subscales in health professions students.

Methods: Students in six programs received two administrations. Surveys were matched and deidentified before analysis. Total and subscale homogeneity was assessed using Cronbach’s alpha. Association between subscale and total scores was assessed using Pearson correlation. Total and subscale reliability was determined using two-way intraclass correlation coefficients. Minimum detectable change (MDC₉₅)[2] was calculated.

Results: Two …

Validation Of The State Version Of The State-Trait Anxiety Inventory In A University Sample, Christopher L. Thomas, Jerrell C. Cassady

Education Faculty Publications and Presentations

Spielberger's State-Trait Anxiety Model makes a theoretical distinction between the contribution of dispositional anxiety and the transitory experience of anxiety to performance difficulties during testing situations. According to the State-Trait framework, state anxiety is viewed as the primary performance barrier for test-anxious students, and as such, educators and educational researchers have expressed interest in validated, state anxiety measurement tools. Currently, the most widely used measure of state anxiety is the state version of the State-Trait Anxiety Inventory. However, evidence regarding the psychometric properties of this scale is relatively scarce. Therefore, the current study was designed to determine the structural validity, …

Rate To Measure Mathematics Teaching: Using The Many-Facet Rasch Modeling To Reevaluate The Mathematics Classroom Observation Protocol For Practices (Mcop2), Chunling Niu

Theses and Dissertations--Education Sciences

Rater-mediated classroom observation protocols are increasingly being used for teaching performance assessments, which makes identifying and controlling for various rater effects a central issue to ensure the rating quality. A series of validation studies under the classical test theory framework, including content validity, interrater reliability, and structure analysis, have been completed for the 16-item Mathematics Classroom Observation Protocol for Practices (MCOP²).

However, the MCOP² data have never been investigated under the Rasch framework. Due to the methodological limitations of the CTT approach for rater-mediated assessments, it is imperative to examine the MCOP² validity and reliability using …

A Psychometric Evaluation Of The Best In Class Adherence And Competence Scale, Katrina A. Markowicz

Theses and Dissertations

It is critical to utilize treatment integrity instruments to support the evaluation of evidence-based programs in early classroom contexts. However, in the early childhood field, guidelines for collecting treatment integrity data are underdeveloped. Consequently, most treatment integrity instruments employed in the field solely assess adherence, vary in design features and have little psychometric evidence supporting their use. As such, this represents a gap in the field that might slow efforts to implement evidence-based programs. The current study examines the score reliability and validity of an observational treatment integrity instrument (The BEST in CLASS Adherence and Competence Scale [BiCACS]; Sutherland et …

An Evaluation Of The Factor Structure And Internal Consistency Of The ‘Conceptions Of Learning’ And ‘Preferences For Teaching’ Measures In American Occupational Therapy Students, Tore Bonsaksen, Adele Breen-Franklin

Journal of Occupational Therapy Education

When planning to use measurement scales in new samples and contexts, examining the scales’ psychometric properties is an important initial step. This study examined the factor structure and internal consistency of two measures that are part of the Approaches and Study Skills Inventory for Students (ASSIST) – the Conceptions of learning and Preferences for teaching and courses – in a sample of American occupational therapy students. The students (n = 115) completed the measures and provided basic sociodemographic information. Scale structure was examined with Principal Components Analysis (PCA), while consistency between scale items was assessed with mean inter-item correlations. …

The Reliability Of Single-Item Assessments, Sijun Zhang

Legacy Theses & Dissertations (2009 - 2024)

Single-item assessments have become more popular recently in distinct areas, even though there is no consensus about whether they are sufficiently reliable. Researchers have developed methods to estimate the reliability of single-item assessments, some are based on factor analysis (method FA), correction for attenuation (method CA), and others employ Molenaar and Sijtsma’s theory (method MS), coefficient λ6 (method λ6), or latent class model (method LCRC). However, no empirical study has investigated which method estimates the reliability of single-item assessment most precisely. This study investigated this question via a simulation study. To represent assessments as found in practice, the simulation study …

Assessing Online Viewing Practices Among College Students, Elizabeth J. Threadgill, Larry R. Price

Journal of Media Literacy Education

This article focuses on media literacy education for college students. First, we conducted psychometric analyses to verify the properties of the Critical Evaluation and Analysis of Media (CEAM) scale. CEAM measures college students’ self-reported practices for critically evaluating and analyzing the credibility, audience, and technical design elements of online media, such as news, advertisement, and entertainment media. Using CEAM, our second goal was to identify trends in critical viewing practices among first-year students enrolled in college. Results of confirmatory factor analysis (CFA) and item response theory (IRT) supported a three-factor structure for the CEAM scale. Composite score reliability for all …

Developing A Rubric To Assess Critical Thinking In A Multidisciplinary Context In Higher Education, Sadia Muzaffar Bhutta, Sahreen Chauhan, Syeda Kauser Ali, Raisa B. Gul, Shanaz Hussein Cassum, Tashmin Khamis

School of Nursing & Midwifery

Critical thinking (CT) is a generic attribute that is greatly valued across academic disciplines in higher education, and around the globe. It is also defined as one of the graduate attributes of higher education for the sample private university where this research was conducted, as it is perceived that CT helps the graduate to become ‘engaged citizens’ in the twenty-first century. Despite the well-documented importance of CT, its assessment remains a challenge. This study addresses this challenge through the systematic development and field-testing of a rubric for assessing critical thinking in a multidisciplinary context in higher education. A multidisciplinary group …

Validating Professional Standards For Teachers: A Practical Guide For Research Design: Snapshot Literature Review, Jen Jackson, Yung Nietschke

Dr Jen Jackson

This report aims to establish a strong evidence base for planning a validation study of professional standards for teachers. It presents findings from a rapid "snapshot" review of relevant research literature, to identify previous examples of validation studies, and extract lessons from these about worthwhile methods and considerations in research design. This review was originally conducted to inform the design of a validation study of the draft Myanmar Teacher Competency Standards Framework, but may also have wider relevance to other education systems pursuing similar standards-based reforms. This report presents findings from the literature review. It is divided into four sections: …

Measuring Police Officer Self-Efficacy For Working With Individuals With Autism Spectrum Disorder, Abigail M. A. Love

Theses and Dissertations--Educational, School, and Counseling Psychology

Autism spectrum disorder (ASD) is currently one of the most researched of all childhood developmental disorders and is receiving attention in many domains including popular media, social sciences, education, and medicine. The purpose of this dissertation was to design and provide initial psychometric evidence for a scale that measures police officer self-efficacy for working with individuals with ASD. Psychometric properties of a scale designed to measure knowledge of ASD were also explored. Data from 620 police officers actively serving in the United States were collected in two separate phases. A 13-item scale was created to measure police officer self-efficacy for …

The Short Assist Scales: Measurement Properties In A Sample Of Occupational Therapy Students In The Usa, Tore Bonsaksen, Adele Breen-Franklin

Journal of Occupational Therapy Education

Shortening measurement scales can improve the scales’ feasibility, but at the same time, their measurement properties can be affected. This study investigated psychometric properties of the short Approaches and Study Skills Inventory for Students (ASSIST) among occupational therapy students in the United States. The students (n = 120) completed the ASSIST and provided basic socio-demographic and education-related information. Scale structure was examined with Principal Components Analysis (PCA), while consistency between scale items was assessed with Cronbach’s α and inter-item correlations. Three factors were confirmed, but three items showed poor or ambiguous fit with the proposed scales. These items were …

Variable- And Person-Centered Approaches To Examining Construct-Relevant Multidimensionality In Writing Self-Efficacy, Morgan Debusk-Lane

Theses and Dissertations

Writing self-efficacy is a vital component to a students’ motivation and will to succeed towards writing. The measurement of writing self-efficacy over the past 40 years, despite its development, continues to largely be represented by Confirmatory Factor Analysis models that are limited due to their restricted item to factor constraints. These constraints, given prior literature and the theoretical understanding of self-efficacy, do not adequately model construct- relevant psychometric multidimensionality as a product of conceptual overlap or a hierarchical or general factor. Given this, the present study’s purpose was to examine the adapted Self-efficacy for Writing Scale (SEWS) for the presence …

Validating Professional Standards For Teachers: A Practical Guide For Research Design: Snapshot Literature Review, Jen Jackson, Yung Nietschke

Teaching standards and teacher evaluation

This report aims to establish a strong evidence base for planning a validation study of professional standards for teachers. It presents findings from a rapid "snapshot" review of relevant research literature, to identify previous examples of validation studies, and extract lessons from these about worthwhile methods and considerations in research design. This review was originally conducted to inform the design of a validation study of the draft Myanmar Teacher Competency Standards Framework, but may also have wider relevance to other education systems pursuing similar standards-based reforms. This report presents findings from the literature review. It is divided into four sections: …

Effects Of Structural Flaws On The Psychometric Properties Of Multiple-Choice Questions, Sarah B. Mcbrien

Department of Teaching, Learning, and Teacher Education: Dissertations, Theses, and Student Research

The sentiment that there is more work to be done than there is time is pervasive among faculty members at most academic institutions. At health science centers, faculty members often balancing teaching responsibilities, clinical loads, and research endeavors. Creative use of educational support staff may provide institutions an avenue for accomplishing goals related to quality improvement, curriculum revision, and accreditation tasks. One such task is the maintenance of a bank of multiple-choice examination items that are free of structural flaws. This study measured the effects of a systematic approach to revising structural flaws in multiple-choice questions on the psychometric properties …

Survey Research In Postsecondary Chemistry Education: Measurements Of Faculty Members’ Instructional Practice And Students’ Affect, Rebecca E. Gibbons

USF Tampa Graduate Theses and Dissertations

Collection of data through survey-type measurements and analysis contributes rich, meaningful information to the chemical education research enterprise. This dissertation reports two strands of research that each contribute a “snapshot” of the state of chemical education on two different levels. The first uses survey research methods, collecting data from faculty members to learn about postsecondary chemistry education across the United States. The second uses survey instruments of student achievement emotions within the organic chemistry classroom, collecting longitudinal data to learn about the relationships of emotions with achievement over time. Both areas are of interest because chemical education research produces evidence-based …

Introduction: History And Conceptual Basis Of Assessment In Higher Education, Peter Ewell, Tammie Cumming

Publications and Research

Assessment and accountability are now inescapable features of the landscape of higher education, and ensuring that these assessments are psychometrically sound has become a high priority for accrediting agencies and therefore also for higher education institutions. Bringing together the higher education assessment literature with the psychometric literature, this book focuses on how to practice sound assessment.

This volume provides comprehensive and detailed descriptions of tools for and approaches to assessing student learning outcomes in higher education. The book is guided by the core purpose of assessment, which is to enable faculty, administrators, and student affairs professionals with the information they …

The Trouble With Test Banks, Harvey Richman, Molly Hrezo

Perspectives In Learning

We compared the psychometrics of quiz questions randomly selected from a test bank with the psychometrics of quiz questions the instructor had selected from the bank for quality and modified (if necessary). On multiple psychometric indices, the instructor selected/modified questions were superior to questions randomly selected from the test bank. Most notably, when compared with instructor written/modified questions, randomly selected bank questions were nearly 6.5 times more likely to contain a distractor that drew more responses than the correct answer. Details and implications are discussed.

Teaching Behaviour And Well-Being In Students : Development And Concurrent Validity Of An Instrument To Measure Student-Reported Teaching Behaviour., Patrick Possel, Kathleen Moritz Rudasill, Jill L. Adelson, Annie C. Bjerg, Don T. Wooldridge, Stephanie Winkeljohn Black

Patrick Pössel

Teaching behavior has important implications for students’ emotional well-being. Multiple models suggest students’ perceptions of teaching behaviors are more critical than other measures for predicting well-being, yet student-report instruments that measure concrete and specific teaching behavior are limited. The purpose of the present studies is to develop an instrument to assess students’ perceptions of concrete and specific teaching behavior and to test which teaching behavior is associated students’ well-being. Construct validity and internal consistency for the 37-item Teaching Behavior Questionnaire (TBQ-S), composed of instructional, negative teaching, socioemotional, and organizational behavior were examined using data from two independent samples (Study 1: …

Reliability And Validity Of Michigan School Libraries For The 21st Century Measurement Benchmarks, Natosha Nicole Floyd

Wayne State University Dissertations

The purpose of this study was to examine the psychometric properties of the Michigan School Libraries for the 21st Century Measurement Benchmarks (SL21). The instrument consists of 19 items with three subscales: Building the 21st Century Learning Environment Subscale, Teaching for 21st Century Learning Subscale, and Leading the Way to 21st Century Learning Subscale. The sample consisted of 54 respondents who were administered the instrument in 2014 and 2015. Cronbach’s alpha for the total instrument was 0.807 (n = 19 items). Exploratory factor analysis (EFA) was used to measure construct validity. The findings derived from the EFA did not tend …

Dimensionality Analysis Of The Pals Classroom Goal Orientation Scales, Angela K. Tombari

Theses and Dissertations--Educational, School, and Counseling Psychology

Achievement goal theory is one of the most broadly accepted theoretical paradigms in educational psychology with over 35 years of influencing research and educational practice. The longstanding use of this construct has led to two consequences of importance for this research: 1) many different dimensionality representations have been debated, and 2) methods used to confirm dimensionality of the scales have been supplanted from best practice. A further issue is that goal orientations are used to inform classroom practice, whereas most measurement studies focus on the structure of the personal goal orientation scales rather than the classroom level structure. This study …