Education Commons^™

Avatars & Choice: Fostering Student Agency, Engagement, And Equity In Assessment, Sandra M. Sweeney

Doctoral Dissertations

Provision of item choice and use of digital avatars in reading assessment contexts may play a critical role in fostering student agency, engagement, and equity in assessment. Using a mixed methods approach, this study was conducted over four phases within an equity framework. Phase I consisted of a survey, during Phase II an iOS software application and reading test was developed, Phase III was an experimental study, and during phase IV post-experiment interviews were conducted. Research questions for this study (1) explored student interests and experiences related to assessments and technology use, (2) investigated the effect of item choice and …

Evaluating The Effectiveness Of Thompson’S (2105) Survey Of Language Usage And Spanish Of Heritage Learners Placement Program Exam At The High-School Level, Elizabeth Villanueva

Doctoral Dissertations

Language placement test serve with multiple purposes to measure the language abilities and performance of language learners to place them in the most appropriate language course with curriculum that best meets the language needs. There is the need to assess appropriately the Spanish heritage language learners’ (SHLLs) abilities at the high-school level. Therefore, this mixed-method study investigated how Thompson’s (2015) modified Yes or No 10-question Survey of Language Usage (Survey) and the three part Spanish for Heritage Language Learners Placement Program Exam (Placement Test) could be used effectively with three Spanish class levels of HLLs at the high-school level to …

3cam Model Concept Maps, Critical Thinking, Collaboration Assessment (3cam) Toward The Path Of Mastery Learning, Elham Zandvakili

Doctoral Dissertations

This study reports an exploratory study of the 3CAM model of classroom learning. 3CAM is an acronym for concept maps, critical thinking, collaboration, and mastery. It is a student-centered approach to mastery learning that empowers students to take responsibility for their own learning. The model is a theory and a practice. The theory is the language games of critical thinking and the practice is the activities of visualizing concept maps, applying critical thinking, collaborating, and creating their own assessment. Students play the language games of critical thinking using the WH questions: “what, when, why, where, who and how”. Students apply …

Evaluating A Translingual Administration Of The Early Grades Math Assessment (Egma) In The Democratic Republic Of The Congo, Fernanda Gandara

Doctoral Dissertations

Translanguaging is a view around languages that normalizes diglossia without separation: the linguistic resources of the bilinguals are considered one integrated system. Translanguaging is also a language practice of bilinguals, who select features from their entire linguistic repertoire to make sense of the world around them. Translanguaging is widely used by students and teachers in the bilingual classroom, as it allows students to build upon their entire set of resources, enhance learning outcomes, perform identities, and develop their languages even further. However, translanguaging is rarely used in assessments of bilinguals. Assessments of bilinguals, especially large-scale tests, are typically monolingual in …

Assessing Transformative Learning: Toward A Unified Framework, Robert Charles Cox

Doctoral Dissertations

This study describes the development, administration, and results of an exploratory, 30- item instrument to assess aspects of transformative learning attributable to an educational program. The instrument, TRansformative Outcomes and PrOcesses Scale (TROPOS), assesses four subscales associated with transformative learning: criticality, attitude toward uncertainty, social support, and transformative outcomes. Potential instrument items were derived from a literature review. A panel of experts evaluated these items for inclusion in the study. Study participants were alumni of the same master’s degree program who graduated during the past 10 years, 2007-2016 (N=119). This study …

Maximizing Test Efficiency: The Effects Of Test Format On Nonsense Word Reading, Amanda Kern

Doctoral Dissertations

A repeated measures study was conducted to determine the effects of test format on accuracy and fluency performance on a computer-based, nonsense word, decoding task. Decoding is a phonics skill that is highly predictive of overall reading performance (Fletcher, Lyon, Fuchs, & Barnes, 2007). Therefore, identifying students who are struggling with decoding and providing instruction to remedy skill deficits is of high importance to teachers. A possible way for teachers to determine the instructional needs of their students is through testing (Hosp & Ardoin, 2008). However, time dedicated to test completion in classrooms limits the time available for instruction. Therefore, …

Shared Focus/Collective Responsibility: The Lived Experience Of Educators As Members Of A Data Team In A Connecticut Public High School, Abbie-Jean M. Lareau

Doctoral Dissertations

ABSTRACT SHARED FOCUS/COLLECTIVE RESPONSIBILITY: THE LIVED EXPERIENCE OF EDUCATORS AS MEMBERS OF A DATA TEAM IN A CONNECTICUT PUBLIC HIGH SCHOOL This study explores the experiences of five high school English Teachers in a Connecticut public school acting as an Instructional Data Team as prescribed by the Connecticut Accountability for Learning (CALI) model. Data Teams are teams of educators that participate in collaborative, structured, scheduled meetings, which focus on the effectiveness of teaching as determined by student achievement. Data Teams adhere to continuous improvement cycles, analyze trends, and determine strategies to facilitate analysis that results in action. Data Teams can …

The Development And Validation Of The Emotion Knowledge And Awareness Test, Catherine A. Rossi

Doctoral Dissertations

The purpose of this study was to develop, test, and pilot a general outcome measurement tool that will allow educators to test young children’s knowledge of factors of emotional development: emotional identification and fluency, understanding situations where multiple emotions are present, understanding that others may feel differently in situations, and emotional regulation (CASEL, 2014). There are few assessments that reliably measure emotion knowledge in early elementary grades. The Emotion Knowledge and Awareness Test (EKAT) has been developed for kindergarten through second grade students to measure emotion awareness across two domains: knowledge and management. It was developed as a pre/posttest assessment …

Effects Of Training On Intent, Ease, Self-Efficacy, Frequency, And Usefulness In Multimedia-Based Feedback For University-Level Instructors Using Canvas® Lms, Christopher Kent O'Leary

Doctoral Dissertations

The purpose of this study was to investigate how training and professional development effected university-level instructors’ perceived usefulness, perceived ease of use, behavioral intent to use, perception of self-efficacy, and frequency of use of audio-, video-, and speech-to-text-recognition-based technologies associated with the feedback and assessment process in college-level teaching. Except for usefulness, each dependent variable was divided into two based on whether the item was multimedia or not: (a) use of technology with multimedia and (b) use of technology without multimedia. The convenience sample included 52 university-level instructors who had enrolled in either the Canvas® Essentials (a basics course) or …

Implementing Universal Social And Emotional Learning Programs: The Development, Validation, And Inferential Findings From The Schoolwide Sel Capacity Assessment, Cheyne A. Levesseur

Doctoral Dissertations

In order to effectively transport universal social and emotional learning (SEL) programs into natural settings, it is important to understand implementation barriers that may hinder the likelihood of successful outcomes (Fixsen, Naoom, Blasé, Friedman, & Wallace, 2005). The current study is primarily based on the notion that within the planning phase of implementation, few technically adequate assessment measures targeting both organizational capacity (OC) and provider characteristics (PC) for SEL programming actually exist. The purpose is to extend the SEL implementation assessment literature by developing a new rating scale designed to measure SEL implementation barriers (School SEL Capacity Assessment [SSCA]) and …

Investigating The Predictive Validity Of Three Measures Of Number Sense, Bethany Politylo

Doctoral Dissertations

Number sense has been identified as an important foundational skill in the development of later mathematics competence. Although number sense has historically been difficult to define in the educational literature, operational definitions of the construct typically consist of a collection of early numeracy skills or “number sense components” such as quantity discrimination, rote counting, and one-to-one correspondence. Consequently, assessments of number sense tend to measure a wide variety of these skills. The purpose of this study was to investigate the predictive validity of three measures of number sense: the Test of Early Numeracy (TEN), Number Sense Brief Screener (NSB), and …

Predicting High-Stakes Tests Of Math Achievement Using A Group-Administered Rti Instrument: Validating Skills Measured By The Monitoring Instructional Responsiveness: Math, Jeremy Thomas Coles

Doctoral Dissertations

Three universal screeners and nine progress monitoring probes from the Monitoring Instructional Responsiveness: Math (MIR:M), a silent, group-administered math assessment designed for implementation with an RTI Model, were administered to 223 fifth-grade students. The growth parameters of the overall MIR:M composite and two global composites (math calculation and math reasoning) identified significant variation in student growth, within significant linear and quadratic trajectories. However, there were significant differences in the nature of the growth trajectories that have applied educational implications. In addition, growth parameters across the three composites provided significant predictive potential when using the Tennessee Comprehensive Assessment Program (TCAP) Achievement …

Development Of The Biostatistics And Clinical Epidemiology Skills Assessment For Medical Residents, Patrick Brian Barlow

Doctoral Dissertations

This study developed the Biostatics and Clinical Epidemiology Skills (BACES) assessment, and established its preliminary item characteristics and validity evidence. Unlike previous instruments, the BACES assessment was developed and tested using an item response theory (IRT) approach to measurement to create a new, adaptive biostatistics and clinical epidemiology knowledge assessment for graduate medical professionals. Thirty multiple-choice questions were written to focus on interpreting relevant examples of clinical epidemiology and statistical methods. A four person expert panel reviewed these items for content validity. After this review, the BACES assessment was administered to 147 medical residents across three academic medical centers. Results …

The Ability Of Early Reading Measures Administered In First Grade To Predict Fourth Grade Reading Comprehension For Puerto Rican Students In English Immersion, Sarah Peller

Doctoral Dissertations

The present study examined the relationship between children's early literacy-related abilities and their reading achievement in late elementary school in the context of a Puerto Rican community in Massachusetts. The researcher examined four years of student achievement test data from the public elementary schools of Holyoke, Massachusetts. The city’s particular sociologic history makes it an interesting and fruitful case for investigating issues around language, culture, and test performance that, while uniquely expressed in Holyoke, share aspects in common with many locales across the United States. The researcher sought to determine the extent to which literacy assessments administered to Hispanic children …

Assessing Student Learning With Technology: A Descriptive Study Of Technology-Using Teacher Practice And Technological Pedagogical Content Knowledge (Tpack), Lara Elaine Ervin-Kassab

Doctoral Dissertations

In 2013, a majority of states in the US had adopted Common Core State Standards under the Race to the Top initiative. With this adoption came the opportunity to utilize computer-delivered and computer-adaptive testing. Although the computer-based assessments were intended to assist teachers in designing classroom assessments and using student data to inform instructional practice, teacher-reported data indicated that the areas in which teachers are most unprepared, lack confidence, or are in need of development were assessment (DeLuca, 2012; Wayman et al., 2007) and technology (Brush & Saye, 2009; Kramarski & Michalsky, 2010).

The Technology Assessment Practices Survey (TAPS) study …

Everyone’S Doing It. Or Are They? Understanding Student Affairs Assessment Practices At Small Private Colleges, Jonita Denise Ashley-Pauley

Doctoral Dissertations

Reports from national organizations and student affairs organizations have strongly suggested student affairs professionals engage in ongoing, comprehensive assessment of how their programs affect student learning (ACPA, 1996; ACPA & NASPA, 1997; Keeling, 2004). In terms of assessment and how it should be conducted, scholars have provided clear guidelines for the conduct of such assessment. However, to date, only one study has looked at assessment practices in student affairs programs; and that study was of three large public institutions whose student affairs programs were determined to have exemplary practices (Green, Jones, & Aloi, 2008). To date, no studies have focused …

Validation Of The Monitoring Academic Progress: Reading (Map: R): Development And Investigation Of A Group-Administered Comprehension-Based Tool For Rti, Angela Nicole Hilton-Prillhart

Doctoral Dissertations

Monitoring Academic Progress: Reading (MAP: R), a silent, group-administered screener was piloted as part of a comprehensive Response to Intervention program. MAP: R along with AIMSweb© Maze and STAR reading were administered to 1,688 students in Grades 1-3. Overall alternate-form reliabilities for MAP: R resulted in moderately high stability (Grade 1 = .79, Grade 2 = .78, and Grade 3 = .75). Test-retest reliability was .90 for Grade1, .84 for Grade 2, and .89 for Grade 3. Concurrent validity, correlations for MAP: R and AIMSweb© Maze ranged from .43 to .69, with correlations for MAP: R and STAR ranging from …

A Validation Of The Monitoring Academic Progress Mathematics: An Experimental Multidimensional Group Administered Curriculum-Based Measure Of Mathematics Fluency And Problem Solving, Michael Brandon Hopkins

Doctoral Dissertations

The study investigated the psychometric properties of a newly developed math curriculum-based measure, the Monitoring Academic Progress: Mathematics (MAP:M), through examination of its internal consistency, alternate-form, slope, and test-retest reliability and validity. Participants included 1688 first through third-grade students from a school district in Northeast Tennessee. Application of Generalizability Theory produced reliability coefficients, score variances, and standard-error-of-measures (SEM) for both absolute and relative decisions based on a particular number of probes. MAP:M reliability coefficients for relative decisions ranged from .67 to .97 across eleven probes. The highest percentage of score variance at all three grades was attributed to the Person …

Grading And Reporting Purposes And Practices In Catholic Secondary Schools And Grades' Efficacy In Accurately Communicating Student Learning, Peter Imperial

Doctoral Dissertations

Few aspects of school are as controversial as the practice of grading, for grades affect students' educational opportunities. The purpose of this study was to identify the practices Catholic high-school teachers employed in determining students' grades. The study investigated the extent to which academic achievement comprised the grades teachers reported, and the extent to which teachers' practices are consistent with their expressed purposes for grading. The study also explored the extent to which Catholic teachers' grading practices are consistent with their schools' purpose for grading. Using random sampling, 486 Catholic secondary school teachers and 50 administrators from 33 high schools …