Digital Commons Network^™

"We’Re Not “Buying- In”: A Systematic Review And Multi Methods Study Of Interventions By Research Universities To Bolster Faculty Engagement In Student Learning Outcomes Assessment, La Trice Ratcliff Small

Theses and Dissertations

What are students learning in college? This question drives public skepticism and requests for accountability from higher education institutions. While faculties are committed to ensuring the highest quality education for college students, those at American research universities have traditionally avoided student learning outcomes assessment (SLOA) (Kuh & Ikenberry, 2009). This multi-methods study employs a systematic review to identify approaches to increasing faculty engagement in SLOA at research universities: leveraging assessment data, praise, and recognition, offering institutional support to alleviate SLOA workload, fostering faculty collaborations, remunerative awards, and sponsoring faculty professional development opportunities. The success of each of these approaches is …

Evaluation Of Cultural-Linguistic Factors In Speech-Language Testing With English Learners, Mayra Alejandra Reyes Ruiz

Theses and Dissertations

As the population of schools increases in diversity, school psychologists are challenged to provide equitable assessments for English Language Learners. However, due to lack of training in non-discriminatory assessment, inconsistent administration practices, and lack of knowledge of language development, in some districts, ELLs are overrepresented in Special Education, including Speech Language Impairment. For fair and a valid assessment, it is imperative that practitioners understand the cultural and linguistic development factors that affect ELL test performance. The Culture-Language Test Classifications, and Culture-Language Interpretive Matrix provide practitioners with information on the degree of cultural loading and linguistic demand required on a test, …

Accounting For Oral Language Skills In Children With Dyslexia: A Systematic Review Of The Literature, Natalie Kay Olsen Miller

Theses and Dissertations

Purpose: In the present study, we conducted a systematic review to determine whether studies involving children with dyslexia include the assessment of oral language skills in their assessment batteries across various professional disciplines. Overlooking assessment of oral language in children with dyslexia may result in the misinterpretation of research findings and applications to children who present with both dyslexia and Developmental Language Disorder (DLD) or experience secondary oral language deficits. Method: According to the Preferred Reporting Items for Systematic Reviews and MetaAnalyses (PRISMA) guidelines, we searched the Elsevier Scopus database and obtained and analyzed 764 articles, up to 40 articles …

On The Importance Of True Peer Norms In The Assessment Of English Learners: A Validation Study Of The Ortiz Picture Vocabulary Acquisition Test, Jane Yan Ting Wong

Theses and Dissertations

Traditional efforts in aiding English learners (ELs) to achieve better test performance such as modifications to the testing process or the use of native language or nonverbal tests are problematic and disregard the unique language developmental experiences of ELs (Ortiz & Wong, 2022). The Ortiz Picture Vocabulary Acquisition Test (Ortiz PVAT; Ortiz, 2018), an assessment of English receptive vocabulary, incorporates ELs’ proportion of lifetime exposure to English (LEE) in test norms to allow for true peer comparison, thus ensuring test fairness in measurement and score interpretation. The current study aimed to add to the existing validity evidence for the test …

Exploring The Role Of Institutional Culture In Student Affairs Assessment Practitioners’ Experiences Implementing Equity-Centered Assessment, Jaime L. Williams

Theses and Dissertations

Student affairs assessment is a field in higher education that emphasizes the measurement of effectiveness and student learning in student serving programs that take place outside of the classroom. Outcomes-based assessment is the basis of most assessment practices in student affairs, and focuses on the continuous improvement of out-of-classroom programs, services, and student learning. Many assessment practices stem from traditional research methods, which have been developed by people who hold mostly majority identities. These methods were not created with the rapidly changing demographics of today’s college-going students in mind. To help address the increasing diversity of college students and the …

Community College Strategic Planning: An Examination Of Implementation, Assessment, And Evaluation Practices, Aaron Miller Prestwich

Theses and Dissertations

Strategic planning is the process in which organizations develop goals and objectives that drive actions for the purpose of fulfilling their institutional mission. This paper addresses how strategic planning can be utilized at community colleges. A review of relevant literature is also included. A qualitative case study research methodology was used to examine three main research questions. 1. How do community colleges evaluate their strategic planning processes in determining the achievement of their strategic plan’s desired results? 2. In what ways, if any, do community colleges assess and define the successful implementation of their strategic plan initiatives? 3. What, if …

Developing An Early Life Cycle Manufacturability Assessment For Conceptual Designs, Tonya Gamblin Mccall

Theses and Dissertations

Studies have shown that 70 – 80% of a product's life cycle costs are committed by the end of the product design phase (Anderson, 2014; National Research Council, 1991; Swift, 1987). This supports the general claim that decision making in the conceptual stage drives the cost throughout the life cycle. The use of concurrent engineering has been viewed as the answer to this problem, offering the Design for Excellence (DFX) as one approach for evaluating product designs across specific disciplines. This research focuses on a subset of DFX referred to as Design for Manufacturability to develop a means to assess …

The Use Of Single-Subject Research Design For Assessment, Evaluation, And Research In Higher Education, Jordan C. Spencer

Theses and Dissertations

While enrolling in a college for a degree is still considered to be more of the expectation than the rule in households across the United States it is facing public criticism regarding its overall cost versus long-term benefits. This has prompted researchers to reevaluate practices in higher education to determine ways in which post-secondary institutions can improve their overall outcomes. In part, research indicates that this should include revisions to assessment, evaluation, and research (AER) practices. Currently, higher education faces many challenges associated with rigorous AER practices, which include an institutional focus on accountability measures, organizational challenges, and difficulties in …

Improving Student Success In A Large-Enrollment Introductory Accounting Course, Melissa P. Larson

Theses and Dissertations

This dissertation follows a three-article format presentation. The topic addresses improving student success in a large enrollment introductory accounting course. The first article is a literature review of pre-class activities within a flipped classroom setting in higher education. The review of 34 articles identified as relevant to the literature review explored what the literature tells us about pre-class learning activities and synthesized what instructors can do to design pre-class activities that encourage students' preparation for class. The review showed the importance of pre-class learning in a flipped classroom and that more research is needed to better understand students' behaviors and …

Assessment Literacy: Using Computer Adaptive Test Data, Ogechi Iwuoha Njoku

Theses and Dissertations

This study employed a quantitative research design to examine teacher assessment literacy and its relationship to external and internal factors. The researcher sought to describe the level of assessment literacy that teachers demonstrate when using score report data from computer-adaptive interim assessment and to analyze whether teachers’ assessment literacy seems to be affected by: a) the quality of professional development training received; b) teachers’ level of self-efficacy; c) teachers’ attribution to student effort, that is their perception of the importance of student effort; and d) teachers’ attribution to context, specifically their perception of the importance of tests. For this study, …

Assessing Readiness For Implementation Of Prognostics And Health Management In Small And Medium Enterprises, Sara C. Fuller

Theses and Dissertations

Prognostics and Health Management (PHM) refers to using robust sensing, monitoring, and control to detect, assess, and track system health degradation and failure modes, allowing for enhanced management and operational decisions. The need for PHM within a manufacturing facility has increased due to a variety of reasons, such as the increasing complexity of manufacturing equipment.

A lack of readiness for digital implementations is linked to failure. The literature highlights certain barriers and enablers that can signal whether a technology implementation will be successful, such as management and maintenance employees’ desire to change the existing process, an understanding and willingness to …

Thriving In College: The Contribution Of Career Services To Student Success, Jodi M. Chowen

Theses and Dissertations

Career services in higher education has a long history of supporting student development and post-graduation success (American Council on Education, 1937; Rayman, 1999; Dey & Cruzvergara, 2014). However, there is a dearth of research identifying specific connections between engagement with career services and student success. College student thriving has been established in previous studies as positively contributing to traditional measures of college student success, including intention to persist, grade point average, institutional fit and satisfaction, and self-reported learning gains (Schreiner, 2013). Examining the relationship of student experience with career services and thriving provides a new way to evaluate the contribution …

Evaluation Of The Throw-Catch Assessment, Bryan Terlizzi

Theses and Dissertations

Motor competence assessment has been characterized by the evaluation of motor skill performance in closed performance contexts that lack task and environmental constraints reflective of real-world contexts. In contrast, the throw-catch (TC) assessment employs a dynamic task environment that allows performers to adapt over multiple trials to evaluate the degree of skilled performance via demonstration of a flexible and adaptable repertoire of both throwing and catching actions. The purpose of this dissertation was to investigate the developmental validity of the TC, as well as the content validity of the TC in terms of assessing throwing skillfulness.

Performance of the TC …

Comparing Relative And Absolute Reliability Of Short Versus Long Narrative Retells, Jenna Hollis

Theses and Dissertations

The purpose of the current study was to examine and compare relative and absolute reliability estimates between brief, linguistically compact narrative retells and longer, more linguistically diffuse narrative retells. The participants included 190 school-age children in firstsixth grade from Utah, Arizona, and Colorado. Participants completed two brief narrative retells using the Narrative Language Measures (NLM) Listening subtest of the CUBED assessment and one longer narrative retell using the wordless picture book Frog, Where Are You? (FWAY). These language samples were then analyzed for language productivity, complexity, and story grammar elements using the Systematic Analysis of Language Transcripts software program and …

Trust In Schools, Student Race, And Third Grade Reading In New York City Public Schools, Alexa Sorden

Theses and Dissertations

This quantitative study examines the relationship between teachers' and parents' trust in the school principal in association with third-grade students reading proficiency as determined by the New York State Testing Program. In addition, this study examines the association between combined trust scores and their influence on Black and Latino students’ reading proficiency. This study merged preexisting New York City Department of Education (NYCDOE) Learning Environment Survey data and the New York State Testing Program examination data. Six hundred eleven schools comprised the final sample from the 708 public elementary schools that currently make up the NYCDOE traditional public school system …

Personnel Administrators’ Use Of The Interview Process As A Predictor Of Quality Principal Candidates: A Quantitative Survey Approach, Cynthia M. Fitzgerald

Theses and Dissertations

The hiring of qualified staff that believe in the vision and mission of the school in which they have applied can be seen as the most important and significant decision a school district can make. Poor hiring decisions can affect a school’s culture and climate for many years, as well as significantly impact the academic prowess of its students. Inadequate interview practices poorly vet job candidates resulting in a lack of performance in newly hired administrators, leaving schools vulnerable to mediocre teaching and low student achievement. The research looked to recognize the changing role of the school principal and to …

Measuring Irrational Beliefs Among Youth: Development Of The Children’S Irrational Response Checklist, Alexa K. Pata

Theses and Dissertations

Cognitive Behavioral Therapy (CBT) and Rational Emotive Behavior Therapy (REBT) are evidenced-based approaches that have been identified as effective for the treatment of psychological disorders among youth (Bernard & Terjesen, 2020). However, although beliefs and cognitions have been shown to be predictive of emotional and behavioral problems in children (Mogoaşe, Podină, et al., 2013), and modifications in cognitions have been shown to be vital for treatment (David et al., 2017), the research and psychometric properties surrounding measures designed to specifically assess irrational beliefs, self-statements, or automatic thoughts in youth are lacking due to theoretical and practical limitations (Terjesen et al., …

Understanding Language Use Patterns Of People With Chronic Pain: A Novel Assessment Approach, Jodie Maccarrone

Theses and Dissertations

It is estimated that 35% of Americans or 116 million people report experiencing chronic pain daily (Nahin, 2015). Due to the unique and individualized nature of chronic pain, successful treatment of this condition is difficult to achieve. The heterogeneity and complexity in presentation may help explain why, as all methods of treatment have fallen short of providing consistent and reliable outcomes (Finnerup et al., 2015; Lumley & Schubiner, 2019), resulting in unsuccessful treatment approaches that can lead to compounding negative consequences such as hyperalgesia (Garland et al., 2013) and even death (Scholl, Seth, Kariisa, Wilson, & Baldwin, 2019). As such, …

A Comparison Of Teleneuropsychological And Traditional Neuropsychological Battery Factor Structures, Alison Datoc

Theses and Dissertations

This study compared the factor structures of a traditional neuropsychological battery, administered in-person, and a teleneuropsychological battery, administered remotely. Participants were divided into two groups dependent on test condition (i.e., in- person or remote). Individuals in the in-person test condition group (n = 100) were selected from a sample of individuals who were assessed in-person in a previous archival study, and individuals in the remote testing condition group (n = 100) were assessed via teleneuropsychology in their home environment.

Two Exploratory Factor Analyses (EFA) using Principal Component Analysis (PCA) method were conducted on the T-scores and scaled scores of each …

Utilizing The Radsm Process: Developing An Unobtrusive Measure Of Cohesion, Zachary Lee Rahner

Theses and Dissertations

In this study, verbal indicators produced following the RADSM process were used to code transcript data collected from 62 three-person teams playing a cooperative bridge crew simulator. A training dataset, consisting of 88 mission transcripts, and a testing dataset, consisting of 39 mission transcripts, were created from the data. Multilevel modeling was employed to develop a linear-regression algorithm to predict/measure team task and social cohesion. The findings revealed that task cohesion perceptions are linked to the proportion of speech dedicated to information requests and instructions, whereas social cohesion perceptions are associated with the proportion of speech dedicated to amusing and …

Measuring Cross-Cultural Engagement Of Those Using The Growing Participator Approach, Cheryl Lea Cross

Theses and Dissertations

The Growing Participator Approach (GPA) is a language-learning approach used among global professionals living cross-culturally. Developer Greg Thomson claims that through the GPA, learners grow as active participants in their new culture by learning language primarily in relationship. Because cultural participation is central to GPA, measuring social engagement is the most appropriate form of evaluation. This research seeks to answer the questions: (1) Does focused language learning using the GPA correspond with a high degree of social integration in the host community? (2) Does the use of scales from other academic fields help evaluate social engagement for language learners?

For …

Improving Outcomes Assessment Through Silo Integration, Jeffrey Scott Harmon

Theses and Dissertations

The purpose of this action research study was to leverage the experiences and perceptions of academic administrators at Mountain State University to disrupt the negative aspects of silo-based decision-making within closing the loop assessment practices. Siloed operations naturally begin to operate in contradiction to one another and often to the detriment of the organization. Focusing specifically on siloed operations across academic schools at Mountain State University, this study reveals issues of inefficiency and redundancy, and develops intervention strategies in an effort to improve closing the loop assessment efforts. These strategies include structural changes leading to a more integrated assessment model …

University Students' Perceptions Of Writing Assessment, Hanan Alaa Hegazi

Theses and Dissertations

Instructors and students are the pillars of higher education. There is substantial interest in teachers’ beliefs, preferences, and perceptions in language assessment research, with an emphasis on writing assessment. Additionally, there is a growing body of research investigating students’ perceptions of assessment. However, research that examines how students perceive writing assessment is limited. Therefore, this study investigates two aspects: (a) students’ perceptions of their writing ability and (b) their perceptions of writing assessment in an English-medium private university in Cairo. This study adopts a mixed-methods approach for data collection, which involved distributing student questionnaires, conducting semi-structured interviews, and collecting writing …

Applying The Comprehensive Evaluation Of Return-On-Talent-Investment Model (Certi) In Higher Education, Mazen Aziz

Theses and Dissertations

Economic turmoil has forced higher education institutions (HEI) to reduce expenditures in many areas, including human resource operations such as talent development. Before considering these cuts, HEI should conduct robust assessments of their efficacy, including whether they generate more revenue than they cost to administer. These assessments were critical contextually as state divestment in higher education and mounting public pressure against tuition hikes forced HEI to heavily rely on external funding sources, which became essential in these economically uncertain times. This three-article dissertation critically examined existing evaluation methodologies of a type of talent development initiative, faculty research development (FRD) programs, …

The Matrix Revisited: A Critical Assessment Of Virtual Reality Technologies For Modeling, Simulation, And Training, George Demetrius Lecakes

Theses and Dissertations

A convergence of affordable hardware, current events, and decades of research have advanced virtual reality (VR) from the research lab into the commercial marketplace. Since its inception in the 1960s, and over the next three decades, the technology was portrayed as a rarely used, high-end novelty for special applications. Despite the high cost, applications have expanded into defense, education, manufacturing, and medicine. The promise of VR for entertainment arose in the early 1990's and by 2016 several consumer VR platforms were released. With VR now accessible in the home and the isolationist lifestyle adopted due to the COVID-19 global pandemic, …

Exploring Neurocognitive Processes That Underlie Reading Performance In Children: A Foundational Study, Ayan Mitra

Theses and Dissertations

With advancement in brain research, neuroscience researchers have collectively informed our understanding of reading-related processes. Despite an extensive body of literature, many educators are not aware of specific neuroimaging findings related to phonological processing and word reading. Therefore, the study builds on this body of research by exploring the connection between the brain and reading scores. Quantitative EEG and standardized academic achievement analyses were performed on 60 school-aged children. Intrahemispheric coherence analysis at rest were conducted across the sample of participants and several coherence networks were extracted and compared to standardized reading achievement scores. Specifically, networks that included Brodmann area …

The Influence Of College-Readiness Testing On High School Students’ And Educators’ Attitudes On Education, Bradley Krauz

Theses and Dissertations

.

College-readiness testing has increased drastically over the last thirty years, with increases in the number of Scholastic Achievement Tests and American College Tests taken by students. The number of Advanced Placement tests has also reached an all-time high. With states using these college-readiness assessments as high-stakes exit tests and the socioeconomic benefits connected to college attendance and graduation, the focus on college-readiness assessment has impacted the classroom environment. With more time spent preparing for college-readiness assessments, the environment in which students interact and grow has evolved. This qualitative case study, informed by Freire’s (2000) “banking concept” of education and …

Assessment Of Psychological Functioning In Retired Firefighters, Jordana Simone Pepper

Theses and Dissertations

The past decade has witnessed a significant increase in clinical attention directed to mental health problems in firefighters. The basis for heightened activity in this area is the convergence of evidence indicating that firefighters demonstrate significantly high levels of psychological disorders such as depression and PTSD (Henderson et al., 2016). A previously unexplored risk factor for psychopathology in firefighters is active retirement. Retirement can lead to a decline in psychological functioning, as well as a decline in a person’s self-concept clarity through group loss (Slotter, Winter & Soto, 2015). This loss has the potential to cause, or enhance, feelings of …

Strategic Organizational Sustainability Climate: Scale Development And Validation, Petra Brnova

Theses and Dissertations

The Strategic Organizational Sustainability (SOS) Climate encompasses the employee perceptions of the policies, practices, and procedures that promote long term organizational success in the era of pressing economic, social, and environmental challenges. In order to promote such workplace climate, organizations must be able to measure it. To this end, the SOS Climate scale was developed and validated using first a phenomenological approach in interviews with sustainability professionals working in organizations across economic sectors. After this, scale items were generated and judged, followed by a pilot study. Principal component analysis was conducted for preliminary dimensionality and item reduction. Lastly, confirmatory factor …

Utilizing A Learner Centered Design Model To Support A Change In Grading And Assessment Practices, Carmen Margot Bergmann

Theses and Dissertations

Practices in grading and assessment have been studied extensively. Guskey and Brookhart (2019) found many studies dating back to the early 1900s, and one as early as 1888, that looked at the reliability and consistency of grades. Despite more than 100 years of research on grading and assessment practices and many efforts to change these practices, most practices today are remarkably similar to those utilized in the early 1900s. The purpose of this qualitative study was to explore the effects of using a Learner Centered Design Model to support a school staff in altering their beliefs and practices regarding grading …